4854 Azure Databricks Jobs - Page 40

As a Senior Python Data Engineer with 4+ years of experience, you will play a crucial role in designing, building, and optimizing reliable data platforms and analytics solutions by partnering with product, analytics, and business teams. Your expertise in Azure Databricks, PySpark, Spark SQL, and Power BI will be essential in ensuring the success of our projects in a fast-paced and collaborative environment. **Key Responsibilities:** - Design and implement scalable ETL/ELT pipelines on Azure Databricks using PySpark/Spark SQL. - Model data for semantic layers to power BI and analytics use cases. - Build and maintain Power BI datasets, reports, and dashboards, utilizing DAX, data modeling, and...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

You have the opportunity to join as an Azure Data Factory with Python in Chennai. This is a hybrid job type with 3 days working from the office. **Role Overview:** As an Azure Data Factory with Python, you will be responsible for handling various tasks related to Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions. Your role will require in-depth knowledge of relational database design, data warehousing, and dimensional data modeling concepts. Additionally, you will be working with Python, Spark, and Pyspark. **Key Responsibilities:** - Minimum 6 to 13 years of experience - Hands-on ...

Work Location: Hyderabad /Bangalore /Pune! Experience: 7-13yrs Required Skills: Develop and maintain Azure Data Architecture, ensuring compliance with data-related policies and standards Analyze data-related system integration challenges and propose appropriate solutions Design and implement data solutions on Azure, using a range of services like Azure SQL Database, Data Factory, Data Lake Store, Data Lake Analytics, Stream Analytics, Azure Storage, Cosmos DB and more Collaborate with data scientists and IT team members to assist with data-related technical issues and support their data infrastructure needs Implement data security and privacy protection Thanks & Regards Suganya R suganya@sps...

We are seeking a skilled Databricks Developer to design, develop, and optimize data pipelines and analytics solutions on the Databricks platform. Key Responsibilities: Design and implement ETL pipelines using Databricks and PySpark . Develop and maintain Delta Lake solutions for data reliability and performance. Optimize Spark jobs for scalability and cost efficiency. Collaborate with data scientists , analysts , and business teams to deliver data-driven insights. Ensure data security , compliance , and governance within cloud environments. Integrate Databricks with cloud services (AWS, Azure, or GCP). Implement CI/CD pipelines for data workflows and maintain version control using Git. Requi...

Data Bricks JD Key responsibilities Data pipeline development: Design, develop, and deploy scalable ETL (Extract, Transform, Load) pipelines using Databricks, Spark, and other cloud-native tools. Platform optimization: Optimize data processing workflows for performance, scalability, and cost efficiency within the Databricks environment. Data modeling and architecture: Contribute to the design and implementation of data models, schemas, and architectures for data lakes and data lakehouses. Data quality and governance: Implement data quality checks, validation routines, and ensure data security and compliance standards are met. Collaboration: Work closely with data scientists, analysts, and ot...

Lead Databricks data platform design & implementation. Own end-to-end architecture: ingestion, transformation, governance. Lakehouse expertise with Delta Tables, Unity Catalog, workflows. Mentor teams. Spark SQL, Python, Scala. CI/CD knowledge requir Perks and benefits C1:28L fixed+15% var. C2:33L fixed+20%

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

In this role, you will be responsible for the following: - Experience with Azure data engineering, specifically Azure Databricks for analysis, design, development, and implementation of unstructured data, Enterprise Data Warehousing, Data Marts, Data Conversion, and Data Integration. - Proficiency in industry best practices and knowledge of various vendors to analyze, design, and recommend third-party tools as needed. - Ability to drive analysis of required functionality and implement customizations or develop custom solutions to meet business requirements, focusing on technical excellence and high quality. - Familiarity with cloud migration methodologies and processes, including tools like ...

Role Overview: You will be responsible for designing and implementing data solutions using technologies such as PySpark, Spark SQL, and Power BI. As a Lead Python Data Engineer, you will play a key role in building and optimizing scalable data pipelines while ensuring data governance, security, and compliance in cloud environments. Key Responsibilities: - Utilize PySpark to build and optimize scalable data pipelines, including Spark SQL, DataFrames, and Datasets. - Work with Azure Databricks (Unity Catalog) to manage Delta tables, workflows, and script in Python. - Design and model data for Data Warehousing and Visualization projects through Semantic Layers. - Write complex SQL queries and b...

Educational Requirements MCA,MSc,MTech,Bachelor of Engineering,BCA,BSc Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion • As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology domain. • You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements. • You will play a key role in the overall estimation of work requirements to provide the right information on project estimations to Techno...

We are seeking a Senior Data Engineer (Azure) who can seamlessly blend hands-on data engineering expertise with a solution design and architectural mindset. This role will be responsible for building scalable, high-performance data solutions on Azure leveraging Data Factory, Databricks, and Microsoft Fabric. The ideal candidate is a proactive technologist who can own data pipelines end-to-end today and evolve into an Azure Data Architect in future client engagements. Key Responsibilities Design, develop, and maintain robust ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks. Build scalable data models and architecture leveraging Microsoft Fabric, Lakehouse, and related services....

Job Title: Data Engineer - Azure Stack We are looking for a highly skilled Data Engineer with deep expertise in Azure Stack to join our growing team. As a Data Engineer, you will be instrumental in designing and developing robust data pipelines, data lakes, and cloud-based solutions to support our business intelligence and analytics initiatives. You will work in a hybrid cloud environment to manage data services, ensuring high scalability, security, and performance for data-driven decision-making. Key Responsibilities: Data Engineering: Design and implement scalable data pipelines, ETL workflows, and processing frameworks within Azure Stack and hybrid cloud environments. Cloud Architecture: ...

Role Description: Developing Modern Data Warehouse solutions using Databricks and Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and fix the issues Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs Drive technical discussion with client architect and team members Orchestrate the data pipelines in scheduler via Airflow Skills and Qualifications: Bachelor's and/or master's degree in computer science or equivalent experience. Good understandin...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qualit...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Greetings from Tata Consultancy Services Unleash innovation with cloud at TCS!!! Join the In-Person Interview on 22nd November 2025 and Pave your path to value with TCS Team. Interview will be Offline on 22nd November 2025 at TCS Bengaluru(Venue will be shared in the call letter upon confirmation). PFB the Job Description:- Job Title: Azure Data Engineer Experience Required: 4 to 10 Years Location: Bengaluru Job Description: Strong hands-on experience with Databricks and Apache Airflow for data orchestration. Expertise in PySpark , SQL , and Python for large-scale data processing. Proven experience in building and maintaining scalable data pipelines in a cloud environment. Experience leading...

About Position: We are seeking a highly skilled and experienced Platform Engineer to join our Team. The ideal candidate will bring deep expertise in cloud-based data engineering, healthcare data modeling, and consulting, with a strong background in Azure, Databricks, Azure Data Factory (ADF), SQL, and Platform engineering. Role: Platform Engineer Location: All Persistent Locations Experience: 8 to 10 Years Job Type: Full Time Employment What You'll Do: Design, implement, and manage Cloud Data Platform infrastructure for Azure Data Factory (ADF), Self-hosted Integration Runtime (SHIR), Logic Apps, Azure Data Lake Storage Gen2 (ADLS Gen2), and Blob Storage. Configure and optimize Snowflake dat...

Role: Azure Bricks Developer Job Description : The Azure Data Bricks Engineer plays a critical role in establishing and maintaining an efficient data ecosystem within an organization. This position is integral to the development of data solutions leveraging the capabilities of Microsoft Azure Data Bricks. The engineer will work closely with data scientists and analytics teams to facilitate the transformation of raw data into actionable insights. With increasing reliance on big data technologies and cloud-based solutions, having an expert on board is vital for driving data-driven decision-making processes. The Azure Data Bricks Engineer will also be responsible for optimizing data workflows, ...

Role: Azure Bricks Developer Job Description : The Azure Data Bricks Engineer plays a critical role in establishing and maintaining an efficient data ecosystem within an organization. This position is integral to the development of data solutions leveraging the capabilities of Microsoft Azure Data Bricks. The engineer will work closely with data scientists and analytics teams to facilitate the transformation of raw data into actionable insights. With increasing reliance on big data technologies and cloud-based solutions, having an expert on board is vital for driving data-driven decision-making processes. The Azure Data Bricks Engineer will also be responsible for optimizing data workflows, ...

Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks and Apache Spark. Build data ingestion, transformation, and processing frameworks for structured and unstructured data. Work with Azure services including ADLS Gen2, Azure Data Factory (ADF), Azure Synapse, Azure SQL, Delta Lake, and Event Hubs. Optimize and tune Spark jobs for performance, cost efficiency, and scalability. Implement advanced analytics and machine learning workflows using Databricks notebooks. Ensure data quality, data governance, and compliance throughout the data lifecycle. Collaborate with data architects, analysts, and business stakeholders to understand requirements and ...

Role & responsibilities Title:Azure data engineer Remote Exp:5+ Mandatory SKills: Azure Databricks-, PowerApps,power automate-,Synapse analytics-, Pyspark-, python-

About Position: We are currently seeking a Sr IT Data Analyst to perform data analysis for a data warehouse/operational data store, data marts, and other data stores in support of the business. The new hire will define and maintain business intelligence/data warehouse methodologies, standards, and industrys best practices. Role: Sr. IT Data Analyst Location: All Persistent Locations Experience: 8 to 12 Years Job Type: Full Time Employment What You'll Do: Gather business requirements for analytical applications in iterative/agile development model partnering with Business and IT stakeholders. Create source-to-target mapping based on requirements. Create rules definitions, data profiling and t...

About Position: We're seeking an experienced Snowflake Data Engineer to join our team. As a Azure Data Engineer, you will be responsible for designing, building, and maintaining large-scale data warehouses and data pipelines using Snowflake, SQL, and other related technologies. Role: Sr. Azure Data Engineer Location: All Persistent Locations Experience: 8 to 10 Years Job Type: Full Time Employment What You'll Do: Design and implement data warehouses and data pipelines using Snowflake. Develop and maintain SQL scripts, stored procedures, and data models. Optimize data warehouse performance, scalability, and security. Collaborate with data analysts and data scientists to support data-driven de...

Job Description Azure Data Engineer (Python | PySpark | Gen AI) Experience: 10–14 Years Location: Bangalore / Chennai Notice Period: Immediate to 15 Days (preferred) Role Overview: We are looking for a highly skilled Azure Data Engineer with strong hands-on experience in Python, PySpark, Azure data ecosystem , and basic knowledge of Generative AI . The ideal candidate should have deep expertise in building scalable data pipelines, implementing modern data platforms, and supporting AI-driven data initiatives. Key Responsibilities: Design, develop, and optimize data pipelines using Azure Data Factory, Databricks, Python, and PySpark . Build and maintain ETL/ELT workflows for large-scale data p...