4854 Azure Databricks Jobs - Page 31

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application development mainten...

We are a technology-led healthcare solutions provider. We are driven by our purpose to enable healthcare organizations to be future-ready. We offer accelerated, global growth opportunities for talent thats bold, industrious, and nimble. With Indegene, you gain a unique career experience that celebrates entrepreneurship and is guided by passion, innovation, collaboration, and empathy. To explore exciting opportunities at the convergence of healthcare and technology, check out www.careers.indegene.com Looking to jump-start your career? We understand how important the first few years of your career are, which create the foundation of your entire professional journey. At Indegene, we promise you...

Greetings!!! TCS is hiring... Weekend Walk-in-Interview DAte- 29- Nov-25(Saturday) Role: Azure Data Engineer EXP: 5- 10 YEARS LOCATION: Chennai Job Description 3+ years of relevant experience in Pyspark and Azure Synapse Analytics/Azure Databricks. • Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources. • Good experience in SQL or native SQL query languages. • Strong experience in implementing synapse analytics/Databricks notebooks using Python/Pyspark. • Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, Azure functions. • Advanced working knowledge in building robust data pipelines using ...

The Data Engineer Designs, implements, and maintains complex data engineering solutions in the Business Intelligence and Analytics team Responsible for design, development, implementation, testing, documentation, and support of analytical and data solutions/projects requiring data aggregation/data pipelines/ETL/ELT from multiple sources into an efficient reporting mechanism, database/data warehouse using appropriate tools like Informatica, Azure Data Factory, SSIS. This includes interacting with business to gather requirements, analysis, and creation of functional and technical specs, testing, training, escalation, and follow-up. Support of the applications would include resolving issues rep...

Shift: 24x7 Shift Job Requirement: Primary Skills Azure Data Factory, Azure Synapse Analytics, Azure Databricks: Extensive experience in building and managing scalable data pipelines for data integration, transformation, and analysis.Azure Data Lake Storage, Azure SQL Database: Proven ability to manage and optimize data storage solutions, ensuring data accessibility and reliability. Azure Machine Learning: Expertise in developing, training, and deploying machine learning models using Azure's machine learning tools and services. Data Warehousing & Data Modeling: Strong experience with designing and maintaining data warehouses, with deep understanding of ETL processes and data models. Programm...

Roles and Responsibilities Location - Bangalore Exp - 6+ Years Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions such as Blob Storage, Cosmos DB, Data Lake Storage etc. Collaborate with cross-functional teams to gather requirements for data processing needs and design scalable architectures that meet business needs. Develop complex SQL queries to optimize database performance and troubleshoot issues in Microsoft Azure databases like SQL Server & Synapse Analytics. Implement machine learning models using Azure Machine Learning services to solve real-world problems. Inte...

Job Location: Kochi Looking for Immediate joiners only Qualifications: 8+ years of experience in data engineering, with a focus on scalable architecture design. Strong proficiency in Python, PySpark, Python-based UI libraries and Gradio or Streamlit. Strong proficiency in Python, especially in Pandas and NumPy. Strong proficiency in Databricks environment and Native Apps Hands-on experience with Databricks (notebooks, jobs, lakehouse architecture). Role & responsibilities Analyze existing SAS web-based forecasting and reporting applications. Convert SAS stored processes and PROC logic into PySpark equivalent Native Apps. Translate SAS data handlers and preprocessing routines to Python-based ...

Relevant experience in Pyspark and Azure Databricks. Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources. Good experience in SQL or native SQL query languages. Strong experience in implementing Databricks notebooks using Python. Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, Azure functions. Exposure to basic issues in working within a Cloud (Azure) environment. Advanced working SQL knowledge and experience working with relational/non-Relational databases, query. Exposure to Jira and Confluence required

Required Azure Data Engineer And Azure Devops Experience- 3 to 5 salary- 10lpa to 15lpa Need Immediate joiner communication should be excellent

Lumen is seeking a skilled Data Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining data pipelines and architectures that enable effective data collection and analysis. You will work closely with data analysts and data scientists to ensure that our data infrastructure supports the needs of the business. Your expertise will help enhance our data quality and provide actionable insights that drive strategic decisions. Key Responsibilities: 6-8 years of hands-on experience predominantly in data engineering , ETL/ELT , and modern data platforms such as ( Synapse, Databricks , Big Query). Proven experience in data warehouse migration ...

Utilise Position: Data Engineer - Databricks Location: Chennai, Puducherry, Bangalore, Hyderabad - Onsite Role: Full Time Notice: Immediate or 30-day notice only preferredPrimary Skills: Data Migration experience, Data Bricks, Lakebridge, Medallion Architecture, Lake flow Connect, Auto Loader, Unity Catalog, SQL, PySpark. About The Role: Summary: Design and manage high-performance data pipelines on Databricks Lakehouse, ensuring scalable and optimised data solutions. Key Responsibilities : Build reusable data ingestion and transformation frameworks using Databricks Notebooks, Jobs, and Workflows. Develop and optimise Delta Lake datasets with effective partitioning and indexing. Implement dat...

Roles and Responsibility Design, develop, and implement scalable Kafka infrastructure solutions. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain technical documentation for Kafka infrastructure projects. Troubleshoot and resolve complex issues related to Kafka infrastructure. Ensure compliance with industry standards and best practices for Kafka infrastructure. Participate in code reviews and contribute to the improvement of the overall code quality. Job Requirements Strong understanding of Kafka architecture and design principles. Experience with Kafka tools such as Streams, KSQL, and SCADA. Proficient in programming languages su...

Role & responsibilities Understand business requirements and design the ETL flow accordingly Build ETL / ELT pipeline using Azure Databricks Implement Lakehouse framework Optimize spark jobs for performance and cost efficiency Ingest data from multiple sources Work with Azure Data Lake, Azure Data Factory for seamless integration Implement robust Partitioning and clustering on the schema Implement CI/CD pipeline

As an experienced professional with 5+ years of overall experience and 3+ years of relevant experience, you will be responsible for the following key responsibilities: - Develop and maintain data pipelines using Azure Databricks. - Write efficient and scalable code in Python. - Work with large datasets and optimize performance. - Collaborate with data scientists and engineers. - Deploy and monitor data solutions in the Azure cloud. If there are any additional details about the company or the team in the job description, please provide them to include in the job description.,

As a Senior Azure Databricks professional at EY, you will be part of a dynamic Data and Analytics team, contributing to the development and deployment of Azure Databricks in a cloud environment using Azure Cloud services. Your primary responsibilities will include ETL design, development, and deployment to Cloud Service, interacting with Onshore teams to understand their business goals, and designing and optimizing model codes for faster execution. Key responsibilities: - Develop & deploy azure databricks in a cloud environment using Azure Cloud services - ETL design, development, and deployment to Cloud Service - Interact with Onshore, understand their business goals, contribute to the deli...

As a Data and Analytics Engineering professional at PwC, your primary focus will be on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. You will play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. Specifically, in data engineering at PwC, you will be responsible for designing and building data infrastructure and systems to facilitate efficient data processing and analysis. Your responsibilities will include developing and implementing data pipelines, data integration, and data transformation solutions. In your role as an Azure Data Engineer, you will be in...

As a Data Engineer at the product manufacturing company, your role will involve the following tasks: - Managing data pipelines / jobs - Monitoring data pipelines / jobs - Managing RAG indexes - Adding new potential data sources To excel in this role, you should possess the following skills: **Languages:** - Python - PySpark - SQL **Tools:** - Azure DataBricks - Azure DevOps - VS Code - Rest API Qualifications required for this position include: - Bachelors degree in computer science, Data Engineering, or a related field - 3+ years of experience as a Data Engineer or in a similar role - Thorough understanding of data warehousing concepts, dimensional data modeling, delta lake architecture, an...

You are looking for an experienced MS Fabric Data Architect to join your team in Chennai, Bangalore, Hyderabad, Noida, or Pune. As a candidate, you should have at least 8 years of technical experience, with a minimum of 2 years of hands-on experience with Microsoft Fabric, preferably from an Azure Databricks/Synapse background. You should have led at least 2 end-to-end Data Lakehouse projects on MS Fabric using Medallion Architecture. Your expertise in the Fabric ecosystem should include Data Factory, Notebooks, Pyspark, Delta Live Tables, Dataflow Gen2, Shortcuts, Fabric Lakehouse/Warehouse, Copy Job, Mirroring, Event Stream, KQL database, Fabric SQL DB, and Semantic model (optional), among...

As a Manager Data Engineer in Tax Technology, your role will involve interacting with clients to understand their business challenges and document requirements. Critical thinking and problem-solving skills will be crucial for interpreting data and presenting solutions and insights to clients. You will also be responsible for evaluating internal systems, identifying inefficiencies, problems, and inaccuracies, and developing protocols for data handling, processing, and cleaning. Additionally, you will work closely with management and users to gather requirements, provide status updates, and build relationships. Key Responsibilities: - Design, build, and maintain Azure data services for interna...

Key Accountabilities / Responsibilities: Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to End pipeline design, and code quality. Review and optimize PySpark , SQL , and Databricks code for performance, scalability, and maintainability. Offer engineering support and mentorship to data engineering teams within delivery squads, guiding them in building robust, reusable, and secure data solutions. Collaborate with architects to define data ingestion, transformation, and storage strategies leveraging Azure services such as Azure Data Factory , Azure Databricks, Azure Data Lakes Drive automati...

As an Azure Databricks Engineer, your primary role will involve designing, developing, and optimizing end-to-end ETL/ELT pipelines on Azure Databricks using PySpark and Delta Lake to support analytics and ML use-cases. You will be responsible for implementing scalable data ingestion patterns from batch and streaming sources, integrating with Azure Data Factory, ADLS Gen2, and event streams. Additionally, you will tune Spark jobs, manage cluster configurations, and drive cost-performance optimizations for production workloads. Your tasks will also include developing Databricks SQL models, notebooks, and CI/CD pipelines to automate deployment, testing, and versioning of data artifacts. Collabo...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Job description Hiring for Azure Databrick Engineer Mandatory Skills: Databrick, Data lake, Azure Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and d...

Role & responsibilities Job Description We are seeking a skilled Azure DevOps Engineer to support and enhance our Azure-based Data & Analytics ecosystem . The ideal candidate will have deep experience in CI/CD, Infrastructure as Code, Azure data services, security, automation, and cost management. This role involves working closely with BI developers, data engineers, and analytics teams to ensure smooth deployments, stable environments, and reliable cloud infrastructure. Key Responsibilities 1. DevOps Engineering & CI/CD Design, configure, and maintain Azure DevOps pipelines (Build & Release). Implement and manage CI/CD workflows for ADF, Databricks, Fabric, and Azure Analysis Services. Mana...

Key Responsibilities Manage and configure Azure DevOps Repos, Boards, Pipelines for CI/CD automation. Design, maintain, and version cloud infrastructure using ARM templates, Terraform, or Bicep . Develop and support Azure Data Factory pipelines (ETL/ELT) for enterprise data workflows. Work with Microsoft Fabric for workspace administration, pipeline orchestration, and data integration. Deploy and manage Azure Analysis Services & Tabular Models , including performance optimization. Implement and maintain EntraID/Azure AD -based access controls for Power BI and Azure services. Build approval flows, deployment scripts, and custom automation using PowerShell and Python . Manage Git repositories,...