4854 Azure Databricks Jobs - Page 24

Experience Level: 8+ Years Loc: Bangalore/Chennai/Pune/Kolkata/Gurugram Role & responsibilities Bachelor's and/or masters degree in computer science or equivalent experience. Must have total 8+ yrs. of IT experience and experience in Data warehouse/ETL projects. Deep understanding of Star and Snowflake dimensional modelling. Strong knowledge of Data Management principles Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture Should have hands-on experience in SQL, Python and Spark (PySpark) Candidate must have experience in AWS/ Azure stack Desirable to have ETL with batch and streaming (Kinesis). Experience in building ETL / data warehouse transformation ...

Job Title: Data Scientist - Manager Location: Kolkata Job Description: We are seeking a skilled Data Scientist with expertise in Microsoft Azure solutions to join our team. The ideal candidate will be responsible for developing and deploying advanced analytics models and solutions using Azure's suite of tools and services. You will work closely with stakeholders to transform data into actionable insights that support strategic decision-making. Key Responsibilities: - Design, develop, and deploy machine learning models and data science solutions using Azure Machine Learning and other Azure services. - Collaborate with data engineers and business stakeholders to understand data needs and trans...

1. Customer Issue Resolution Act as the primary technical contact for customer-reported issues on Azure Synapse Analytics , Azure Data Factory , Azure Databricks , and Cosmos DB . Analyse and resolve data ingestion, transformation, and query performance issues using SQL , PySpark , and Azure-native tools . Provide timely and effective solutions, workarounds, or guidance aligned with Microsoft support standards. 2. Root Cause Analysis & Preventive Actions Perform deep-dive investigations into recurring or complex issues. Use telemetry, logs, and diagnostic tools to identify root causes. Recommend and implement preventive measures to reduce future incidents. 3. Service Health Monitoring & Opti...

Azure Databricks (ADB), Delta Lake, Azure Data Lake Storage (ADLS). Azure Data factory (ADF), Azure SQL Database (SQL DB), SQL, ELT / ETL Pipeline Development in Spark based environment. SparkCore, PySpark, Python, SparkSQL, Scala, Azure Blob Storage. CI/CD, Version control tools like GitHub, Azure DevOps.

Job Summary Azure Big Data Engineer role involves building scalable data ingestion pipelines for batch and streaming datasets using Azure technologies like ADF, PySpark, and Databricks. Requires 4-9 years IT experience, including 2+ years in big data engineering on Azure. Focuses on data processing, orchestration, collaboration with data science and app dev teams, and delivering analytics solutions. Job Description Design and build metadata-driven data ingestion pipelines for structured/unstructured data, including harmonization and high-performance processing. Schedule, orchestrate, validate pipelines; handle exceptions, log monitoring, and debugging for reliable operations. Collaborate wit...

Responsibilities: * Design data solutions using Azure Databricks, Synapse & DW. * Collaborate with cross-functional teams on project delivery. * Optimize performance through data modeling and ETL processes.

Role & responsibilities SQL Expertise Strong hands-on experience with DDL, DML, query optimization, and performance tuning . Programming Languages – Proficiency in Python or Java for data processing and automation. Data Modelling – Good understanding of entity-relationship modelling, star schema, and Kimball methodology . Cloud Data Engineering – Hands-on experience with Azure Synapse, Azure Data Factory, Azure Data Lake, Databricks and Snowflake ETL Development – Experience building scalable ETL/ELT pipelines and data ingestion workflows. Ability to learn and apply Snowflake concepts as needed. Communication Skills : Strong presentation and communication skills to engage both technical and ...

Role & responsibilities SQL Expertise Strong hands-on experience with DDL, DML, query optimization, and performance tuning . Programming Languages – Proficiency in Python or Java for data processing and automation. Data Modelling – Good understanding of entity-relationship modelling, star schema, and Kimball methodology . Cloud Data Engineering – Hands-on experience with Azure Synapse, Azure Data Factory, Azure Data Lake, Databricks and Snowflake ETL Development – Experience building scalable ETL/ELT pipelines and data ingestion workflows. Ability to learn and apply Snowflake concepts as needed. Communication Skills : Strong presentation and communication skills to engage both technical and ...

Role & responsibilities SQL Expertise Strong hands-on experience with DDL, DML, query optimization, and performance tuning . Programming Languages – Proficiency in Python or Java for data processing and automation. Data Modelling – Good understanding of entity-relationship modelling, star schema, and Kimball methodology . Cloud Data Engineering – Hands-on experience with Azure Synapse, Azure Data Factory, Azure Data Lake, Databricks and Snowflake ETL Development – Experience building scalable ETL/ELT pipelines and data ingestion workflows. Ability to learn and apply Snowflake concepts as needed. Communication Skills : Strong presentation and communication skills to engage both technical and ...

Role & responsibilities Design, develop, and maintain scalable and robust data pipelines on Databricks. Collaborate with data scientists and analysts to understand data requirements and deliver solutions. Optimize and troubleshoot existing data pipelines for performance and reliability. Ensure data quality and integrity across various data sources. Implement data security and compliance best practices. Monitor data pipeline performance and conduct necessary maintenance and updates. Document data pipeline processes and technical specifications. Qualifications 5+ years of experience in data engineering. Proficiency with Databricks and pySpark. Strong SQL skills and experience with relational d...

Role & responsibilities Design, develop, and maintain scalable and robust data pipelines on Databricks. Collaborate with data scientists and analysts to understand data requirements and deliver solutions. Optimize and troubleshoot existing data pipelines for performance and reliability. Ensure data quality and integrity across various data sources. Implement data security and compliance best practices. Monitor data pipeline performance and conduct necessary maintenance and updates. Document data pipeline processes and technical specifications. Qualifications 5+ years of experience in data engineering. Proficiency with Databricks and pySpark. Strong SQL skills and experience with relational d...

Role & responsibilities Design, develop, and maintain scalable and robust data pipelines on Databricks. Collaborate with data scientists and analysts to understand data requirements and deliver solutions. Optimize and troubleshoot existing data pipelines for performance and reliability. Ensure data quality and integrity across various data sources. Implement data security and compliance best practices. Monitor data pipeline performance and conduct necessary maintenance and updates. Document data pipeline processes and technical specifications. Qualifications 5+ years of experience in data engineering. Proficiency with Databricks and pySpark. Strong SQL skills and experience with relational d...

Role & responsibilities We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks. The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Required Skills & Qualifications: SQL Expertise Strong hands-on experience with DDL, DML, query optimization, and performance tuning. Programming Languages – Proficiency in Python or Java for data processing and automation. Data Modelling – Good understanding of entity-relationship modelling, star schema, and Kimball methodology. Cloud Data Enginee...

Role & responsibilities We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks. The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Required Skills & Qualifications: SQL Expertise Strong hands-on experience with DDL, DML, query optimization, and performance tuning. Programming Languages – Proficiency in Python or Java for data processing and automation. Data Modelling – Good understanding of entity-relationship modelling, star schema, and Kimball methodology. Cloud Data Enginee...

Role & responsibilities We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks. The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Required Skills & Qualifications: SQL Expertise Strong hands-on experience with DDL, DML, query optimization, and performance tuning. Programming Languages – Proficiency in Python or Java for data processing and automation. Data Modelling – Good understanding of entity-relationship modelling, star schema, and Kimball methodology. Cloud Data Enginee...

Role & responsibilities We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions using modern cloud data platforms. The ideal candidate will have deep expertise in Data Modeling, Snowflake, DBT, Azure Data Factory, and techniques. You will play a pivotal role in shaping our data strategy, optimizing pipelines, and ensuring data integrity across the organization. Key Responsibilities: Architect and implement end-to-end data solutions using Snowflake and DBT. Design and maintain robust data models (star/snowflake schemas) to support analytics and reporting. Develop and orchestrate ETL/ELT pipelines using Azure Data Factory. Collaborate with data...

Role & responsibilities We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions using modern cloud data platforms. The ideal candidate will have deep expertise in Data Modeling, Snowflake, DBT, Azure Data Factory, and techniques. You will play a pivotal role in shaping our data strategy, optimizing pipelines, and ensuring data integrity across the organization. Key Responsibilities: Architect and implement end-to-end data solutions using Snowflake and DBT. Design and maintain robust data models (star/snowflake schemas) to support analytics and reporting. Develop and orchestrate ETL/ELT pipelines using Azure Data Factory. Collaborate with data...

Role & responsibilities We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions using modern cloud data platforms. The ideal candidate will have deep expertise in Data Modeling, Snowflake, DBT, Azure Data Factory, and techniques. You will play a pivotal role in shaping our data strategy, optimizing pipelines, and ensuring data integrity across the organization. Key Responsibilities: Architect and implement end-to-end data solutions using Snowflake and DBT. Design and maintain robust data models (star/snowflake schemas) to support analytics and reporting. Develop and orchestrate ETL/ELT pipelines using Azure Data Factory. Collaborate with data...

Job Description Azure Data Engineer (Python | PySpark | Gen AI) Experience: 10–14 Years Location: Bangalore / Chennai Notice Period: Immediate to 15 Days (preferred) Role Overview: We are looking for a highly skilled Azure Data Engineer with strong hands-on experience in Python, PySpark, Azure data ecosystem , and basic knowledge of Generative AI . The ideal candidate should have deep expertise in building scalable data pipelines, implementing modern data platforms, and supporting AI-driven data initiatives. Key Responsibilities: Design, develop, and optimize data pipelines using Azure Data Factory, Databricks, Python, and PySpark . Build and maintain ETL/ELT workflows for large-scale data p...

Job Description Azure Data Engineer (Python | PySpark | Gen AI) Experience: 10–14 Years Location: Bangalore / Chennai Notice Period: Immediate to 15 Days (preferred) Role Overview: We are looking for a highly skilled Azure Data Engineer with strong hands-on experience in Python, PySpark, Azure data ecosystem , and basic knowledge of Generative AI . The ideal candidate should have deep expertise in building scalable data pipelines, implementing modern data platforms, and supporting AI-driven data initiatives. Key Responsibilities: Design, develop, and optimize data pipelines using Azure Data Factory, Databricks, Python, and PySpark . Build and maintain ETL/ELT workflows for large-scale data p...

Mandatory Skill Experience in developing MLOps framework cutting ML lifecycle: model development, training, evaluation, deployment, monitoring including Model Governance Expert in Azure Databricks, Azure ML, Unity Catalog Hands-on experience with Azure DevOps, MLOPS CI/CD Pipelines, Python, Git, Docker Experience in developing standards and practices for MLOPS life cycle Nice to Have Skill Strong understanding of data privacy, compliance, and responsible Al Azure Data Factory (ADF) Soft Skill Excellent communication & stakeholder management skills Experience working in cross-functional teams (data scientists, platform architects)

Work Mode: Hybrid (3 days per week) Location: Bangalore/ Pune/ Chennai Role & responsibilities Databricks platform engineer As a Databricks Platform engineer, you will work with various business facing functions on their Big Data Challenges using the Databricks Platform. You will be maintaining the platform's stability, performance, and security, ensuring that it enables our data analysts, data scientists, and other users to effectively work with big data and machine learning Preferred candidate profile 7+ years of experience with Big Data Technologies such as Apache Spark, cloud native Data lakes and Data mesh platforms technical Architecture or consulting role Strong experience in administ...

As a Data Engineer, you will be responsible for working with a variety of technologies in the field of data engineering and data science. Your main responsibilities will include: - Demonstrating expertise in working with Azure Datalake, Azure function, Azure Databricks, Azure Data Factory, and PostgreSQL. - Utilizing working knowledge in Azure DevOps and Git flow as an added advantage. - Showcasing proficiency in AWS Kinesis, AWS EMR, AWS Glue, AWS RDS, AWS Athena, and AWS RedShift. - Providing innovative solutions to data engineering problems and documenting technology choices and integration patterns. - Applying best practices for project delivery with clean code and demonstrating innovati...

As a Senior Data Engineer (Azure), you will play a crucial role in designing, building, and maintaining data solutions on the Azure cloud platform. Your expertise will be instrumental in creating scalable and efficient data pipelines and architectures to meet the business requirements effectively. **Key Responsibilities:** - Design, develop, and deploy data solutions on Azure, utilizing services like Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics. - Collaborate with analysts and stakeholders to understand business requirements and translate them into technical solutions. - Build and maintain scalable data pipelines for processing and transforming large ...

As a highly skilled Azure PySpark Solution Architect, your role involves designing and implementing scalable data solutions on Microsoft Azure. Your expertise in Azure services, PySpark, and solution architecture will ensure efficient data processing and analytics workflows for enterprise applications. **Key Responsibilities:** - Design and implement end-to-end data solutions using Azure Data Services and PySpark - Develop high-performance ETL pipelines leveraging Azure Databricks, Azure Data Factory, and Synapse Analytics - Architect scalable, secure, and cost-efficient cloud solutions aligning with business objectives - Collaborate with data engineers, data scientists, and business stakeho...