4854 Azure Databricks Jobs - Page 29

Job Title: Data Engineer Location: Kolkata, India Experience: Minimum 5 years in Data Engineering Joining: Immediate Job Description: We are looking for a skilled Data Engineer to design, build, and maintain scalable data architectures and pipelines. The ideal candidate will have hands-on experience in data transformation, data lake solutions, and analytics enablement, along with strong problem-solving and collaboration skills. Key Responsibilities: Develop & Maintain: Design, build, and maintain scalable data architectures and pipelines to support analytics and business requirements. Ensure proper documentation of solutions. Monitor & Troubleshoot: Support stakeholders with data issues, mon...

Hi, We are looking for Data engineer Exp: 7+ yrs Skills: Azure Data Factory, Data Bricks, SSIS, SSAS

Job Location: Kochi Looking for Immediate joiners only Qualifications: 8+ years of experience in data engineering, with a focus on scalable architecture design. Strong proficiency in Python, PySpark, Python-based UI libraries and Gradio or Streamlit. Strong proficiency in Python, especially in Pandas and NumPy. Strong proficiency in Databricks environment and Native Apps Hands-on experience with Databricks (notebooks, jobs, lakehouse architecture). Role & responsibilities Analyze existing SAS web-based forecasting and reporting applications. Convert SAS stored processes and PROC logic into PySpark equivalent Native Apps. Translate SAS data handlers and preprocessing routines to Python-based ...

Skill: Azure Data bricks Experience: 4 to 9 years Location: AIA Bangalore Job Summary We are seeking a highly skilled Sr. Developer with 7 to 10 years of experience to join our dynamic team. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. This role involves working in a hybrid model with day shifts focusing on developing and optimizing data solutions to drive business success. Secondary Skill - SQL and ETL development Responsibilities Develop and implement data solutions using Databricks SQL to enhance data processing capabilities. Optimize data storage and retrieval processes with Databricks Delta Lake for improved performanc...

Skill: Azure Databricks Experience: 4 to 9 years Location: AIA Chennai Job Summary We are seeking a Sr. Developer with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Delta Lake Workflows and PySpark. This role involves working in a hybrid model during day shifts focusing on developing and optimizing data solutions. Experience in Research and Development Manufacturing or Supply Chain is a plus. Responsibilities Develop and optimize data solutions using Databricks SQL to enhance data processing capabilities. Implement and manage Databricks Delta Lake to ensure efficient data storage and retrieval. Design and automate workflows using Data...

Dear Candidates, Greetings from Sunware Technologies! Hiring - Senior Databricks Experts! (6 to 10 Years) If Databricks is your playground, this is the opportunity youve been waiting for! Responsibilities: Design, develop, optimize & support data pipelines in Databricks Work with Python, PySpark, Azure/AWS/GCP Build CI/CD pipelines with GitHub & GitHub Actions Implement Databricks Jobs, Bundles, Orchestrations Follow Agile & DevOps practices Improve performance, scalability & cost efficiency Troubleshoot issues & remove technical blockers Contribute to coding standards & best practices Mandatory Skills: Strong hands-on Databricks + PySpark Strong Python coding Cloud: Azure / AWS / GCP Data l...

Role Overview: We are seeking street-smart and technically strong Data Engineers who can take ownership of designing and developing cuttingedge data and AI platforms using Azure-native technologies and Databricks. You will play a critical role in building scalable data pipelines, modern data architectures, and intelligent analytics solutions. Key Responsibilities: Design and implement scalable, metadata-driven frameworks for data ingestion, quality, and transformation across both batch and streaming datasets. Develop and optimize end-to-end data pipelines to process structured and unstructured data, enabling the creation of analytical data products. Build robust exception handling, logging, ...

Min 3+ yrs in Data engineer(GenAI platform) ETL/ELT workflows using AWS,Azure Databricks,Airflow,Azure Data Factory Exp in Azure Databricks,Snowflake,Airflow,Python,SQL,Spark,Spark Streaming,AWS EKS, CI/CD(Jenkins) Elasticsearch,SOLR,OpenSearch,Vespa

AIA - In person Drive - Chennai Skill: Databricks + Pyspark Location: Chennai Experience: 4 to 12 Years Job description Experience with Azure Data Bricks, Data Factory Experience with Azure Data components such as Azure SQL Database, Azure SQL Warehouse, SYNAPSE Analytics Experience in Python/Pyspark/Scala/Hive Programming. Experience with Azure Databricks/ADB Experience with building CI/CD pipelines in Data environments

Strong proficiency in Python. Strong proficiency with Databricks and PySpark Strong proficiency with cloud platforms such as AWS, Azure, or GCP. Experience with data warehousing and data lake technologies.

1. Strong experience in Azure Databricks for ETL development and Azure Data Lake Storage 3. Familiarity with Apache NiFi for data ingestion, transformation, and routing. 4. Experience in PySpark

Design, develop, and maintain scalable data pipelines and ETL/ELT workflows. Build, optimise, and troubleshoot SQL queries, transformations, and Databricks data processes. Work with large datasets to deliver efficient, reliable,

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Databricks Good to have skills : Microsoft SQL Server, Microsoft Azure Analytics Services Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will oversee the development process and ensure successful project delivery. Roles & Responsibilities:- Expected to perform independently and become an...

Design, build, and maintain scalable data pipelines in Databricks. Collaborate with cross-functional teams to gather and interpret data requirements. Develop data models and perform data analysis using SQL and Python. Implement and optimize ETL processes for data ingestion and transformation. Monitor and troubleshoot data pipeline issues to ensure data integrity and availability. Create data visualizations and dashboards to present findings to stakeholders. Stay up-to-date with the latest features and best practices in Databricks and big data technologies. Requirements Proficiency in Databricks and experience with Apache Spark. Strong knowledge of SQL and Python programming languages. Experi...

Data Engineer (Python enterprise developer) : 7+ years of experience in python scripting. Proficient in developing applications in Python language. Exposed to python-oriented Algorithms libraries such as NumPy, pandas, beautiful soup, Selenium, pdfplumber, Requests etc. Proficient in SQL programming, Postgres SQL. Knowledge on DevOps like CI/CD, Jenkins, Git. Experience working with AWS(S3) and Azure Databricks. Have experience in delivering project with Agile and Scrum methodology. Able to co-ordinate with Teams across multiple locations and time zones Strong interpersonal and communication skills with an ability to lead a team and keep them motivated.

Key Responsibilities Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF) , Databricks , Synapse Analytics , and related Azure services. Implement ETL/ELT processes to integrate data from multiple structured and unstructured data sources. Build and optimize data lake and data warehouse solutions in Azure Data Lake Storage (ADLS) and Azure Synapse . Collaborate with data scientists, analysts, and business stakeholders to deliver scalable data solutions. Develop CI/CD pipelines for data workflows using Azure DevOps or equivalent tools. Implement data governance, quality, and security best practices following enterprise standards. Monitor, troubleshoot, and opt...

Role & responsibilities • 5+ years of relevant experience as a DevOps Engineer. • Strong experience in setting up and maintaining CI/CD pipelines (Azure DevOps, Jenkins, GitHub Actions). • Proficiency in scripting languages: Python, Bash, or PowerShell. • Solid understanding of Datafactory, Databricks to work on notebooks using python Preferred candidate profile We need someone with strong, practical experience in Azure Data Factory and Azure Databricks, along with solid knowledge of CI/CD (Azure DevOps).

We are seeking a skilled Data Engineer with strong experience in SQL, PySpark, and cloud technologies to join our dynamic team. The ideal candidate will have a solid background in designing and implementing data engineering pipelines, with a focus on performance, scalability, and reliability. You will work closely with other data engineers, data scientists, and stakeholders to develop, maintain, and optimize data infrastructure. Key Responsibilities : SQL Development : - Write medium-complexity SQL queries to extract, transform, and load data efficiently. - Optimize SQL queries for performance and scalability. - Collaborate with team members to understand data requirements and translate them...

A Data Engineer Job Description Samples & Tips in 2025A data engineer designs, builds, and maintains the data infrastructure, such as databases and data pipelines, that collect, store, and process raw data into usable information for data scientists and business analysts.

JOB DISCRIPTION Experience:6+ Years Location: chennai mandatory skills: Azure databricks + azure data-factory pyspark + python + ready to work in shift + have application support exp Experience and Skills: - Candidate should have solid experience in providing application support and well versed with Incident/problem management. Should be experienced in leading a team and help in building a team equipped with the skills/knowledge to support Cloud enabled applications. - Good understanding around Azure services like ADF, ADLS, SQL, Azure Monitor, Application Insights, Azure functions. Should be comfortable around APIs and their implementation. Should be comfortable in troubleshooting/coordinat...

Role & responsibilities Key Responsibilities: Develop and Maintain Data Pipelines: Design, develop, and manage scalable ETL pipelines to process large datasets using PySpark, Databricks, and other big data technologies. Data Integration and Transformation: Work with various structured and unstructured data sources to build efficient data workflows and integrate them into a central data warehouse. Collaborate with Data Scientists & Analysts: Work closely with the data science and business intelligence teams to ensure the right data is available for advanced analytics, machine learning, and reporting. Optimize Performance: Optimize and tune data pipelines and ETL processes to improve data thro...

About Cloudaeon: Cloudaeon is a global technology consulting and services company helping enterprises modernize and manage their cloud infrastructure, big data ecosystems, DevOps pipelines, and advanced analytics platforms . We deliver high-quality, scalable solutions built on deep domain expertise and leading enterprise data technologies. Our teams work actively on AI and GenAI initiatives , incorporating machine learning, intelligent automation, and modern data engineering practices to create future-ready digital solutions. With a highly skilled global team committed to excellence, we consistently exceed customer expectations and help organizations achieve their strategic goals. Job Role A...

Role Overview: You will be joining the Data Science and Artificial Intelligence Team at Hitachi Solutions, where you will have the opportunity to fast-track your career and work in a disruptive startup atmosphere focused on hypergrowth and innovation. As a Data Scientist, you will play a critical role in transforming the company into a billion-dollar product company by focusing on engineering excellence and simplifying cloud solutions for customers. Key Responsibilities: - Execute: Be action-oriented, detail-oriented, and customer-focused, building strong collaborative relationships with other teams, and iterating rapidly towards innovative solutions. - Learn: Continuously explore new techni...

As an Azure Data Factory (ADF) Professional at YASH Technologies, your role involves leveraging cutting-edge technologies to drive business transformation. Your key responsibilities will include: - Experience in Azure Data factory, Azure Databricks, Azure Synapse, Azure SQL, ETL, and knowledge in Azure Fabric - Creating Pipelines, datasets, dataflows, Integration runtimes, and monitoring Pipelines, as well as triggering runs - Extracting Transformation and Load Data from source systems, processing the data in Azure Databricks, and creating SQL scripts for complex queries - Creating Synapse pipelines to migrate data from Gen2 to Azure SQL and Data Migration pipeline to Azure cloud (Azure SQL)...

Role & responsibilities Implement efficient and maintainable code using best process and coding standards. Design, develop, test, and deploy high-performance and scalable data solutions using Python. Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. Implement efficient and maintainable code using best practices and coding standards Utilize experiences in SQL to design, optimize, and maintain relational databases. Write complex SQL queries for data retrieval, manipulation, and analysis. Perform database performance tuning and optimization. Databricks Platform Work with Databricks platform for big data processing and a...