2404 Azure Databricks Jobs - Page 20

Experience: 5-10 years Location: Hyderabad/Bangalore Notice Period: Preferably Immediate or Candidates Who Can Join Within 45 Days Job Summary: We are seeking a highly skilled Azure Data Engineer to join our Data & Analytics team. The ideal candidate will have hands-on experience with Apache Spark, Python, and Hadoop ecosystem and will be proficient in building and managing data pipelines on Azure cloud services. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes on Azure Data Factory and Azure Databricks . Implement real-time data streaming solutions using Spark Streaming, Kafka, or Storm. Optimize and manage big data solutions leveraging the Hadoo...

Experience Required: 5 to 10 Years Mandate Mode of work: Hybrid -2-3 days work from Office (Bangalore) Skills Required: Azure Machine Learning (AML), AML Python SDK, Pandas / NumPy Azure Databricks Python and YAML Notice Period : Immediate Joiners/ Permanent (Can join Immediately by 15th September 2025 ) Minimum Qualifications: Bachelors degree in Computer Science, Data Science, or related field. 5+ years of experience in Data Engineering . 5+ years of programming experience with Python and YAML . Experience building automated ML workflows and preparing datasets for training. Immigration sponsorship not available for this role. Preferred Qualifications: Experience with Azure Databricks . Han...

Azure Data Engineer - JD Experience 5 8 years 1. Data Management and Storage: Design and implement data storage solutions using Azure SQL Database, Azure Data Lake Storage and Azure Blob Storage. Ensure data storage systems are scalable, performant, and cost-effective. 2. Data Integration and ETL: Develop and manage ETL (Extract, Transform, Load) processes using Azure Data Factory. Ensure efficient data cleaning, transformation, and loading into Data Lakes. 3. Big Data and Analytics: Utilize big data technologies like Azure Databricks and Apache Spark for data processing and analytics. Create data processing workflows and pipelines to support data analytics and machine learning applications....

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Databricks, Microsoft Azure Data Services, Apache Spark Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications function seam...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Databricks, Microsoft Azure Data Services, Apache Spark Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications are aligned w...

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Microsoft Azure Analytics Services Good to have skills : NAMinimum 15 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect, you will define the data requirements and structure for the application. Your typical day will involve modeling and designing the application data structure, storage, and integration, ensuring that the architecture aligns with business needs and technical specifications. You will...

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Microsoft Azure Analytics Services Good to have skills : NAMinimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect, you will define the data requirements and structure for the application. Your typical day will involve modeling and designing the application data structure, storage, and integration, ensuring that the architecture aligns with business needs and technical specifications. You will...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform, Microsoft Azure Data Services, Microsoft Azure Databricks Good to have skills : NAMinimum 15 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with cross-functional teams to gather requirements, developing application features, and ensuring...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quali...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality...

EY GDS is hring for Azure Data Engineers with 4 to 7 years of experience in Kolkata Key skills : Azure Databricks, Pyspark, SQL, Azure data factory, Workflow. Interested candidates, can apply on the below link for interview process. https://careers.ey.com/job-invite/1621277/

ROLE SUMMARY We are seeking a highly skilled PySpark Developer with hands-on experience in Databricks IT Systems Development unit in an offshore capacity. This role focuses on designing, building, and optimizing large-scale data pipelines and processing solutions on the Databricks Unified Analytics Platform. The ideal candidate will have expertise in big data frameworks, distributed computing, and cloud platforms, with a deep understanding of Databricks architecture. This is an excellent opportunity to work with cutting-edge technologies in a dynamic, fast-paced environment. ROLE RESPONSIBILITIES Data Engineering and Processing : Develop and manage data pipelines using PySpark on Databricks....

As an ETL Test Engineer, you will play a crucial role in performing manual and automation testing to validate data sources, extract data, apply transformation logic, and load data into target tables. Your primary responsibility will involve closely collaborating with Data Engineering teams to gather requirements, understand data needs, and translate them into effective test cases. Additionally, you will design, build, and maintain test plans and cases specifically tailored for ETL and data testing processes. Your day-to-day tasks will include conducting data validation and testing to ensure the accuracy, consistency, and compliance of data. You will be responsible for executing both manual a...

As an Azure Databricks Lead, you will be responsible for designing, implementing, and optimizing data solutions using Azure Databricks. Your expertise will be crucial in creating robust data pipelines, ensuring data quality, and improving overall performance. Collaborating with cross-functional teams, you will deliver high-quality solutions that meet business requirements. You will design and develop scalable data processing pipelines using Azure Databricks and PySpark. Implementing ETL processes, you will ingest, transform, and load data from various sources. Collaboration with data engineers and architects will ensure efficient data movement and transformation. Establishing data quality ch...

You are seeking an experienced and highly motivated Senior Azure Data Engineer to join a Data & Analytics team. As a Senior Data Engineer, your primary responsibility will be to design, develop, implement, and manage scalable, robust, and secure data solutions on the Microsoft Azure platform. You will be leading a team of data engineers, setting technical direction, ensuring the quality and efficiency of data pipelines, and collaborating closely with data scientists, analysts, and business stakeholders to meet data requirements. Your key responsibilities will include leading, mentoring, and providing technical guidance to a team of Azure Data Engineers. You will design, architect, and implem...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. We're looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. Your key responsibilities include developing and deploying azure databricks in a cloud...

Primary Responsibilities: Should be Curious and Quick learner for Tech needed for the project Should be able to Explore and Suggest new Ideas/Tech for the project Should be able to understand the feature requirements from the product and be able to come up with Technical Solutions keeping in mind the Scalability, Extensibility, Security, Cost etc. Come up with a plan break down the feature in workable stories Work closely with Product & Development team The Delivered feature should be of Quality with low defect rate Work collaboratively with the team and should be able to help others on technical issues or functional questions they might have Should be able to own a feature and run through w...

About the Role We are looking for a skilled Data Engineer with 35 years of experience to design,implement, and maintain a Medallion Architecture on Azure Data Platform. The ideal candidate should have strong hands-on experience with SQL Server, PySpark, and Power BI, and a solid understanding of data modelling and data pipelines. Key Responsibilities • Design, build, and optimize scalable data pipelines and dataflows in Azure Data Factory / Azure Synapse following the Medallion Architecture (Bronze, Silver, Gold layers). • Develop and manage data ingestion processes from diverse sources into Azure Data Lake. • Implement and optimize data transformations using PySpark / Databricks. • Work wit...

Role & responsibilities Assist in data collection, cleansing, and preparation from various sources. Support basic data modeling and documentation efforts. Develop and maintain simple data pipelines using tools like Azure Data Factory (ADF) . Write and optimize queries using SQL . Use Python or PySpark scripts to perform data transformations. Perform data validation and quality checks to ensure accuracy. Collaborate with senior analysts, engineers, and business teams to gather data requirements and support reporting needs. Contribute to dashboards, reports, and ad-hoc data analysis as needed. Bachelor's degree in Computer Science, Information Technology , or a related field. 1 to 3 years of h...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Senior Data Engineer, you bring over 10 years of experience in applying advanced concepts and technologies in production environments.Your expertise and skills make you an ideal candidate to lead and deliver cutting-edge data solutions.Expertise Extensive hands-on experience with Azure Databricks and modern data architecture principles. In-depth understanding of ...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure DevOps Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time educationArchitecture and Design:Propose solutions that may shape the strategic technology direction of our data platform.Architect scalable and efficient Databricks and OpenAI platform for an increasing number of users.Infrastructure Automation:Develop and maintain Terraform Infrastructure as Code (IaC) scripts to automate Databricks and OpenAI environment deployments.Required Qu...