137 Databricks Engineer Jobs

We are looking for Databricks Lead with strong experience of AWS & Pyspark.

Role Design, Build & Optimize Scalable Data Solutions and End-to-End Pipelines Responsibilities Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with various data sources and systems. Collaborate with cross-functional teams to understand data, and deliver effective BI solutions. Implement data ingestion, transformation, and processing workflows using Spark (PySpark/Scala), SQL, and Databricks notebooks. Develop and maintain data models, ETL/ELT processes ensuring high performance, reliability, scalability and data quality. Build and maintain APIs and data services to support analytics, reporting, and application integration. Ensure data quality, integrit...

Location Pune , Hinjewadi ( F2F on 8th Nov) Mode of work: 5 Days WFO Work Timings: 12.30 PM to 9.30 PM IST Notice Period Immediate to Any serving. Important points: Relevant experience should be 5 yrs minimum into Databricks. Lead or Team handling experience will be preferred. Candidate should be from Data background in his entire experience. Eg. He can start career with any of the Data skills (SQL/PLSQL/Informatica, Etc.) and should be working in Databricks from past 5 to 6 years minimum. ADB- DE: Primary: Azure, Databricks, Pyspark/Python Secondary: Datawarehouse,, ADF Must Have • 10+ Years of IT experience in Datawarehouse and ETL • Hands-on data experience on Cloud Technologies on Azure,...

Skill: Databricks Production Support - Senior Level Experience: 8-12 Years Location: Hyderabad & Bangalore Notice Period: Immediate - 15 Days Shift Timings: 1PM - 10PM Detailed job description - Skill Set: We are seeking a highly skilled Databricks Platform Operations to join our team, responsible for daily monitoring and resolution of data load issues, platform optimization, capacity planning, and governance management. This role is pivotal in ensuring the stability, scalability, and security of our Databricks environment while acting as a technical architect for platform best practices. The ideal candidate will bring a strong operational background, potentially with earlier experience as a...

Skill: Senior Data Engineer Experience: 12+ Years Location: Hyderabad, Bangalore, Pune, Chennai Shift: 2:30PM - 11:30PM (IST) Notice Period: Immediate - 15 Days JOB SUMMARY: Senior engineer/ Senior developers with 12+ yrs exp., relevant- 8 years Experience with databases like Databricks Reporting tools like Grafana, Tableau, Carto Scripting with Python on AWS Good to have - LTE and 5G wireless networks Good to have (and) Willingness to learn - Android device services like Google Firebase Experience in running customer trials for new products/services Normalize the data for various factors when drawing insights Analyze performance data to identify the root cause for connectivity issues experi...

5+ years of Data Engineering experience, or equivalent demonstrated 5+ years of relevant Python development experience Experience with Databricks , Spark, Hive, AWS EMR/S3, Data Stage or similar systems for performance. Experience with AWS technologies like Lambda, S3 Familiarity with modern build pipelines, tools, CI/CD concepts Experience in data modelling within a data warehouse environmen

Description: Application Architect Databricks / Data Engineering Architect 100% Remote Opportunity Role Overview The Application Architect will define and own the end-to-end technical architecture for the RTRA data platform. This includes designing scalable ingestion, transformation, and analytics frameworks built on Databricks and Azure. The architect ensures data integrity, performance, and compliance across global deployments while driving engineering excellence in design and implementation. Key Responsibilities Architect enterprise-grade data ingestion and transformation pipelines on Databricks, leveraging PySpark, Delta Lake, and Azure Data Factory. Define scalable data models supportin...

Data Engineering Manager - Azure & Python Experience: 8 - 13 Years Exp. Salary: Competitive Preferred Notice Period : 30 Days Shift : 10:00 AM to 7:00 PM IST Opportunity Type: Noida (Remote for 6 months, Later Hybrid) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Data Mesh, Engineering management, Data Engineering, Azure Data Factory, Python, SQL OR NoSQL OR Azure, Backend OR FullStack Nuaav (One of Uplers' Clients) is Looking for: An Engineering Manager who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a d...

Data Engineering Manager - Azure & Python Experience: 8 - 13 Years Exp. Salary: Competitive Preferred Notice Period : 30 Days Shift : 10:00 AM to 7:00 PM IST Opportunity Type: Noida (Remote for 6 months, Later Hybrid) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Data Mesh, Data Engineering, Python, SQL, Kafka, Airflow, Hadoop, Spark Nuaav (One of Uplers' Clients) is Looking for: An Engineering Manager who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from...

Data Engineering Manager - Azure & Python Experience: 8 - 13 Years Exp. Salary: Competitive Preferred Notice Period : 30 Days Shift : 10:00 AM to 7:00 PM IST Opportunity Type: Noida (Remote for 6 months, Later Hybrid) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Data Mesh, Data Engineering, Python, SQL, Kafka, Airflow, Hadoop, Spark Nuaav (One of Uplers' Clients) is Looking for: An Engineering Manager who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from...

Data Engineering Manager - Azure & Python Experience: 8 - 13 Years Exp. Salary: Competitive Preferred Notice Period : 30 Days Shift : 10:00 AM to 7:00 PM IST Opportunity Type: Noida (Remote for 6 months, Later Hybrid) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Data Mesh, Data Engineering, Python, SQL, Kafka, Airflow, Hadoop, Spark Nuaav (One of Uplers' Clients) is Looking for: An Engineering Manager who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from...

Data Engineering Manager - Azure & Python Experience: 8 - 13 Years Exp. Salary: Competitive Preferred Notice Period : 30 Days Shift : 10:00 AM to 7:00 PM IST Opportunity Type: Noida (Remote for 6 months, Later Hybrid) Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have skills required : Data Mesh, Data Engineering, Python, SQL, Kafka, Airflow, Hadoop, Spark Nuaav (One of Uplers' Clients) is Looking for: An Engineering Manager who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from...

Databricks -(SME) with 8+ Yrs exp, Skills: Databricks, Unity Catalog, new Databricks offerings (i.e., Genie), Azure, Data Management, Data Engineering, Responsibilities: Design and build scalable data platforms using Azure and Databricks.

Required Skills & Experience: 7+ years of experience as a Data Engineer who have hands on experience on Databricks . Strong hands-on experience with: Apache Spark Databricks, PySpark & Python SQL AWS S3 AWS Athena Snowflake (Good to have but candidate must be proficient in writing SQL queries for data analysis) GitHub & GitHub Actions Solid understanding of AWS Cloud services related to data engineering. Experience working with Snowflake is an added advantage. Strong understanding of data modelling, data warehousing, and spark jobs performance optimization. Excellent problem-solving and analytical skills. Key Responsibilities: Design, build, and maintain ETL/ELT pipelines using Databricks in...

About Position: We are seeking a Senior Platform Engineer to architect, build, and manage enterprise-scale data platforms that power advanced analytics and AI initiatives. This role blends cloud engineering, DevOps automation, and data platform administration to deliver secure, scalable, and cost-efficient solutions across Azure and AWS environments. You will lead efforts to optimize Databricks and Snowflake platforms, enforce governance and compliance, and implement automation that accelerates delivery and improves reliability. Role: Senior Data Platform Engineer Location: Pune, Hyderabad, Bangalore Experience: 10 to 12 Years Job Type: Full Time Employment What You'll Do: Architect and mana...

Introduction for position Software Engineer on Databricks; working in a global team. Your tasks Develop, test, and maintain software applications using Java, Python, SQL, and Linux on Databricks Design and Implement data integration workflows with business logic in Java Implement Databricks workflows Implement ML Flow based applications Collaborate with cross-functional teams to gather requirements and design efficient and scalable solutions. Implement and manage CI/CD through github enterprise actions Implement and manage data pipelines using Airflow for orchestrating workflows and scheduling tasks. Work with cloud technologies, such as AWS, Azure, or Google Cloud Platform, to deploy and sc...

Must have skills: Hands-on experience with Databricks platform, including Delta Lake/ Lakehouse architecture Person should be familiar with Python / Pyspark code (not needed a developer) Knowledge of data structures, data modeling, ETL/ELT, and data warehousing. SQL basic in data querying and troubleshooting / manipulation. Key asks for the role: We need a candidate who can drive high-level design and solutioning based on established patterns. The person will collaborate closely with Solution Architect team. At this level, the candidate will not be working as a full-time developer but should be familiar with Python code and able to perform code reviews, debugging, and mentoring of junior dev...

Role & responsibilities Preferred candidate profile Design, develop, and deploy machine learning models using techniques such as regression, classification, clustering, and time series forecasting . Perform data analysis, preprocessing, and feature engineering to prepare high-quality datasets for modeling. Build and manage data pipelines and workflows in Databricks for model training and deployment. Utilize Unity Catalog for data governance, access control, and metadata management. Implement MLflow for experiment tracking, model versioning, and lifecycle management. Integrate ML workflows with CI/CD pipelines to ensure automated and reliable deployments. Optimize data processes using SQL and...

Job description Hiring for Databricks with experience range 2 years & above Mandatory Skills: Databricks Education: BE/B.Tech/MCA/M.Tech/MSc./MS Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the b...

Responsibilities: Design and implement secure, scalable, and automated Databricks environments to support AI/ML workloads. Develop infrastructure-as-code (IaC) solutions using Terraform for provisioning Databricks, cloud resources, and network configurations. Build automation and self-service capabilities using Python, Java and APIs for platform onboarding, workspace provisioning, orchestration and monitoring. Collaborate with data science and ML teams to define compute requirements, governance policies, and efficient workflows across dev/qa/prod environments. Integrate Databricks offering with cloud-native services on Azure/AWS Champion CI/CD and GitOps for managing ML infrastructure and co...

Role: DataBricks Engineer Notice Period: Immediate joiners only Location: Pune Work Mode: Hybrid Position Overview: We need a skilled Databricks Data Engineer with strong analytical and troubleshooting abilities. The ideal candidate should have hands-on experience in building scalable data pipelines using PySpark on cloud platforms like Azure/AWS along with a solid hands-on experience on ETL tools like Informatica PC/SSIS/DataStage, and relational databases. Mandatory skills needed: 1) Strong hands-on experience with Databricks - PySpark notebooks and Datbricks pipeline development 2) Experience using PySpark with Databricks 3) Strong understanding of SQL and query optimization techniques. 4...

Responsibilities: Experience in SAP, BI, Informatica and Databricks stack

Relevant experience in Pyspark and Azure Databricks. Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources. Good experience in SQL or native SQL query languages. Strong experience in implementing Databricks notebooks using Python. Good experience in Azure Data Factory, ADLS, Storage Services, Serverless architecture, Azure functions. Exposure to basic issues in working within a Cloud (Azure) environment. Advanced working SQL knowledge and experience working with relational/non-Relational databases, query. Exposure to Jira and Confluence required

About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies across industries are engaging with us and deploying their prediction and optimization solutions at scale. Head quartered in the San Francisco Bay Area, we serve clients in the US, Canada, Europe, and South East Asia. We are seeking an experienced data scientist who apart from the required mathematical and statistical expertise also possesses the natural curiosity and creative mind to ask questions, connect the dots, and uncover opportunities that lie hidden with the ultimate goal of re...

TCS is Hiring for Senior Data Engineer Role & responsibilities Design, develop, and implement scalable data pipelines for ingesting, processing, and distributing large volumes of data. Apply advanced data modelling techniques to optimise data structures for operational and analytical use cases. Collaborate with stakeholders to understand data requirements and deliver effective solutions. Monitor, troubleshoot, and optimise data infrastructure for performance, reliability, and cost-efficiency. Ensure data quality, governance, and security through best practices and process implementation. Provide technical mentorship to junior engineers and foster a culture of continuous learning. Stay curren...