142 Databricks Engineer Jobs - Page 6

Job Title: Data Engineer Job Summary: Are you passionate about building scalable data pipelines, optimizing ETL processes, and designing efficient data models? We are looking for a Databricks Data Engineer to join our team and play a key role in managing and transforming data in Azure cloud environments. In this role, you will work with Azure Data Factory (ADF), Databricks, Python, and SQL to develop robust data ingestion and transformation workflows. Youll also be responsible for integrating SAP IS-Auto data, optimizing performance, and ensuring data quality & governance. If you have strong experience in big data processing, distributed computing (Spark), and data modeling, we’d love to hea...

Job Title: Databricks Data Modeler Job Summary We are looking for a Data Modeler to design and optimize data models supporting automotive industry analytics and reporting. The ideal candidate will work with SAP ECC as a primary data source, leveraging Databricks and Azure Cloud to design scalable and efficient data architectures. This role involves developing logical and physical data models, ensuring data consistency, and collaborating with data engineers, business analysts, and domain experts to enable high-quality analytics solutions. Key Responsibilities 1. Data Modeling & Architecture: Design and maintain conceptual, logical, and physical data models for structured and unstructured data...

We are seeking a results-driven Data Project Manager (PM) to lead data initiatives leveraging Databricks and Confluent Kafka in a regulated banking environment. The ideal candidate will have a strong background in data platforms, project governance, and financial services, and will be responsible for ensuring successful end-to-end delivery of complex data transformation initiatives aligned with business and regulatory requirements. Key Responsibilities: Lead planning, execution, and delivery of enterprise data projects using Databricks and Confluent. Develop detailed project plans, delivery roadmaps, and work breakdown structures. Ensure resource allocation, budgeting, and adherence to timel...

Job Summary: We are seeking a talented Data Engineer with strong expertise in Databricks, specifically in Unity Catalog, PySpark, and SQL, to join our data team. Youll play a key role in building secure, scalable data pipelines and implementing robust data governance strategies using Unity Catalog. Key Responsibilities: Design and implement ETL/ELT pipelines using Databricks and PySpark. Work with Unity Catalog to manage data governance, access controls, lineage, and auditing across data assets. Develop high-performance SQL queries and optimize Spark jobs. Collaborate with data scientists, analysts, and business stakeholders to understand data needs. Ensure data quality and compliance across...

Role: Sr. Databricks Developer Description - External With a startup spirit and 100,000+ curious and courageous minds, we have the expertise to go deep with the worlds biggest brandsand we have fun doing it. Now, we’re calling all you rule-breakers and risk-takers who see the world differently and are bold enough to reinvent it. Responsibilities Closely work with Architect and lead to design solutions to meet functional and non-functional requirements. Participate to understand architecture and solution design artifacts. Evangelize re-use through the implementation of shared assets. Proactively implement engineering methodologies, standards, and leading practices. Provide insight and directi...

Required Skills: 2+ years of experience : in data engineering and solution architecture. Expertise in Azure Data Factory (ADF) and Azure Synapse Analytics . Strong hands-on experience with Databricks and PySpark . Proficiency in SQL , including performance tuning on large datasets. Familiarity with Data Mesh architecture . Good knowledge of Microsoft Fabric . Understanding of CI/CD pipelines . Good to Have Skills: Experience with AWS services : (Glue, S3, Redshift, etc.). Familiarity with Airflow or other orchestration tools . Databricks certification .

L&T Technology Services is Hiring!! Job Title: Data Engineer Location: Tower 14, John Deere, Pune Experience Required: 3-5years in data engineering Skills Required: Python, Pyspark, SQL, AWS, Databricks, CI/CD, Docker, Devops or Dataops

Responsibilties: Bachelors degree in computer science, information systems, computer engineering, systems analysis or a related discipline, or equivalent work experience. 4 to 8 years of experience building enterprise, SaaS web applications using one or more of the following modern frameworks technologies: Java/ .Net/C etc. Exposure to Python & Familiarity with AI/ML-based data cleansing, deduplication and entity resolution techniques Familiarity with a MVC framework such as Django or Rails Full stack web development experience with hands-on experience building responsive UI, Single Page Applications, reusable components, with a keen eye for UI design and usability. Understanding of micro se...

Responsibilities Design, develop, and maintain scalable and robust data pipelines on Databricks. Collaborate with data scientists and analysts to understand data requirements and deliver solutions. Optimize and troubleshoot existing data pipelines for performance and reliability. Ensure data quality and integrity across various data sources. Implement data security and compliance best practices. Monitor data pipeline performance and conduct necessary maintenance and updates. Document data pipeline processes and technical specifications. Qualifications Bachelor's degree in Computer Science, Engineering, or a related field. 6+ years of experience in data engineering. Proficiency with Databrick...

Position Azure Databricks Engineer with Banking Domain Exp. Location –Pune and Kolkata Azure Databricks AML Transactions KYC Fraud Management Risk Management Credit SQL Banking Domain Exp Thanks and Regards Rajat Kumar Recruitment Lead (Sales and Marketing) Savi Technologies Inc. Cell: 7906842558 E-Mail: rajat@savi-tech.com

Immediate to 30 days notice period candidates preferred Key Responsibilities: Design and implement general architecture for complex data systems. Translate business requirements into functional and technical specifications. Design and implement lakehouse architecture. Develop and manage cloud-based data architecture and reporting solutions. Apply data modelling principles for relational and dimensional data structures. Design Data Warehouses following established principles (e.g., Kimball, Inmon). Create and manage source-to-target mappings for ETL/ELT processes. Mentor junior engineers and contribute to architectural decisions and code reviews. Minimum Qualifications: Bachelors Degree in Co...

Role & responsibilities Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and fix the issues Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs Help joiner team members to resolve issues and technical challenges. Drive technical discussion with client architect and team members Orchestrate the data pipelines in scheduler via Airflow Preferred candidate profile Must have total ...

Job Summary As a key member of the Data business leadership team, the role will be responsible for building and expanding the Google Cloud Platform data and analytics capability within the organization. This individual will drive technical excellence, innovative solution development, and successful delivery of GCP-based data initiatives. The role requires close collaboration with clients, delivery teams, GCP alliance partners, and internal stakeholders to grow GCP offerings, build talent pipelines, and ensure delivery excellence. Areas of Responsibility 1. Offering and Capability Development Design and enhance GCP-based data platform offerings and accelerators Define architectural standards,...

Key Responsibilities: • Design, implement, and optimize scalable data pipelines using Databricks and Apache Spark. • Architect data lakes using Delta Lake, ensuring reliable and efficient data storage. Manage metadata, security, and lineage through Unity Catalog for governance and compliance. • Ingest and process streaming data using Apache Kafka and real-time frameworks. Collaborate with ML engineers and data scientists on LLM-based AI/GenAI project pipelines. Apply CI/CD and DevOps practices to automate data workflows and deployments (e.g., with GitHub Actions, Jenkins, Terraform). Optimize query performance and data transformations using advanced SQL. Implement and uphold data governance,...

5+ years of experience building Tableau dashboards and visualizations. 1+ years of hands-on experience integrating Tableau with Databricks (including SQL, Delta Lake, and Spark environments).

Were Hiring: Senior Data Engineer GCP | Databricks | E-commerce Domain Work Locations : Chennai | Bangalore | Hyderabad | Gurugram | Jaipur | Pune | Bhopal Experience : 7–8+ Years Shift Timing : 2 PM – 10 PM IST Work Mode : Hybrid – 3 days/week from office Only Immediate Joiners (0–15 Days Notice) Are you a seasoned Data Engineer passionate about building next-gen data platforms? We’re hiring for an offshore role supporting one of our top global e-commerce clients. You'll work on large-scale consumer data and cloud-native architectures, helping create impactful data products. Join Xebia and become part of a high-performance team working with the latest technologies in data engineering. Role ...

Role & responsibilities 8+ years of experience as a Data Engineer, with a focus on Databricks and cloud-based data platforms, with a minimum of 4 years of experience in writing unit/end-to-end tests for data pipelines and ETL processes on Databricks. Hands-on experience in PySpark programming for data manipulation, transformation, and analysis. Strong experience in SQL and writing complex queries for data retrieval and manipulation. Experience in Docker for containerising and deploying data engineering applications is good to have. Strong knowledge of the Databricks platform and its components, including Databricks notebooks, clusters, and jobs. Experience in designing and implementing data ...