63 Data Lakehouse Jobs

Skill: Databricks Production Support - Senior Level Experience: 8-12 Years Location: Hyderabad & Bangalore Notice Period: Immediate - 15 Days Shift Timings: 1PM - 10PM Detailed job description - Skill Set: We are seeking a highly skilled Databricks Platform Operations to join our team, responsible for daily monitoring and resolution of data load issues, platform optimization, capacity planning, and governance management. This role is pivotal in ensuring the stability, scalability, and security of our Databricks environment while acting as a technical architect for platform best practices. The ideal candidate will bring a strong operational background, potentially with earlier experience as a...

Role & responsibilities 6+ years of experience in software development, data engineering, ETL, and analytics reporting development Experience in building and maintaining data and system integrations using dimensional data modelling and optimized ETL pipelines. Proven track record of designing and implementing complex data solutions Demonstrated understanding and experience using: Python & PySpark: Ability to write efficient scripts for data transformation, and pipeline orchestration, knowledge of Spark or any distributing frameworks Knowledge of data modelling and data architecture principles Familiarity with event-driven architectures , API -based data sources , data quality validation, arc...

Develop and migrate data pipelines using Spark, Python/Scala. Move Hive and Control-M jobs to Airflow/DBT. Integrate with Kafka, Solace, S3, MinIO, and deploy on Kubernetes ensuring scalable, automated, production-ready solutions. Required Candidate profile Experienced Data Engineer (6–9 yrs) with strong Spark, Python/Scala, and SQL skills. Hands-on in Airflow, DBT, Kafka, Kubernetes, and data lakehouse tools.Capable of independent delivery and migration

- Design, develop, and operate scalable and maintainable data pipelines in the Azure Databricks environment - Develop all technical artefacts as code, implemented in professional IDEs, with full version control and CI/CD automation - Enable data-driven decision-making in Human Resources (HR), Purchasing (PUR) and Finance (FIN) by ensuring high data availability, quality, and reliability - Implement data products and analytical assets using software engineering principles in close alignment with business domains and functional IT - Apply rigorous software engineering practices such as modular design, test-driven development, and artifact reuse in all implementations - Global delivery footprin...

Job Summary: A global AI and analytics leader helping Fortune 1000 companies solve complex challenges. Play a key role as a Microsoft Fabric Data Architect to drive data lakehouse projects and innovation. Work with a global team across industries like CPG, Retail, Insurance, BFS, Manufacturing, Life Sciences, and Healthcare. Be part of a certified great place to work with opportunities for growth and cutting-edge technologies. Job Description: Hands-on experience with Microsoft Fabric, Azure Databricks, and Synapse, leading end-to-end Data Lakehouse projects with Medallion Architecture. Deep expertise in Microsoft Fabric components including Data Factory, Pyspark, Delta Live Tables, Fabric L...

Position: Full Stack Developer (Data Engineering Focus) Location: Remote (Pune preferred) Experience Required: 5+ Years We are looking for candidates who are : Fluent in English. 5+ years of progressively responsible experience in data engineering with a focus on data modelling and 3+ years in data engineering (Microsoft Fabric or Azure Synapse) and report development (Power BI). Proven track record as a Data Engineer or similar role, and in Power BI development, including Paginated or SSRS reports . Experience in Data Lake and Data Lakehouse implementation (e.g., Microsoft Fabric, Azure Synapse, Databricks, Snowflake, Microsoft SQL Server, Apache Spark/Hadoop, or other similar big data or S...

Roles and Responsibilities: Collaborate with data product owners, data engineers, and business stakeholders to gather and document detailed business and technical requirements for data products and reporting needs Capture and maintain use cases, business rules, and logic for assigned data domains (e.g., fan data, marketing), ensuring alignment across teams and platforms Lead the effort in gathering technical specifications to support the integration of various internal and external data sources, including understanding integration methods and patterns Translate business needs into clear, structured documentation outlining data transformations, validations, standardizations, and reporting log...

As an accomplished Lead Data Engineer with expertise in Databricks, you will play a crucial role in enhancing data engineering capabilities while working with advanced technologies like Generative AI. Key Responsibilities: - Lead the design, development, and optimization of data solutions using Databricks, ensuring scalability, efficiency, and security. - Collaborate with cross-functional teams to gather and analyze data requirements, translating them into robust data architectures and solutions. - Develop and maintain ETL pipelines, leveraging Databricks and integrating with Azure Data Factory as needed. - Implement machine learning models and advanced analytics solutions, incorporating Gen...

JD Data Platform Lead Trinity Mobility is a leading provider of IoT and AI based smart city digital platforms. Our primary focus is into making smart cities a reality, where citizens will have a better quality of life with the power of real time connected urban infrastructure. Trinitys Smart Cities solutions adds Digital Intelligence to the urban ecosystem and enable government to solve public problems responsively & proactively. Cities undertaking digital transformation need to create the technology base to connect urban systems, add intelligence and automate civic service delivery. Trinity approach of single suite software solution fits well with this objective and enable cities to roll ou...

Description : We're seeking a skilled Mid-Level DataEngineer to join our team at SMC Global Securities Experience : 2-4 years Notice Period : Immediate , 1 month Job Location : Delhi(On-site) Key Skills Required Design, build, and maintain highly efficient and scalable real-time & batch data pipelines Implement and enforce data modeling standards Build data pipelines using a Medallion Architecture, progressing data through Bronze ,Silver and Gold Develop and optimize composable data architectures and data transformation processes Manage and maintain data storage solutions across our Data Lake (S3), Data Warehouse Write and optimize complex SQL queries and Python scripts Implement and orchest...

Who We Are We are an organisation that exists to drive progress. That's the red thread that connects everyone at The Economist Group (TEG). Our businesses share a devotion to innovation, independence and rigour in their fields of expertise. We empower people to understand and tackle the critical challenges and changes facing the world. Our analytical rigour, global expertise and evidence-based insights enable individuals and organisations to make sense of these shifts and chart a course through them. We deliver analysis and insights in many formats to subscribers and clients in 170 countries through our four businesses, The Economist, Economist Impact, Economist Intelligence and Economist Ed...

Job Title: Senior Senior Data Engineer AWS & Data Lakehouse Specialist Job Location: Madurai Working Mode: Remote Experience: 7+ Years Working Hours: 2 PM to 11 PM IST Interview Process: 2- 3 rounds of interviews from Tech Mango + 1 Level of Client Interview. Job Title: Senior Data Engineer AWS & Data Lakehouse Specialist Requirement Summary: We are seeking a highly skilled and motivated Senior Data Engineer with overall 8+ years of experience and 4–5 years of hands-on experience in building scalable data solutions on AWS. The ideal candidate will be proficient in Python, PySpark, and AWS Glue, with a strong understanding of Data Lakehouse architecture—especially the medallion model. You wil...

Job Title: Senior Senior Data Engineer AWS & Data Lakehouse Specialist Job Location: Madurai Working Mode: Remote Experience: 7+ Years Working Hours: 2 PM to 11 PM IST Interview Process: 2- 3 rounds of interviews from Tech Mango + 1 Level of Client Interview. Job Title: Senior Data Engineer AWS & Data Lakehouse Specialist Requirement Summary: We are seeking a highly skilled and motivated Senior Data Engineer with overall 8+ years of experience and 4–5 years of hands-on experience in building scalable data solutions on AWS. The ideal candidate will be proficient in Python, PySpark, and AWS Glue, with a strong understanding of Data Lakehouse architecture—especially the medallion model. You wil...

As a sharp and experienced Consultant/Architect, you will guide clients in strategically adopting Microsoft Fabric, focusing on designing and implementing the gold and silver data layers. Your responsibilities will include: - Designing end-to-end data architectures in Microsoft Fabric with a specific focus on the gold and silver layers. - Collaborating with business units to understand data landscapes and translating requirements into actionable adoption strategies. - Leading implementations involving Fabric components such as Data Factory, Synapse Data Warehouse, Data Lakehouse, and Power BI datasets. - Developing and optimizing data models for the silver and gold layers, considering perfor...

Title: Cloud DevOps Engineer Location: Remote (Offshore, India, EST Time USA) Duration: 6+ Months MIO: Skype Architect, configure, and optimize Databricks Pipelines for large-scale data processing within an Azure Data Lakehouse environment.

We are seeking technically strong Data Engineeer who can take ownership of designing and developing cutting-edge data and AI platforms using big data and cloud technologies on Microsoft Azure. You will play a critical role in building scalable data pipelines, modern data architectures, and intelligent analytics solutions. Key Responsibilities: Design and implement scalable, metadata-driven frameworks for data ingestion, quality, and transformation across both batch and streaming datasets. Develop and optimize end-to-end data pipelines to process structured and unstructured data, enabling the creation of analytical data products. Build robust exception handling, logging, and monitoring mechan...

About the Role We are looking for an experienced Data Modeler to join our data engineering team for a leading banking project . The ideal candidate will have hands-on experience in data modeling using Erwin , a deep understanding of Medallion architecture , and strong analytical skills to translate business requirements into scalable, high-quality data models. Key Responsibilities Design, develop, and maintain conceptual, logical, and physical data models using Erwin Data Modeler . Implement and optimize Medallion architecture (Bronze, Silver, Gold layers) for data pipelines and analytical systems. Collaborate with data engineers, business analysts, and architects to define data modeling sta...

Design, develop, and deploy automated data remediation workflows using Power Automate Premium and Copilot Studio. Create intelligent agents grounded in enterprise data using Model Context Protocol (MCP) and optimize prompt/context schemas. Required Candidate profile Write and optimize SQL queries and Python scripts within Microsoft Fabric Notebooks Integrate with enterprise systems: Snowflake, Dataverse, Azure SQL, Microsoft Fabric Lakehouse/Warehouse. Perks and benefits Perks and Benefits

As a Data Quality (DQ) Engineer at Astellas Pharma Inc. in Bengaluru, you will play a crucial role in ensuring the accuracy, completeness, consistency, and reliability of data within key systems. Your responsibilities will include implementing data quality business rules, conducting DQ analysis, and remediation activities. Here are the key responsibilities you will be handling: - Participate in creating data quality checks and standards for multiple source systems. - Implement business data quality checks on the SaaS platform (E.g. Databricks) in collaboration with business teams and data lake teams. - Perform unit testing, test-driven development (TDD), and test scripts execution to ensure ...

As a Data Management Lead at our client's R&D team in Kolkata, you will have the opportunity to play a crucial role in developing and maintaining data management related modules. With your 10-15 years of experience in data management, you will drive the design, development, and deployment of cutting-edge products at the intersection of GenAI and data transformation. Your responsibilities will include: - Driving the design, development, and deployment of data management and storage related modules in the product. - Overseeing data architecture and integration processes across modules. - Enabling real-time and batch ETL and ELT processes to ensure data quality, performance, and optimal usage o...

As a Data Modeler at our company, you will be a key player in building scalable data architecture. Your primary responsibilities will include: - Designing and maintaining conceptual, logical, and physical data models. - Collaborating with data architects and engineers to ensure accurate data structures. - Implementing best practices in dimensional data modeling to support analytics and reporting. - Working across teams to align data models with business needs and performance goals. To qualify for this role, you should have: - 5+ years of experience in data modeling. - Proven expertise in dimensional data modeling techniques. - Strong understanding of data lakehouse and data warehouse archite...

Qinecsa Qinecsa is a global team of technology innovators and entrepreneurs with deep experience in clinical research, medical product safety and public health surveillance. We are working with regulators, major pharmaceutical companies and academia to develop the next generation of analytical solutions used to improve drug, vaccine and device safety monitoring and public health surveillance. We are growing and looking for world class talent to help us deliver innovative products and services that help our customers answer complex and important questions. Position title - Senior Data Engineer Experience - 10-12 Years Location - Remote(India) Overview Reporting to Head of Development, you wil...

Role & responsibilities Database Expertise: Primary (Greenplum & Teradata) - Data Integration & ETL Tools: Primary - Streaming & Real-Time Data: Primary - Scripting & Automation: Primary - Workflow Orchestration: Secondary - Cloud & DevOps: Secondary - Big Data & Lakehouse Technologies: Secondary - Data Replication: good to have - Soft Skills: good to have Preferred candidate profile

Posting title: Sr. Data Engineer (Databricks) Experience: 5+ Years Location: Pune/ Ahmedabad Work mode: Hybrid Primary skills: Databricks, Data Modelling/ Data Lakehouse, SQL, Python/Scala, Azure Data Factory (ADF)/AWS Glue Qualification: Any Technical Degree Roles & Responsibilities: Data Architecture & Development: Lead the design, development, and optimization of scalable, secure, and high-performance data solutions in Databricks. ETL/ELT Pipeline Engineering: Build and maintain robust pipelines, integrating Databricks with Azure Data Factory (or AWS Glue), ensuring reliability and efficiency. Advanced Analytics & AI Integration: Implement machine learning models and Generative AI-powered...

Position Summary... Provides overall direction by analyzing business objectives and customer needs; developing, communicating, building support for, and implementing business strategies, plans, and practices; analyzing costs and forecasts and incorporating them into business plans; determining and supporting resource requirements; evaluating operational processes; measuring outcomes to ensure desired results; identifying and capitalizing on improvement opportunities; promoting a customer environment; and demonstrating adaptability and sponsoring continuous learning. Develops and implements strategies to attract and maintain a highly skilled and engaged workforce by diagnosing capability gaps...