584 Delta Lake Jobs - Page 6

Role & responsibilities Designs and develops robust data pipelines for ingesting, transforming, and loading (ETL/ELT) data from multiple sources into analytics platforms. Mastery of SQL, Python (Pandas, NumPy, PySpark),Experience with modern ETL/ELT frameworks, expertise in Databricks/ Delta Lake / Glue / Redshift Preferred candidate profile

At Mr. Cooper Group, You Make the Dream Possible. Our purpose is simple: Keeping the dream of homeownership alive. As a Mr. Cooper Group team member, you play a big role in making that dream possible. Around here, we know our roles and work together, volunteer to make a difference, and challenge the status quo when needed. Everything we do is in the care and service of our teammates and our customers. Join us and make the dream of home ownership possible! Job Description Summary We are looking for a skilled Data Engineer to design, build, and optimize scalable data pipelines that power analytics, reporting, and machine learning across the organization. You will work on Microsoft Fabric, Data...

WPP is the creative transformation company. We use the power of creativity to build better futures for our people, planet, clients, and communities. Working at WPP means being part of a global network of more than 100,000 talented people dedicated to doing extraordinary work for our clients. We operate in over 100 countries, with corporate headquarters in New York, London and Singapore. WPP is a world leader in marketing services, with deep AI, data and technology capabilities, global presence and unrivalled creative talent. Our clients include many of the biggest companies and advertisers in the world, including approximately 300 of the Fortune Global 500. Our people are the key to our succ...

We are seeking an experienced and highly motivated Senior Data Engineer to join our dynamic team. The ideal candidate will play a critical role in designing, developing, and maintaining high-performance data infrastructure and pipelines. As a Senior Data Engineer, you will be responsible for ensuring the scalability, performance, and reliability of data systems that support business intelligence, analytics, and data science initiatives across the organization. You will work in a collaborative environment with cross-functional teams to translate business needs into technical solutions and help shape the organizations overall data strategy. This role offers an excellent opportunity to work wit...

As a Data Engineer & Warehousing professional, your primary responsibilities will include managing the full development cycle of Data Engineering & Warehousing concepts, from requirements gathering to maintenance. You will be identifying and resolving data issues to ensure data quality and consistency, and implementing automation opportunities. Developing expertise in data and data models within the data warehouse, and understanding supported business domains will also be part of your role. Effective communication with technical personnel, business managers, and senior leadership regarding data inquiries and requests is essential. You will conduct internal testing & user acceptance testing, ...

Responsibilities An Azure Data Engineer is responsible for designing, building, and maintaining the data infrastructure for an organization using Azure cloud services. This includes creating data pipelines, integrating data from various sources, and implementing data security and privacy measures. The Azure Data Engineer will also be responsible for monitoring and troubleshooting data flows and optimizing data storage and processing for performance and cost efficiency. Mandatory Skills Bachelor's or higher degree in Computer Science, Data Engineering, or a related discipline, or equivalent (minimum 10+ years overall work experience). Expertise in designing and implementing high-performance d...

Job Requirements Mandatory Skills: Bachelor or higher degree in Computer Science, Data Engineering, or a related discipline, or equivalent or higher degree in Computer Science, Data Engineering, or a related discipline, or equivalent (minimum 10+ years overall work experience). Expertise in designing and implementing high-performance data ingestion pipelines using Databricks and other relevant technologies. Proven track record of delivering and presenting proofs of concept for key technology components to project stakeholders. Development of scalable and reusable frameworks for ingesting, processing, and enriching datasets using Databricks. Integration of end-to-end data pipelines, ensuring ...

As a Head of Analytics or Data Architect with over 15 years of experience, you will play a crucial role in designing and implementing an organizational data strategy aligned with business processes. Your responsibilities will include developing data models, managing data warehouses, implementing data governance standards, and collaborating with business leaders to define actionable metrics and data visualization dashboards. - Interact closely with Business Leaders and Product Team to design, develop, and implement an overall organizational data strategy - Identify data sources and build complex data ingestion, data integration, and ETL strategy - Create and maintain an end-to-end vision for ...

As an Azure Databricks Lead, your role will involve designing, implementing, and optimizing data solutions using Azure Databricks. Your expertise will contribute to building robust data pipelines, ensuring data quality, and enhancing overall performance. You will collaborate with cross-functional teams to deliver high-quality solutions aligned with business requirements. **Key Responsibilities:** - Design and Develop Data Pipelines: - Create scalable data processing pipelines using Azure Databricks and PySpark. - Implement ETL (Extract, Transform, Load) processes to ingest, transform, and load data from various sources. - Collaborate with data engineers and architects to ensure efficient dat...

Data Architect is responsible to define and lead the Data Architecture, Data Quality, Data Governance, ingesting, processing, and storing millions of rows of data per day. This hands-on role helps solve real big data problems. You will be working with our product, business, engineering stakeholders, understanding our current eco-systems, and then building consensus to designing solutions, writing codes and automation, defining standards, establishing best practices across the company and building world-class data solutions and applications that power crucial business decisions throughout the organization. We are looking for an open-minded, structured thinker passionate about building systems...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success . Senior Data Lake Engineer at BairesD ev We are seeking a Senior Data Lake Engineer with expertise in data lake architecture, schema-on-read, da...

As a Data Engineer at UPS, your role involves participating in the support of batch and real-time data pipelines for Marketing and Finance business units. You will be responsible for integrating data from various sources, performing ETL data conversions, and facilitating data cleansing and enrichment. Your duties will include full systems life cycle management activities, such as analysis, technical requirements, design, coding, testing, and implementation of systems and applications software. Additionally, you will contribute to synthesizing disparate data sources to support reusable and reproducible data assets. **Key Responsibilities:** - Supervising and supporting data engineering projec...

Title: Staff Data Software Engineer Reporting to: Director, Data & AI Location: Bengaluru (Bangalore) Opportunity Get Well is seeking a skilled and motivated Staff Data Software Engineer to help build and optimize our cloud-native data platform supporting AI, analytics, and clinical applications. You will play a key role in developing secure and scalable data pipelines and collaborating with cross-functional teams to deliver high-quality data solutions in a regulated healthcare environment. This is a hands-on engineering role ideal for someone who enjoys building data infrastructure, working with modern cloud data platforms, and contributing to the architecture and performance of large-scale...

Title: Data Software Engineer, Platform Engineering Reporting to: Senior Director, Product Development Location: Bengaluru (Bangalore) Opportunity: Get Well is seeking a technically adept Data Software Engineer, Platform Engineering to implement, maintain and optimize our cloud-native data platform supporting AI, analytics, and clinical applications. This role will work with the architect to implement scalable, secure, and high-performance data pipelines and processing systems within a regulated healthcare environment. The Data Software Engineer will focus on implementing and optimizing data processing workflows, ensuring data quality, and adhering to healthcare compliance standards such as ...

Job Description Data Architect Databricks (Azure/AWS) Role Overview: We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS . The role involves designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data. Responsibilities Key Responsibilities: Define and design cloud-native data architecture on Databricks using Delta Lake, Unity Catalog, and related services. Develop migrat...

JOB DESCRIPTION Data Engineer Designation Data Engineer Experience 5+ Years Location Mumbai (onsite) Job Summary: We are seeking a highly skilled Data Engineer with deep expertise in Apache Kafka integration with Databricks, structured streaming, and large-scale data pipeline design using the Medallion Architecture. The ideal candidate will demonstrate strong hands-on experience in building and optimizing real-time and batch pipelines, and will be expected to solve real coding problems during the interview. Job Description: • Design, develop, and maintain real-time and batch data pipelines in Databricks. • Integrate Apache Kafka with Databricks using Structured Streaming. • Implement robust ...

Role & responsibilities Lead the design, development, and optimization of ETL/ELT pipelines using Databricks , Python, Spark , and Delta Lake . Architect scalable data solutions using Medallion architecture (Bronze, Silver, Gold layers). Design and implement data models and transformations using SQL and Python . Build and maintain audit frameworks to ensure traceability, compliance, and data lineage. Develop data quality monitoring and automated testing frameworks for pipeline reliability. Perform data analysis to support operational data requests and user queries. Collaborate with clinical data teams to analyse IRT/RTSM datasets . Create and maintain dashboards and reports using BI tools (e...

Role - Databricks with Python Exp - 5 to 9 Yrs Location - Hyderabad Note - This is a scheduled drive. Only eligible candidates who receive invite from us will be allowed inside Campus. Job Description Extensive expertise in designing and implementing data load processes using Azure Data Factory, Azure Databricks, Delta Lake, Azure Delta Lake Storage and Python/PySpark Proficient with Databricks & Python Senior developers with Full Database/ Datawarehouse/ DataMart development capabilities Senior SME with SQL Server required. Proficiency with standard file formats and markup language technology such as JSON, XML, XSLT. Proficiency with Azure Cloud data environments highly desired. Excellent v...

Role: Data Engineering Lead Location: Bangalore (Work from Office) Experience: 12+ Years Notice Period: Immediate to 30 Days Job Description: Design, develop, and optimize scalable data architectures using Databricks and Apache Spark . Build and maintain ETL/ELT pipelines for large-scale data processing. Ensure data governance , security , and compliance across the Databricks environment. Collaborate with analytics, marketing, and business teams to deliver data-driven solutions. Integrate Databricks with AWS/Azure/GCP , and CRM tools like Salesforce or Veeva . Lead and mentor a team of data engineers, ensuring delivery excellence. Implement Medallion Architecture and Delta Lake for efficient...

Experience : 1.00 + years Salary : INR 1800000-2200000 / year (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Zero to 1) (*Note: This is a requirement for one of Uplers client - Zero to 1) What do you need for this opportunity Must have skills required: graph features (PPR, Graph/GraphRAG: Neo4j, Jaccard) for constrained recommendations, Re-rankers: cross-encoders, reranking with transformers, Languages: Python 3.10+, Classical ML: scikit-learn, cross-val, Data: pandas, Delta Lake (S3), Feature Engineering, LightGBM/XGBoost, model sele...

You are an accomplished and dynamic Data Engineering Lead responsible for driving the design, development, and delivery of cutting-edge data solutions. Your role involves overseeing the design and development of robust data pipelines and systems, managing and mentoring a team of 5 to 7 engineers, and playing a critical role in architecting innovative solutions tailored to client needs. You will lead by example, fostering a culture of accountability, ownership, and continuous improvement while delivering impactful, scalable data solutions in a fast-paced consulting environment. Key Responsibilities: - Architecture & Delivery: - Lead the end-to-end architecture of data pipelines leveraging Azu...

As a Data Engineer at UPS, your role involves participating in the support of batch and real-time data pipelines for Marketing and Finance business units. You will be responsible for integrating data from various sources, performing ETL data conversions, and facilitating data cleansing and enrichment. Your duties will include full systems life cycle management activities, such as analysis, technical requirements, design, coding, testing, and implementation of systems and applications software. Additionally, you will contribute to synthesizing disparate data sources to support reusable and reproducible data assets. **Key Responsibilities:** - Supervising and supporting data engineering projec...

Position Overview We are seeking an experienced Senior Analytics Engineer to join our data team and drive the design, implementation, and maintenance of our data architecture and semantic layers. This role combines deep technical expertise in data modeling with strategic thinking about how data can best serve our organization's analytical needs. The ideal candidate will have extensive experience with modern data stack technologies and a proven track record of building scalable, AI-ready data architectures. Key Responsibilities Data Architecture & Modeling Design and implement dimensional data models following Kimball methodology and best practices Plan, create, and execute comprehensive data...

Job Description Manager, Data Engineer The Opportunity Based in Hyderabad, join a global healthcare biopharma company and be part of a 130-year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achieve new milestones in global healthcare. Be part of an organisation driven by digital technology and data-backed approaches that support a diversified portfolio of prescription medicines, vaccines, and animal health products. Drive innovation and execution excellence. Join a team that is passionate about using data, analytics, and insights to drive decision-making and create custom software, allowing us to tackle some of the world's greatest health threat...

Data Platform Engineer 241 Key Responsibilities Develop and maintain end-to-end data pipelines for ingesting, wrangling, transforming, and joining data from diverse sources. Design and implement scalable, high-performance ETL pipelines using tools such as AWS Glue, Databricks, Apache Airflow, and DataProc. Develop data models, schemas, and storage solutions for relational, NoSQL, and lakehouse environments (Snowflake, BigQuery, Delta Lake). Optimize data pipelines for performance and cost, including infrastructure considerations. Implement CI/CD pipelines for data solutions and infrastructure using tools like GitHub Actions, Jenkins, Terraform, or similar. Collaborate with teams to define ar...