584 Delta Lake Jobs - Page 4

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software - one of the fastest-growing IT services companies - where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportati...

The Oracle Cloud Infrastructure Compute team is seeking a passionate, experienced Data Engineer ready to tackle complex business and technical challenges through the managing and analysis of data, in a fast-paced environment. As OCI continues to scale to demands of an ever-growing customer base and regions, we need engineers who can lead data-driven initiatives to ensure OCI continues to provide an outstanding customer experience while continuously improving the efficiency of development processes. The ideal candidate is someone who thrives in the face of ambiguity and can quickly distill abstract ideas into concrete solutions and has a proven track record of delivering complex data engineer...

Join us as a Senior Spark Data Engineer at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. As a part of the team, you will deliver technology stack, using strong analytical and problem solving skills to understand the business requirements and deliver quality solutions. You'll be working on complex technical problems that will involve detailed analytical skills and analysis. This will be done in conjunction with fellow engineers, business analysts and business stakeholders. To be successful as a Senior Spark ...

Harness is a high-growth company that is disrupting the software delivery market. Our mission is to enable the 30 million software developers in the world to deliver code to their users reliably, efficiently, securely and quickly, increasing customers pace of innovation while improving the developer experience. We offer solutions for every step of the software delivery lifecycle to build, test, secure, deploy and manage reliability, feature flags and cloud costs. The Harness Software Delivery Platform includes modules for CI, CD, Cloud Cost Management, Feature Flags, Service Reliability Management, Security Testing Orchestration, Chaos Engineering, Software Engineering Insights and continues...

We are seeking skilled and motivated Spark & Databricks Developers to join our dynamic team for a long-term project. The ideal candidate will have strong hands-on experience in Apache Spark , Databricks , and GitHub-based development workflows . Key Responsibilities: Design, develop, and optimize big data pipelines using Apache Spark . Build and maintain scalable data solutions on Databricks . Collaborate with cross-functional teams for data integration and transformation. Manage version control and code collaboration using GitHub . Ensure data quality , performance tuning, and job optimization. Participate in code reviews , testing, and documentation activities. Must-Have Skills: 58 years o...

Key Responsibilities: Data Architecture & Management: Design and implement scalable, cloud-agnostic Data Lake, Data LakeHouse, Data Mesh and Data Fabric architectures to efficiently store, process, and manage structured and unstructured data from various sources. Data Pipeline Development : Design, develop, and maintain robust data pipelines to ingest, process, and transform data from multiple sources into usable formats for analytics and reporting using services like AWS Glue, Azure Data Factory, GCP Dataflow, Apache Spark, or Apache Airflow. Data Integration and ETL: Develop and optimize Extract, Transform, Load (ETL) and ELT processes to integrate disparate data sources into the data lake...

Role Overview: As a Technical Manager with expertise in Oracle, PL/SQL, and data workflows optimization on the Databricks platform, you will play a crucial role in designing, developing, and optimizing data solutions. Your deep knowledge in Apache Spark, PySpark, and Python will be essential in supporting scalable data engineering and analytics solutions. You will spend 80% of your time on hands-on development, design, and architecture, with the remaining 20% focused on guiding the team on technology and removing impediments. Capital Markets Projects experience is preferred. Key Responsibilities: - Design and implement scalable data Lakehouse solutions using Databricks and Delta Lake. - Deve...

Role Overview: You will be joining Investor Services Technology as an Applications Development Technology Senior Data Lead Analyst. In this senior-level position, you will be responsible for establishing and implementing canonical data architecture, driving data governance, leading data analysis and programming activities for applications across Investor Services, and modernizing the data strategy and architecture. Key Responsibilities: - Design and implement Spark, Hive, Scala pipelines using Medallion model - Architect data integration across custody platforms - Embed automation in metadata, data dictionary, data catalogues, and quality checks - Ensure reliability, cost optimization, and d...

As a Data Architect specializing in Databricks and Snowflake, your role involves designing and optimizing cloud-native data architectures to support scalable data engineering, advanced analytics, and AI/ML solutions in alignment with business requirements. Your key responsibilities include: - Designing and implementing Lakehouse architectures utilizing Databricks, Delta Lake, and Apache Spark. - Leading the development of data pipelines, ETL/ELT processes, and data integration strategies. - Collaborating with both business and technical teams to establish data architecture standards, governance, and security models. - Optimizing the performance and cost-efficiency of Databricks clusters and ...

Experience needed: 8-12 years Type: Full-Time Mode: WFO Shift: IST Location: Hyderabad, India Notice Period: Immediate to 15 days About the Role We are seeking an experienced Databricks Implementation Lead to spearhead end-to-end delivery of a large-scale data engineering and analytics project built on the Databricks Lakehouse platform . The ideal candidate will have deep expertise in data architecture , hands-on experience with Databricks (SQL, PySpark, Delta Lake, MLflow) , and the ability to lead teams through solution design, migration, optimization, and production rollout . Key Responsibilities 1. Project Leadership Own the complete Databricks implementation lifecycle from requirement g...

Work Locations: Mumbai OR Hyderabad OR Gurgaon About the Role: We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to deliver high-quality data solutions. Key Responsibilities Architect and implement enterprise-grade data platforms on Azure Databricks (DLT, Workflows, Unity Catalog) with strong security, governance, and reliability. Design end-to-end data pipelines: batch and streaming (Structured Streaming), CDC, and near real-time analytics. Define and...

Experience : 8.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Office (Noida) Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers client - Nuaav) What do you need for this opportunity Must have skills required: Architecture, J2EE, Python, Azure, AWS, SQL, NoSQL Nuaav is Looking for: Company Overview Nuaav is a boutique consulting firm that positions itself as a strategic partner for corporate leaders, focusing on delivering real business results and driving impactful change in complex and rapidly evolving business environments. Unlike large-scale consulting firms, Nuaav brings the bouti...

Role Overview: You will be a senior Data Architect with expertise in the Databricks Unified Data Analytics Platform. The primary responsibilities will include defining data requirements, designing scalable data architectures, and ensuring robust integration across applications. You will serve as a Subject Matter Expert, advising stakeholders, influencing key architectural decisions, and mentoring junior team members while shaping enterprise-level data strategies. Key Responsibilities: - Define data requirements and model application data structures. - Design data architecture, storage, and integration solutions aligned with business needs. - Act as a Subject Matter Expert for data architectu...

Experience needed: 8--12 years Type: Full-Time Mode: WFO Shift: IST Location: Hyderabad, India Notice Period: Immediate to 15 days About the Role We are seeking an experienced Databricks Implementation Lead to spearhead end-to-end delivery of a large-scale data engineering and analytics project built on the Databricks Lakehouse platform . The ideal candidate will have deep expertise in data architecture , hands-on experience with Databricks (SQL, PySpark, Delta Lake, MLflow) , and the ability to lead teams through solution design, migration, optimization, and production rollout . Key Responsibilities 1. Project Leadership Own the complete Databricks implementation lifecycle from requirement ...

Skills: Databricks, Apache Spark, SQL, Python, Big Data, Azure, Data Modeling, Azure Data Services, Title : Senior Databricks Architect Location : Mumbai, Gurgaon, Hyderabad About The Role We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to deliver high-quality data solutions. Key Responsibilities Architect and implement enterprise-grade data platforms on Azure Databricks (DLT, Workflows, Unity Catalog) with strong security, governance, and reliabilit...

Skills: Databricks, Apache Spark, SQL, Python, Big Data, Azure, Data Modeling, Azure Data Services, Title : Senior Databricks Architect Location : Mumbai, Gurgaon, Hyderabad About The Role We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to deliver high-quality data solutions. Key Responsibilities Architect and implement enterprise-grade data platforms on Azure Databricks (DLT, Workflows, Unity Catalog) with strong security, governance, and reliabilit...

One of our US Based client who is transforming how people buy and sell secondhand apparel, and data is central to that mission. We're looking for a Data Engineer to join our Data Engineering team with a focus on analytics engineering and enabling scalable, self-service data across the organization. In this role, you'll design, build, and maintain scalable data infrastructure and robust pipelines to support a wide range of analytics use cases. You'll collaborate with cross-functional partners to develop trusted data models that power reporting, analytics, and automation. You'll also contribute to platform-level efforts around content governance and performance optimization. This is a foundati...

Must have skills: Hands-on experience with Databricks platform, including Delta Lake/ Lakehouse architecture Person should be familiar with Python / Pyspark code (not needed a developer) Knowledge of data structures, data modeling, ETL/ELT, and data warehousing. SQL basic in data querying and troubleshooting / manipulation. Key asks for the role: We need a candidate who can drive high-level design and solutioning based on established patterns. The person will collaborate closely with Solution Architect team. At this level, the candidate will not be working as a full-time developer but should be familiar with Python code and able to perform code reviews, debugging, and mentoring of junior dev...

Proficiency in Databricks, Python (PySpark) and SQL. Solid understanding of data engineering concepts, ETL pipelines & data modeling. Exp with Delta Lake, Databricks Workflows & version control (Git). Strong problem-solving and collaboration skills.

Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data pipelines using Apache Spark, Delta Lake, ETL processes. Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time. Develop complex SQL queries to optimize database performance and troubleshoot issues. Ensure scalability, reliability, and security of all systems by implementing best practices in coding standards. Participate in code reviews to improve overall quality of the system. Desired Candidate Profile 4-7 years of experience as a Databricks Engineer or similar role. Strong expertise in Apache Spark (Pyspark), Python programming language. Proficiency in...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Analytics Services Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Roles & Responsibilities: -Develop and Optimize Data Pipelines using PySpark and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads. -Design and Implement ETL Processes by leveraging Databricks notebooks, Delta Lake, and Python-based custom scripts for data ingestion and curation. -Collaborate with Data Analysts and St...

Key Responsibilities - Familiarity with modern storage formats like Parquet and ORC. Design and develop conceptual, logical, and physical data models to support enterprise data initiatives. Build, maintain, and optimize data models within Databricks Unity Catalog. Develop efficient data structures using Delta Lake, optimizing for performance, scalability, and reusability. Collaborate with data engineers, architects, analysts, and stakeholders to ensure data model alignment with ingestion pipelines and business goals. Translate business and reporting requirements into robust data architecture using best practices in data warehousing and Lakehouse design. Maintain comprehensive metadata artifa...

Skills: Databricks, azure, PySpark, Data Engineering, Azure Data Services, Delta Lake, ETL Pipelines, DevOps, Title: Senior Databricks Architect Location: Mumbai, Gurgaon, Hyderabad About The Role We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to deliver high-quality data solutions. Key Responsibilities Architect and implement enterprise-grade data platforms on Azure Databricks (DLT, Workflows, Unity Catalog) with strong security, governance, and re...

Skills: Databricks, Microsoft Azure, Data Engineer, pyspark, kafka, python, Apache Spark, SQL, About The Role We are seeking a Senior Databricks Architect to lead the design and implementation of scalable, secure, and cost-optimized data platforms on Azure using Databricks. You will own end-to-end architecture for data ingestion, transformation, governance, and analytics, and mentor engineering teams to deliver high-quality data solutions. Key Responsibilities Architect and implement enterprise-grade data platforms on Azure Databricks (DLT, Workflows, Unity Catalog) with strong security, governance, and reliability. Design end-to-end data pipelines: batch and streaming (Structured Streaming)...

At BairesDev, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide. When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success. Principal Data Lake Engineer at BairesDev We are seeking a Principal Data Lake Engineer with deep expertise in data lake architecture, schema-on...