584 Delta Lake Jobs - Page 5

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software - one of the fastest-growing IT services companies - where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportati...

Role Overview: As a Senior Data Engineer, your primary responsibility is to design and optimize data pipelines, ETL workflows, and cloud-based data solutions using your expertise in Databricks, Apache Airflow, SQL, and Python. You play a crucial role in driving efficient and scalable data engineering solutions by implementing big data processing techniques and automation. Key Responsibilities: - Design, develop, and optimize data pipelines utilizing Databricks and Apache Airflow. - Implement PySpark-based transformations and processing in Databricks for handling large-scale data efficiently. - Develop and maintain SQL-based data pipelines, focusing on performance tuning and optimization. - C...

Summary We are building data-centric applications on Databricks Apps that combine interactive React UIs with Python backends powered by Databricks SQL and Delta Lake. We are looking for a Full-Stack Developer who can design and deliver modern, scalable applications that integrate seamlessly with the Databricks Lakehouse platform. This role is strictly involved in the development of the product and does not involve access to Protected Health Information (PHI) & Personally Identifiable Information (PII) or any secured/confidential client data. The work is limited to application development & demo and does not include handling or processing of sensitive health information. Your role in our miss...

Job Title:Immediate Data Scientist (3+ Years Experience) Bengaluru Location:Bengaluru (Work from Office Minimum 4 Days/Week) Employment Type:Full-time (Third-Party Payroll, Not Contractual) Experience Required:3+ years in AI/ML Educational Qualifications: o B.E./B.Tech/M.Tech/MCA in Computer Science, Electronics & Communication, Electrical Engineering, or a related field. o A master's degree in computer science, Artificial Intelligence, or a specialisation in Deep Learning or Computer Vision is highly preferred. Experience: o 46 years of IT experience, with a minimum of 3+ years in data science o Proven experience in designing and deploying deep learning models, particularly in computer visi...

Req ID: 341067 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Databricks Architect to join our team in Bangalore, Karn?taka (IN-KA), India (IN). Databricks Data Platform - Architect Job Description Role Summary As a Databricks Architect , you will lead the design and implementation of scalable, secure, and high-performance data solutions using the Databricks Lakehouse Platform. You will define architectural standards, guide engineering teams, and collaborate with stakeholders to align data strategies with business g...

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world. Your Role Designing and developing end-to-end data pipelines using Azure Data Factory and Databricks, PySpark, SQL, Delta Lake, azure data lake Building and optimizing ETL workflows for ingestion, transformation, and loading of structured and semi-structured data into Azure Synapse Analytics an...

Location: Bangalore Experience: 6-9 Years Choosing Capgemini means choosing a place where you'll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine what's possible. Join us in helping leading Consumer Products and Retail Services (CPRS) organizations unlock the value of technology and drive scalable, sustainable growth. Your Role As a Data Intelligence & AI Solution Architect , you will lead the design and implementation of advanced data platforms and AI-driven solutions. You'll collaborate with presales, delivery, and client teams to architect scalable systems using Databricks , MLOps frameworks , and cloud-native technologies . Key R...

About The Role Grade Level (for internal use): 11 Summary As a Data Engineer & AI Developer, you will play a key role in transforming complex data into clear, actionable insights. You will be responsible for building robust data pipelines, developing interactive dashboards, and integrating cutting-edge AI techniques to enhance our data processes and insights. This is a unique opportunity to blend expertise in data engineering and visualization with a forward-thinking approach to artificial intelligence. Key Responsibilities ETL/ELT Development: Design, build, and optimize scalable data pipelines using ETL/ELT processes to ingest, clean, and transform large datasets from various sources. AI-P...

About Us Observe.AI is the leading AI agent platform for customer experience. It enables enterprises to deploy AI agents that automate customer interactions, delivering natural conversations for customers with predictable outcomes for the business. Observe.AI combines advanced speech understanding, workflow automation, and enterprise-grade governance to execute end-to-end workflows with AI agents. It also enables teams to guide and augment human agents with AI copilots, and analyze 100% of human and AI interactions for insights, coaching, and quality management. Companies like DoorDash, Affordable Care, Signify Health, and Verida use Observe.AI to transform customer experiences every day by ...

Responsibilities: Design and implement secure, scalable, and automated Databricks environments to support AI/ML workloads. Develop infrastructure-as-code (IaC) solutions using Terraform for provisioning Databricks, cloud resources, and network configurations. Build automation and self-service capabilities using Python, Java and APIs for platform onboarding, workspace provisioning, orchestration and monitoring. Collaborate with data science and ML teams to define compute requirements, governance policies, and efficient workflows across dev/qa/prod environments. Integrate Databricks offering with cloud-native services on Azure/AWS Champion CI/CD and GitOps for managing ML infrastructure and co...

As a candidate for this role, you would be responsible for the following: - Understanding of Spark core concepts like RDDs, DataFrames, DataSets, SparkSQL, and Spark Streaming. - Experience with Spark optimization techniques. - Deep knowledge of Delta Lake features like time travel, schema evolution, data partitioning. - Ability to design and implement data pipelines using Spark and Delta Lake as the data storage layer. - Proficiency in Python/Scala/Java for Spark development and integrate with ETL process. - Knowledge of data ingestion techniques from various sources (flat files, CSV, API, database). - Understanding of data quality best practices and data validation techniques. Qualificatio...

As a Lead Consultant- Databricks Developer at Genpact, your role involves solving real-world cutting-edge problems to meet both functional and non-functional requirements. Your primary responsibilities will include: - Maintaining close awareness of new and emerging technologies and their potential application for service offerings and products. - Collaborating with architects and lead engineers to develop solutions that meet functional and non-functional requirements. - Demonstrating knowledge of relevant industry trends and standards. - Showcasing strong analytical and technical problem-solving skills. - Having experience in the Data Engineering domain. Qualifications we seek in you: - Bach...

As an experienced candidate with over 8 years of overall experience and 5+ years of relevant experience, your role will involve the following key responsibilities: - Strong understanding of Spark core including RDDs, DataFrames, DataSets, SparkSQL, and Spark Streaming - Proficiency in Delta Lake features such as time travel, schema evolution, and data partitioning - Designing and building data pipelines using Spark and Delta Lake - Solid experience in Python/Scala/Java for Spark development - Knowledge of data ingestion from files, APIs, and databases - Familiarity with data validation and quality best practices - Working knowledge of data warehouse concepts and data modeling - Hands-on expe...

Hiring: Cloud DevOps Engineer Location: Remote (India-based) Were looking for a seasoned Cloud DevOps Engineer with 10+ years of hands-on experience to join a dynamic team driving innovation in cloud-native data platforms. Key Responsibilities: Architect & optimize Databricks Pipelines in Azure Data Lakehouse Manage Azure infrastructure: Databricks, AKS/ACI, Storage, Networking Implement monitoring with Azure Monitor, Log Analytics, Prometheus/Grafana Enable microservices architecture for scalable data solutions Drive CI/CD automation using Terraform, ARM templates, GitHub Actions/Azure DevOps Required Skills: Strong experience with Azure Databricks, Delta Lake, Apache Spark Deep knowledge o...

Job Application Link:https://app.fabrichq.ai/jobs/7651f5ee-7067-41e8-9b00-177569e3ad98 Job Summary: We are looking for an accomplished Principal Data Architect to lead the design and implementation of cloud-native, scalable, and intelligent data platforms. The ideal candidate will have deep hands-on experience across Azure, AWS, and GCP, with proven expertise in Databricks and AI/ML integration. This is a client-facing leadership role that demands both technical excellence and strategic communication skills. Key Responsibilities Design and implement modern data architectures using Databricks, Azure, AWS, or GCP. Lead data lakehouse, AI/ML pipeline, and analytics platform development end to e...

As a Lead Data Scientist (Generative AI) at Blend, you will be spearheading the development of advanced AI-powered classification and matching systems on Databricks. Your role will involve contributing to flagship programs like the Diageo AI POC by building RAG pipelines, deploying agentic AI workflows, and scaling LLM-based solutions for high-precision entity matching and MDM modernization. **Key Responsibilities:** - Design and implement end-to-end AI pipelines for product classification, fuzzy matching, and deduplication using LLMs, RAG, and Databricks-native workflows. - Develop scalable, reproducible AI solutions within Databricks notebooks and job clusters, leveraging Delta Lake, MLflo...

Job Title - Senior Data Engineer Job Description - Bachelor's degree in computer science, Information Systems, or related field. 3.5+ years of experience in data platform operations or support roles. Proven expertise in Greenplum (PostgreSQL-based MPP), AWS (S3, EC2, Glue, Lambda) etc. Hands on experience in Databricks (Spark, Delta Lake, notebooks, Informatica PowerCenter), Cognos reporting, Power BI, DAX, data modeling, report publishing, ITIL Certification. Excellent communication and stakeholder engagement skills. Ability to work independently and manage multiple priorities. Certifications in AWS, Databricks and Power BI is desirable. Experience with Agile methodologies and DevOps practi...

Job Title-Data Engineer Exp-6-8 Yeras Location- Mumbai Job Responsibilities- Actionable Designing and implementing data storage solutions on Azure Building and maintaining data pipelines for data integration and processing Optimizing data processing performance through tuning and monitoring Developing and maintaining data models and schemas Ensuring data security and privacy prerequisites are followed Designing and developing BI reports and dashboards Collect data from various sources, transform into a practical format, and load into the appropriate data storage solution on Azure using tools such as Azure Data Factory and Azure Databricks. Develop and maintain data models and schemas optimiz...

We are seeking an experienced Databricks Full Stack Data Engineer with 56 years of industry experience. The ideal candidate will have a proven track record of working on live projects, preferably within the manufacturing or energy sectors. He/she will play a key role in developing and maintaining scalable data solutions using Databricks and related technologies. Key Responsibilities: Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with various data sources and systems. Collaborate with cross-functional teams to understand data, and deliver effective BI solutions. Implement data ingestion, transformation, and processing workflows using Spark (PySpark/Sca...

Senior IT Officer, Business Solutions I (Senior Data Engineer) Job #: req34539 Organization: World Bank Sector: Information Technology Grade: GG Term Duration: 2 years 0 months Recruitment Type: Local Recruitment Location: Chennai,India Required Language(s): English Preferred Language(s): English Closing Date: 10/20/2025 (MM/DD/YYYY) at 11:59pm UTC Description Do you want to build a career that is truly worthwhile The World Bank Group is a unique global partnership of five institutions driven by a bold vision to create a world free of poverty on a livable planet. As one of the largest sources of funding and knowledge for developing countries, we help solve the world's greatest development ch...

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software one of the fastest-growing IT services companies where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation &...

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software one of the fastest-growing IT services companies where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation &...

Why Join Iris Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry Do you want to grow in an award-winning culture that truly values your talent and ambitions Join Iris Software one of the fastest-growing IT services companies where you own and shape your success story . About Us At Iris Software, our vision is to be our client's most trusted technology partner, and the first choice for the industry's top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation &...

Senior Data Consultant We are seeking a highly skilled and innovative Senior Data Consultant (Databricks) to join our dynamic Data & Analytics team. This role is ideal for someone passionate about building scalable data solutions and driving business value through advanced analytics. As a Senior Data Consultant, you will play a key role in designing, developing, and optimizing data pipelines, collaborating closely with solution architects, analysts, and cross-functional teams to deliver robust data models and cloud-based solutions that support enterprise analytics and machine learning initiatives Key Responsibilities Design, develop, and maintain end-to-end data pipelines using modern data p...

Title: Cloud DevOps Engineer Location: Remote (Offshore, India, EST Time USA) Duration: 6+ Months MIO: Skype Architect, configure, and optimize Databricks Pipelines for large-scale data processing within an Azure Data Lakehouse environment.