Databricks Data Engineer

About Exponentia.ai

Exponentia.ai

is a fast-growing AI-first technology services company, partnering with enterprises to shape and accelerate their journey to AI maturity. With a presence across the

US, UK, UAE, India, and Singapore

, we bring together deep domain knowledge, cloud-scale engineering, and cutting-edge artificial intelligence to help our clients transform into agile, insight-driven organizations.We are proud partners with global technology leaders such as

Databricks, Microsoft, AWS, and Qlik

, and have been consistently recognized for innovation, delivery excellence, and trusted advisories.

Awards & Recognitions

• Innovation Partner of the Year Databricks, 2024
• Digital Impact Award, UK 2024 (TMT Sector)
• Rising Star APJ Databricks Partner Awards 2023
• Qlik's Most Enabled Partner APAC
  

With a team of

450+ AI engineers, data scientists, and consultants

, we are on a mission to redefine how work is done, by combining human intelligence with AI agents to deliver exponential outcomes.Learn more: www.exponentia.ai

About The Role

We are seeking an experienced

Databricks Data Engineer

with 5+ years of experience to design, build, and optimize scalable, high-performance data pipelines and analytics solutions using the Databricks platform. The ideal candidate will play a key role in architecting data platforms and mentoring junior engineers.

Key Responsibilities

• Design, develop, and optimize large-scale ETL/ELT pipelines using Databricks, Spark, and Python.
• Architect and manage Delta Lake tables for high-performance analytics.
• Ingest and process structured and unstructured data from multiple sources.
• Optimize Spark workloads for performance, scalability, and cost efficiency.
• Implement robust data quality, monitoring, logging, and alerting frameworks.
• Lead integration with cloud services (Azure/AWS/GCP) and data orchestration tools.
• Drive CI/CD automation for data pipelines and notebook deployments.
• Enforce data security, governance, and compliance standards.
• Collaborate with architects, data scientists, analysts, and business stakeholders.
• Mentor junior engineers and drive engineering best practices.