Sr Data Engineer

About Exponentia.ai

Exponentia.ai

US, UK, UAE, India, and Singapore

Databricks, Microsoft, AWS, and Qlik

Awards & Recognitions

• Innovation Partner of the Year – Databricks, 2024
• Digital Impact Award, UK – 2024 (TMT Sector)
• Rising Star – APJ Databricks Partner Awards 2023
• Qlik’s Most Enabled Partner – APAC
  

450+ AI engineers, data scientists, and consultants

About The Role

Senior Data Engineer

Key Responsibilities

Databricks & Data Engineering

• Design, develop, and optimize data pipelines using Databricks (SQL, Python, PySpark).
• Work with Delta Lake, Lakehouse architecture, and Unity Catalog for governance and lineage.
• Implement and manage Databricks workflows, cluster configurations, and job scheduling.
• Troubleshoot and optimize Spark jobs for performance, reliability, and cost efficiency.
• Integrate Databricks with cloud platforms (AWS/Azure/GCP), data lakes, and external systems.
  

Technical Ownership & Development

• Own the end-to-end design and delivery of complex engineering and data solutions.
• Build scalable ETL/ELT pipelines and collaborate with architects on solution design.
• Review code, enforce best practices, and maintain high engineering standards.
• Create reusable components, frameworks, and automation scripts.
  

Collaboration & Leadership

• Mentor junior/mid-level engineers on Databricks, PySpark, and data engineering best practices.
• Collaborate closely with product owners, architects, and cross-functional teams.
• Participate in sprint planning, design reviews, and architectural discussions.
  

Quality, Testing & DevOps

• Implement CI/CD pipelines for Databricks (Databricks Repos, GitHub/Azure DevOps/GitLab).
• Ensure high-quality deliverables through unit testing, data validation, and automated checks.
• Support production deployments, monitoring, and incident resolution.