Databricks Data Engineer

• Innovation Partner of the Year - Databricks, 2024

• Digital Impact Award, UK - 2024 (TMT Sector)

• Rising Star - APJ Databricks Partner Awards 2023

• Qlik s Most Enabled Partner - APAC

Key Responsibilities

• Design, develop, and maintain

  ETL pipelines

  using

  PySpark

  on

  Databricks

  .
• Create and manage

  Python APIs

  to enable secure connections with

  Azure ADLS

  .
• Integrate data from

  SAP

  ,

  flat files

  , and

  SQL databases

  into

  Azure Data Lake

  via

  ADF

  .
• Collaborate with BI teams to ensure accurate data delivery for

  CXO and Finance dashboards

  in

  Power BI

  .
• Optimize data workflows for performance, scalability, and cost efficiency.
• Ensure compliance with

  data governance

  ,

  security

  , and

  quality standards

  .
• Communicate effectively with stakeholders and take ownership of assigned tasks.

Required Skills & Qualifications

• 3-5 years

  of experience in

  data engineering

  or big data development.
• Proficiency in

  Databricks

  ,

  PySpark

  , and

  Spark SQL

  .
• Strong

  Python

  skills with experience in

  API development

  (especially for Azure ADLS integration).
• Working knowledge of

  Azure Data Factory

  ,

  Azure Data Lake Storage

  , and

  Power BI

  integration.
• Understanding of

  data modeling

  ,

  ETL design

  , and

  data warehousing concepts

  .
• Excellent communication skills and ability to work independently while seeking help when needed.

• Innovate with Purpose:

  Opportunity to create pioneering AI solutions in partnership with leading cloud and data platforms

• Shape the Practice:

  Build a marquee capability from the ground up with full ownership

• Work with the Best:

  Collaborate with top-tier talent and learn from industry leaders in AI

• Global Exposure:

  Be part of a high-growth firm operating across US, UK, UAE, India, and Singapore

• Continuous Growth:

  Access to certifications, tech events, and partner-led innovation labs

• Inclusive Culture:

  A supportive and diverse workplace that values learning, initiative, and ownership.