Data Engineer

Job Title:

Experience:

Employment Type:

Location:

Job Summary

Data Engineer

Key Responsibilities

• Collaborate with stakeholders to gather and analyze data requirements.
• Explore, clean, and transform data to ensure

  high-quality datasets

  .
• Design and implement

  data models

  for efficient storage and retrieval.
• Develop and maintain

  ETL pipelines

  for ingestion, transformation, and storage.
• Create

  Databricks notebooks

  for data engineering workflows and analytics.
• Write and execute

  unit test cases

  to validate data pipelines and transformations.
• Maintain

  technical documentation

  – requirement specs, design docs, and backend appendices.
• Track and update tasks/progress in

  JIRA

  on a daily basis.
• Support

  data warehousing solutions on AWS

  for reporting and analytics.
• Collaborate with cross-functional teams to optimize performance and ensure scalability.

Skills & Competencies

• Strong programming skills in

  Python

  and

  PySpark

  .
• Expertise in

  SQL

  and

  Postgres SQL

  for data querying and manipulation.
• Hands-on experience with

  Databricks

  and ETL frameworks.
• Strong knowledge of

  data modeling, data exploration, and requirement gathering

  .
• Familiarity with

  data warehousing concepts

  and

  AWS cloud services

  .
• Ability to write

  unit test cases

  and perform debugging.
• Strong documentation skills (technical specs, design documents, backend appendices).
• Experience with

  Agile methodologies

  and tools like

  JIRA

  .

Qualifications

• Bachelor’s degree in

  Computer Science, Information Systems, Data Engineering

  , or related field.
• 4+ years of experience in

  data engineering, ETL, and data warehousing solutions

  .
• Proven expertise in working with

  Databricks, Python, PySpark, SQL, and AWS

  .

If Intrested. Please submit your CV to Khushboo@Sourcebae.com or share it via WhatsApp at 8827565832

Stay updated with our latest job opportunities and company news by following us on LinkedIn: :https://www.linkedin.com/company/sourcebae