Junior Data Engineer

Job Title:

Role Type:

Experience

Location:

Role Overview

The Junior Data Engineer will play a key role in building, maintaining, and optimizing end-to-end data pipelines across modern cloud-based data platforms. The role involves supporting data ingestion, transformation, validation, and operational monitoring to ensure reliable, high-quality, and timely data delivery for analytics, reporting, and business decision-making.

Key Responsibilities

• Design, develop, and maintain

  ETL pipelines using Databricks and PySpark.

• Extract, transform, and integrate data from multiple sources, including APIs, databases, and flat files.
• Implement and optimize

  data transformations

  and load curated datasets into

  Delta Tables.

• Schedule, orchestrate, and monitor workflows using

  Databricks Workflows.

• Perform daily data validation checks to ensure accuracy, completeness, and consistency of

  data loads

  .
• Maintain and update data catalog, lineage documentation, and metadata repositories.
• Generate and circulate

  success/failure reports

  , job run summaries, and operational dashboards.
• Build and

  maintain data quality dashboards

  and monitoring tools using Power BI or Superset.
• Collaborate with

  Data Leads, BI teams

  , and cross-functional stakeholders for schema design, data integration, and analytics support.
• Troubleshoot ETL issues, apply error-handling logic, and contribute to pipeline performance optimization.

-

Required Skills and Competencies

Technical Skills:

• Programming:

  SQL, Python, PySpark

• ETL Platforms & Tools: Databricks Notebooks, Databricks Workflows, Delta Lake
• Cloud Storage: Azure Data Lake / AWS S3
• Version Control: Git, GitHub
• Data Quality & Reporting: Excel, Power BI, Superset

Knowledge Areas:

• Strong understanding of ETL concepts, data integration, and data quality frameworks
• Basic familiarity with data modeling and cloud-based architectures
• Understanding of data governance, security, and metadata management principles

Soft Skills:

• Analytical and problem-solving mindset
• Strong attention to detail and process discipline
• Effective communication and teamwork abilities
• Eagerness to learn and adapt to new technologies

Education:

Bachelors degree in Computer Science, Information Technology, Data Science, or a related field.

Why Join Us:

• Opportunity to work on cutting-edge data technologies and cloud platforms.
• Collaborative environment with mentorship and learning opportunities.
• Exposure to end-to-end data lifecycle management and real-world data engineering challenges.