Data Engineer

Job Title:

Job Location:

Experience Level:

Employment Type:

Role Overview

As a Data Engineer supporting our Financial Services clients, you will help modernize and migrate data platforms from legacy systems to secure, cloud-native environments. Working under senior engineers and solution architects, you’ll develop and optimize ETL pipelines, assist in data quality and reconciliation, and contribute to the delivery of compliant, audit-ready data solutions using Azure Data Factory, Databricks, and PySpark.

Ideal candidate has some hands-on experience with financial data pipelines, regulatory compliance, and large-scale data modernization initiatives.

Key Responsibilities

• Build and maintain ETL pipelines for financial data migration, cleansing, and transformation.
• Support ETL modernization efforts by converting legacy workflows into Azure-native and Databricks-based solutions.
• Assist in implementing Lakehouse architectures (bronze/silver/gold layers) using Delta Lake and PySpark.
• Conduct data validation, reconciliation, and quality checks to ensure complete and accurate financial data transfers.
• Work with senior engineers to document data lineage, metadata, and transformation logic for audit and compliance.
• Support implementation of data governance and access control practices aligned with financial regulatory standards.
• Contribute to CI/CD and automation efforts for data pipeline deployments.
• Troubleshoot and optimize data flows for performance, reliability, and scalability.

Technical Skills & Experience

• 1–3 years of hands-on experience in data engineering, ETL, or data migration.
• Proficiency in PySpark, SQL, and Python for data processing and transformation.
• Exposure to Azure Data Factory, Databricks, or other modern ETL frameworks.
• Familiarity with financial data structures (transactions, risk, account hierarchies, etc.) and sensitivity to regulated data handling.
• Understanding of data quality, lineage, and auditability concepts.
• Basic knowledge of Lakehouse design, Delta Lake, and cloud storage layers (e.g., Blob Storage).
• Experience with version control (GitHub, Azure DevOps) and CI/CD pipelines for data delivery.
• Awareness of compliance frameworks such as SOX, PCI DSS, or GDPR.

Preferred Experience

• Exposure to financial data migration projects or regulatory reporting environments.
• Knowledge of Terraform or IaaC concepts.
• Familiarity with Agile delivery practices and sprint-based project work.
• Experience supporting data reconciliation or audit remediation activities

  .