Data Engineer

Qualification

BCA. MCA preferable

Required Skill Set

• 5+ years in Data Engineering, with at least 2 years on GCP/BigQuery
• Strong Python and SQL expertise (Airflow, dbt or similar)
• Deep understanding of ETL patterns, change-data-capture, and data-quality frameworks
• Experience with IoT or time-series data pipelines a plus
• Excellent communication skills and track record of leading cross-functional teams

• Design, build, and maintain scalable ETL/ELT pipelines in Airflow and BigQuery
• Define and enforce data-modeling standards, naming conventions, and testing frameworks
• Develop and review core transformations:

1. IoT enrichment (batch-ID assignment, stage tagging)
2. Transactional ETL (ERPNext/MariaDB BigQuery)
3. Finance automation pipelines (e.g., bank reconciliation)

• Create and manage schema definitions for staging, enriched_events, and erp_batch_overview tables
• Implement data-quality tests (using dbt or custom Airflow operators) and oversee QA handoff
• Collaborate closely with DevOps to ensure CI/CD, monitoring, and cost-efficient operations
• Drive documentation, runbooks, and knowledge transfer sessions
• Mentor and coordinate with freelance data engineers and analytics team members

Desired profile of the

• Proficiency in

  Python

  and

  SQL

  , including working with

  Airflow

  and

  dbt

  or similar tools.
• Strong understanding of

  ETL/ELT design patterns

  ,

  CDC (Change Data Capture)

  , and data governance best practices.
• Excellent communication skills and the ability to translate technical requirements into business outcomes.