Data Engineer

Data Engineer

REMOTE, INDIA

Day to day:

As a Data Engineer, you will design, build, and maintain data products such as pipelines, models, APIs, and visualizations using best-in-class tools and DataOps practices. Your role involves creating scalable solutions that integrate machine learning and AI capabilities, implementing software engineering standards like modular code, version control, automated testing, and CI/CD workflows. You’ll work with orchestration tools like Airflow and transformation frameworks such as DBT on AWS to develop and optimize ETL/ELT pipelines, while ensuring data integration across disparate systems for end-to-end accessibility. Responsibilities include modeling and transforming data using SQL and DBT, optimizing data warehouse performance and cost in Snowflake, and troubleshooting pipeline issues to maintain operational excellence. Additionally, you’ll document architectures and workflows, align development with business strategy, and enhance data science processes for future AI/ML lifecycles.

Must Haves:

• 3+ years of progressive working experience as a Data Engineer
• 2+ years of experience programming in Python or .NET for data engineering solutions
• 2+ years of experience developing ELT pipelines using DBT and orchestration tools such as Airflow or Prefect
• 2+ years of experience developing end-to-end data and analytics products
• 2+ years of AWS(preferred), Azure, or GCP cloud computing experience
• 2+ years of experience using containerization and implementing CI/CD workflows for data pipeline deployments
• 2+ years of experience building distributed systems and workflow automation using tools like Airflow or Prefect (preferred)
• 2+ years of experience in data modeling, including Data Vault methodology and semantic modeling
• 2+ years of experience working with cloud-based data warehouses such as Snowflake (preferred) or Redshift
• 2+ years of experience writing advanced SQL queries and working with relational databases (RDBMS); exposure to NoSQL databases preferred
• 2+ years of experience working with data management and governance tools like OpenMetadata (preferred) or similar platforms