Python (Airflow/DBT) Engineer

0 years

0 Lacs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Project Description:

  • This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data accessibility, performance, and governance while enabling advanced analytics and automation.
  • The resource will join an ongoing effort to accelerate the migration and modernization process, contributing to data pipeline development, orchestration, and optimization using tools like Airflow, DBT, and Docker, with strong emphasis on Python scripting and database engineering.


Responsibilities:

  • Data Pipeline Development: Build and optimize ETL/ELT pipelines using Python, Airflow, and DBT to ingest, transform, and load data into Snowflake.
  • Cloud Migration Support: Assist in migrating existing on-prem data workflows and databases to Snowflake on Azure, ensuring minimal disruption and high data fidelity.
  • Data Modeling & Transformation: Design and implement robust data models and transformation logic using DBT and SQL, aligned with business requirements.
  • Containerization: Use Docker to containerize data services and workflows for consistent deployment across environments.
  • Database Engineering: Apply strong SQL and Snowflake expertise to optimize queries, manage schemas, and ensure data quality and performance.
  • Version Control & Collaboration: Use Git/GitHub for source control, code reviews, and CI/CD integration.
  • Monitoring & Troubleshooting: Monitor pipeline performance, troubleshoot issues, and implement logging and alerting mechanisms.
  • Security & Governance: Ensure data security, compliance, and governance standards are met throughout the migration process.


Mandatory Skills:

  • Docker


Mandatory Skills Description:

  • Python, Airflow / DBT, Docker, strong database skills (Snowflake), git/GitHub, Azure
  • Scope - resource will help expedite work already in progress as part of cloud migration of our on-prem data systems to Cloud (snowflake on Azure).


Nice-to-Have Skills Description:

  • Certifications


Languages:

  • English: Proficient

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Luxoft logo
Luxoft

IT Services and IT Consulting

Zug New York

RecommendedJobs for You