Data Engineer (Middle/Senior) ID42376

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.

WHY JOIN US

If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE

As a

Middle/Senior Python & Data Engineer

, you’ll enhance data quality and accelerate integration test cycles across the climate data platform, ensuring faster, more reliable production releases. You’ll develop and maintain Python-based workflows, robust validation frameworks, and automation pipelines while collaborating with cross-functional teams to deliver high-quality climate data products. This role offers hands-on experience with Airflow, Pandas, Kubernetes, and Azure in a dynamic, impact-driven environment.

WHAT YOU WILL DO

- Develop, test, and maintain the Python-based data processing framework;- Scrutinize and enhance the Data Quality Framework to ensure robust validation;- Design and maintain the technical components of release processes;- Socialize and communicate release processes with multiple stakeholders across teams;- Own and lead the integration testing process to improve stability and reliability.

MUST HAVES

-

4+ years

of experience in

Python

engineering with strong expertise in building and automating data workflows; - Hands-on experience with

Azure

cloud services;- Proficiency with

Airflow

,

Pandas

, and

Kubernetes

(K8s);- Upper-intermediate English level.

NICE TO HAVES

- Experience with PySpark, Databricks, Data Lakes, and Parquet;- Knowledge of RDBMS concepts;- Familiarity with data quality checks and strong analytical thinking;- Experience in designing and maintaining testing frameworks (unit, integration, and system-level).

PERKS AND BENEFITS

-

Remote work & Local connection:

Work where you feel most productive and connect with your team in periodic meet-ups to strengthen your network and connect with other top experts.-

Legal presence in India:

We ensure full local compliance with a structured, secure work environment tailored to Indian regulations.-

Competitive Compensation in INR:

Fair compensation in INR with dedicated budgets for your personal growth, education, and wellness.-

Innovative Projects:

Leverage the latest tech and create cutting-edge solutions for world-recognized clients and the hottest startups.