Data Engineer - Python

Data Engineer-Python

Pune

3 to 4 years

Technologies / Skills Mandatory:

• Strong hands-on experience with Python (Pandas, NumPy) and SQL. Experience in ETL/ELT pipeline development, data modeling, and working with large-scale data systems. Familiarity with CI/CD workflows, Git, and version control practices.
• Responsibilities Collaborate with business stakeholders and technical teams to gather requirements and translate them into scalable data solutions.
• Design, build, and maintain robust, secure, high-performance data pipelines.
• Ensure adherence to data quality, governance, and compliance standards.
• Work with architects and engineering leads to follow best practices and optimize for performance.
• Communicate insights and technical decisions effectively with cross-functional stakeholders. Participate in Agile ceremonies and deliver iterative improvements in data infrastructure.

Required Qualifications

• 3-4 years of hands-on experience with Python and SQL for large-scale data transformation and ingestion.
• Strong understanding of data modeling, partitioning, schema design, and query performance optimization.
• Experience with Git, CI/CD pipelines, and working in Agile environments.
• Familiarity with data engineering concepts like orchestration, workflow management, and data quality frameworks.
• Desired Qualifications Experience with workflow orchestration tools like Apache Airflow. Exposure to streaming platforms such as Kafka. \
• Familiarity with modern ETL/ELT patterns and data modeling techniques. Basic proficiency in shell scripting for automation and support tasks.