Data Engineer - Python

Job Title: Data Engineer - Python

Location: Chennai

Job description:

Position: Data Engineer
Location: ChennaiExperience: 4-6 Years

Role Overview
We are looking for a highly skilled Data Engineer with strong Python development expertise to design, develop, and maintain scalable data pipelines and data platforms. The ideal candidate should have hands-on experience in building ETL/ELT solutions, processing large datasets, and working with cloud-based data ecosystems. The role involves partnering with data analysts, Power BI developers, product teams, and business stakeholders to deliver reliable and high-quality data solutions.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and SQL.
• Build and optimize ETL/ELT processes for structured and unstructured data.
• Develop data ingestion frameworks from APIs, databases, files, and cloud storage.
• Perform data transformation, cleansing, validation, and quality checks.
• Work with cloud platforms (AWS/Azure) to build and support modern data solutions.
• Design and maintain data models, data marts, and analytical datasets.
• Optimize performance of data pipelines and database queries.
• Implement monitoring, logging, and operational support for production workloads.
• Collaborate with Power BI, Data Science, and application teams to deliver business solutions.
• Follow best practices for version control, code reviews, CI/CD, and automated testing.

Required Skills
Strong Must-Have Skills

• Expert-level Python programming
• Strong SQL and database design concepts
• ETL/ELT development experience
• Data pipeline development and orchestration
• Data validation and data quality frameworks
• Git version control
• Linux/Unix scripting

Data Engineering Technologies

• PySpark / Apache Spark
• Apache Airflow or equivalent scheduling tools
• Data Warehousing concepts
• Snowflake, SQL Server, PostgreSQL, Redshift, or similar platforms
• REST API integration

Cloud Technologies (Preferred)

• AWS (S3, Glue, Lambda, EMR, RDS) OR
• Azure (Data Factory, Databricks, Synapse, ADLS)

Preferred Qualifications

• Experience handling large-scale datasets and big data workloads.
• Experience with Power BI reporting datasets and semantic models.
• Exposure to real-time or near real-time data processing.
• Knowledge of CI/CD pipelines and DevOps practices.
• Experience supporting production data platforms.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
• 4-6 years of experience in Data Engineering.
• Relevant cloud certifications (AWS/Azure) are a plus.

Pay: ₹510,000.00 - ₹1,700,000.00 per year

Application Question(s):

• Are you currently serving the notice period ?

Experience:

• Data Engineer: 4 years (Preferred)

Work Location: In person