Senior Python Data Engineer

Job Title:- Sr. Python Data Engineer

Location:- Chennai & Bangalore (REMOTE)

Job Type:- Permanent Employee

Experience :- 8 to 12 Years

Shift: 2 11 PM

Responsibilities

• Design and develop data pipelines and ETL processes.
• Collaborate with data scientists and analysts to understand data needs.
• Maintain and optimize data warehousing solutions.
• Ensure data quality and integrity throughout the data lifecycle.
• Develop and implement data validation and cleansing routines.
• Work with large datasets from various sources.
• Automate repetitive data tasks and processes.
• Monitor data systems and troubleshoot issues as they arise.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or similar role (Minimum 6+ years’ experience as Data Engineer).
• Strong proficiency in Python and PySpark.
• Excellent problem-solving abilities.
• Strong communication skills to collaborate with team members and stakeholders.
• Individual Contributor

Technical Skills Required

• Expert
• Python, PySpark and SQL/Snowflake
• Advanced
• Data warehousing, Data pipeline design – Advanced Level
• Data Quality, Data validation, Data cleansing – Advanced Level
• Intermediate/Basic
• Microsoft Fabric, ADF, Databricks,
• Master Data management/Data Governance
• Data Mesh, Data Lake/Lakehouse Architecture