Senior Python Data Engineer

Sr. Python Data Engineer – (6 to 12 Years Experience)

Responsibilities

• Design and develop data pipelines and ETL processes.
• Collaborate with data scientists and analysts to understand data needs.
• Maintain and optimize data warehousing solutions.
• Ensure data quality and integrity throughout the data lifecycle.
• Develop and implement data validation and cleansing routines.
• Work with large datasets from various sources.
• Automate repetitive data tasks and processes.
• Monitor data systems and troubleshoot issues as they arise.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or similar role (Minimum 6+ years’ experience as Data Engineer).
• Strong proficiency in Python and PySpark.
• Excellent problem-solving abilities.
• Strong communication skills to collaborate with team members and stakeholders.
• Individual Contributor

Technical Skills Required

Expert

• Python, PySpark and SQL/Snowflake
• Azure

Advanced

• Data warehousing, Data pipeline design – Advanced Level
• Data Quality, Data validation, Data cleansing – Advanced Level

Intermediate/Basic

• Microsoft Fabric, ADF, Databricks,
• Master Data management/Data Governance
• Data Mesh, Data Lake/Lakehouse Architecture