Data Engineer

Roles and Responsibilities :

• Design, develop, test, deploy and maintain large-scale data pipelines using Python, PySpark, and Data Bricks.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality data solutions on time.
• Develop ETL processes to extract insights from various sources such as relational databases (SQL) and NoSQL databases like Fabric.
• Troubleshoot issues related to data quality, performance optimization, and scalability in the production environment.

Job Requirements :

• 3-10 years of experience in a similar role as a Data Engineer or equivalent experience working with big data technologies.
• Strong proficiency in Python programming language along with expertise in PySpark and Data Bricks.
• Experience working with SQL databases including designing schema's creating stored procedures etc.