5.0 - 10.0 years

10 - 15 Lacs

pune, bengaluru, delhi / ncr

Work from Office

Job Description: We are looking for a skilled Data Engineer with strong expertise in Talend and PySpark to join our dynamic team. The ideal candidate will be responsible for designing, developing, and validating data pipelines, with a focus on migration from Talend to PySpark. Key Responsibilities: Design and develop data integration workflows using Talend Studio and manage them via Talend Management Console (TMC). Work with advanced Talend features including Joblets, PreJobs, PostJobs, and SubJobs. Analyze and interpret complex Talend job designs, ensuring proper understanding of data flow and control flow logic. Utilize Talend components for S3, Redshift, tDBInput, tMap, and other Java-based components. Migrate and validate data pipelines by comparing Talend job definitions with PySpark implementations. Write optimized, scalable, and maintainable PySpark code for large-scale data processing. Collaborate with cross-functional teams to ensure accurate and efficient data flow across systems. Requirements: Proven hands-on experience with Talend Studio and TMC. Strong understanding of Talend architecture and advanced job configuration. Proficient in PySpark and capable of validating and refactoring code for data pipeline migrations. Experience working with AWS services like S3, Redshift is a plus. Strong problem-solving and analytical skills. Excellent communication and team collaboration abilities.

Posted Date not available

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.