9.0 - 14.0 years

10 - 20 Lacs

Hyderabad, Bengaluru, Mumbai (All Areas)

Hybrid

Job Summary: (Full-Time Opportunity with MNC Client) We are looking for a skilled Data Engineer to join our team and build scalable data pipelines using Python , PySpark , and AWS services like S3 and Redshift . The ideal candidate will be responsible for collecting data from multiple sources, transforming and normalizing it, and ensuring its availability for downstream analytics and visualization platforms. Key Responsibilities: • Design and develop ETL/ELT pipelines using PySpark and Python • Ingest and process data from diverse sources, including APIs, files, and databases • Store, manage, and organize data efficiently in AWS S3 • Transform and load processed data into AWS Redshift for reporting and analytics • Implement data validation, quality checks, and normalization standards • Collaborate with analytics and BI teams to ensure data is structured for dashboards and visualization tools • Monitor, troubleshoot, and optimize pipeline performance Required Skills & Experience: • Strong proficiency in Python and PySpark • Hands-on experience with AWS services : S3, Redshift, Lambda, Glue (preferred) • Solid understanding of data modeling , ETL processes , and SQL • Experience working with large-scale datasets and distributed data processing • Familiarity with data quality and governance best practices

Posted 2 months ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.