Posted:3 days ago| Platform:
Hybrid
Full Time
Role Technology Lead No of years experience 5+ Detailed job description - Skill Set: Role Summary: As part of the offshore development team, the AWS Developers will be responsible for implementing ingestion and transformation pipelines using PySpark, orchestrating jobs via MWAA, and converting legacy Cloudera jobs to AWS-native services. Key Responsibilities: Write ingestion scripts (batch & stream) to migrate data from on-prem to S3. Translate existing HiveQL into SparkSQL/PySpark jobs. Configure MWAA DAGs to orchestrate job dependencies. Build Iceberg tables with appropriate partitioning and metadata handling. Validate job outputs and write unit tests. Required Skills: 35 years in data engineering, with strong exposure to AWS. Experience in EMR (Spark), S3, PySpark, SQL. Working knowledge of Cloudera/HDFS and legacy Hadoop pipelines. Prior experience with data lake/lakehouse implementations is a plus Mandatory Skills AWS Developer
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Pune, Bengaluru, Mumbai (All Areas)
16.0 - 25.0 Lacs P.A.
10.0 - 20.0 Lacs P.A.
Hyderabad, Pune, Bengaluru
8.5 - 13.0 Lacs P.A.
10.0 - 12.0 Lacs P.A.
Chennai, Bengaluru
17.0 - 27.5 Lacs P.A.
Pune, Maharashtra, India
Salary: Not disclosed
8.0 - 11.0 Lacs P.A.
Hyderabad, Chennai, Bengaluru
14.0 - 20.0 Lacs P.A.
Hyderabad
12.0 - 22.0 Lacs P.A.
Bengaluru
14.0 - 18.0 Lacs P.A.