Big Data Developer

Location : Indore, Pune, Bangalore, Gurugram, Noida

Notice period : Can join Immediately or Currently serving ( 30- 45 days )

• 3-6 years of good hands on exposure with Big Data technologies – pySpark (Data frame and SparkSQL)
• Hands-on experience with using Cloud Platform provided Big Data technologies (i.e. Glue, Lambda, RedShift, S3, etc.)
• Good hands on experience of python
• Good understanding of SQL and data warehouse tools like (Redshift)
• Strong analytical, problem-solving, data analysis and research skills
• Demonstrable ability to think outside of the box and not be dependent on readily available tools
• Excellent communication, presentation and interpersonal skills are a must
• Orchestration with Step Function/MWAA and Any job scheduler experience

Roles & Responsibilities

• Develop efficient ETL pipelines through spark or Glue
• Able to implement business use cases using Python and pySpark.
• Able to write ELT/ETL jobs on AWS (Crawler, Glue Job)
• Participate in code peer reviews to ensure our applications comply with best practices.
• Gather requirements to define AWS services and accordingly implement different security features
• Provide estimates for development Task.
• Can perform integration testing of developed infrastructure.