Big Data Hadoop Developer

You will be working with a renowned MNC in a hybrid work setup in Gurgaon with a full-time employment opportunity. With an experience range of 5-12 years, you are expected to serve the notice period and join within 60 days. As a Data Engineer, your primary responsibility will be designing Data Engineering solutions on the big data ecosystem. This will involve developing custom applications, modifying existing applications to meet dynamic business requirements, hands-on coding, debugging, documentation, and close collaboration with the SRE team. You will also provide post-implementation and ongoing support for the developed solutions. Your role will also include developing and designing software applications by translating user needs into system architecture. You will assess and validate application performance, integrate component systems, provide process flow diagrams, and test the engineering resilience of software and automation tools. In this position, you will be tasked with identifying innovative ideas and proof of concepts to address the current and future needs of customers. You will work with a dynamic Loyalty Technology team focusing on developing a modern loyalty platform to enhance customer engagement and attract new customers to the Amex brand. Collaboration is key in this role, as you will partner with other development teams, testing and quality, and production support teams to ensure smooth transitions throughout the development life cycle. Your focus will be on executing a strategy and roadmap to transition from legacy platforms to a modern, microservices-based architecture to align with long-term business objectives. Key Skills required for this role include proficiency in Big Data technologies such as Spark, Hive, Python, SQL, Hadoop, and Scala. Your expertise in these areas will be instrumental in driving engagement and loyalty within the cardmember base and supporting the growth of the Amex brand.,