Hadoop Developer

Role Overview: You will be responsible for developing and maintaining Hadoop applications using technologies such as HDFS, Hive, Spark, Sqoop, Flume, Oozie, Unix Script, and Autosys. Your role will involve working with big data frameworks and ensuring the smooth functioning of data processing systems. Key Responsibilities: - Gather requirements and design data processing frameworks - Develop and implement data processing solutions using Spark with Java - Utilize your excellent communication skills to collaborate effectively with team members and stakeholders - Be prepared to work in shifts based on project requirements Qualifications Required: - Solid understanding of Hadoop concepts, including the file system and Map Reduce - Hands-on experience with Spark framework, Unix scripting, and writing UDF in Hive - Knowledge of Software Development Life Cycle and Project Development Lifecycle - Ability to work independently, strong debugging skills in both Hive and Spark, and experience in developing large-scale systems - Familiarity with job scheduling tools like Autosys and knowledge in Kafka Please note that experience in Banking and Finance Domain, Agile Methodology, and job scheduling tools like Autosys are considered advantageous for this role. Role Overview: You will be responsible for developing and maintaining Hadoop applications using technologies such as HDFS, Hive, Spark, Sqoop, Flume, Oozie, Unix Script, and Autosys. Your role will involve working with big data frameworks and ensuring the smooth functioning of data processing systems. Key Responsibilities: - Gather requirements and design data processing frameworks - Develop and implement data processing solutions using Spark with Java - Utilize your excellent communication skills to collaborate effectively with team members and stakeholders - Be prepared to work in shifts based on project requirements Qualifications Required: - Solid understanding of Hadoop concepts, including the file system and Map Reduce - Hands-on experience with Spark framework, Unix scripting, and writing UDF in Hive - Knowledge of Software Development Life Cycle and Project Development Lifecycle - Ability to work independently, strong debugging skills in both Hive and Spark, and experience in developing large-scale systems - Familiarity with job scheduling tools like Autosys and knowledge in Kafka Please note that experience in Banking and Finance Domain, Agile Methodology, and job scheduling tools like Autosys are considered advantageous for this role.