Big Data/Hadoop Developer

• A Big Data/Hadoop Developer designs, develops, and maintains Hadoop-based solutions. This role involves working with the Hadoop ecosystem to build data processing pipelines, write MapReduce jobs, and integrate Hadoop with other systems.
• They collaborate with data scientists and analysts to gather requirements and deliver insights, ensuring efficient data ingestion, transformation, and storage. Key Responsibilities:
• Design and Development: Creating, implementing, and maintaining Hadoop applications, including designing data processing pipelines, writing MapReduce jobs, and developing efficient data ingestion and transformation processes.
• Hadoop Ecosystem Expertise: Having a strong understanding of the Hadoop ecosystem, including components like HDFS, MapReduce, Hive, Pig, HBase, and tools like Flume, Zookeeper, and Oozie.
• Data Analysis and Insights: Analyzing large datasets stored in Hadoop to uncover valuable insights and generate reports.
• Collaboration: Working closely with data scientists, analysts, and other stakeholders to understand requirements and deliver effective solutions.
• Performance Optimization: Optimizing the performance of Hadoop jobs and data processing pipelines, ensuring efficient resource utilization.
• Data Security and Privacy: Maintaining data security and privacy within the Hadoop environment.
• Documentation and Best Practices: Creating and maintaining documentation for Hadoop development, including best practices and standards. Skills and Qualifications:
• Strong Programming Skills: Proficient in languages like Java, Python, or Scala, and experience with MapReduce programming.
• Hadoop Framework Knowledge: Deep understanding of the Hadoop ecosystem and its core components. Data Processing Tools: Experience with tools like Hive, Pig, HBase, Spark, and Kafka.
• Data Modeling and Analysis: Familiarity with data modeling techniques and experience in analyzing large datasets.
• Problem-Solving and Analytical Skills: Ability to troubleshoot issues, optimize performance, and derive insights from data.
• Communication and Collaboration: Effective communication skills to collaborate with diverse teams and stakeholders.
• Linux Proficiency: Familiarity with Linux operating systems and basic command-line operations.
• Tamil candidates only

Job Type: Full-time

Pay: ₹633,061.90 - ₹1,718,086.36 per year

Benefits:

• Food provided
• Work from home

Work Location: In person