Big Data Developer (Immediate Joiner)

*APPLICABLE ONLY FOR IMMEDIATE JOINERS*

Job Title:

Position Overview:

We are seeking a talented Software Development Engineer- Big Data with strong expertise in big data technologies. The ideal candidate will have hands-on experience with Apache Spark, Hadoop, AWS (Amazon Web Services), Kafka, NoSQL databases (e.g., MongoDB, Cassandra), Hive, Docker, Kubernetes, and proficiency in SQL and one or more of the coding languages such as Java, Scala, Python. This role requires a deep understanding of software

development principles, distributed systems, and container orchestration.

Responsibilities:

• Design, develop, and optimize scalable and efficient big data applications and pipelines using Apache Spark, Hadoop, and related frameworks.
• Implement data processing workflows and streaming solutions utilizing Apache Kafka for real-time data ingestion and processing.
• Develop and maintain ETL (Extract, Transform, Load) processes to support data integration and transformation tasks.
• Utilize NoSQL databases for data storage and retrieval needs, ensuring data consistency and performance.
• Containerize and orchestrate big data applications using Docker and Kubernetes for scalability and reliability.
• Collaborate closely with data scientists, analysts, and product teams to understand requirements and deliver robust data solutions.
• Optimize performance and efficiency of data processing workflows and applications, focusing on scalability and cost-effectiveness.
• Mentor and guide junior team members, participate in code reviews, and contribute to improving team processes and practices.

Qualifications:

• Bachelors or Masters degree in Computer Science, Engineering, or related field.
• 2+ years of professional software development experience with a focus on big data technologies.
• Strong programming skills in Java/Scala/Python, and SQL for building scalable applications and data processing pipelines.
• Hands-on experience with Apache Spark, Hadoop, and related ecosystem tools is preferred.
• Solid understanding of NoSQL databases and distributed computing principles.
• Familiarity with real-time data streaming and messaging systems like Apache Kafka.
• Excellent problem-solving skills, analytical mindset, and attention to detail.
• Strong communication skills and ability to collaborate effectively in a team environment.
• Experience with Agile methodologies and DevOps practices is a plus.
• Hands on experience in containerization and orchestration technologies such as Docker and Kubernetes is a plus.