Big Data Developer

Big Data Developer (Manager)

Location: Pune

Experience: 3-5 years

Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.

Key Responsibilities:

• Design, develop, and maintain big data solutions using Java and Apache Spark.
• Develop and manage APIs for data ingestion, processing, and extraction.
• Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and deliver efficient solutions.
• Optimize and tune big data workflows for performance and scalability.
• Implement data engineering best practices to ensure data quality, integrity, and security.
• Work with big data tools and technologies such as Hadoop, HDFS, Hive, HBase, Kafka, and others as needed.
• Troubleshoot and resolve issues related to data processing and workflows.
• Stay updated with the latest trends and advancements in big data technologies and tools.

Required Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 4-8 years of experience in big data development and data engineering.
• Proficiency in Java and experience with Apache Spark.
• Experience in API development and integration.
• Strong understanding of data engineering principles and big data concepts.
• Familiarity with big data tools such as Hadoop, HDFS, Hive, HBase, and Kafka.
• Experience with SQL and NoSQL databases.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.

Preferred Qualifications:

• Experience with cloud platforms such as, Spark, Data/Delta lakes, Modern Data stack.
• Knowledge of containerization technologies like Docker and Kubernetes.
• Experience with continuous integration and continuous deployment (CI/CD) pipelines.
• Familiarity with machine learning frameworks and libraries.

Benefits:

• Competitive salary and benefits package.
• Opportunity to work with cutting-edge technologies in a dynamic and collaborative environment.
• Professional growth and development opportunities.