Big Data Developer

Job Description: Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools. Key Responsibilities: - Design, develop, and maintain big data solutions using Java and Apache Spark. - Develop and manage APIs for data ingestion, processing, and extraction. - Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and deliver efficient solutions. - Optimize and tune big data workflows for performance and scalability. - Implement data engineering best practices to ensure data quality, integrity, and security. - Work with big data tools and technologies such as Hadoop, HDFS, Hive, HBase, Kafka, and others as needed. - Troubleshoot and resolve issues related to data processing and workflows. - Stay updated with the latest trends and advancements in big data technologies and tools. Required Qualifications: - Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. - 4-8 years of experience in big data development and data engineering. - Proficiency in Java and experience with Apache Spark. - Experience in API development and integration. - Strong understanding of data engineering principles and big data concepts. - Familiarity with big data tools such as Hadoop, HDFS, Hive, HBase, and Kafka. - Experience with SQL and NoSQL databases. - Excellent problem-solving and analytical skills. - Strong communication and collaboration skills. Preferred Qualifications: - Experience with cloud platforms such as, Spark, Data/Delta lakes, Modern Data stack. - Knowledge of containerization technologies like Docker and Kubernetes. - Experience with continuous integration and continuous deployment (CI/CD) pipelines. - Familiarity with machine learning frameworks and libraries. Benefits: - Competitive salary and benefits package. - Opportunity to work with cutting-edge technologies in a dynamic and collaborative environment. - Professional growth and development opportunities.