Big Data Developer

As an experienced Big Data Developer, you will be responsible for designing, developing, and optimizing big data solutions using Java and Apache Spark. Your expertise in API development, data engineering, and big data tools will be crucial in collaborating with data scientists and analysts to deliver efficient solutions. You will play a key role in optimizing big data workflows for performance and scalability while ensuring data quality, integrity, and security. Your key responsibilities will include: - Designing, developing, and maintaining big data solutions using Java and Apache Spark. - Developing and managing APIs for data ingestion, processing, and extraction. - Collaborating with stakeholders to understand data requirements and deliver efficient solutions. - Optimizing big data workflows for performance and scalability. - Implementing data engineering best practices for data quality, integrity, and security. - Working with big data tools and technologies such as Hadoop, HDFS, Hive, HBase, Kafka, and others as needed. - Troubleshooting and resolving issues related to data processing and workflows. - Staying updated with the latest trends and advancements in big data technologies and tools. To qualify for this role, you should have: - A Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. - 4-8 years of experience in big data development and data engineering. - Proficiency in Java and experience with Apache Spark. - Experience in API development and integration. - Strong understanding of data engineering principles and big data concepts. - Familiarity with big data tools such as Hadoop, HDFS, Hive, HBase, and Kafka. - Experience with SQL and NoSQL databases. - Excellent problem-solving and analytical skills. - Strong communication and collaboration skills. Preferred qualifications include experience with cloud platforms, containerization technologies like Docker and Kubernetes, continuous integration and deployment pipelines, and familiarity with machine learning frameworks and libraries. In return, you will receive a competitive salary and benefits package, along with the opportunity to work with cutting-edge technologies in a dynamic and collaborative environment. Professional growth and development opportunities will also be available to support your career advancement.,