Opening For Big Data Developer

Job Description

Role & responsibilities Design, develop, and implement scalable big data solutions using technologies such as Hadoop, Spark, Hive, and Kafka. Build data pipelines for batch and real-time data ingestion, transformation, and loading. Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver clean, reliable datasets. Optimize existing data workflows and troubleshoot data-related issues. Implement best practices for data management, security, and performance. Work with cloud platforms (e.g., AWS, Azure, GCP) for scalable data solutions. Preferred candidate profile Bachelors or Master’s degree in Computer Science, Engineering, or a related field. 3+ years of experience in big data development. Strong programming skills in Java, Scala, or Python. Hands-on experience with Hadoop ecosystem tools (e.g., HDFS, Hive, Pig, MapReduce). Experience with Apache Spark and distributed computing frameworks. Experience in real-time data streaming using Apache Kafka or similar technologies. Proficient in SQL and working with large datasets. Experience with cloud platforms like AWS EMR, Azure HDInsight, or GCP Dataproc is a plus.