Big Data Developer

As a Big Data Engineer at our client's organization, you will join our team in a mid-level position in a full-time, hybrid role based in Chennai and Bangalore. You should have 4 to 6 years of experience in big data technologies, focusing on developing and optimizing high-quality data pipelines and applications. Your proficiency in Java is crucial for building robust and scalable data processing applications. Expertise in Python is also essential for efficient data manipulation and automation of processing tasks. A deep understanding of ETL processes is required to extract, transform, and load data from various sources into centralized databases. Experience with Hadoop ecosystems is necessary to leverage distributed computing for processing large datasets efficiently. You should be skilled in utilizing Hive for executing queries and managing large datasets within a Hadoop environment. Proficiency in PySpark is important for real-time data processing and analytics, optimizing data workflows within a big data framework. A strong command over SQL for complex database querying, involving joins, aggregations, and performance tuning, is expected. Your problem-solving and analytical skills will be utilized to troubleshoot data issues and enhance data architectures. As a Big Data Engineer, your responsibilities will include designing and implementing scalable data pipelines for batch and stream processing, collaborating with data scientists and architects, optimizing ETL processes, developing data workflows, enhancing data models and architecture, identifying and resolving data discrepancies, and staying updated with the latest big data technologies. If you meet the qualifications and skills mentioned above and are interested in joining our team, please share your CV at naveenvj@chiselontechnologies.com. Thank you for considering this opportunity.,