Role & responsibilities 10+ years of highly technical, hands-on software engineering experience. * Expert in Java. Proficiency in other languages like Rust, Go, Python, NodeJS is a plus. * Experience working in EMS/NMS product with knowledge of FTTX domain. * Experience in designing and building infrastructure and web services at large scale. * Expert knowledge of computer science, with strong competencies in data structures, algorithms, and software design. * Strong, creative problem-solving skills and ability to abstract and share details to create meaningful articulation. * Proficient in design and implementation of microservices-based, API/Endpoint architectures Strong background in designing and developing event-based / pub-sub workflows & data ingestion solutions. Proficiency and hands on experience with Kafka at scale (or similar) Desired. * Strong background in transactional databases and good understanding and experience with no-SQL datastores. * Organized and goal-focused, ability to deliver in a fast-paced environment. Preferred candidate profile Note : Immediate to 30 days notice period Pease attached the updated resume on - 9920855109/piyali@agileturn.in
Piyali Chattopadhyay Mb : 9920855109 piyali@agileturn.in
Job Description: We are looking for a Big Data Engineer with strong hands-on experience in building and optimizing data pipelines using Spark and Python. The role involves working in a large-scale distributed environment, performing ETL, and ensuring high data quality and performance. Key Responsibilities: Develop and optimize Big Data pipelines using Spark, Python, and Hive Perform data ingestion, transformation, and validation in distributed systems Write and maintain Shell scripts for automation and workflow management Work with large datasets in Hadoop/HDFS environments Collaborate with cross-functional teams to deliver scalable data solutions Required Skills: 8-12 years of experience in Big Data technologies Strong coding skills in Python, Spark (PySpark/Scala) & Hive Experience with Hadoop ecosystem Good knowledge of Shell scripting Strong problem-solving and debugging skills Role & responsibilities