Java Spark Developer

Role Overview: You will be responsible for designing and implementing scalable data-analytics pipelines for large-volume telecom datasets using Java Spark. Your main focus will be on developing distributed Spark applications to extract meaningful insights from raw network data, such as movement patterns, home/work location identification, and behavioral trends. Key Responsibilities: - Design, implement, and optimize Java-based Apache Spark pipelines for high-volume telecom data processing and insight generation. - Build modular, multi-threaded, and asynchronous data-processing jobs triggered via APIs. - Develop correlation logic to identify frequent locations, movement flow, dwell patterns, and device event interactions. - Integrate and maintain data ingestion from ScyllaDB, ClickHouse, and PostgreSQL to ensure consistency and performance. - Collaborate with data analysts and testers to validate insights and fine-tune algorithms. - Implement robust error handling, logging, and performance tuning for production-ready deployment. - Participate in version control, CI/CD pipelines, and code reviews to maintain high code quality. Qualifications Required: - Languages: Proficiency in Core Java (8 or above) with strong OOP and concurrency concepts. - Frameworks & Libraries: Experience with Apache Spark (Java API), Spring Boot, Spring Security, and Maven. - Databases: Familiarity with ScyllaDB, ClickHouse, and PostgreSQL. - Data Processing: Expertise in telecom CDR, IMSI/IMEI mapping, cell-site and geolocation analytics, and device-event correlation. - Strong understanding of distributed computing, multi-threading, and asynchronous data flows. Additional Details: The position requires an analytical thinker with strong problem-solving and debugging abilities. Excellent teamwork and communication skills are essential, along with a self-driven approach to optimization, documentation, and delivery. (Note: The job type is Full-time, Permanent),