Posted:2 weeks ago|
Platform:
Work from Office
Full Time
Job Title: Senior Software Engineer - Data Engineer with Python, Kafka Streaming & Spark
Shift Timings: General ShiftYour future duties and responsibilities:
Job Summary:CGI is looking for a skilled and proactive Data Engineer with hands-on experience in Kafka streaming, Apache Spark.The ideal candidate will play a key role in designing, developing, and deploying scalable backend systems and real-time data pipelines.This position is ideal for someone passionate about building high-performance systems and working with cutting-edge technologies in cloud-native environments.Key Responsibilities:Develop real-time data streaming applications using Apache Kafka and Kafka Streams.Build and optimize large-scale batch and stream processing pipelines with Apache Spark.Containerize applications and manage deployments using Kubernetes.Collaborate with DevOps teams to ensure CI/CD pipelines are robust and scalable.Write unit tests and conduct code reviews to maintain code quality and reliability.Troubleshoot and debug production issues across multiple environments.
Strong programming skills in Python.
Hands-on experience with Apache Kafka, Kafka Streams, and event-driven architecture.Solid knowledge of Apache Spark (batch and streaming).Familiarity with microservices architecture, RESTful APIs, and distributed systems.Experience with build tools such as Maven or Gradle.Familiar with Git, Jenkins, CI/CD pipelines, and Agile development practices.Excellent problem-solving skills and ability to work in a fast-paced environment.Education & Experience:Bachelor's or Master's degree in Computer Science, Engineering, or related field.Minimum 6 years of experience in backend development with Java and related technologies.Preferred Skills (Nice to Have):Knowledge of cloud platforms like AWS, Azure, or GCP.Understanding of security best practices in cloud-native environments.Familiarity with SQL/NoSQL databases (e.g., PostgreSQL, Cassandra, MongoDB).Experience with Scala or Python for Spark jobs is a plus.
CGI
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Java coding challenges to boost your skills
Start Practicing Java Now
hyderabad, telangana
Salary: Not disclosed
6.0 - 11.0 Lacs P.A.
5.25 - 7.65 Lacs P.A.
kolkata, bengaluru
15.0 - 30.0 Lacs P.A.
17.0 - 18.0 Lacs P.A.
4.0 - 8.0 Lacs P.A.
mumbai
4.0 - 7.0 Lacs P.A.
bengaluru
5.0 - 8.0 Lacs P.A.
9.0 - 13.0 Lacs P.A.
8.0 - 10.0 Lacs P.A.
