Data Engineer

As a Data Engineer with expertise in Kafka, MongoDB, and OpenShift (AWS), you will play a crucial role in designing, building, and maintaining robust data pipelines to ensure the seamless flow of data across different systems. Your primary responsibility will involve collaborating with data scientists, analysts, and stakeholders to enhance data processing and storage solutions. Your key responsibilities will include designing and implementing scalable data pipelines using Kafka for real-time data ingestion and processing. You will also be tasked with managing and optimizing MongoDB databases to ensure high availability and performance levels. Additionally, you will develop containerized Springboot/Java applications and deploy them using OpenShift for efficient operations. Leveraging AWS services such as S3 and Redshift for data storage, processing, and analysis will be an essential part of your role. In this position, you will work closely with cross-functional teams to gather requirements and deliver data solutions that align with business needs. Monitoring and troubleshooting data pipeline performance and implementing necessary improvements will also be a key aspect of your responsibilities. The ideal candidate for this role should have 6 to 10 years of relevant experience and the position is based in Hyderabad.,