Kafka and Grafana Specialist

As a Kafka and Grafana Specialist at RiDiK, a subsidiary of CLPS Incorporation, you will play a crucial role in designing, optimizing, and monitoring Kafka-based data pipelines and creating insightful Grafana dashboards. Your expertise in Kafka architecture, Grafana monitoring, and scripting in .Net or Python will enable real-time processing and visualization of system metrics. Key Responsibilities: - Develop and maintain Kafka producer and consumer applications for efficient data flow. - Optimize Kafka clusters for performance, scalability, and reliability. - Design and manage Grafana dashboards for monitoring Kafka metrics and system performance. - Integrate Grafana with Elasticsearch or other data sources. - Set up alerting mechanisms in Grafana to ensure system health monitoring. - Collaborate with DevOps, data engineers, and software teams to build reliable data pipelines. - Ensure the security and compliance of Kafka and Grafana implementations. Required Qualifications: - Experience: 8+ years in configuring Kafka, Elasticsearch, and Grafana. - Strong understanding of Apache Kafka architecture. - Proficiency in Grafana visualization and dashboard management. - Hands-on experience with .Net or Python for Kafka development. - Knowledge of distributed systems and message-oriented middleware. - Familiarity with time-series databases and monitoring tools. - Expertise in data serialization formats like JSON. - Proficient in Azure platforms and Kafka monitoring tools. - Excellent problem-solving and communication skills. Join RiDiK, a global technology solutions provider, and be part of an innovative, fast-growing team shaping the future of technology across industries. Operating from regional hubs in 10 countries and backed by a global delivery network, RiDiK combines local insight with technical excellence to deliver real, measurable impact.,