Vodafone Idea | Apache Druid Developer

Job Purpose

VI is looking for an experienced Apache Druid Developer to join our data engineering team. The ideal candidate will have a deep understanding of real-time data ingestion, processing, and querying in large-scale analytics environments. He will be responsible for designing, implementing, and optimizing data pipelines in Apache Druid to support real-time data analytics and drive business insights.

Key Result

Areas/Accountabilities

• Data Ingestion Pipelines

  : Design and implement data ingestion workflows in Apache Druid, including real-time and batch data ingestion.

• Query Optimization

  : Develop optimized Druid queries and leverage Druids indexing and storage capabilities to ensure low-latency, high-performance analytics.

• Data Modeling

  : Create and maintain schemas optimized for time-series data analysis, supporting aggregation, filtering, and complex analytical functions.

• Cluster Management

  : Deploy, configure, and manage Druid clusters, monitoring performance, reliability, and cost-effectiveness.

• Data Integration

  : Collaborate with other teams to integrate Druid with data sources (e.g., Kafka, Hadoop, S3) and downstream applications.

• Performance Monitoring & Tuning

  : Continuously monitor cluster performance, fine-tune data configurations, and troubleshoot any issues that may impact availability and response times.

Core Competencies,

Knowledge, Experience

• In-depth experience with

  Apache Druid

  (setup, configuration, tuning, and operations).
• Strong knowledge of

  SQL

  and familiarity with

  Druid SQL

  .
• Experience with

  data ingestion and ETL pipelines

  , especially with Kafka, Hadoop, Spark, and other data sources.
• Proficiency in

  Java, Python

  , or other programming languages for custom data processing and integration.
• Familiarity with

  distributed data systems

  and big data frameworks (e.g., Hadoop, Apache Kafka, Apache Spark).

Must have technical / professional qualifications

• Bachelor’s degree in Computer Science, with 6+ experience in Data Science, Engineering, or a related field.
• Experience with

  data visualization tools

  (e.g., Superset, Tableau, Looker) and integration with Druid
• Experience with

  other analytics databases

  (e.g., ClickHouse, Snowflake, BigQuery).