Data Engineer -Observability & Insights Platform

Job Title:

Location:

Employment Type:

Experience:

1. Observability Signal Correlation

• Integrate and analyze logs, metrics, and traces using Grafana and Prometheus
• Enrich observability data with business context for deeper insights

2. Data Enrichment & Pipeline Development

• Build and maintain data pipelines that enhance technical signals with business metadata
• Leverage OpenTelemetry (OTel) for observability instrumentation

3. Machine Learning Integration

• Design, build, and deploy ML models for anomaly detection, forecasting, and incident noise reduction
• Continuously improve ML models for greater accuracy and business value

4. Disruption Prediction & Risk Mitigation

• Identify trends and patterns to predict business disruptions and support preemptive actions

5. Action Enablement

• Deliver actionable observability insights through dashboards and tools
• Support both automated and manual decision-making

6. Cross-Functional Collaboration

• Work closely with IT, DevOps, and Business teams to align technical implementations with business goals

7. Continuous Improvement

• Monitor and optimize data pipelines for accuracy, reliability, and performance

• Proven experience as a Data Engineer or similar role focused on observability and analytics
• Strong proficiency in SQL and Python
• Hands-on experience with Google Cloud Platform (GCP)
• Expertise in BigQuery, Grafana, Prometheus, and Splunk
• Familiarity with OpenTelemetry (OTel)
• Experience with big data tools such as Apache Spark, Kafka, and Airflow

• Applied machine learning techniques for anomaly detection and forecasting
• Ability to reduce alert noise and provide high-value insights
• Strong analytical skills for interpreting complex datasets

• Excellent communication and collaboration skills
• Strong problem-solving mindset
• Passion for using data to solve real business problems