Data Engineer

Role Overview

We are looking for a Senior Data Engineer to lead the design and development of a next-generation data platform that powers real-time and batch applications at scale. This platform supports business logic, personalisation, user cohorting, CRM, product analytics, and Generative AI workloads.

You'll work cross-functionally with analysts, engineers, and product teams to build high-throughput data pipelines, ensure reliability and cost-efficiency, and empower data-driven decisions across all touchpoints web, mobile (Android/iOS) and server.

Key Responsibilities

Data Platform & Pipeline Development

• Build and scale real-time and batch data pipelines capable of supporting high-volume data ingestion and processing.
• Power diverse applications across: business logic and personalization, user cohorting and CRM, product and business analytics, and Generative AI (data retrieval, prompt engineering, context feeding).

Analytics Enablement Across Platforms

• Partner with product analysts to co-design analytics schemas that align across all client platforms.
• Enable consistent event tracking and unified user behavior analysis.
• Ensure availability of enriched and aggregated datasets that can be plugged directly into product and business workflows.

Lifecycle Management & Platform Efficiency

• Own the entire lifecycle of the data platform from design and provisioning to resource decommissioning.
• Implement systems for:
• Dynamic resource allocation (compute, storage, streaming)
• Tiered data retention and archival
• Usage-based cost governance and alerting
• Develop tooling, playbooks, and dashboards for observability, efficiency, and compliance.

Monitoring, Governance & Reliability

• Build proactive monitoring and alerting for data freshness, volume anomalies, and schema drift.
• Conduct root cause analyses (RCA) for failures or inconsistencies across systems.
• Define and enforce role-based access control (RBAC) and audit policies for secure data operations.
• Maintain thorough documentation of data flows, architecture, and contracts.

Must-Have Qualifications

• Experience building cloud-native data solutions on AWS (RDS, Redshift, Athena, Kinesis, Lambda, S3) and GCP (BigQuery, Dataflow, Datastream).
• Proficiency in SQL, NoSQL, and data modeling for both OLTP and OLAP systems.
• Strong backend engineering skills using Golang (preferred) or other typed languages.
• Hands-on experience with event streaming platforms like Kafka, Kinesis, or RabbitMQ.
• Deep understanding of data warehousing, pipeline orchestration, and cloud architecture.
• Demonstrated ability to implement secure, auditable, and scalable data governance frameworks.

Good-to-Have Skills

• Scripting expertise in Bash or Python for automation.
• Familiarity with Apache Spark, Flink, or other big data processing engines.
• Experience with CI/CD, Infrastructure-as-Code (Terraform, CloudFormation), and deployment automation.
• Experience designing datasets and platforms that support both BI and machine learning workloads.

Why Our Team Loves Working at AppsForBharat!

We don't just offer benefits ; we offer a life-first approach to work.

• Family-First Insurance Coverage for you, your spouse, AND your parents/in-laws because your peace of mind includes theirs.
• Mental Health Support Unlimited confidential therapy sessions, accessible from wherever you're comfortable.
• Wellness Perks Exclusive medicine discounts plus complimentary eye and dental checkups.
• Life conscious policies such as
  Period Leave

  ,

  generous maternity, paternity, and wedding leave because life happens.
• Why wait for month-end blues Your salary hits your account by the 25th every month.
• We invest in your future self with dedicated professional development benefits to fuel your journey.
• Monthly activities and quarterly outings spanning sports, music, and diverse interests. Every personality type finds their groove.
• Located in the heart of HSR Layout pet-friendly, plant-happy, and designed as your peaceful sanctuary in the bustling city.

If you're interested, please fill out the job application form - https://forms.gle/d6mPg7N1Dwd2tqdq5