Data Engineer

About Cybage

Cybage Software Pvt. Ltd. is a technology consulting is a technology consulting organization specializing in outsourced product engineering services. As a leader in technology & product engineering space, Cybage works with some of the worlds largest Independent Software Vendors (ISVs). Our solutions are focused on modern technologies and are enabled by a scientific, data-driven system called Decision Mines for Digital Excellence

Key Aspects of the Role:

• Design and implement the

  Audience Database architecture

  , integrating multiple data sources including CRMs, APIs, and web tracking.
• Build and manage

  ETL/ELT pipelines using Airbyte

  to ingest and normalize data into storage layers such as

  PostgreSQL, S3

  , and

  ClickHouse

  .
• Develop backend components and RESTful APIs using

  FastAPI

  to serve audience data for dashboards and campaign systems.
• Integrate and optimize

  Elasticsearch

  for indexing, search, and personalized audience filtering.
• Apply data transformations, deduplication, and schema management using

  Python

  and SQL.
• Ensure high availability, performance, and reliability of the data infrastructure.
• Work closely with product and analytics teams to define data requirements and delivery mechanisms.
• Lead and mentor a team of data engineers and ensure project milestones are met.

Required skillset:

• Experience in

  Data Engineering

  , with strong Python programming skills.
• Proven experience with

  Airbyte

  (Cloud or OSS) for connector-based data ingestion.
• Hands-on experience building APIs using

  FastAPI

  or similar Python frameworks (Flask, Django REST).
• Strong experience with

  Elasticsearch

  , including index design, query optimization, and integration.
• Solid command of

  SQL

  and data modeling in

  PostgreSQL

  or other relational databases.
• Familiarity with

  cloud storage and processing (e.g., AWS S3)

  .
• Experience with

  OAuth2, webhooks

  , and API-based integrations.
• Ability to lead small technical teams and coordinate with stakeholders across functions.