4 years

0 Lacs

Posted:4 weeks ago| Platform: Linkedin logo

Apply

Work Mode

Remote

Job Type

Full Time

Job Description

Role:

Experience:

Work location:

Notice period:

Shift timing:

Budget:


Data Engineer


Required Skills & Qualifications:

  • 4+ years of

    Data engineering

    experience.
  • Strong programming skills in

    Python

    and

    SQL

    .
  • Proficiency with

    GCP data services

    : BigQuery, Cloud Storage, Dataflow, Pub/Sub, Composer/Airflow.
  • Experience with

    ETL/ELT pipeline design

    and workflow orchestration.
  • Familiarity with

    vector databases/embeddings

    (e.g., Pinecone, FAISS, Vertex AI Matching Engine).
  • Knowledge of

    data modeling, governance, and version control

    .
  • Experience with

    CI/CD, Docker, and Kubernetes

    for data pipeline deployment.
  • Strong analytical and debugging skills.



Key Responsibilities:

  • Design and implement

    data ingestion pipelines

    from GCS, BigQuery, and Google Drive.
  • Build workflows for

    knowledge base indexing/vectorization

    (RAG pipelines).
  • Implement

    incremental updates

    , targeted revisions, and full rebuild options for AI agents.
  • Collaborate with ML Engineers to integrate

    data pipelines with Vertex AI models

    .
  • Optimize pipelines for

    cost, performance, and scalability

    within GCP.
  • Ensure

    data quality, governance, and security

    with IAM-based access control.
  • Maintain

    logging, monitoring, and alerting

    for pipeline health.
  • Work with DevOps to enable

    self-healing and rollback automation

    .



About JBS:


Data and Analytics solutions


Learn more about us at

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You