Data Engineer

Job Title:

Position Overview

We are looking for a skilled and passionate Data Engineer to join our GenAI Applications team. This role offers the opportunity to work at the intersection of traditional data engineering and cutting-edge AI/ML systems, helping us build scalable, cloud-native data infrastructure to support innovative Generative AI solutions.

What We’re Looking For – Required Skills & Experience

• 4–8 years of experience in data engineering or related fields.
• Strong programming skills in

  Python

  and

  SQL

  , with experience in large-scale data processing.
• Proficient with

  cloud platforms

  (AWS, Azure, GCP) and native data services.
• Experience with

  open-source tools

  such as Apache NiFi, MLflow, or similar platforms.
• Hands-on experience with

  Apache Spark

  ,

  Kafka

  , and

  Airflow

  .
• Skilled in working with both

  SQL and NoSQL databases

  , including performance tuning.
• Familiarity with

  modern

  data

  warehouses

  : Snowflake, Redshift, or BigQuery.
• Proven experience building scalable pipelines for batch and real-time processing.
• Experience implementing

  CI/CD pipelines

  and performance optimization in data workflows.

Key Responsibilities

• Data

  Pipeline Development

• Design and optimize robust, scalable data pipelines for AI/ML model training and inference
• Enable batch and real-time data processing using big data technologies
• Collaborate with GenAI engineers to understand and meet data requirements

• Cloud Infrastructure & Tools

• Build and manage cloud-native data infrastructure using AWS, Azure, or Google Cloud
• Implement Infrastructure as Code (IaC) using tools like Terraform or CloudFormation
• Ensure data reliability through monitoring and alerting system                                                                                                                                                                                                                                                                                                                      

Preferred Skills

• Understanding of machine learning workflows and MLOps practices
• Familiarity with

  Generative AI

  concepts such as LLMs, RAG systems, and vector databases
• Experience implementing data quality frameworks and performance optimization
• Knowledge of model deployment pipelines and monitoring best practices