Senior Data Engineer

Now Hiring: Senior Data Engineer

Locations:

Job Type:

Experience:

Senior Data Engineer

What You’ll Do

• AI Integration:

  Build and deploy LLM-powered workflows including RAG pipelines, agent frameworks, and AI-driven data processes (LangChain, LangGraph, CrewAI, etc.).

• Data Pipeline Engineering:

  Design, develop, and maintain reliable, scalable ETL/ELT pipelines using Python and Azure.

• Collaboration:

  Work closely with data scientists, analysts, and engineering teams to deliver high-quality, data-driven solutions.

• Automation & Deployment:

  Containerize and deploy data services using Docker, Kubernetes, and CI/CD pipelines across Azure/AWS/GCP.

• Data Governance & Observability:

  Ensure data quality, compliance, monitoring, and security best practices.

• Documentation:

  Maintain clear, high-quality technical documentation.

• Troubleshooting:

  Identify and resolve performance bottlenecks and data issues.

What We’re Looking For

• Bachelor’s/Master’s in Computer Science, IT, or related field.

• 6–8+ years of experience

  in data engineering with strong expertise in Python, Azure, CI/CD, and deployment.
• Strong knowledge of:
• LLMs & Generative AI (fine-tuning, prompt engineering, RAG).
• ETL/ELT pipelines (structured & unstructured data).
• Azure services (ADF, Databricks, Azure SQL, etc.).
• Big data & cloud tools (Spark, Hadoop, Kafka).
• SQL & NoSQL databases.
• Docker, Kubernetes, cloud-native deployment.
• Understanding of ML fundamentals (model training, feature engineering).
• Strong collaboration, communication, and problem-solving skills.

Preferred Qualifications

• Azure or other cloud certifications
• Experience with large-scale big data platforms
• Familiarity with MLOps and GenAI deployment