Predigle - Data Engineer

About The Role

Key Responsibilities

• Working experience of 3 years in Data engineering.
• Design, build, and optimize scalable data pipelines using modern frameworks and orchestration tools.
• Develop and maintain ETL/ELT workflows using AWS, Azure Databricks, Airflow, and Azure Data Factory.
• Manage and model data in Snowflake to support advanced analytics and machine learning use cases.
• Collaborate with analytics, product, and engineering teams to align data solutions with business goals.
• Ensure high standards for data quality, governance, and pipeline performance.
• Mentor junior engineers and help lead a high-performing data and platform engineering team.
• Lead and support GenAI platform initiatives, including building reusable libraries, integrating vector databases, and developing LLM-based pipelines.
• Build components of agentic frameworks using Python, Spring AI, and deploy them on AWS EKS.
• Establish and manage CI/CD pipelines using Jenkins.
• Drive ML Ops and model deployment workflows to ensure reliable and scalable AI solution delivery.
  

Required Qualifications

• Proven hands-on experience with Azure Databricks, Snowflake, Airflow, and Python.
• Strong proficiency in SQL, Spark, Spark Streaming, and modern data orchestration frameworks.
• Solid understanding of data modeling, ETL best practices, and performance optimization.
• Experience in cloud-native environments (AWS and/or Azure).
• Strong hands-on expertise in AWS EKS, CI/CD (Jenkins), and ML Ops/model deployment workflows.
• Ability to lead, mentor, and collaborate effectively across cross-functional teams.
  

Preferred Qualifications

• Experience with Search Platforms such as Elasticsearch, SOLR, OpenSearch, or Vespa.
• Familiarity with Spring Boot microservices and EKS-based deployments.
• Background in Recommender Systems, with leadership roles in AI/ML projects.
• Expertise in GenAI platform engineering, including LLMs, RAG architecture, Vector Databases, and agentic design.
• Proficiency in Python, Java, Spring AI, and enterprise-grade software development.
• Ability to build platform-level solutions with a focus on reusability, runtime libraries, and scalability.
  

What We Offer

• A collaborative, growth-oriented work culture with room for ownership and innovation.
• Competitive compensation and a comprehensive benefits package.
• Flexible hybrid/remote work model to support work-life balance.