Data Engineer

AI Data Engineer (Snowflake)

Required Skills & Experience

-3+ years in data engineering or AI engineering

-Proficiency with Snowflake (Snowpark, Streams/Tasks, UDFs)

-Hands-on experience implementing embedding pipelines and vector stores (Snowflake or external)

-Experience with Python and data engineering libraries

-Experience with OCR/document extraction (e.g., Cortex capabilities, Azure DI, etc.)

-Strong understanding of LLMs, embeddings, and RAG architectures

-Proficiency in modern CICD workflows (GitHub Actions, Azure DevOps, etc.)

-Strong software engineering fundamentals (modularity, testing, error handling)

• Insight Global is seeking an experienced AI Data Engineer with deep Snowflake expertise to join one of our medical device clients in India.
• In this role, you will develop high-quality ingestion pipelines and vector-enabled architectures using Snowflake, Snowpark, and Cortex to support advanced Retrieval-Augmented Generation (RAG) systems. You will create efficient workflows for chunking, embedding, indexing, and vector search, while also building automated OCR and document‑intelligence pipelines to transform unstructured content into AI‑ready datasets.
• This position involves integrating LLM workflows—including embeddings, retrieval chains, prompt orchestration, and evaluation—and deploying modular, production‑grade code through modern CI/CD practices.
• You will collaborate closely with data scientists, AI engineers, and cloud engineering teams to deliver scalable, reliable, and secure AI capabilities.
• Strong logging, monitoring, and error-handling will be essential to ensure system performance, auditability, and compliance.
• Additionally, you will contribute to internal tooling, frameworks, and best practices that elevate our AI data engineering maturity.