AI and Databricks Engineer

As an AI and Databricks Engineer, you will be responsible for developing industry-grade LLM and Gen-AI applications using OpenAI, Anthropic (Claude), or other major providers. Your role will involve hands-on experience with Databricks, including Spark, Delta Lake, MLflow, Databricks Notebooks, and Unity Catalog. You will need expertise in Python for building Autonomous Gen-AI solutions and proficiency in LangChain, LlamaIndex for building agentic architectures. Additionally, experience with vector databases such as Pinecone, Weaviate, Chroma, FAISS, RAG, ARAG, BigQ, CAG, A/B testing, reinforcement learning, etc., is required. Integration of LLM systems with APIs and enterprise data sources will also be part of your responsibilities. You should have rich experience with cloud environments like Azure, AWS, or GCP and their AI/ML services. A solid understanding of data governance, security, and scalability within Databricks is essential. A degree in Computer Science or a similar major is mandatory for this role. Qualifications Required: - Strong experience in developing LLM and Gen-AI applications - Hands-on experience with Databricks and its components - Expertise in Python for AI solution development - Proficiency in LangChain, LlamaIndex for agentic architectures - Experience with vector databases, RAG, ARAG, BigQ, CAG, A/B testing, reinforcement learning, etc. - Integration of LLM systems with APIs and enterprise data sources - Experience working with cloud environments and their AI/ML services - Understanding of data governance, security, and scalability within Databricks Additional Details about the Company: The company is looking to hire one experienced resource with 4+ years of experience and 1-2 resources with 1 year of experience. Junior resources will receive training on the project to enhance their skills and capabilities.,