About Us: We are seeking a talented and passionate Applied AI/ML Engineer to join our team. In this role, you will spearhead the end-to-end lifecycle of foundational model development, employing state-of-the-art approaches in generative AI. Your role will entail focus on data- and compute-efficient learning approaches to tackle challenges characteristics to Indian context. Your responsibilities will include optimizing model training and inference pipelines, production ready model deployment, ensuring scalability through distributed systems, and fine-tuning models on domain adaptation. You will collaborate with cross-functional teams to build robust AI stacks and integrate them seamlessly into production pipelines. Beyond research and experimentation, you will play a pivotal role in transforming state-of-the-art models into operational systems that deliver measurable impact. As a leader in this domain, you will collaborate with other technical team members and subject matter experts, document technical processes, and maintain clear, organized codebases to support innovation and reproducibility. This role is ideal for proactive individuals passionate about driving transformative advancements in generative AI and scaling solutions for real-world impact. Key Responsibilities: Development and training of foundational models across modalities End to end lifecycle management of foundational model development from data curation to model deployment by collaborating with the core team members Conduct research to advance model accuracy and efficiency. Implement state-of-the-art AI techniques in Text/Speech and language processing. Collaborate with cross-functional teams to build robust AI stacks and integrate them seamlessly into production pipelines. Develop pipelines for debugging, CI/CD and observability of the development process. Demonstrated ability to lead projects and provide innovative solutions. Should document technical processes, model architectures, and experimental results., maintain clear and organized code repositories. Education Qualification: Bachelor’s or Master’sin any related field with 2 to 5 years of experience in industry in applied AI/ML. Minimum Requirements: Proficiency in Python programming and familiarity with 3-4 from the list of toolsspecified below: 1. Foundational model libraries and frameworks (TensorFlow, PyTorch, HF Transformers, NeMo, etc) 2. Experience with distributed training (SLURM, Ray, Pytorch DDP, Deepspeed, NCCL, etc) 3. Inference servers(vLLM) 4. Version controlsystems and observability (Git, DVC, MLFlow, W&B, KubeFlow) 5. Data analysis and curation tools(Dask, Milvus, Apache Spark, Numpy) 6. Text-to-Speech tools (Whisper, Voicebox, VALL-E (X), HuBERT/Unitspeech) 7. LLMOPs Tools, Dockers etc 8. Hands on experience with AI application libraries and frameworks (DSPy, Langgraph, langchain, llamaindex etc.)
About Us: We are seeking a talented and passionate Applied AI/ML Engineer to join our team. In this role, you will spearhead the end-to-end lifecycle of foundational model development, employing state-of-the-art approaches in generative AI. Your role will entail focus on data- and compute-efficient learning approaches to tackle challenges characteristics to Indian context. Your responsibilities will include optimizing model training and inference pipelines, production ready model deployment, ensuring scalability through distributed systems, and fine-tuning models on domain adaptation. You will collaborate with cross-functional teams to build robust AI stacks and integrate them seamlessly into production pipelines. Beyond research and experimentation, you will play a pivotal role in transforming state-of-the-art models into operational systems that deliver measurable impact. As a leader in this domain, you will collaborate with other technical team members and subject matter experts, document technical processes, and maintain clear, organized codebases to support innovation and reproducibility. This role is ideal for proactive individuals passionate about driving transformative advancements in generative AI and scaling solutions for real-world impact. Key Responsibilities: Development and training of foundational models across modalities End to end lifecycle management of foundational model development from data curation to model deployment by collaborating with the core team members Conduct research to advance model accuracy and efficiency. Implement state-of-the-art AI techniques in Text/Speech and language processing. Collaborate with cross-functional teams to build robust AI stacks and integrate them seamlessly into production pipelines. Develop pipelines for debugging, CI/CD and observability of the development process. Demonstrated ability to lead projects and provide innovative solutions. Should document technical processes, model architectures, and experimental results., maintain clear and organized code repositories. Education Qualification: Bachelors or Mastersin any related field with 2 to 5 years of experience in industry in applied AI/ML. Minimum Requirements: Proficiency in Python programming and familiarity with 3-4 from the list of toolsspecified below: 1. Foundational model libraries and frameworks (TensorFlow, PyTorch, HF Transformers, NeMo, etc) 2. Experience with distributed training (SLURM, Ray, Pytorch DDP, Deepspeed, NCCL, etc) 3. Inference servers(vLLM) 4. Version controlsystems and observability (Git, DVC, MLFlow, W&B, KubeFlow) 5. Data analysis and curation tools(Dask, Milvus, Apache Spark, Numpy) 6. Text-to-Speech tools (Whisper, Voicebox, VALL-E (X), HuBERT/Unitspeech) 7. LLMOPs Tools, Dockers etc 8. Hands on experience with AI application libraries and frameworks (DSPy, Langgraph, langchain, llamaindex etc.) Show more Show less
We are looking for a skilled and enthusiastic Applied AI/ML Engineer to be a part of our team. As an Applied AI/ML Engineer, you will be responsible for leading the entire process of foundational model development, focusing on cutting-edge generative AI techniques. Your main objective will be to implement efficient learning methods for data and compute, specifically addressing challenges relevant to the Indian scenario. Your tasks will involve optimizing model training and inference pipelines, deploying production-ready models, ensuring scalability through distributed systems, and fine-tuning models for domain adaptation. Collaboration with various teams will be essential as you work towards building strong AI stacks and seamlessly integrating them into production pipelines. Apart from conducting research and experiments, you will be crucial in converting advanced models into operational systems that generate tangible results. Your leadership in this field will involve working closely with technical team members and subject matter experts, documenting technical processes, and maintaining well-structured codebases to encourage innovation and reproducibility. This position is perfect for proactive individuals who are passionate about spearheading significant advancements in generative AI and implementing scalable solutions for real-world impact. Your responsibilities will include: - Developing and training foundational models across different modalities - Managing the end-to-end lifecycle of foundational model development, from data curation to model deployment, through collaboration with core team members - Conducting research to enhance model accuracy and efficiency - Applying state-of-the-art AI techniques in Text/Speech and language processing - Collaborating with cross-functional teams to construct robust AI stacks and smoothly integrate them into production pipelines - Creating pipelines for debugging, CI/CD, and observability of the development process - Demonstrating project leadership and offering innovative solutions - Documenting technical processes, model architectures, and experimental outcomes, while maintaining clear and organized code repositories To be eligible for this role, you should hold a Bachelor's or Master's degree in a related field and possess 2 to 5 years of industry experience in applied AI/ML. Minimum requirements for this position include proficiency in Python programming and familiarity with 3-4 tools from the specified list below: - Foundational model libraries and frameworks (TensorFlow, PyTorch, HF Transformers, NeMo, etc) - Experience with distributed training (SLURM, Ray, Pytorch DDP, Deepspeed, NCCL, etc) - Inference servers (vLLM) - Version control systems and observability (Git, DVC, MLFlow, W&B, KubeFlow) - Data analysis and curation tools (Dask, Milvus, Apache Spark, Numpy) - Text-to-Speech tools (Whisper, Voicebox, VALL-E (X), HuBERT/Unitspeech) - LLMOPs Tools, Dockers, etc - Hands-on experience with AI application libraries and frameworks (DSPy, Langgraph, langchain, llamaindex, etc),
About the Project: We are embarking on an ambitious project to develop cutting-edge language technologies, including Large Language Models (LLMs), Automatic Speech Recognition (ASR), and Text-to-Speech (TTS) systems, for 22 diverse Indian languages. We are seeking a highly skilled and motivated Computational Linguist to join our team and play a crucial role in shaping the future of multilingual AI. Job Summary: The Computational Linguist Intern/Contractor will be responsible for providing linguistic expertise and support to the development and improvement of our LLM, ASR, and TTS models across a wide range of Indian languages. This role will involve analyzing linguistic data, creating resources, and collaborating with machine learning engineers to enhance the accuracy and naturalness of our language technologies. Responsibilities: 1.Research aspect Collaborate with machine learning engineers to integrate linguistic knowledge into model development. Identify and address linguistic challenges related to the development of LLMs, ASR, and TTS systems, such as dialectal variations, low-resource languages, data composition of pretraining data. Design, execute pilot experiments for data synthesis, exploratory data analysis and analyze results Evaluate the linguistic quality of model outputs and provide feedback for improvement. 2.Implementation aspect Develop and adapt linguistic tools and techniques for data processing and analysis. Qualifications and Experience: 1.Education: PhD in Computational Linguistics 2.Experience: Professional experience: prior professional experience is not strictly required. However, relevant academic or project experience, like Experience with developing or evaluating NLP tools or systems like TTS is highly desirable. Research Experience: Experience with linguistic research, data analysis, or experimental design is a plus. Programming/Scripting: Expertise in programming or scripting languages (e.g. Python), especially for data processing and tool development. Experience working with low resource languages is a plus. Preferred Skills: Linguistic Analysis: Strong understanding of linguistic principles and the ability to analyze linguistic data. Problem-Solving: Ability to identify and solve linguistic challenges related to language technology. Collaboration: Excellent communication and collaboration skills to work effectively with machine learning engineers and other team members. Research Skills: Ability to conduct research, design experiments, and analyze results is a plus Note: Publications or Presentations: Publications or presentations at relevant conferences or journals are a plus.
Key Responsibilities Collaborate with the BharatGen research and engineering team to design, build, and optimize AI/ML models. Implement and test algorithms in Python for applied AI/ML use cases. Apply Data Structures and Algorithms (DSA) concepts to optimize code for efficiency. Contribute to data preprocessing, feature engineering, and model evaluation pipelines. Work under the guidance of senior researchers and engineers to develop prototypes and POCs. Document technical processes and contribute to knowledge sharing within the team. Required Skills & Knowledge Hands-on Python programming experience. Strong basics in AI/ML concepts (supervised and unsupervised learning, evaluation metrics, model training/testing workflows). Good understanding of Data Structures and Algorithms (DSA). Familiarity with popular ML libraries and frameworks (e.g., NumPy, Pandas, scikit-learn, TensorFlow/PyTorch) will be a plus. Problem-solving mindset, eagerness to learn, and ability to work in a collaborative team environment. Eligibility Final-year students, recent graduates, or postgraduates in Computer Science, Information Technology, Data Science, AI & ML, or related disciplines. Prior academic or project experience in AI/ML is desirable. Internship Details Type: On-site Duration: 6 months Location: IIT Bombay Campus, Mumbai
About BharatGen: BharatGen is a pioneering foundational AI startup based in India with a mission to build AI for India in India. We are a team of passionate engineers and researchers backed by leading organizations, working on cutting-edge technology that will redefine AI in India. We are looking for a visionary marketer to join our founding team and tell our story to the world. About the Role: This opportunity is to build the entire marketing function from the ground up. You will be the architect and executor of our marketing strategy. You will be responsible for building our brand, creating a new category, and driving adoption of our platform among developers and enterprises globally. This role is both strategic and deeply hands-on. You must be a tech-savvy storyteller who is passionate about the future of AI. Key Responsibilities: Strategy & Leadership: Develop and execute a comprehensive marketing strategy from scratch, defining KPIs and owning the marketing budget to drive business growth. Product & Content Marketing: Translate our complex AI technology into compelling narratives, use cases, and benefits. Create a rich content pipeline including technical blog posts, whitepapers, tutorials, case studies, and documentation to educate and attract our target audience. Digital & Community Management: Build and manage our online presence across key channels. Actively engage with the developer and AI/ML community, fostering conversations and building a loyal following. Public Relations & Influencer Marketing: Cultivate strong relationships with industry media, analysts, and key influencers. Secure press coverage, speaking opportunities, and expert features to establish us as a thought leader. Demand Generation: Design and run integrated campaigns to drive awareness, generate qualified leads, and grow our user base through SEO, email marketing, and potential event sponsorships. Operations & Analytics: Select and manage our marketing technology stack. Oversee external agencies and freelancers as needed. Continuously measure, analyze, and report on campaign performance, using data to inform future strategies. Who You Are: Experience: 5+ years of marketing experience, ideally within a B2B technology company. Experience marketing to a technical audience (developers, data scientists, engineers) is a massive plus. Technically Curious: You are genuinely passionate about AI/ML and are comfortable diving deep into technical concepts. You don't need to be a coder, but you must be eager to learn and speak our language. An Exceptional Writer & Communicator: You have a gift for storytelling and can articulate complex ideas with clarity, precision, and persuasion across various formats. A Strategic Thinker & A Doer: You can devise a high-level strategy but aren't afraid to roll up your sleeves and execute. You have a "get it done" attitude and thrive in a fast-paced, ambiguous startup environment. Data-Driven: You use data to make decisions, measure success, and continuously optimize your efforts. An Owner: You are a proactive, self-motivated individual who takes full ownership of your domain and is excited by the prospect of building something from zero. Bonus Points: Direct experience marketing an API, open-source, or other developer-focused product. A pre-existing network of contacts in the tech media or AI/ML community. Experience working in a venture-backed startup environment. A strong personal brand or social media presence in the tech space. What We Offer: A chance to be a part of the founding team of a category-defining AI startup. The opportunity to build a marketing function from the ground up and have a direct impact on the company's trajectory. A culture of intellectual curiosity, rapid iteration, and deep collaboration. If you are a builder who wants to be at the forefront of the AI revolution, we would love to hear from you. Please apply with your resume and a portfolio or links to your work (e.g., blog posts, campaigns you've led, or your personal X/LinkedIn profile).
Key Responsibilities Collaborate with the BharatGen research and engineering team to design, build, and optimize AI/ML models. Implement and test algorithms in Python for applied AI/ML use cases. Apply Data Structures and Algorithms (DSA) concepts to optimize code for efficiency. Contribute to data preprocessing, feature engineering, and model evaluation pipelines. Work under the guidance of senior researchers and engineers to develop prototypes and POCs. Document technical processes and contribute to knowledge sharing within the team. Required Skills & Knowledge Hands-on Python programming experience. Strong basics in AI/ML concepts (supervised and unsupervised learning, evaluation metrics, model training/testing workflows). Good understanding of Data Structures and Algorithms (DSA). Familiarity with popular ML libraries and frameworks (e.g., NumPy, Pandas, scikit-learn, TensorFlow/PyTorch) will be a plus. Problem-solving mindset, eagerness to learn, and ability to work in a collaborative team environment. Eligibility Final-year students, recent graduates, or postgraduates in Computer Science, Information Technology, Data Science, AI & ML, or related disciplines. Prior academic or project experience in AI/ML is desirable. Internship Details Type: On-site Duration: 6 months Location: IIT Bombay Campus, Mumbai
Job Description: • Talent Acquisition: - Drive end-to-end recruitment for technical roles – from sourcing to onboarding. - Partner with hiring managers to define job requirements. - Source candidates through portals, LinkedIn, and referrals. - Screen profiles, coordinate interviews, and ensure a positive candidate experience. - Maintain ATS and recruitment reports. • HR Operations: - Oversee leave, attendance, and HRMS records. - Support employee onboarding and exit formalities. - Assist in employee engagement and internal communication. - Contribute to talent management programs and L&D initiatives. - Help streamline and document HR processes. Minimum Qualifications and Experience: • Bachelor’s or Master’s degree in HR or any related field with 3-4 years of experience in tech hiring and HR operations. Required Expertise: • Strong knowledge of hiring tools and platforms (e.g., LinkedIn, Naukri) • Familiarity with HR systems and tools. • Excellent communication, coordination, and organizational skills.
Job Description: Talent Acquisition: - Drive end-to-end recruitment for technical roles from sourcing to onboarding. - Partner with hiring managers to define job requirements. - Source candidates through portals, LinkedIn, and referrals. - Screen profiles, coordinate interviews, and ensure a positive candidate experience. - Maintain ATS and recruitment reports. HR Operations: - Oversee leave, attendance, and HRMS records. - Support employee onboarding and exit formalities. - Assist in employee engagement and internal communication. - Contribute to talent management programs and L&D initiatives. - Help streamline and document HR processes. Minimum Qualifications and Experience: Bachelor's or Master's degree in HR or any related field with 3-4 years of experience in tech hiring and HR operations. Required Expertise: Strong knowledge of hiring tools and platforms (e.g., LinkedIn, Naukri) Familiarity with HR systems and tools. Excellent communication, coordination, and organizational skills.
Job Description: • Talent Acquisition: - Drive end-to-end recruitment for technical roles – from sourcing to onboarding. - Partner with hiring managers to define job requirements. - Source candidates through portals, LinkedIn, and referrals. - Screen profiles, coordinate interviews, and ensure a positive candidate experience. - Maintain ATS and recruitment reports. • HR Operations: - Oversee leave, attendance, and HRMS records. - Support employee onboarding and exit formalities. - Assist in employee engagement and internal communication. - Contribute to talent management programs and L&D initiatives. - Help streamline and document HR processes. Minimum Qualifications and Experience: • Bachelor’s or Master’s degree in HR or any related field with minimum 5 years of experience in tech hiring and HR operations. Required Expertise: • Strong knowledge of hiring tools and platforms (e.g., LinkedIn, Naukri) • Familiarity with HR systems and tools. • Excellent communication, coordination, and organizational skills.
About Us: As an AI Full Stack Developer, you will have the opportunity to build end-to-end applications that leverage generative AI models and agentic architectures to address real-world business needs across different domains. You will design and develop autonomous and human-in-the-loop agentic AI systems, web and mobile user interfaces, and scalable backend services and APIs. This role is ideal for software engineers who are passionate about crafting elegant user experiences, enjoy working across the stack, and want to convert generative AI capabilities into production-ready solutions. Key Responsibilities: Build and maintain full-stack applications—including web and mobile frontends, scalable backend services, APIs, and AI agents—powered by large and small language models (LLMs and SLMs). Manage databases to support AI features and design efficient data models. Integrate with third-party APIs and services to weave AI features into existing business applications and workflows. Implement testing automation to enable unit, functionality, integration, and performance testing. Implement CI/CD pipelines with DevOps and MLOps to deploy, monitor, and evaluate applications and services in production environments. Troubleshoot bugs and field issues, and create documentation, as required, to support customers and business partners. Train peers on processes, functionalities, and best practices for deploying scalable, reliable, and secure enterprise-grade cloud services and applications. Collaborate with product managers, UI/UX designers, and AI engineers to deliver complete solutions and exceptional user experiences. Minimum Qualification and Experience: Bachelor’s or Master’s degree in Computer Science or related fields with 5+ years of experience as a full stack developer, preferably with exposure to AI/ML. Required Expertise: Solid foundation in computer science fundamentals such as data structures, algorithms, programming, design patterns, virtualization, etc., and strong problem-solving skills. Having high standards of code quality (clean, well-documented, modular, maintainable, reliable, efficient, secure coding) and automated testing. Proficiency in frontend technologies such as HTML5, CSS3, Javascript, and modern web and mobile app development frameworks such as React, Angular, React Native, Flutter. Proficiency in common programming languages such as Python, Java. Hands-on experience with backend frameworks such as Node.js, Django, Flask, FastAPI. Experience in building large-scale microservices and applications using cloud platforms (e.g., AWS, GCP, Azure) and containerization (e.g., Docker, Kubernetes). Experience of building and consuming secure and scalable APIs (e.g., RESTful, GraphQL) for exposing backend services and efficient data handling. Working knowledge of SQL and noSQL databases and ability to write complex queries and optimize database performance. Team player with excellent interpersonal skills and ability to collaborate effectively with remote team members. Go-getter attitude and ability to flourish in a fast-paced, startup environment. Preferred Skills: Experience with or working knowledge of any of the following would be a big plus - Building AI/ML applications such as AI agents, chatbots, and automation workflows Vector databases, embeddings, retrieval-augmented generation (RAG). Model context protocol (MCP), Agent to Agent (A2A), and Agent Communication Protocol (ACP). AI/ML tools such as PyTorch, TensorFlow, Langchain, LlamaIndex, etc.
About Us: We are looking for a Gen AI - Engineer to join our growing team to help design, build, fine-tune, and deploy cutting - edge generative AI models and agentic systems. You will work on the full lifecycle of foundational model development - involving both large and small language models (LLMs and SLMs) - to create scalable AI solutions that address diverse needs across different business domains. This role is ideal for proactive individuals with a strong foundation in machine learning and an experimental mindset, who are passionate about driving transformative advancements in generative AI from research to real-world production impact. Key Responsibilities: Develop and train foundational generative AI models across modalities such as text-to-text, text-to-speech, automatic speech recognition, and vision language. Fine-tune and adapt models for specific tasks and domains. Build and maintain pipelines for data curation, preprocessing, training, evaluation, and continuous improvement of models. Implement debugging, CI/CD, and observability to ensure reliability and efficiency across the development lifecycle. Develop retrieval-augmented generation (RAG) pipelines and optimize prompt engineering strategies. Optimize training and inference performance through quantization, distributed training/inference, GPU/TPU acceleration. Monitor, benchmark, and improve model performance with a focus on accuracy, efficiency, and reducing hallucinations. Collaborate with cross-functional teams to build robust AI stacks and integrate them seamlessly into production pipelines for deployment. Document technical processes, AI model architectures, and experimental results, while maintaining well-structured, version-controlled code repositories. Stay current with advancements in transformer architectures, open-source releases, and AI tooling. Minimum Qualifications and Experience: Bachelor’s or Master’s in Computer Science, AI/ML, Data Science or any related field with 2 to 5 years of industry experience in applied machine learning or AI development. Required Expertise: Proficiency in Python programming with solid foundation in computer science fundamentals such as data structures and algorithms. Strong problem-solving skills and demonstrated ability to lead projects. Hands-on experience with a few of the tools listed below: One or more model libraries and ML frameworks such as TensorFlow, PyTorch, HF Transformers, NeMo, etc. AI application libraries and orchestration frameworks such as DSPy, Langgraph, Langchain, Llamaindex, etc. GPU/TPU based training and inference using libraries such as vLLM. Distributed training tools such as SLURM, Ray, Pytorch DDP, NCCL, etc. Version control, observability systems, and MLOps tools such as Git, DVC, W&B, MLFlow, KubeFlow, etc. Data analysis and curation tools such as Dask, Milvus, Apache Spark, Numpy, etc. Chunking, embeddings, vector databases (e.g., Pinecone, Weaviate, Milvus), and retrieval-augmented generation (RAG). Model context protocol (MCP), Agent to Agent (A2A), and Agent Communication Protocol (ACP). Team player with excellent interpersonal skills and ability to collaborate effectively with remote team members. Go-getter attitude and ability to flourish in a fast-paced, startup environment. Prior experience of building and deploying LLMs or SLMs, experience with multimodal models, and track record of contributions to open-source AI/ML projects would be a big plus.
Job Description: Talent Acquisition: - Drive end-to-end recruitment for technical roles from sourcing to onboarding. - Partner with hiring managers to define job requirements. - Source candidates through portals, LinkedIn, and referrals. - Screen profiles, coordinate interviews, and ensure a positive candidate experience. - Maintain ATS and recruitment reports. HR Operations: - Oversee leave, attendance, and HRMS records. - Support employee onboarding and exit formalities. - Assist in employee engagement and internal communication. - Contribute to talent management programs and L&D initiatives. - Help streamline and document HR processes. Minimum Qualifications and Experience: Bachelor's or Master's degree in HR or any related field with minimum 5 years of experience in tech hiring and HR operations. Required Expertise: Strong knowledge of hiring tools and platforms (e.g., LinkedIn, Naukri) Familiarity with HR systems and tools. Excellent communication, coordination, and organizational skills.
You will be an AI Full Stack Developer responsible for building end-to-end applications that utilize generative AI models and agentic architectures to meet real-world business requirements across various sectors. Your role will involve designing and developing autonomous and human-in-the-loop agentic AI systems, web and mobile interfaces, as well as scalable backend services and APIs. This position is perfect for software engineers who are dedicated to creating sophisticated user experiences, excel in working across the stack, and are keen on transforming generative AI capabilities into production-ready solutions. - Build and maintain full-stack applications, including web and mobile frontends, scalable backend services, APIs, and AI agents utilizing large and small language models (LLMs and SLMs). - Manage databases to support AI features and create efficient data models. - Integrate with third-party APIs and services to incorporate AI features into existing business applications and workflows. - Implement testing automation for unit, functionality, integration, and performance testing. - Establish CI/CD pipelines with DevOps and MLOps to deploy, monitor, and evaluate applications and services in production environments. - Troubleshoot bugs, address field issues, and generate necessary documentation to assist customers and business partners. - Train colleagues on processes, functionalities, and best practices for deploying scalable, reliable, and secure enterprise-grade cloud services and applications. - Collaborate with product managers, UI/UX designers, and AI engineers to deliver comprehensive solutions and exceptional user experiences. To be considered for this role, you should hold a Bachelors or Masters degree in Computer Science or related fields and possess a minimum of 5 years of experience as a full stack developer, with a preference for exposure to AI/ML. - Strong foundation in computer science fundamentals like data structures, algorithms, programming, design patterns, and virtualization, with robust problem-solving abilities. - Uphold high standards of code quality through clean, well-documented, modular, maintainable, reliable, efficient, and secure coding practices, along with automated testing. - Proficiency in frontend technologies such as HTML5, CSS3, Javascript, and modern web and mobile app development frameworks like React, Angular, React Native, and Flutter. - Mastery in common programming languages such as Python and Java. - Hands-on experience with backend frameworks like Node.js, Django, Flask, and FastAPI. - Experience in constructing large-scale microservices and applications using cloud platforms (e.g., AWS, GCP, Azure) and containerization (e.g., Docker, Kubernetes). - Knowledge of building and consuming secure and scalable APIs (e.g., RESTful, GraphQL) for exposing backend services and efficient data handling. - Familiarity with SQL and noSQL databases along with the ability to write complex queries and optimize database performance. - Team player with exceptional interpersonal skills and the capacity to collaborate effectively with remote team members. - Possess a go-getter attitude and thrive in a fast-paced, startup environment. Experience with or knowledge of the following would be advantageous: - Building AI/ML applications such as AI agents, chatbots, and automation workflows. - Vector databases, embeddings, retrieval-augmented generation (RAG). - Model context protocol (MCP), Agent to Agent (A2A), and Agent Communication Protocol (ACP). - AI/ML tools like PyTorch, TensorFlow, Langchain, LlamaIndex, etc.,
Job Summary: We are looking for an AI Evaluation & Test Engineer to join our growing team to ensure that our generative AI models and applications are safe, accurate, trustworthy, and deliver an elegant user experience. You will serve as the first customer of our AI systems. This role is ideal for product-minded engineers who obsess over product quality and customer-centricity, and are passionate about shaping the behavior of AI systems in the real world. Key Responsibilities: Build and maintain AI evaluation pipelines to test, measure, and evaluate the behavior and performance of AI systems. Implement traces, spans, and session tracking for observability and identify error propagation in multi-step pipelines. Define AI quality metrics and KPIs around factuality, faithfulness, toxicity, grounding precision/recall, latency, cost, etc., with clear acceptance bars. Implement evaluation and testing automation to enable end-to-end system and regression testing at scale. Define criteria for and implement release gates in the CI/CD pipeline. Find creative ways to break products. Assist in root cause analysis and troubleshooting of bugs and field issues. Collaborate with cross-functional teammates from product, engineering, linguistics, and customer support to shape human-AI interaction paradigms and ensure that our AI models and applications deliver the desired outcome and user experience. Minimum Qualifications and Experience: Bachelor’s or Master’s degree in CS/CE/IT/EE/E&TC or related fields with 5+ years of experience in manual and automation testing of software products, with at least 2 years in evaluating and testing AI/ML products. Required Expertise: Strong software testing fundamentals and expertise in writing test plans, executing test cases, and generating detailed reports and dashboards. Strong analytical and debugging skills, and attention to detail. Proficiency in Python, scripting, and software testing automation frameworks and tools such as Pytest, Selenium, Robot Framework, etc. Working knowledge of generative AI models, AI agents, and related concepts such as retrieval augmented generation (RAG), prompt engineering, context engineering, explainability, traceability, observability, guard rails, reasoning, specificity, etc. Sound understanding of the fundamental differences in the approach for testing conventional software versus evaluating generative AI systems. Team player with excellent interpersonal skills and the ability to collaborate effectively with remote and cross-functional team members. Go-getter attitude and ability to flourish in a fast-paced, startup environment. Experience in any of the following would be a big plus - - AI evaluation frameworks such as Arize, Braintrust, DeepEval, LangSmith, Ragas - AI safety and red teaming experience, e.g., prompt injection, jailbreak, adversarial and stress testing. - Different types of AI evaluation methods, e.g, Human-in-the-loop, LLM-as-a-Judge.