Applied Data Scientist

This is an hybrid role based in Bangalore, India with the team working together in person 2 days per week.

Galileo is the leading platform for Gen AI evaluation and observability, with a mission to democratize building safe, reliable and robust applications in the new era of AI powered software development. Our foundation is built on pioneering the early technology behind the worlds most ubiquitous AI applications including Apples Siri and Google Speech. We firmly believe that AI developers require meticulously crafted, research-driven tools to create trustworthy and high-quality generative AI applications that will revolutionize our work and lifestyle.

Galileo addresses the complexities inherent in implementing, evaluating, and monitoring GenAI applications, optimizing the development process for both individual developers and teams by offering a comprehensive platform that spans the full AI development lifecycle. Galileo bridges critical gaps, significantly enhancing developers ability to refine and deploy reliable and precise GenAI applications.

Since its inception, Galileo has rapidly gained traction, serving Fortune 100 banks, Fortune 50 telecom companies, as well as AI teams at prominent organizations such as Reddit and Headspace Health, among dozens of others.

Galileo has AI research at its core, with the founders coming from Google and Uber where they solved challenging AI/ML problems in the Speech, Evaluation and ML Infra domains. It is now a Series B business backed by tier 1 investors including Battery Ventures, Scale Venture Partners, and Databricks Ventures, with $68M in total funding. We are headquartered in San Francisco with locations such as New York and Bangalore, India forming our areas of future growth.

role involves a dynamic combination of technical expertise and customer engagement,

You will provide expert-level support, troubleshoot and resolve issues, and conduct training sessions to empower users with the tools and knowledge needed to maximize the benefits of Galileo s solutions.

1. Implement Advanced ML Techniques

   : Work hands-on with state-of-the-art machine learning technologies, including Multi-agents, retrieval augmented generation (RAG), tools, and other cutting-edge LLM technologies, to enhance Galileo s AI features.
   

2. Develop and Optimize LLMs

   : Build, train, and refine large language models such as Llama and Mistral tailored for Galileos users. Utilize the Galileo platform to enhance the performance and efficiency of these models, ensuring they meet specific customer requirements.
   

3. Own and Evolve Metrics:

   Design, implement, and maintain evaluation metrics that power Galileo s model intelligence system. Create high-quality datasets, engineer new prompts, and iterate on measurement frameworks to improve model performance tracking and interpretability.
   

4. Collaborate Closely with Customers

   : Engage directly with Galileos customers to deliver solutions that address their specific generative AI challenges. This involves understanding their unique needs and proposing tailored applications of Galileo s technologies
   

5. Contribute to Product Strategy

   : Provide insights and feedback from customer experiences to the product development teams to inform future product enhancements and new features. This role acts as a bridge between customer needs and the technical capabilities of Galileo.

• Education: Bachelor s degree in Data Science, Computer Science, Statistics, Mathematics, or a related quantitative field.
• Experience: At least 3 years of professional experience applying deep learning frameworks such as PyTorch, TensorFlow, or Keras to real-world business or product challenges, including a minimum of 1 year of hands-on experience working with large language models (LLMs) in production or applied settings.
• Technical Skills: Proficiency in statistical analysis and data science methodologies using Python, R, or SQL. Demonstrable experience in building and optimizing machine learning models.

Preferred Qualifications

• Advanced Degree: Master s or Ph.D. in Data Science, Machine Learning, Computer Science, or a related field.
• Specialized Experience: Experience with large language models (LLMs) and technologies such as retrieval augmented generation (RAG) or similar ML models in production environments.
• Industry Knowledge: Prior experience in implementing AI solutions in real-world applications, particularly in sectors relevant to Galileos client base.
• Project Management: Strong project management skills with a proven track record of leading projects from conception to implementation.
• Communication Skills: Excellent communication and interpersonal skills, capable of explaining complex technical details to non-technical stakeholders and conducting effective training sessions.

• Join a seasoned founding team that has prev iously led product and engineering teams from 0 to $100M+ in revenue and from 0 to 1B+ users globally
• We obsess over our team s culture driven by inclusivity, empathy and curiosity
• We invest in our team s development and happiness because our employees are the keys to our success and ensuring happy customers towards that end, we offer:
• • Medical, Dental and Vision Insurance
  • Unlimited PTO
  • Parental Leave (birthing non-birthing) - 100% pay for 8 weeks
  • 401(k) Retirement Savings Plan
  • Pre-IPO Stock Options
  • Commuter Benefits (pre-tax + company sponsored)
  • Mental Physical Wellness Stipend
  • Catered Meals on in-office days
  • HQ in Burlingame + hub in NYC + hub in Bangalore
  • Build the company alongside the Founders

*Benefits/perks may vary by state, country and employment type - please reach out to your recruiter for more information.

Galileo is an equal opportunity employer supporting workforce diversity. We do not discriminate on the basis of race, religion, color, national origin, gender identity, sexual orientation, age, marital status, protected veteran status, disability status, or any other unlawful factor.

Galileo is committed to providing any necessary accommodations for individuals with disabilities within our application and interview process. To request accommodation due to a disability, please inform your recruiter.

Galileo is committed to fair and equitable compensation practices. The pay range for this role is listed below and represents the expected salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to job-related skills, depth of experience, relevant certifications and training, and specific work location. The total compensation package for this position may also include eligibility for commission, equity, and company sponsored benefits/perks.