6 Ab Experiments Jobs

Design and execute test strategies for Gen AI models including LLMs image generators and multimodal systems Create and maintain test cases and prompt libraries to evaluate model output quality eg relevance coherence creativity factual accuracy Test model behaviour across different scenarios languages and user intents eg hallucinations bias toxicity safety risks Perform manual and automated testing of Gen AI APIs chatbots and content generation tools Validate input output behaviour prompt testing response evaluation token level analysis Collaborate with engineering teams to implement prompt evaluation frameworks log monitoring and output scoring systems Track model performance metrics BLEU RO...

As an Analyst/Sr. Analyst (Programmatic Campaign Management) at Affle, you will be joining the mDSP Growth team in Gurgaon. The team is dedicated to developing and executing advanced growth strategies for mobile companies worldwide. Your role will involve iterating and conducting A/B experiments on key campaign components such as audiences and creatives to achieve outstanding results for our customers. **Role Overview:** You will be responsible for planning, executing, and optimizing mobile marketing campaigns using mDSP's ML programmatic tools. Working closely with the Customer Success Manager, you will align mDSP campaigns with customers" business goals, provide regular feedback on campaig...

Your main responsibility as a Data Platform Engineer at GlobalLogic will be to bridge marketing strategy to scaled activation through the following ways: - Architect ML-based solutions in collaboration with DS teams, software engineering teams, and Product teams. - Translate data science prototypes into production services with clear APIs, SLAs/SLOs, and acceptance criteria in high-volume, low-latency contexts (e.g., AdTech). - Design, build, and operate batch/streaming feature pipelines with schema control, validation, lineage, and offline/online parity using Python, Airflow/Composer, Kafka, and BigQuery; leveraging Spark, MySQL, and Redis as needed. - Implement reproducible ML training wor...

As a Scientist at Uber Eats, you will play a crucial role in the Search Team, dedicated to enhancing the search experience for millions of users across the globe. Your expertise in data analysis, machine learning, and statistical modeling will be instrumental in improving search algorithms, thereby increasing user satisfaction and operational efficiency. Key Responsibilities: - Conduct in-depth analyses of extensive datasets to uncover trends, patterns, and opportunities for enhancing search performance. - Develop, implement, and optimize search algorithms to elevate the relevance and precision of search results. - Guide and supervise junior ICs, contributing significantly to various aspects...

Role Overview: As a Data Scientist at EbizON, you will be responsible for analyzing complex datasets, developing data-driven models, and generating actionable insights to support strategic decision-making. You will collaborate with cross-functional teams to design and implement predictive models and machine learning solutions. The ideal candidate for this role is highly analytical, detail-oriented, and passionate about leveraging data to drive innovation and business growth. Key Responsibilities: - Data Modeling & Analysis: Design and develop models to analyze speech, text, and interaction data, including preprocessing pipelines, feature engineering, and outcome evaluation. - Machine Learnin...

You will be joining the mDSP Growth team as an Analyst/Sr. Analyst for Programmatic Campaign Management based in Gurgaon. The Growth team focuses on implementing advanced growth strategies to assist mobile companies worldwide in achieving their objectives through iterative A/B experiments on key campaign components like audiences and creatives. If you have experience on the advertiser side or with DSP and are eager to apply your knowledge while gaining industry insights, this opportunity might be a perfect fit for you. Your primary responsibilities will include planning, executing, and optimizing mobile marketing campaigns using mDSP's ML programmatic tools. Collaborating with the Customer S...