Senior Data Scientist Engineer

So, what s the role all about

The Prompt Engineer partners with global development teams to help diagnose and resolve prompt-based issues. This includes helping to define and execute tests for LLM-based systems that are difficult to evaluate with traditional test automation tools. The Prompt Engineer also helps educate the development teams on advances in prompt engineering and helps update production prompts to evolving industry best practices.

How will you make an impact

Regularly review production metrics and specific problem cases to find opportunities for improvement.

Help diagnose and resolve issues with production prompts in English.

Refine prompts to generative AI systems to achieve customer goals.

Collect and present quantitative analysis on solution success.

Work with application developers to implement new production monitoring tools and metrics.

Work with architects and Product Managers to implement prompts to support new features.

Meet regularly with teams working in United States Mountain and Pacific time zones (UTC-7:00 and UTC-8:00).

Review new prompts and prompt changes with Machine Learning Engineers.

Consult with Machine Learning Engineers for more challenging problems.

Stay informed about new advances in prompt engineering.

Have you got what it takes

BS in technology-related field such as computer science, business intelligence/analytics, or finance.

5- 7 years work experience in a technology-related industry or position.

Familiarity with best practices in prompt engineering, to include differences in prompts between major LLM vendors.

Ability to develop and maintain good working relationships with cross-functional teams.

Ability to clearly communicate and present to internal and external stakeholders.

Experience with Python and at least one web app framework for prototyping, e. g. , Streamlit or Flask.

What s in it for you

Enjoy NiCE-FLEX!

Requisition ID: 7815Reporting into: