Software Engineer II

Do you want to fine-tune OpenAI’s most advanced models on Azure — working with GPT-4.1, GPT-5, and beyond? From supervised fine-tuning (SFT) to reinforcement learning methods like DPO and others, this role puts you hands-on with the techniques shaping the future of AI.

On this team, you’ll play a key role in improving the performance and reliability of customizing some of the world’s most advanced AI models. You’ll gain hands-on experience with fine-tuning workflows, experimenting with reinforcement learning techniques, and applying advanced optimization strategies that directly impact product quality. You’ll also work directly with the training code, debug complex behaviors, and sharpen the skills that make cutting-edge models more reliable and effective. The models you help shape will power critical workloads at some of the world’s leading companies.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more, and we’re dedicated to this mission across every aspect of our company. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world.

• 5+ years of experience writing production code in building internet scale services and distributed systems.
• Engineering knowledge of machine learning systems and data pipelines.
• Experience mentoring other developers, working partners and being a team player.
• Excellent communication and presentation skills

Required:

• Ability to debug, read code and work in a large codebase.

Responsibilities:

Coding

• Supports efforts to use debugging, tests, tools, logs, telemetry, and other methods to proactively verify assumptions before issues occur for product features in production. Conducts incident retrospectives to identify root causes of problems, implements repair actions, and identifies mechanisms to prevent incident recurrence with minimal supervision. Under minimal guidance, applies least-access principles, and uses logging, telemetry, and other appropriate mechanisms to investigate issues while retaining privacy and security.
• Reviews product feature code and test code to ensure it meets team standards, contains the correct test coverage, and is appropriate for the product feature. Contributes to bringing insight to code reviews to help improve code quality, coaching and providing feedback to develop other engineers' skills with minimal guidance. Contributes to code reviews in a timely fashion that helps accelerate the pace of development on the team. Considers diagnosability, reliability, testability, and maintainability when reviewing code and understands when code is ready to be shared or delivered. Applies and reviews for coding patterns, security risks, compliance issues, and best practices in code reviews. Uses automated source code analysis tools that are incorporated into the build/development process with minimal supervision.
• Creates and implements code for a product, service, or feature, reusing code as applicable with minimal supervision. Writes and learns to create code that is extensible and maintainable. Considers diagnosability, reliability, and maintainability with few defects, and understands when the code is ready to be shared and delivered. Applies coding patterns and best practices to write code (e.g., leveraging state-of-the-art generative artificial intelligence [GenAI], approaches to source code organization, naming conventions). Escalates identified blockers or unknowns during the development process, communicates how they will impact timelines, and contributes to identifying strategies and/or opportunities to address them with minimal supervision.

Design

• Understands and provides feedback for proposals for architecture, with technical leadership from others. With minimal supervision, tests and explores various design options for a product/solution feature, outlining strengths and weaknesses of each option. Collaborates with architects with minimal supervision to build and modify a product/solution feature, providing feedback as needed. Begins to own or collaborate with other engineers on the architecture of solutions, following technical leadership as applicable. Contributes to the development of design documents that support user stories and other product requirements with oversight. Develops an awareness of the current technology landscape. Escalates and shares findings from investigations with the team and owns some design decisions. Helps to ensure system architecture and individual designs meet performance, scalability, resiliency, cost of goods sold (COGS), and other requirements and expectations. Upholds Microsoft standards of security, privacy, and other compliance requirements and expectations. Understands the importance of building solutions that expand upon the work of others. Contributes to the refinement of product features by escalating findings from analyses to inform decisions regarding the engineering of products.
• Creates a clear test strategy that ensures solution quality, prevents regression from being introduced into existing code with minimal supervision. Executes test plans that incorporate security testing to validate security invariants (including negative cases) with minimal supervision. Adds new tests to cover gaps, deleting or fixing broken tests, improving the speed, reliability, and defect localization of tests in the feature area. Builds testable code and considers testability during design for a set of features with minimal guidance. Understands the different types of tests that can be done on a particular system (e.g., unit tests), and maintains up-to-date understanding of testing architectures used both across Microsoft and across the industry. Leverages artificial intelligence (AI) tools for test automation with minimal supervision.

Engineering Excellence

• Contributes to the identification of requirements for, and development of automation within production and deployment of a complex product feature, targeting zero-touch deployment when possible. Runs code in simulated, or other non-production environments to confirm functionality and error-free runtime for products with little to no oversight.
• Applies best practices to build code based on well-established methods and secure design principles while also applying best practices for new code development and formal validation of security invariants. Follows best practices for product development and scaling to customer requirements, and applies best practices for meeting scaling needs and performance expectations and security promises.