About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About The Role Ray aims to provide a universal API for building distributed applications. To achieve this goal requires a distributed system with high levels of performance and reliability. We're looking for engineers with systems software experience that are interested in contributing to the Ray backend. About The Ray Core Team The Ray Core team develops and maintains the Ray C++ backend (e.g., distributed scheduler, language runtime integration, I/O and memory subsystems). We are responsible for the reliability, scalability, and performance of Ray as well as ensuring that Ray provides the right feature set to support higher level libraries and use cases. The team works on a balance of new features / distributed libraries, test infra improvements, debugging, and longer-term architectural improvements to Ray. A Snapshot Of Projects You Can Work On Optimizing performance of large-scale workloads on Ray Stability and stress testing infrastructure Improving fault tolerance (HA) As Part Of This Role, You Will Develop high quality open source software to simplify distributed programming (Ray) Identify, implement, and evaluate architectural improvements to Ray core Improve the testing process for Ray to make releases as smooth as possible Communicate your work to a broader audience through talks, tutorials, and blog posts We'd Love To Hear From You If Have At least 2 year of relevant work experience Solid background in algorithms, data structures, system design Experience in building scalable and fault-tolerant distributed systems Knowledge of distributed model training and inference (e.g. tensor parallel, pipeline parallel) is preferred Knowledge of GPU programming is preferred Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish Show more Show less

About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About The Role The ML Development Platform team is responsible for creating the suite of tools and services that enable users to create production quality applications using Ray. The product is the user’s primary interface into the world of Anyscale and by building a polished, stable, and well-designed product, we are able to enable a magical developer experience for our users. This team provides the interface for administering Anyscale components including Anyscale workspaces, production and development tools, ML Ops tools and integrations, and more. Beyond the user-facing features, engineers help build out critical pieces of infrastructure and architecture needed to power our platform at scale. With a taste for good products, a willingness to work with and understand the user base, and technical talent to build high quality software, the engineers can help build a delightful experience for our users from new developers learning to use Ray to businesses powering their products on Anyscale. As Part Of This Role You Will Develop a next-gen ML Ops platform and development tooling centered around Ray Build high quality frameworks for accelerating the AI development lifecycle from data preparation to training to production serving Work with a team of leading distributed systems and machine learning experts Communicate your work to a broader audience through talks, tutorials, and blog posts We'd Love To Hear From You If You Have At least 2 years of backend development with a solid background in algorithms, data structures, and system design Experience working with modern machine learning tooling, including PyTorch, MLFlow, data catalogs, etc. Familiarity with technologies such as Python, FastAPI, or SQLAlchemy Motivated people who are excited to build tools to power the next generation of cloud applications! Bonus Points If You Have Experience in building and maintaining open-source projects. Experience in building and operating machine learning infrastructure in production. Experience in building highly available serving systems. A Snapshot Of Projects You Might Work On Full stack work on Anyscale workspaces, debugging and dependency management on Anyscale Development of new ML Ops tooling and capabilities, like dataset management, experiment and lineage tracking, etc. Lead the development of the Anyscale SDK, authentication, etc. Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish Show more Show less

About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About The Role RLlib is an open-source library for reinforcement learning that offers both high scalability and a unified API for a variety of applications. It is used by many high profile gaming and finance companies to build cutting-edge RL based systems. We're looking for software engineers with existing machine learning experience that are interested in continuing to enhance RLlib. We are looking for senior hires as well as less experienced but motivated individuals. We'd Love To Hear From You If You Have Have relevant experience using RLlib or developing RL algorithms Have strong proficiency in Python and PyTorch or Tensorflow. Are excited about working with customers who are applying RL to their own use cases Are excited about working on open source and broadcasting new features to the community As Part Of This Role You Will Develop high quality open source software to simplify reinforcement learning (RLlib) Identify, implement, and evaluate promising new RL algorithms from the literature Improve the testing process for RLlib to make releases as smooth as possible Communicate your work to a broader audience through talks, tutorials, and blog posts Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish Show more Show less

About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. We are looking for a Senior Full-Stack Software Engineer to join our Foundation Team, focused on Enterprise Governance and Security. In this role, you will be pivotal in shaping the future of AI governance by building enterprise-grade tools that redefine security, observability, and integrations at scale. You’ll collaborate closely with users and product teams to deliver impactful solutions that prioritize security, efficiency, and seamless integration. Anyscale is transforming how enterprises leverage AI by harnessing the potential of Generative AI, empowering leaders to adopt and deploy AI responsibly and efficiently. We provide AI platform leaders with critical guardrails—establishing a secure foundation, flexible controls, and seamless integrations—all without compromising developer productivity. Our suite of governance features enables sustainable, scalable AI practices for the modern enterprise, offering comprehensive security, control, observability, and automation at scale. A snapshot of projects you may work on Secure Access and Permissions Systems: Develop robust permission and access control systems that integrate seamlessly with our AI infrastructure. Design and implement SSO (Single Sign-On), RBAC (Role-Based Access Control), IAM, and other essential security features. Cost and Usage Optimization: Build systems for cost tracking, billing, quota management, and budget alerts to optimize resource usage and compliance. Observability and Automation: Ensure high levels of observability and automation within AI and ML-driven applications, enabling scalable and reliable governance. Cross-Functional Collaboration: Partner with users, product managers, and cross-functional teams to understand requirements and deliver solutions that enhance productivity and user experience. We'd love to hear from you if have Educational Background: Bachelor’s or Master’s degree in Computer Science or a related field. Experience: 5+ years in full-stack software engineering, ideally within enterprise SaaS or fintech sectors. Technical Skills: Expertise in SSO, RBAC, IAM, and permission systems. Additional Expertise: Familiar with cost tracking, billing systems, and alerting/notification mechanisms. Soft Skills: Strong problem-solving abilities, meticulous attention to detail, and excellent communication skills. You thrive in collaborative, team-oriented environments and are passionate about building tools that enhance productivity and streamline user experience. Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish Show more Show less

The Customer Support Engineer will play a crucial role in the customers post-sale journey - helping them to onboard, adopt and grow on Anyscale, troubleshooting and resolving open customer tickets and driving consumption. Anyscale is an ever evolving platform and hence will require close co-ordination with our engineering teams to debug complex issues. This is an exciting role for those who are technically curious and passionate about ML/AI, LLM, vLLM and the role of AI in next generation applications. It s an opportunity to make a significant impact in a collaborative, fast-paced environment while building a new segment in this space. In this role, you'll be able to Resolve customer issues and help in their successful adoption of Anyscale platform Be a technical advisor, and internal champion for our key customers Own customer issues end-to-end, from troubleshooting, triaging, escalations and eventual resolution Participate in our follow-the-sun customer support model to ensure continuity in resolving high priority tickets Keep track of open customer bugs and feature requests to influence prioritization and provide timely customer updates upon resolution Contribute towards improvement of internal tools and documentation of playbooks, guides and best practices etc based on observed patterns Habitually provide feedback and collaborate cross-functionally with product and engineering teams to address customer issues with a focus on improving the product experience Build and maintain strong relationships with technical stakeholders within customer accounts Qualifications 5+ years of experience in a customer-facing technical role with 2+ years in a dynamic, fast-paced, startup-like environment Strong organizational skills and ability to manage multiple customer needs simultaneously Experience as a machine learning engineer Experience in training, fine-tuning and inference/serving of LLMs Knowledge in one or more of the major cloud platforms (AWS, GCP or Azure) Excellent communication and interpersonal skills. Strong sense of ownership, self-motivation and eagerness to acquire new skills and do new things Willingness to uplevel the knowledge and skills of your peers through mentorship, trainings and shadowing Bonus Experience with Ray Knowledge of MLOps platforms Familiarity with container orchestration platforms (eg, Kubernetes), infrastructure as code (eg Terraform), CI/CD tools (eg Github Actions)

About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About This Role Anyscale is looking to hire strong engineers to build the developer productivity team. Developer productivity engineering at Anyscale is a unique and challenging role. The core mission is to accelerate the productivity of the engineering organization through innovative technical solutions and strategic technology choices. This role covers the spectrum of open source Ray and the proprietary Anyscale platform as well. Due to the nature of our work being right in the intersection between distributed systems and machine learning, the development and testing of the project naturally brings forth many challenging systems and deployment issues. As Part Of This Role, You May Design and implement developer velocity improvement projects across all engineering teams Define and deliver developer-focused solutions CI/CD tools, build system, automated releases systems that enable scalable development Design, build and maintain core testing infrastructure to ensure that Ray remains an industry-leading scalable and distributed programming runtime and that our proprietary platform remains highly stable and scalable Work with infrastructure teams to influence, develop, and evaluate Anyscale cluster management features Work with the open source Ray team to design and implement distributed testing frameworks and applications to help ensure correctness of the program across operating systems, architecture, and underlying environments We'd Love To Hear From You If You Have At least 2 year of software engineering experience in CI/CD, build systems (Bazel), large-scale systems engineering or distributed systems in a cloud environment Experience with Infrastructure as Code tooling (Terraform, Cloudformation, Pulumi, etc) Experience with AWS cloud infrastructure (EC2, S3, IAM, Docker, etc) Experience with Kubernetes Experience working on programming languages, security, or cloud developer productivity tools is a plus Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish

About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About The Role We are seeking a Backend Software Engineer to join our team focused on building user-facing application features for the Anyscale AI platform. The role involves interacting with users, understanding their requirements, designing and implementing features, and finally maintaining and improving these features over time. The backend of the platform generally deals with implementing the core business logic of these features. About The Team The Workspace & Observability Team is dedicated to empowering clients to create robust AI applications using our powerful platform built on Ray. We are a collaborative group of experts committed to providing bespoke monitoring tools and integrations that enhance the development lifecycle. In particular, these tools accelerate the process of writing, debugging, deployment, and monitoring of AI applications. Observability in a distributed cluster can deal with a ton of data. There are a ton of interesting problems to solve around how to ingest, aggregate, format, and ultimately present that data to our users in a digestible way. With Ray and Anyscale, we have the opportunity to provide great tools out of the box for our users. Join us in shaping the future of AI application development! A snapshot of projects you may work on The Ray Dashboard observability tool which gives users insight into their Ray application including what code is running in which machine, how much data is being moved between various machines, and the hardware utilization of each machine. Library-specific observability tools like the Ray Train dashboard or Ray Serve dashboard which accelerates our users ability to develop distributed training or model serving applications. Unified log viewer, a tool that ingests logs across a ray cluster and presents the ability to query those logs in meaningful ways, such as by function name, log level, timestamp, or machine. Anomaly detection. The ability for the Anyscale platform to automatically detect performance bottlenecks or bugs in our users workloads and suggest or automatically fix these issues. Work with a team of leading distributed systems and machine learning experts. Communicate your work to a broader audience through talks, tutorials, and blog posts. Help us to build and shape a world class company. We'd love to hear from you if have Proficiency in backend or full stack development, including experience with web API frameworks and databases. Proficiency in Python or an ability to quickly learn new programming languages. Good understanding of AI and machine learning concepts. Experience with observability tools and monitoring solutions (e.g., Datadog, Splunk, AWS CloudWatch). Familiarity with Ray or similar distributed systems frameworks. Solid background in debugging, architecture design, and coding. Excellent problem-solving skills and a collaborative mindset. Passion for building tools that enhance user experience and optimize workflows. Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish