About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About The Role Ray aims to provide a universal API for building distributed applications. To achieve this goal requires a distributed system with high levels of performance and reliability. We're looking for engineers with systems software experience that are interested in contributing to the Ray backend. About The Ray Core Team The Ray Core team develops and maintains the Ray C++ backend (e.g., distributed scheduler, language runtime integration, I/O and memory subsystems). We are responsible for the reliability, scalability, and performance of Ray as well as ensuring that Ray provides the right feature set to support higher level libraries and use cases. The team works on a balance of new features / distributed libraries, test infra improvements, debugging, and longer-term architectural improvements to Ray. A Snapshot Of Projects You Can Work On Optimizing performance of large-scale workloads on Ray Stability and stress testing infrastructure Improving fault tolerance (HA) As Part Of This Role, You Will Develop high quality open source software to simplify distributed programming (Ray) Identify, implement, and evaluate architectural improvements to Ray core Improve the testing process for Ray to make releases as smooth as possible Communicate your work to a broader audience through talks, tutorials, and blog posts We'd Love To Hear From You If Have At least 2 year of relevant work experience Solid background in algorithms, data structures, system design Experience in building scalable and fault-tolerant distributed systems Knowledge of distributed model training and inference (e.g. tensor parallel, pipeline parallel) is preferred Knowledge of GPU programming is preferred Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish Show more Show less
About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About The Role The ML Development Platform team is responsible for creating the suite of tools and services that enable users to create production quality applications using Ray. The product is the user’s primary interface into the world of Anyscale and by building a polished, stable, and well-designed product, we are able to enable a magical developer experience for our users. This team provides the interface for administering Anyscale components including Anyscale workspaces, production and development tools, ML Ops tools and integrations, and more. Beyond the user-facing features, engineers help build out critical pieces of infrastructure and architecture needed to power our platform at scale. With a taste for good products, a willingness to work with and understand the user base, and technical talent to build high quality software, the engineers can help build a delightful experience for our users from new developers learning to use Ray to businesses powering their products on Anyscale. As Part Of This Role You Will Develop a next-gen ML Ops platform and development tooling centered around Ray Build high quality frameworks for accelerating the AI development lifecycle from data preparation to training to production serving Work with a team of leading distributed systems and machine learning experts Communicate your work to a broader audience through talks, tutorials, and blog posts We'd Love To Hear From You If You Have At least 2 years of backend development with a solid background in algorithms, data structures, and system design Experience working with modern machine learning tooling, including PyTorch, MLFlow, data catalogs, etc. Familiarity with technologies such as Python, FastAPI, or SQLAlchemy Motivated people who are excited to build tools to power the next generation of cloud applications! Bonus Points If You Have Experience in building and maintaining open-source projects. Experience in building and operating machine learning infrastructure in production. Experience in building highly available serving systems. A Snapshot Of Projects You Might Work On Full stack work on Anyscale workspaces, debugging and dependency management on Anyscale Development of new ML Ops tooling and capabilities, like dataset management, experiment and lineage tracking, etc. Lead the development of the Anyscale SDK, authentication, etc. Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish Show more Show less
About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About The Role RLlib is an open-source library for reinforcement learning that offers both high scalability and a unified API for a variety of applications. It is used by many high profile gaming and finance companies to build cutting-edge RL based systems. We're looking for software engineers with existing machine learning experience that are interested in continuing to enhance RLlib. We are looking for senior hires as well as less experienced but motivated individuals. We'd Love To Hear From You If You Have Have relevant experience using RLlib or developing RL algorithms Have strong proficiency in Python and PyTorch or Tensorflow. Are excited about working with customers who are applying RL to their own use cases Are excited about working on open source and broadcasting new features to the community As Part Of This Role You Will Develop high quality open source software to simplify reinforcement learning (RLlib) Identify, implement, and evaluate promising new RL algorithms from the literature Improve the testing process for RLlib to make releases as smooth as possible Communicate your work to a broader audience through talks, tutorials, and blog posts Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish Show more Show less
About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. We are looking for a Senior Full-Stack Software Engineer to join our Foundation Team, focused on Enterprise Governance and Security. In this role, you will be pivotal in shaping the future of AI governance by building enterprise-grade tools that redefine security, observability, and integrations at scale. You’ll collaborate closely with users and product teams to deliver impactful solutions that prioritize security, efficiency, and seamless integration. Anyscale is transforming how enterprises leverage AI by harnessing the potential of Generative AI, empowering leaders to adopt and deploy AI responsibly and efficiently. We provide AI platform leaders with critical guardrails—establishing a secure foundation, flexible controls, and seamless integrations—all without compromising developer productivity. Our suite of governance features enables sustainable, scalable AI practices for the modern enterprise, offering comprehensive security, control, observability, and automation at scale. A snapshot of projects you may work on Secure Access and Permissions Systems: Develop robust permission and access control systems that integrate seamlessly with our AI infrastructure. Design and implement SSO (Single Sign-On), RBAC (Role-Based Access Control), IAM, and other essential security features. Cost and Usage Optimization: Build systems for cost tracking, billing, quota management, and budget alerts to optimize resource usage and compliance. Observability and Automation: Ensure high levels of observability and automation within AI and ML-driven applications, enabling scalable and reliable governance. Cross-Functional Collaboration: Partner with users, product managers, and cross-functional teams to understand requirements and deliver solutions that enhance productivity and user experience. We'd love to hear from you if have Educational Background: Bachelor’s or Master’s degree in Computer Science or a related field. Experience: 5+ years in full-stack software engineering, ideally within enterprise SaaS or fintech sectors. Technical Skills: Expertise in SSO, RBAC, IAM, and permission systems. Additional Expertise: Familiar with cost tracking, billing systems, and alerting/notification mechanisms. Soft Skills: Strong problem-solving abilities, meticulous attention to detail, and excellent communication skills. You thrive in collaborative, team-oriented environments and are passionate about building tools that enhance productivity and streamline user experience. Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish Show more Show less
The Customer Support Engineer will play a crucial role in the customers post-sale journey - helping them to onboard, adopt and grow on Anyscale, troubleshooting and resolving open customer tickets and driving consumption. Anyscale is an ever evolving platform and hence will require close co-ordination with our engineering teams to debug complex issues. This is an exciting role for those who are technically curious and passionate about ML/AI, LLM, vLLM and the role of AI in next generation applications. It s an opportunity to make a significant impact in a collaborative, fast-paced environment while building a new segment in this space. In this role, you'll be able to Resolve customer issues and help in their successful adoption of Anyscale platform Be a technical advisor, and internal champion for our key customers Own customer issues end-to-end, from troubleshooting, triaging, escalations and eventual resolution Participate in our follow-the-sun customer support model to ensure continuity in resolving high priority tickets Keep track of open customer bugs and feature requests to influence prioritization and provide timely customer updates upon resolution Contribute towards improvement of internal tools and documentation of playbooks, guides and best practices etc based on observed patterns Habitually provide feedback and collaborate cross-functionally with product and engineering teams to address customer issues with a focus on improving the product experience Build and maintain strong relationships with technical stakeholders within customer accounts Qualifications 5+ years of experience in a customer-facing technical role with 2+ years in a dynamic, fast-paced, startup-like environment Strong organizational skills and ability to manage multiple customer needs simultaneously Experience as a machine learning engineer Experience in training, fine-tuning and inference/serving of LLMs Knowledge in one or more of the major cloud platforms (AWS, GCP or Azure) Excellent communication and interpersonal skills. Strong sense of ownership, self-motivation and eagerness to acquire new skills and do new things Willingness to uplevel the knowledge and skills of your peers through mentorship, trainings and shadowing Bonus Experience with Ray Knowledge of MLOps platforms Familiarity with container orchestration platforms (eg, Kubernetes), infrastructure as code (eg Terraform), CI/CD tools (eg Github Actions)
About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About This Role Anyscale is looking to hire strong engineers to build the developer productivity team. Developer productivity engineering at Anyscale is a unique and challenging role. The core mission is to accelerate the productivity of the engineering organization through innovative technical solutions and strategic technology choices. This role covers the spectrum of open source Ray and the proprietary Anyscale platform as well. Due to the nature of our work being right in the intersection between distributed systems and machine learning, the development and testing of the project naturally brings forth many challenging systems and deployment issues. As Part Of This Role, You May Design and implement developer velocity improvement projects across all engineering teams Define and deliver developer-focused solutions CI/CD tools, build system, automated releases systems that enable scalable development Design, build and maintain core testing infrastructure to ensure that Ray remains an industry-leading scalable and distributed programming runtime and that our proprietary platform remains highly stable and scalable Work with infrastructure teams to influence, develop, and evaluate Anyscale cluster management features Work with the open source Ray team to design and implement distributed testing frameworks and applications to help ensure correctness of the program across operating systems, architecture, and underlying environments We'd Love To Hear From You If You Have At least 2 year of software engineering experience in CI/CD, build systems (Bazel), large-scale systems engineering or distributed systems in a cloud environment Experience with Infrastructure as Code tooling (Terraform, Cloudformation, Pulumi, etc) Experience with AWS cloud infrastructure (EC2, S3, IAM, Docker, etc) Experience with Kubernetes Experience working on programming languages, security, or cloud developer productivity tools is a plus Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About The Role We are seeking a Backend Software Engineer to join our team focused on building user-facing application features for the Anyscale AI platform. The role involves interacting with users, understanding their requirements, designing and implementing features, and finally maintaining and improving these features over time. The backend of the platform generally deals with implementing the core business logic of these features. About The Team The Workspace & Observability Team is dedicated to empowering clients to create robust AI applications using our powerful platform built on Ray. We are a collaborative group of experts committed to providing bespoke monitoring tools and integrations that enhance the development lifecycle. In particular, these tools accelerate the process of writing, debugging, deployment, and monitoring of AI applications. Observability in a distributed cluster can deal with a ton of data. There are a ton of interesting problems to solve around how to ingest, aggregate, format, and ultimately present that data to our users in a digestible way. With Ray and Anyscale, we have the opportunity to provide great tools out of the box for our users. Join us in shaping the future of AI application development! A snapshot of projects you may work on The Ray Dashboard observability tool which gives users insight into their Ray application including what code is running in which machine, how much data is being moved between various machines, and the hardware utilization of each machine. Library-specific observability tools like the Ray Train dashboard or Ray Serve dashboard which accelerates our users ability to develop distributed training or model serving applications. Unified log viewer, a tool that ingests logs across a ray cluster and presents the ability to query those logs in meaningful ways, such as by function name, log level, timestamp, or machine. Anomaly detection. The ability for the Anyscale platform to automatically detect performance bottlenecks or bugs in our users workloads and suggest or automatically fix these issues. Work with a team of leading distributed systems and machine learning experts. Communicate your work to a broader audience through talks, tutorials, and blog posts. Help us to build and shape a world class company. We'd love to hear from you if have Proficiency in backend or full stack development, including experience with web API frameworks and databases. Proficiency in Python or an ability to quickly learn new programming languages. Good understanding of AI and machine learning concepts. Experience with observability tools and monitoring solutions (e.g., Datadog, Splunk, AWS CloudWatch). Familiarity with Ray or similar distributed systems frameworks. Solid background in debugging, architecture design, and coding. Excellent problem-solving skills and a collaborative mindset. Passion for building tools that enhance user experience and optimize workflows. Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
About Anyscale: At Anyscale, the mission is to democratize distributed computing and make it accessible to software developers of all skill levels. The company is commercializing Ray, a popular open-source project that is creating an ecosystem of libraries for scalable machine learning. Ray is utilized by companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more to accelerate the progress of AI applications. Anyscale is focused on building the best platform to run Ray, enabling any developer or data scientist to scale an ML application from their laptop to the cluster without the need to be a distributed systems expert. Backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About The Role: The primary role is to serve as a technical advisor and champion for Anyscale customers with expertise in infrastructure, cloud management, K8, etc. Responsibilities include playing a crucial role in the customers" post-sale journey, helping them to onboard, adopt and grow on Anyscale, troubleshooting and resolving open customer tickets, and driving consumption. This role requires close coordination with engineering teams to debug complex issues. The position offers an exciting opportunity for those who are technically curious and passionate about ML/AI, LLM, vLLM, and the role of AI in next-generation applications. Responsibilities Include: - Being a solutions architect, technical advisor, and internal champion for key customers to successfully onboard and adopt the Anyscale platform - Owning customer issues end-to-end, from troubleshooting, escalations, and resolution - Participating in the follow-the-sun customer support model to ensure continuity in resolving high-priority tickets - Managing current workload state of key customers and identifying new workloads to drive account expansion - Contributing towards the improvement of internal tools, documentation of playbooks, guides, and best practices based on observed patterns - Providing feedback and collaborating cross-functionally with product and engineering teams to address customer issues and improve the product experience - Building and maintaining strong relationships with technical stakeholders within customer accounts Qualifications: - 5+ years of experience in a customer-facing technical role with 2+ years in a dynamic, fast-paced, startup-like environment - Strong organizational skills and ability to manage multiple customer needs simultaneously - Proficiency in deploying and resolving issues within container orchestration platforms (such as Kubernetes) and working with infrastructure as code tools (such as Terraform) - Hands-on experience with major cloud platforms (AWS, GCP, or Azure) - Knowledge of Observability tools (e.g., Grafana) - Excellent communication and interpersonal skills - Strong sense of ownership, self-motivation, and eagerness to acquire new skills - Willingness to uplevel the knowledge and skills of peers through mentorship, training, and shadowing Bonus Qualifications: - Experience with Ray - Knowledge of MLOps platforms in support of ML/AI, Data Engineering, and Data Science teams - Familiarity with container orchestration platforms (e.g., Kubernetes), infrastructure as code (e.g., Terraform), CI/CD tools (e.g., Github Actions) - Knowledge of training, fine-tuning, and inference/serving of LLMs Compensation: Anyscale takes a market-based approach to compensation, being data-driven, transparent, and consistent. The target salary for this role may be adjusted over time based on market data changes. Anyscale Inc. is an E-Verify company, and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish.,
About the Company: At Anyscale, we are dedicated to democratizing distributed computing and making it accessible to software developers of all skill levels. We are commercializing Ray, a popular open-source project that has created a robust ecosystem of libraries for scalable machine learning. Ray is already being utilized by prominent companies like OpenAI, Uber, Spotify, Instacart, Cruise, among others, to accelerate the advancement of AI applications in the real world. With Anyscale, we aim to create the optimal platform for running Ray, enabling any developer or data scientist to scale a machine learning application from their personal laptop to a cluster without requiring expertise in distributed systems. Backed by prestigious investors such as Andreessen Horowitz, NEA, and Addition, Anyscale has raised over $250 million to date. Job Summary: As a Technical Services Engineer at Anyscale, your primary responsibility will be to act as a technical advisor and advocate for Anyscale customers. You will play a pivotal role in guiding customers through their post-sale journey, assisting with onboarding, adoption, and growth on the Anyscale platform. Additionally, you will be tasked with troubleshooting and resolving customer tickets while driving consumption. Given the continuous evolution of the Anyscale platform, close collaboration with our engineering teams will be essential to debug complex issues. This role is ideal for individuals who are passionate about ML/AI, LLM, vLLM, and the impact of AI on next-generation applications. It offers an opportunity to make a significant impact in a collaborative, fast-paced environment while contributing to the development of a new segment in this field. Key Responsibilities: - Serve as a solutions architect, technical advisor, and internal advocate for key customers, facilitating successful onboarding and adoption of the Anyscale platform. - Take ownership of customer issues from start to finish, including troubleshooting, triaging, escalations, and resolution. - Engage in our follow-the-sun customer support model to ensure consistent resolution of high-priority tickets. - Monitor open customer bugs and feature requests to influence prioritization and provide timely updates upon resolution. - Manage the current workload status of key customers and identify new workloads to drive account expansion. - Contribute to the enhancement of internal tools and documentation, such as playbooks, guides, and best practices, based on observed patterns. - Offer feedback and collaborate with product and engineering teams to address customer issues and enhance the product experience. - Cultivate and maintain strong relationships with technical stakeholders within customer accounts. Qualifications: - 5+ years of experience in a customer-facing technical role, with at least 2 years in a dynamic, fast-paced, startup-like environment. - Strong organizational skills and the ability to manage multiple customer needs simultaneously. - Hands-on experience in ML/AI, Data Engineering, and Data Science. - Proficiency in cloud platforms such as AWS, GCP, or Azure. - Excellent communication and interpersonal skills. - Strong sense of ownership, self-motivation, and a willingness to acquire new skills. - Willingness to enhance the knowledge and skills of peers through mentorship, trainings, and shadowing. Bonus Qualifications: - Experience with Ray. - Knowledge of MLOps platforms. - Familiarity with container orchestration platforms (e.g., Kubernetes), infrastructure as code (e.g., Terraform), CI/CD tools (e.g., Github Actions). - Knowledge or training in fine-tuning and inference/serving of LLMs. Compensation: At Anyscale, we adopt a market-based approach to compensation, guided by data-driven, transparent, and consistent practices. The target salary for this role may be adjusted over time to align with market trends. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish.,
About Anyscale At Anyscale, our mission is to democratize distributed computing and make it accessible to software developers of all skill levels. We are commercializing Ray, a popular open-source project that is creating an ecosystem of libraries for scalable machine learning. Many renowned companies such as OpenAI, Uber, Spotify, Instacart, Cruise, and more have integrated Ray into their tech stacks to advance the progress of AI applications in the real world. With Anyscale, we are dedicated to building the optimal platform to run Ray, allowing any developer or data scientist to scale an ML application seamlessly from their laptop to the cluster without the need for expertise in distributed systems. Proudly backed by Andreessen Horowitz, NEA, and Addition with over $250 million raised to date. We are currently seeking a Senior Full-Stack Software Engineer to join our Foundation Team, concentrating on Enterprise Governance and Security. In this role, you will play a crucial part in shaping the future of AI governance by developing enterprise-grade tools that redefine security, observability, and integrations on a large scale. Your collaboration with users and product teams will lead to impactful solutions that prioritize security, efficiency, and seamless integration. Anyscale is revolutionizing how enterprises utilize AI through the power of Generative AI, enabling leaders to adopt and deploy AI responsibly and efficiently. We equip AI platform leaders with essential guardrails, establishing a secure foundation, flexible controls, and seamless integrations, all while enhancing developer productivity. Our suite of governance features facilitates sustainable, scalable AI practices for modern enterprises, providing comprehensive security, control, observability, and automation at scale. Projects you may work on include: - Secure Access and Permissions Systems: Develop robust permission and access control systems that seamlessly integrate with our AI infrastructure. Design and implement SSO (Single Sign-On), RBAC (Role-Based Access Control), IAM, and other critical security features. - Cost and Usage Optimization: Create systems for cost tracking, billing, quota management, and budget alerts to optimize resource usage and compliance. - Observability and Automation: Ensure high levels of observability and automation within AI and ML-driven applications, enabling scalable and reliable governance. - Cross-Functional Collaboration: Collaborate with users, product managers, and cross-functional teams to comprehend requirements and deliver solutions that enhance productivity and user experience. We are interested in hearing from you if you have: - Educational Background: Bachelors or Masters degree in Computer Science or a related field. - Experience: Over 5 years in full-stack software engineering, with a preference for experience in enterprise SaaS or fintech sectors. - Technical Skills: Proficiency in SSO, RBAC, IAM, and permission systems. - Additional Expertise: Knowledge of cost tracking, billing systems, and alerting/notification mechanisms. - Soft Skills: Strong problem-solving abilities, meticulous attention to detail, and excellent communication skills. You excel in collaborative, team-oriented environments and have a passion for creating tools that enhance productivity and streamline user experience. Anyscale Inc. is an E-Verify company, and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish.,
About Anyscale: At Anyscale, our mission is to democratize distributed computing and make it accessible to software developers of all skill levels. We are commercializing Ray, a popular open-source project that is creating an ecosystem of libraries for scalable machine learning. Ray is utilized by companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many others to accelerate the progress of AI applications. With Anyscale, we strive to create the best platform for running Ray, enabling any developer or data scientist to scale an ML application from their laptop to the cluster without requiring expertise in distributed systems. We are proud to be backed by Andreessen Horowitz, NEA, and Addition, with over $250 million raised to date. About The Role: We are looking for a Backend Software Engineer to join our team, focusing on building user-facing application features for the Anyscale AI platform. This role involves interacting with users, understanding their requirements, designing and implementing features, and maintaining and enhancing these features over time. The backend of the platform primarily deals with implementing the core business logic of these features. About The Team: The Workspace & Observability Team is dedicated to empowering clients to develop robust AI applications using our platform built on Ray. We are a collaborative group of experts committed to providing customized monitoring tools and integrations that improve the development lifecycle. Our tools accelerate the process of writing, debugging, deployment, and monitoring of AI applications. There are numerous interesting challenges to tackle in observability within a distributed cluster, including how to handle data ingestion, aggregation, formatting, and presenting data in a user-friendly manner. Join us in shaping the future of AI application development with Ray and Anyscale. Snapshot of projects you may work on: - Developing the Ray Dashboard observability tool to provide users with insights into their Ray applications, including code distribution, data movement between machines, and hardware utilization. - Creating library-specific observability tools like the Ray Train dashboard or Ray Serve dashboard to facilitate the development of distributed training or model serving applications. - Designing a Unified log viewer to ingest and query logs across a Ray cluster by function name, log level, timestamp, or machine. - Implementing anomaly detection to automatically identify performance bottlenecks or bugs in user workloads. - Collaborating with a team of distributed systems and machine learning experts. - Sharing your work through talks, tutorials, and blog posts to engage a broader audience. - Contributing to building a world-class company. Requirements: - Proficiency in backend or full-stack development, with experience in web API frameworks and databases. - Strong skills in Python or the ability to quickly learn new programming languages. - Good understanding of AI and machine learning concepts. - Experience with observability tools and monitoring solutions such as Datadog, Splunk, or AWS CloudWatch. - Familiarity with Ray or similar distributed systems frameworks. - Sound background in debugging, architecture design, and coding. - Excellent problem-solving abilities and a collaborative mindset. - Passion for developing tools that enhance user experience and optimize workflows. Anyscale Inc. is an E-Verify company, and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish.,
About Anyscale At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAI, Uber, Spotify, Instacart, Cruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world. With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. About The Role The Customer Support Engineer will play a crucial role in the customers’ post-sale journey - helping them to onboard, adopt and grow on Anyscale, troubleshooting and resolving open customer tickets and driving consumption. Anyscale is an ever evolving platform and hence will require close co-ordination with our engineering teams to debug complex issues. This is an exciting role for those who are technically curious and passionate about ML/AI, LLM, vLLM and the role of AI in next generation applications. It’s an opportunity to make a significant impact in a collaborative, fast-paced environment while building a new segment in this space. In this role, you’ll be able to Resolve customer issues and help in their successful adoption of Anyscale platform Be a technical advisor, and internal champion for our key customers Own customer issues end-to-end, from troubleshooting, triaging, escalations and eventual resolution Participate in our follow-the-sun customer support model to ensure continuity in resolving high priority tickets Keep track of open customer bugs and feature requests to influence prioritization and provide timely customer updates upon resolution Contribute towards improvement of internal tools and documentation of playbooks, guides and best practices etc. based on observed patterns Habitually provide feedback and collaborate cross-functionally with product and engineering teams to address customer issues with a focus on improving the product experience Build and maintain strong relationships with technical stakeholders within customer accounts Qualifications 5+ years of experience in a customer-facing technical role with 2+ years in a dynamic, fast-paced, startup-like environment Strong organizational skills and ability to manage multiple customer needs simultaneously Experience as a machine learning engineer Experience in training, fine-tuning and inference/serving of LLMs Knowledge in one or more of the major cloud platforms (AWS, GCP or Azure) Excellent communication and interpersonal skills. Strong sense of ownership, self-motivation and eagerness to acquire new skills and do new things Willingness to uplevel the knowledge and skills of your peers through mentorship, trainings and shadowing Bonus Experience with Ray Knowledge of MLOps platforms Familiarity with container orchestration platforms (e.g., Kubernetes), infrastructure as code (e.g. Terraform), CI/CD tools (e.g. Github Actions) Compensation At Anyscale, we take a market-based approach to compensation. We are data-driven, transparent, and consistent. As the market data changes over time, the target salary for this role may be adjusted. Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish