About AION
AION is building an interoperable AI cloud platform by transforming the future of high-performance computing (HPC) through its decentralized AI cloud. Purpose-built for bare-metal performance, AION democratizes access to compute and provides managed services, aiming to be an end-to-end AI lifecycle platform—taking organizations from data to deployed models using its forward-deployed engineering approach.AI is transforming every business around the world, and the demand for compute is surging like never before. AION thrives to be the gateway for dynamic compute workloads by building integration bridges with diverse data centers around the world and re-inventing the compute stack via its state-of-the-art serverless technology. We stand at the crossroads where enterprises are finding it hard to balance AI adoption with security. At AION, we take enterprise security and compliance very seriously and are re-thinking every piece of infrastructure from hardware and network packets to API interfaces.Led by high-pedigree founders with previous exits, AION is well-funded by major VCs with strategic global partnerships. Headquartered in the US with global presence, the company is building its initial core team in India.
Who You Are
You're a solid engineer with 2-4 years of experience building backend systems and platform infrastructure. You write clean, well-abstracted code with proper design patterns and comprehensive test coverage. You're comfortable working on both the Compute Platform (multi-cloud orchestration, resource management) and Inference Platform (model serving, autoscaling) under the guidance of senior engineers and platform leads.You have strong proficiency in Golang and understand how to build maintainable, production-grade distributed systems. You take pride in code quality, enjoy collaborating on low-level designs, and are eager to learn from experienced engineers while contributing meaningfully to critical infrastructure components.You're product-minded—you understand how your technical decisions impact developers using AION's platform and think about the end-to-end user experience. You're a team player comfortable wearing multiple hats—one day you're building product features, the next you're joining customer calls to understand their deployment challenges, and the day after you're helping with UI/UX, customer success, documentation and product ops.
Requirements
What You'll Do
Platform Development & Implementation
- Build and maintain platform services across AION's Compute and Inference platforms, working closely with senior engineers and platform leads
- Implement features for multi-cloud orchestration, resource scheduling, model deployment pipelines, and autoscaling systems
- Write well-maintained, production-grade code with proper abstractions, design patterns, and comprehensive test coverage
- Contribute to low-level design (LLD) including service APIs, database schema design, data models, and component interactions
- Collaborate with senior engineers on high-level design discussions, providing implementation perspectives and feasibility inputs
Backend Systems & Distributed Infrastructure
- Develop RESTful APIs and gRPC services for platform control planes, resource management, and inference serving
- Design and implement database schemas for storing platform state, resource metadata, billing data, and observability metrics
- Work with distributed storage systems, message queues (Kafka, RabbitMQ), and databases (PostgreSQL, Redis) to build reliable platform components
- Build event-driven architectures for asynchronous processing, job scheduling, and platform automation
- Implement monitoring, logging, and alerting for platform services to ensure production reliability
Code Quality & Engineering Excellence
- Write comprehensive unit tests, integration tests, and end-to-end tests to ensure code reliability
- Participate in code reviews, providing constructive feedback and learning from senior engineers' perspectives
- Refactor existing code to improve maintainability, performance, and scalability
- Document design decisions, API specifications, and operational runbooks for platform services
- Debug production issues and contribute to incident response and post-mortems
Technical Skills & Experience
If you are meeting some of these requirements and feel comfortable catching up on others, we definitely recommend you to apply:
- 2-4 years of experience in backend engineering, platform development, or distributed systems
- Strong proficiency in Golang—you write idiomatic Go code with proper error handling, concurrency patterns, and testing
- Solid understanding of backend systems fundamentals: RESTful APIs, microservices architecture, and API design principles
- Hands-on experience with databases (PostgreSQL, MySQL) including schema design, query optimization, and transactions
- Familiarity with storage systems (object storage like S3, block storage, distributed file systems) and their use cases
- Experience working with message queues (Kafka, RabbitMQ, NATS) and event-driven architectures
- Understanding of distributed systems concepts: consensus, eventual consistency, fault tolerance, and retry mechanisms
- Experience with containerization (Docker) and basic Kubernetes concepts
- Knowledge of testing frameworks and practices (unit tests, integration tests, mocking)
- Familiarity with Git, CI/CD pipelines, and modern development workflows
- Exposure to cloud platforms (AWS/GCP/Azure) and their core services is a plus
- Experience with infrastructure-as-code (Terraform) or observability tools (Prometheus, Grafana) is beneficial
Bonus / Good to Have
Having expertise in one or more of these specializations is highly desired:
- HPC & Cluster Management: Experience handling large-scale HPC clusters using Kubernetes and Slurm for job scheduling, resource allocation, and workload orchestration
- Data Engineering: Expertise with data pipelines, ETL systems, and large-scale data processing frameworks
- Systems-Level Programming: Experience with low-level systems programming such as storage systems, Kubernetes operators, OS-level software development, or daemon services (llm-d, system agents)
- ML Platform Engineering: Experience productionizing ML pipelines, batch job orchestration, model fine-tuning workflows, and Jupyter notebook orchestration systems
Enterprise Deployment: Experience platformizing and packaging software for on-premises deployments or customer VPC installations with emphasis on security, compliance, and operational simplicity
Benefits
Preferred Attributes:
- Founder-level ownership and bias for action
- Strong strategic thinking and ability to connect technical decisions to business impact
- Excellent communication and mentoring skills
- Thrives in ambiguity, fast-paced environments, and early-stage startup culture
Why Join AION?
- Work directly with high-pedigree founders shaping technical and product strategy
- Build infrastructure powering the future of AI compute globally
- Significant ownership and impact with equity reflective of your contributions
- Competitive compensation, flexible work options, and wellness benefits
Apply Now:
If you're a strong engineer ready to lead architecture and scale next-generation AI infrastructure, we want to hear from you. Please share:
- Your resume highlights relevant projects and leadership experience
- Links to products, code, or demos you've built
A brief note on why AION's mission excites you.designs, and building reliable distributed systems that power AI workloads at scale.
