46 Onnx Runtime Jobs

As a Software Engineer at Qualcomm India Private Limited, you will be a part of a leading technology innovator that pushes the boundaries of what's possible to drive digital transformation and enable next-generation experiences for a smarter, connected future. Your primary responsibility will involve designing, developing, modifying, and validating embedded and cloud edge software, applications, and utility programs to launch cutting-edge, world-class products that exceed customer expectations. **Key Responsibilities:** - Collaborate with systems, hardware, architecture, and test engineers to design system-level software solutions - Obtain information on performance requirements and interfac...

As a Machine Learning Systems Architect, your role will involve leading the architecture, development, and deployment of scalable machine learning systems with a focus on real-time inference for LLMs serving multiple concurrent users. You will be responsible for optimizing inference pipelines using high-performance frameworks such as vLLM, Groq, ONNX Runtime, Triton Inference Server, and TensorRT to minimize latency and cost. Your key responsibilities will include: - Designing and implementing agentic AI systems utilizing frameworks like LangChain, AutoGPT, and ReAct for autonomous task orchestration. - Fine-tuning, integrating, and deploying foundation models including GPT, LLaMA, Claude, M...

As a Software Engineer at Qualcomm India Private Limited, you will play a crucial role in designing, developing, modifying, and validating embedded and cloud edge software, applications, and specialized utility programs. Collaborating with systems, hardware, architecture, test engineers, and other teams, you will work on creating cutting-edge products that exceed customer needs. Join the Generative AI team at Qualcomm to integrate advanced GenAI models on Qualcomm chipsets, leveraging the extensive heterogeneous computing capabilities for on-device inference without cloud connectivity. Your role will involve utilizing power-efficient hardware and software stack to run Large Language Models (...

As an AI Scientist at Zudu AI, you will be responsible for designing, building, and optimizing advanced speech and conversational AI models. Your focus will span across various areas including ASR, TTS, LLM fine-tuning, RAG pipelines, and emotion-driven voice synthesis. You will have the opportunity to work with large-scale data, production systems, and next-gen architectures to ensure our AI agents sound truly human. **Key Responsibilities:** - Conduct research and development to develop and fine-tune speech recognition (ASR), text-to-speech (TTS), and natural language understanding (NLU) models. - Build multi-turn conversational AI systems capable of contextual reasoning, grounding, and em...

You are passionate about advancing the field of AI and speech processing. As an AI Scientist at Zudu AI, you will have the opportunity to design, build, and optimize cutting-edge speech and conversational AI models. Your work will involve a wide range of responsibilities, from research and development to system integration and experimentation. **Key Responsibilities:** - **Research & Development** - Develop and fine-tune speech recognition (ASR), text-to-speech (TTS), and natural language understanding (NLU) models. - Build multi-turn conversational AI systems capable of contextual reasoning, grounding, and emotional intelligence. - Explore and implement retrieval-augmented generation (RAG) ...

Company Qualcomm India Private Limited Job Area Engineering Group, Engineering Group > Software Engineering General Summary More details below: Join the exciting Generative AI team at Qualcomm focused on integrating cutting edge GenAI models on Qualcomm chipsets. The team uses Qualcomm chips extensive heterogeneous computing capabilities to allow inference of GenAI models on-device without a need for connection to the cloud. Our inference engine is designed to help developers run neural network models trained in a variety of frameworks on Snapdragon platforms at blazing speeds while still sipping the smallest amount of power. Utilize this power efficient hardware and Software stack to run La...

As a part of the Generative AI team at Qualcomm India Private Limited, you will be working on integrating cutting edge GenAI models on Qualcomm chipsets. The team focuses on leveraging Qualcomm chips" heterogeneous computing capabilities for on-device inference of GenAI models without the need for cloud connection. The inference engine is designed to enable developers to run neural network models trained in various frameworks on Snapdragon platforms efficiently and power-effectively. Your role will involve utilizing the power-efficient hardware and software stack to run Large Language Models (LLMs) and Large Vision Models (LVM) at near GPU speeds. **Responsibilities:** - Spearhead the develo...

As a Software Engineer at Qualcomm India Private Limited, you will play a crucial role in designing, developing, modifying, and validating embedded and cloud edge software to create cutting-edge products that exceed customer expectations. You will collaborate with various teams to design system-level software solutions and gather performance requirements and interfaces information. **Key Responsibilities:** - Spearhead the development and commercialization of the Qualcomm AI Runtime (QAIRT) SDK on Qualcomm SoCs. - Push the performance limits of large models as an AI inferencing expert. - Deploy large C/C++ software stacks using best practices. - Stay updated on GenAI advancements, focusing o...

You will be joining the exciting Generative AI team at Qualcomm, focusing on integrating cutting-edge GenAI models on Qualcomm chipsets. The team utilizes Qualcomm chips" extensive heterogeneous computing capabilities to enable on-device inference of GenAI models without the need for a connection to the cloud. The inference engine is designed to allow developers to run neural network models trained in various frameworks on Snapdragon platforms at high speeds while consuming minimal power. Make use of the power-efficient hardware and software stack to run Large Language Models (LLMs) and Large Vision Models (LVM) at near GPU speeds. **Responsibilities:** - Spearhead the development and commer...

As a Machine Learning Systems Architect, your primary responsibility will be to lead the architecture, development, and deployment of scalable machine learning systems with a focus on real-time inference for Large Language Models (LLMs) to serve multiple concurrent users. To achieve this, you will: - Optimize inference pipelines using high-performance frameworks such as vLLM, Groq, ONNX Runtime, Triton Inference Server, and TensorRT to minimize latency and cost. - Design and implement agentic AI systems using frameworks like LangChain, AutoGPT, and ReAct for autonomous task orchestration. - Fine-tune, integrate, and deploy foundation models like GPT, LLaMA, Claude, Mistral, Falcon, and other...

Role Overview: As a Software Engineer at Qualcomm India Private Limited, you will play a crucial role in designing, developing, modifying, and validating embedded and cloud edge software, applications, and specialized utility programs. Your work will contribute to launching cutting-edge products that exceed customer expectations. Collaboration with systems, hardware, architecture, test engineers, and other teams will be essential to design system-level software solutions based on performance requirements and interfaces. Key Responsibilities: - Spearhead the development and commercialization of the Qualcomm AI Runtime (QAIRT) SDK on Qualcomm SoCs - Push the limits of performance from large Ge...

Lead the architecture, development, and deployment of scalable machine learning systems, focusing on real-time inference for LLMs serving multiple concurrent users. Optimize inference pipelines using high-performance frameworks like vLLM, Groq, ONNX Runtime, Triton Inference Server, and TensorRT to minimize latency and cost. Design and implement agentic AI systems utilizing frameworks such as LangChain, AutoGPT, and ReAct for autonomous task orchestration. Fine-tune, integrate, and deploy foundation models including GPT, LLaMA, Claude, Mistral, Falcon, and others into intelligent applications. Develop and maintain robust MLOps workflows to manage the full model lifecycle including training, ...

We are looking for a Senior Software Engineer who thrives on hands-on coding and problem solving to build the real-time data pipelines and serving systems that power large-scale ML models. You will be directly responsible for designing, coding, and optimizing ETL pipelines, GPU inference serving that ensure models get the freshest data and serve results with millisecond-level latency. This role is ideal for someone who loves to write high-quality production code, profile and debug performance bottlenecks, and ship optimizations at scale, while collaborating closely with applied scientists and other engineers. Microsoft's mission is to empower every person and every organization on the planet...

As a Systems Engineer at Qualcomm India Private Limited, you will be involved in researching, designing, developing, simulating, and validating systems-level software, hardware, architecture, algorithms, and solutions to enable cutting-edge technology development. Collaborating across functional teams, you will work towards meeting and exceeding system-level requirements and standards. **Key Responsibilities:** - **Model Optimization & Quantization** - Optimize deep learning models using quantization techniques such as INT8, INT4, mixed precision, pruning, and knowledge distillation. - Implement Post-Training Quantization (PTQ) and Quantization-Aware Training (QAT) for deployment. - Familiar...

You are a passionate and skilled AI/ML Engineer with 13 years of hands-on experience in computer vision and conversational AI. Your strong foundation in machine learning, experience training custom object detection models (especially using YOLO), and working knowledge of OpenCV and AI/ML frameworks make you an ideal candidate for this role. Exposure to OpenAI's ChatGPT and chatbot development is essential, and any experience in AR/VR will be considered a plus. Key Responsibilities: - Train and deploy custom object detection models using YOLO (v5/v7/v8 or YOLO-NAS) on custom datasets. - Preprocess and annotate data for training using tools like Roboflow or CVAT. - Implement and optimize objec...

Role Overview: You will be part of the System Performance team at Qualcomm India Private Limited, responsible for profiling and optimizing System Performance on Snapdragon Data center chipsets. Your role will require a strong knowledge of AI/ML performance using NPU cores, with additional advantage if you have knowledge of CPU, DDR, and NoCs. Key Responsibilities: - Drive performance analysis on silicon using various System and Cores benchmarks like Dhrystone, GeekBench, SPECInt, CNN/GenAI ML networks. - Utilize performance tools to analyze load patterns across IPs and identify performance bottlenecks in the system. - Analyze Perf KPIs of SoC subsystems like NPU, CPU, Memory, and correlate p...

Role & responsibilities • Lead design and development of the AI/ML compiler toolchain for Ambients ultra-low power AI chips. Build and optimize compiler backends, IR transformations, and runtime systems for AI workloads. Drive model conversion pipelines (TF, TFLite, PyTorch, ONNX Ambient compiler stack). Implement graph-level and operator-level optimizations (fusion, scheduling, memory reuse). Collaborate with hardware and data science teams to co-design hardware-aware compiler strategies. Develop tools for quantization, pruning, mixed precision, and efficient memory allocation. Ensure compiler generates binaries with predictable latency, power, and memory footprint. Define performance metri...

As an AI/ML Engineer, you will be responsible for the following: - 100% hands-on Experience is a must in development and deployment of production-level AI models at enterprise scale. You will be the decision-maker in Build Vs Buy scenarios. - Drive innovation in AI/ML applications across various business domains and modalities such as vision, language, and audio. - Implement Best practices in AI/ML, MLOps, DevOps, and CI/CD for AI/ML projects. - Continuously identify and evaluate emerging tools and technologies in the AI/ML space for potential adoption. Your qualifications should include: - Overall 5 to 7 years of experience, with at least 4 years in AI, ML, and Gen AI technologies. - Proven...

Role Overview: As an MLOps Developer, your primary responsibility will be to design, develop, and maintain complex, high-performance, and scalable MLOps systems that interact with AI models and systems. You will work closely with cross-functional teams, including data scientists, AI researchers, and AI/ML engineers, to understand requirements, define project scope, and ensure alignment with business goals. Additionally, you will provide technical leadership in choosing, evaluating, and implementing software technologies in a cloud-native environment. Troubleshooting intricate software problems and contributing to the development of CI/CD pipelines and high-performance data pipelines will als...

Senior Computer Vision Engineer Panoptyc is seeking an exceptional Senior Computer Vision Engineer to architect and train cutting-edge models for retail object recognition and drive our edge deployment strategy. About The Role You'll be the technical force behind our computer vision capabilities, building and optimizing models that power real-world retail applications. This role demands someone who can move seamlessly from training custom YOLO architectures to deploying optimized models on edge devices, all while pushing the boundaries of what's possible in retail computer vision. What You'll Do Model Development: Design, train, and iterate on custom object detection models specifically tune...

As a Qualcomm Systems Engineer, you will be responsible for researching, designing, developing, simulating, and validating systems-level software, hardware, architecture, algorithms, and solutions to enable the development of cutting-edge technology. You will collaborate across functional teams to meet and exceed system-level requirements and standards. Key Responsibilities: - Model Optimization & Quantization - Optimize deep learning models using quantization (INT8, INT4, mixed precision, etc.), pruning, and knowledge distillation. - Implement Post-Training Quantization (PTQ) and Quantization-Aware Training (QAT) for deployment. - Familiarity with TensorRT, ONNX Runtime, OpenVINO, TVM. - AI...

About Zscaler Serving thousands of enterprise customers around the world including 45% of Fortune 500 companies, Zscaler (NASDAQ: ZS) was founded in 2007 with a mission to make the cloud a safe place to do business and a more enjoyable experience for enterprise users. As the operator of the world's largest security cloud, Zscaler accelerates digital transformation so enterprises can be more agile, efficient, resilient, and secure. The pioneering, AI-powered Zscaler Zero Trust Exchange platform, which is found in our SASE and SSE offerings, protects thousands of enterprise customers from cyberattacks and data loss by securely connecting users, devices, and applications in any location. Named ...

As a Perception Engineering Intern / Apprentice at 10xConstruction, you will help our autonomous drywall-finishing robots see the job-site. You'll design and deploy perception pipelinescamera + LiDAR fusion, deep-learning vision models, and point-cloud geometryto give the robot the awareness it needs. Key Responsibilities Build ROS 2 nodes for 3-D point-cloud ingestion, filtering, voxelisation and wall-plane extraction (PCL / Open3D) Train and integrate CNN / Transformer models for surface-defect detection and semantic segmentation Implement RANSAC-based pose, plane and key-point estimation; refine with ICP or Kalman/EKF loops Fuse LiDAR, depth camera, IMU and wheel odometry data for robust ...

Experience : 3 to 6 Years Notice Period : Immediate or Less than 1 Month Location : Bangalore Key Responsibilities Model conversion pipelines (e.g., PyTorch ONNX) Inference runtimes : ONNX Runtime, TensorRT, ROCm/HIP Toolchains and compilers like TVM, XLA, Vitis AI, XDNA Kernel execution, memory transfer, and result validation Profile ML workloads and optimize for performance. Work on validation plans across software lifecycle stages. Collaborate with cross-functional and global teams on end-to-end AI/ML pipeline validation. Required Skills Strong hands-on experience with Linux (Ubuntu) and Yocto. Solid understanding of machine learning concepts : deep learning, LLMs, recommender systems. Pr...

Role Overview: As a Qualcomm Systems Engineer, you will be part of the AI SW team focused on advancing Artificial Intelligence across various business segments like Mobile, AR & VR Technology, IoT, and Auto ADAS. Your role will involve designing, developing, and implementing AI/ML solutions, collaborating with cross-functional teams, mentoring junior engineers, optimizing AI models, conducting research on industry trends, and managing project timelines efficiently. Your work will directly impact billions of devices worldwide. Key Responsibilities: - Lead the design, development, and implementation of AI/ML solutions across multiple domains. - Collaborate with cross-functional teams for seaml...