Job
Description
OCI Generative AI is a managed service offering which seamlessly integrate LLMs into a wide range of enterprise use cases. The OCI Generative AI service supports Meta s Llama and Cohere models, together with a multilingual embedding capability for over 100 languages. The service makes it easier to work with LLMs with functionality such as LangChain integration, endpoint management, and content moderation. OCI Generative AI includes an improved GPU cluster management experience with multi-endpoint support to host clusters, the ability to handle more model requests by scaling clusters, and endpoint analytics. The OCI Generative AI service also offers flexible fine-tuning available for Cohere models. As a result, enterprises can continue to feel confident that their AI precisely fits their specific business context. With the OCI Generative AI service, customers can tackle a variety of use cases including: Customer operations : Automating customer service based on a customer s product suite, experience, and language. Marketing : Mass personalization of search, outreach, and customer nurture based on buyer profile and purchase history. Sales : Creating virtual sales representatives that guide prospects through offerings during a business transaction Risk and legal : Accelerating contract writing and drafting based on existing best practices, with multilingual support. Strategy and finance : At scale monitoring of competitors and updates from customers, across public and private sources. Your Opportunity: As we innovate to provide a complete, end-to-end platform for generative AI, with advanced security, best-in-class data management, and a comprehensive portfolio of cloud applications able to address any business problem, we will be extremely happy to have you join us and share the very future of our Generative AI platform by building a cloud native Generative AI service. Our vision is to provide a world-class Generative AI experience on Oracle Cloud. Aggressive as it might sound, our growth journey is fuelled by highly energetic, technology savvy engineers like YOU who are looking to grow with us to meet the demands of building a powerful next-generation platform. Are you ready to do something big Qualifications Bachelor s or master s degree or equivalent experience (preferred) in Computer Science, Computer Engineering, or related technical field. 10+ years overall experience in software development, with at least 4 years designing developing distributed systems in cloud Expert in at least one high level language such as Java/C#/C++ (Java preferred) Expert in at least one scripting language such as Python, JavaScript, Shell (Python and JavaScript preferred) Proficiency in at least one UI framework, e.g., react JS, angular will be an added advantage Practical experience in design, implementation and production deployment of distributed systems using microservices architecture and API s using common frameworks like Spring Boot (Java), Vertex.io etc Working knowledge of current techniques and approaches in machine learning and statistical or mathematical models Practical experience working in a cloud environment: Oracle Cloud (OCI), AWS, GCP, Azure Experience or willingness to learn and work in Agile and iterative development and DevOps processes. Strong drive to learn and master new technologies and techniques. Deep understanding of data structures, algorithms, and excellent problem-solving skills. Additional Preferred Qualifications Experience with Cloud Native Frameworks, tools and products is a plus Knowledge and experience with Large Language models, GPU clusters, vLLM, ONNX and related concepts ML Engineering experience As a principal member of the software engineering division, you will participate in all activities of development and operations of OCI Generative AI Service. Design Develop Generative AI services and enterprise specific services around Generative AI with best-in-class security for customers. Prepare component or API design based on OCI standards; work on SDK and API specification Review detailed design, code and tests of peer / junior developers Provide work estimates, inputs and support managers in planning execution Guide peer / junior developers in all aspects of work Contribute to hiring by being part of technical interview panel Develop scalable infrastructure, including microservices and backend for UI, dashboards and other interactive applications. Deploy and scale Gen AI model on OKE cluster. Maintain OCI s Generative AI offerings in production and provide on-call monitoring support to customers Troubleshoot, mitigate and resolve issues and incidents in production using runbooks, contribute to runbooks and present in operations review forums Work with applied scientists and peer SW engineers to build out other parts of the infrastructure, effectively communicating your needs and understanding theirs and address external and internal shareholder s product challenges.
