Job
Description
As a Platform Engineer/Architect at our company, you will play a crucial role in designing, implementing, and maintaining a robust on-premise environment for hosting open-source large language models. Your contributions will directly impact the efficiency, security, and scalability of the infrastructure. Here's how you will contribute and what you will learn: - Design and architect a scalable and secure on-premise hosting environment for large language models. - Develop and implement infrastructure automation tools for efficient management and deployment. - Ensure high availability and disaster recovery capabilities. - Optimize the hosting environment for maximum performance and efficiency. - Implement monitoring tools to track system performance and resource utilization. - Regularly update the infrastructure to incorporate the latest technological advancements. - Establish robust security protocols to protect sensitive data and model integrity. - Ensure compliance with data protection regulations and industry standards. - Conduct regular security audits and vulnerability assessments. - Work closely with AI/ML teams to understand their requirements and provide suitable infrastructure solutions. - Provide technical guidance and support to internal teams and stakeholders. - Stay abreast of emerging trends in AI infrastructure and large language model hosting. - Manage physical and virtual resources to ensure optimal allocation and utilization. - Forecast resource needs and plan for future expansion and upgrades. Key Skills And Experience: - Bachelor's or Master's degree in Computer Science, Information Technology, or a related field with 7-12 years of experience. - Proven experience in infrastructure architecture, with exposure to AI/ML environments. - Experience with inferencing frameworks like TGI, TEI, Lorax, S-Lora, etc. - Experience with training frameworks like PyTorch, TensorFlow, etc. - Proven experience with On-premises OSS models Llama3, Mistral, etc. - Strong knowledge of networking, storage, and computing technologies. - Experience of working with container orchestration tools (e.g., Kubernetes - Redhat OS). - Proficient programming skills in Python. - Familiarity with open-source large language models and their hosting requirements. - Excellent problem-solving and analytical skills. - Strong communication and collaboration abilities. About Us: Nokia is committed to innovation and technology leadership across mobile, fixed, and cloud networks. Your career here will have a positive impact on people's lives and will help build the capabilities needed for a more productive, sustainable, and inclusive world. We foster an inclusive way of working where new ideas are welcomed, risks are encouraged, and authenticity is valued. What we offer: Nokia provides continuous learning opportunities, well-being programs, support through employee resource groups, mentoring programs, and highly diverse teams with an inclusive culture that empowers individuals to thrive. We are dedicated to creating a culture of inclusion based on the core value of respect. Join us and be part of a company where you will feel included and empowered to succeed. As a Platform Engineer/Architect at our company, you will play a crucial role in designing, implementing, and maintaining a robust on-premise environment for hosting open-source large language models. Your contributions will directly impact the efficiency, security, and scalability of the infrastructure. Here's how you will contribute and what you will learn: - Design and architect a scalable and secure on-premise hosting environment for large language models. - Develop and implement infrastructure automation tools for efficient management and deployment. - Ensure high availability and disaster recovery capabilities. - Optimize the hosting environment for maximum performance and efficiency. - Implement monitoring tools to track system performance and resource utilization. - Regularly update the infrastructure to incorporate the latest technological advancements. - Establish robust security protocols to protect sensitive data and model integrity. - Ensure compliance with data protection regulations and industry standards. - Conduct regular security audits and vulnerability assessments. - Work closely with AI/ML teams to understand their requirements and provide suitable infrastructure solutions. - Provide technical guidance and support to internal teams and stakeholders. - Stay abreast of emerging trends in AI infrastructure and large language model hosting. - Manage physical and virtual resources to ensure optimal allocation and utilization. - Forecast resource needs and plan for future expansion and upgrades. Key Skills And Experience: - Bachelor's or Master's degree in Computer Science, Information Technology, or a related field with 7-12 years of experience. - Proven experience in infrastructure architecture, with exposure to AI/ML environments. - Experience with infe
