Principal Software Engineer, Data & AI Platform Engineering

The Data And AI team is a highly focused effort to lead digital-first execution and transformation at Red Hat leveraging data strategically for our customers, partners, and associates. The engineering team is focused on building and delivering strategic AI agents built on our Data & AI platform, designed to augment human capabilities, accelerate business workflows, and scale operations across the enterprise.

We are looking for strong engineers, who can lead the technology and design of significant parts of RedHats Data and AI Platform for creating next generation data products & applications. The successful candidate will have a track record of strong technical skills, drive to be innovative & creative, excellent communication and collaboration skills, thrive in a startup like environment, a keen attention to detail, and a passion for quality and open source software. If you enjoy broadening your technical skills, and working in an environment that thrives on creativity, experimentation, and community innovation, then we are the TEAM for you!

We are looking for a Software Engineer to join our Data and AI Platform team in Bangalore, India. In this role, you will elevate Red Hats data-driven culture and execution by building and delivering a best-in-class cloud-native data platform. You will work with a distributed team to deliver a delightful Developer and Analyst experience; satisfy and exceed requirements for compliance and governance; obtain high system performance and process responsiveness through automated, resilient, efficient processes; prepare to deliver on the needs of future ML-enhanced business processes; support broad internal adoption with rich enablement and low friction.

What you will do

• Designing, implementation and running of robust backend systems.
• Build secure and robust Data & AI Platform services that power MCP servers and Agents built for Red Hat
• Apply Infrastructure-as-Code principles in all aspects of the Data and AI platform implementation
• Build ML Pipeline capabilities into the Data Platform.
• Integrate data platform components together with other Red Hat systems and infrastructure
• Develop migration processes to move historic data and data pipelines from legacy systems to the new data platform
• Participate in the design, implementation and reliability of ML Pipelines.
• Service AI platform users with cost and usage insight, along with cost optimization recommendations
• Create and maintain standard operating procedures (SOPs) for performing maintenance tasks, applying configuration changes and remediating problems in our environment
• Participate in product release cycles, deploying code to integration, staging and production environments, integrating with CI/CD tooling, monitoring and change management
• Interact with automated monitoring and healing infrastructure to ensure healthy environments
• Participate in developing enablement content that will assist peers and users of the data platform
• Help and develop peers through knowledge sharing, mentoring and collaboration

What you will bring

Preferred Skills/Experience

• Bachelor's degree in Computer Science, Computer Engineering, or related field.

• 10/10+ years of software development experience with a focus on data applications & systems

• Exceptional software engineering skills that lead to elegant and maintainable data platform
• Proficiency in at least one general purpose programming language, eg. Python, Go, Java, Rust, etc.
• Loosely held strong opinions and perspectives that you kindly debate, defend, or change to ensure that the entire team moves as one
• Sets and resets the bar on all things quality, from code through to data, and everything in between
• Deep empathy for your users of your platform, leading to a constant focus on removing friction, increasing adoption, and delivering business results
• Prunes and prioritizes work in order to maximize your contributions and impact
• Bias for action and leading by example
• Past experience in building enterprise data platforms that have a high level of governance and compliance requirements

Optional Skills

• Familiarity with open source or inner source development and processes
• Familiarity of data mesh architectural principles
• Familiarity with building MCP servers/tools and Agents
• Experience with Snowflake, Fivetran, dbt, Airflow Astronomer
• Experience with building ML Pipelines with tools like MLflow, Kubeflow etc
• Deep hands on knowledge of Vector Databases, RAG Pipelines is a huge plus.

Personal qualities and communication

• Communication skills and experience in interacting with cross functional business and engineering teams
• Capability in undertaking business needs analysis in direct consultation
• Motivated with a passion for quality, learning and contributing to collective goals
• Excellent communication, presentation, and writing skills.