Data Architect Lead

Optum is a leading global healthcare organization leveraging technology to help millions of people live healthier lives. By joining our team, your work will have a direct impact on improving health outcomes by connecting individuals with essential care, pharmacy benefits, data, and resources. At Optum, youll be part of a diverse and inclusive culture, surrounded by talented colleagues, comprehensive benefits, and ample career development opportunities. Make a meaningful difference in the communities we serve as we advance health equity worldwide. Join us as we embark on a journey of Caring. Connecting. Growing together.

Primary Skills

• System Design
• Apache Spark
• Scala
• Azure Data Factory (ADF)

Primary Responsibilities

• Lead end-to-end **system design** for scalable, high-performance data solutions and applications in a cloud environment.
• Develop and implement robust data processing pipelines using **Apache Spark** and **Scala**, ensuring efficiency, reliability, and maintainability for large-scale enterprise data platforms.
• Architect and orchestrate complex ETL workflows leveraging **Azure Data Factory (ADF)** for seamless integration across diverse data sources.
• Collaborate with business stakeholders to gather requirements and translate them into effective technical solutions with thoughtful architectural planning.
• Optimize Spark-based workflows for speed and scalability; proactively identify areas for performance improvement within existing pipelines.
• Ensure high code quality by writing clean, well-documented Scala code that adheres to company standards and industry best practices.
• Mentor junior engineers in system design concepts as well as Spark/Scala/ADF development; conduct code reviews to promote knowledge sharing and maintain technical excellence.
• Oversee deployment processes using CI/CD pipelines integrated with Azure DevOps tools specifically tailored for Spark/Scala/ADF workloads.
• Monitor pipeline performance in production; troubleshoot advanced issues related to Spark jobs or ADF orchestration promptly to ensure system stability.
• Stay current with emerging technologies in big data processing (particularly within the Apache Spark ecosystem), cloud architecture (with an emphasis on Azure), advancements in Scala programming, and enhancements in ADF capabilities; recommend adoption of relevant new tools or practices where beneficial.
• Produce thorough documentation covering system designs, technical specifications, architectural decisions, operational procedures, and user guidance to ensure clarity across teams.
• Champion security best practices throughout all aspects of solution designintegrating robust authentication/authorization methods and maintaining compliance standards.

Additional Responsibilities

Comply with all company policies/procedures as well as directives related (but not limited) to work location assignments/changes; team or shift changes; flexible work arrangements; alternative work environments; or other business-driven decisions. The company reserves the right to modify these policies at its discretion.

Required Qualifications

• Bachelors or Masters degree in Computer Science, Information Technology or related field
• 8+ years experience in software development
• Strong hands-on expertise in **System Design**, **Apache Spark**, **Scala**, and **Azure Data Factory (ADF)**
• Experience building enterprise-level data warehouse solutions using Azure Databricks & Apache Spark
• Experience creating Power BI reports is an advantage
• Proficiency with code versioning tools such as Git
• Demonstrated ability leading teams of junior developersincluding mentoring & conducting code reviews
• Ability to thrive in fast-paced & collaborative environments
• Proven skills building reusable frameworks using Python is a plus
• Strong understanding of Agile methodologies
• Excellent problem-solving skills; able to manage multiple tasks independently
• Exceptional interpersonal communication skillsboth written & verbal.

At UnitedHealth Group (Optum), our mission is to help people live healthier lives while improving the health system for everyone. We are committed to advancing health equity by breaking down barriersespecially those affecting historically marginalized groupsand delivering care that addresses health disparities. We also prioritize environmental sustainability across our operations. Join us in making healthcare more accessible for all.