Data Engineering Consultant

Caring. Connecting. Growing together.

Primary Responsibilities:

• Design, develop, and maintain scalable data/code pipelines using Azure Databricks, Apache Spark, and Scala
• Collaborate with data engineers, data scientists, and business stakeholders to understand data requirements and deliver high-quality data solutions
• Optimize and tune Spark applications for performance and scalability
• Implement data processing workflows, ETL processes, and data integration solutions
• Ensure data quality, integrity, and security throughout the data lifecycle
• Troubleshoot and resolve issues related to data processing and pipeline failures
• Stay updated with the latest industry trends and best practices in big data technologies
• Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:

• Undergraduate degree or equivalent experience
• 6+ years Proven experience with Azure Databricks, Apache Spark, and Scala
• 6+ years experience with Microsoft Azure
• Experience with data warehousing solutions and ETL tools
• Solid understanding of distributed computing principles and big data processing
• Proficiency in writing complex SQL queries and working with relational databases
• Proven excellent problem-solving skills and attention to detail
• Solid communication and collaboration skills
• . Proficiency with AI-powered development tools such as GitHub Copilot or AWS Code Whisperer or Google's Codey (Duet AI) or any relevant tools is expected. Candidates should be adept at integrating these tools into their workflows to accelerate development, improve code quality, and enhance delivery velocity.
  . Expected to proactively leverage AI tools throughout the software development lifecycle to drive faster iteration, reduce manual effort, and boost overall engineering productivity

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.