HIH - Software Engineering Associate Advisor

HIH - Software Engineering Associate Advisor

Join the team that manages the end-to-end technology and life cycle management of the applications hosted both on premises and in the AWS cloud.

We are looking for an experienced Software Engineer with 8 to 10 years of experience to join the Data and Analytics Engineering (D&AE) operational effectiveness team. The Associate advisor will be responsible for managing and optimizing the data pipelines for the corporate data warehouse hosted on the Teradata platform. The ideal candidate will have a strong technical background and experience in creating & managing complex data queries and pipelines.

Key Responsibilities:

• Design, develop, and maintain ETL processes to integrate data from Teradata into Databricks on AWS cloud
• Optimize and fine-tune Teradata queries, database structures, and data loading strategies to ensure high performance and scalability.
• Create and maintain data mappings, workflows, and sessions in Informatica for data extraction, transformation, and loading.
• Collaborate with data architects, analysts and stewards to define the data requirements and ensure the availability and accuracy of the data for business users
• Monitor and troubleshoot data pipelines, resolving issues related to data integrity, performance, and job failures
• Develop and implement data validations and quality checks to ensure the accuracy and reliability of the data warehouse
• Document technical specifications, processes, and workflows related to Teradata and Informatica development
• Assist in capacity planning, performance tuning and security management
• Partner with other teams and stake holders for any clarifications needed for the timely deliverables.
• Ability to provide alternative solutions.
• Experienced with agile methodology.

Qualifications:

• Bachelor’s degree in the related field.
• 8+ years of experience in developer role.
• 6+ years of hands-on experience with Teradata database development, including query optimization.
• Strong knowledge of SQL and proficiency in writing complex queries, stored procedures, and macros in Teradata
• 4+ years of experience with Databricks with focus on distributed data processing frameworks like Apache Spark
• Experience with AWS services such as S3, Glue, Lambda, Airflow and EC2 for building and managing data infrastructures
• Familiarity with Python for data engineering tasks in Databricks
• Experience with data warehousing concepts
• Ability to handle large datasets and optimize ETL performance for data loading and transformation
• Experience with data pipeline scheduling
• Experience with continuous integration and continuous delivery (CI/CD) tools like GitHub, Jenkins etc.
• Excellent problem-solving skills and attention to details
• Strong communication and collaboration skills

About Evernorth Health Services