Data Engineer

Essential Responsibilities:

• Design, develop, and maintain ETL pipelines using Informatica Power Center and SQL Stored Procedures.
• Hands-on experience working with SQL Server databases.
• Gain a deep understanding of existing data and architecture at a granular level.
• Monitor the performance of ETL jobs, resolve issues, and improve performance metrics as needed.
• Diagnose system performance issues related to data processing and implement solutions to address them.
• Collaborate with other teams to ensure the successful integration of data pipelines into larger system architecture requirements.
• Maintain integrity and quality across all pipelines and environments.
• Understand and follow secure coding practices to ensure the code is not vulnerable.
• Bring ideas to the table to help streamline and rationalize ETL jobs.
• Lead small strategic partner/vendor team members.
• Work with business users and bring closure to their requests.
• You will report to the Division Lead of Data Modeling.

Required Skills and Abilities:

• Bachelor's degree in Computer Science, Mathematics, Statistics, Finance, or a related technical field, or equivalent work experience.
• Strong background in software development with experience in ingesting, transforming, and storing data from large datasets using any ETL tool, preferably Informatica PowerCenter, SSIS, and SQL Stored Procedures, with good knowledge of distributed computing concepts.
• Hands-on experience in designing and developing ETL pipelines.
• Relevant years of exposure and proficiency in data warehousing concepts.
• Proficient in SQL and database design concepts.
• Good knowledge of unit testing and low-level design documentation.

Desired Skills and Abilities:

• Knowledge of SSIS ETL packages is a plus.
• Knowledge of Netezza is a plus.
• Familiarity with Azure cloud computing platforms, including Azure Synapse and ADLS, is a plus.
• Experience with Databricks, ADF, and PySpark is a plus.
• Passion for data and experience working in a data-driven organization.
• Knowledge of GitHub and build management tools.