Senior Data Engineer

Role : Senior Data Engineer

• Develop a thorough understanding of the data definitions, domain values, data relationships, business rules, sources, and data integration used in the business domain.
• Develop and test programs to load, unload, transform and aggregate data from and into data stores.
• Build data pipelines to link data processing programs together into jobs. Set up jobs to run daily, weekly and monthly under scheduler control.
• Incorporate programs into automated CI/CD build and test pipelines.
• Work with Data Analysts to perform data analysis, data profiling and data sourcing in relational and Big Data database environments to implement solutions to business requirements
• Support business analysts and developers with data subject expertise, query building and optimization
• Translating business requirements into data models and ETL design specifications
• Assist in ETL development, testing and troubleshooting of ETL issues.
• Troubleshoot data issues and work with data providers for resolution. Perform L3 support when needed.

Required Skills:

• Strong knowledge of relational databases and data modeling
• Strong SQL query-writing skills
• Strong knowledge of Linux shell and experience with coding Python programs
• Strong analytical, profiling and troubleshooting skills
• Strong knowledge with Big Data/Hadoop platform
• Proficient in ETL tools, data integration and data conversions
• At least 7 years of industry technology experience and knowledge of financial services data
• Good verbal and written communication skills

Desired Skills:

• Experience with Autosys
• Experience with Data Modeling tools (e.g., Power Designer)
• Basic familiarity with using meta data stores which is used to maintain repository of Critical Data Elements

*****