Data Lead Manager (ETL, Informatica, Snowflake)

What you will be doing

responsibilities:

• Design, Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
• Identifying, investigating, and resolving database performance issues, capacity, and scalability.
• Overseeing the design, maintenance, and use of an Extract, Transform, Load (ETL) pipeline.
• Developing testable, reusable code in SQL and Python.
• Communicating complex processes and data issues to clients.
• Providing technical leadership, project management, and mentoring junior engineers.
• Develop data set processes for data modelling, mining, and production.
• Recommend ways to improve data reliability, efficiency, and quality.
• Design and develop scalable data pipelines using AWS services.
• Integrate diverse data sources and ensure data consistency and reliability.
• Collaborate with data scientists and other stakeholders to understand data requirements.
• Implement data security measures and maintain data integrity.
• Monitor and troubleshoot data pipelines to ensure optimal performance.
• Optimize and maintain data warehouse and data lake architectures.
• Create and maintain comprehensive documentation for data engineering processes.
• Manages work efforts of managers/supervisors with responsibility for hiring, firing, performance appraisals and pay reviews.
• Identifies and allocates technical resources, e.g., programmers, business analysts to client projects within Development. Includes a mix of FTEs assigned to the development organization and purchased resources from other lines of business.
• Forecasts resource needs based on an analysis of both portfolio and projected client spend.
• Maximizes both utilization and profitability of assigned team of resources billable time.
• Ensures base applications meet appropriate quality standards.
• Adheres to the departmental application development and client delivery process standards.
• Other related duties assigned as needed.

What you bring:

Knowledge / Experience

• 10+ years of relevant experience.
• Design, code and test major features, and work jointly with other team members to deliver complex areas of functionality under tight deadlines.
• Document specifications, design areas, test results, and solutions implemented
• Code corrections for identified defects for new and existing releases of the software
• Ensure compliance with predefined coding best practices
• Ensure adherence to processes as required by the project
• Update the manager of the progress on module, flag risks and issues early on in the process
• Coordinate with developers and business analyst(s) with focus on effective communication from a delivery perspective
• The individual may be required to work on multiple areas simultaneously (development, platform releases, installations, conversions, support, training, etc.)

Skills

• Experience with AWS cloud services:

  Glue, Snowflake, RDS, EC2, EMR, S3.
• Knowledge of programming languages (e.g. Java and Python).
• Hands-on experience with SQL database design.
• Data pipeline orchestration (e.g., Apache Airflow)
• Big Data tools (e.g., Hadoop, Spark)
• Data warehousing
• ETL tools Sound analytical & communication skills
• Knowledge of FIS products and services
• Skill in project management, organization, communications, analytical and people skills
• Skill in leading, supervising and managing effectively under pressure
• Ability to be comfortable interacting with executive level clients
• Ability to analyze clients business needs and determine related information services support
• Ability to maintain positive working relationship with client
• Ability to manage multiple projects, activities and problem areas
• Ability to delegate projects to qualified subordinates as appropriate
• Ability to lead, direct and manage effectively
• Ability to operate independently
• Ability to exhibit solid decision-making and problem-solving skills
• Ability to communicate effectively verbally and in writing
• Responsible for the creation of the software architecture in modular, easy to maintain and extendible parts (components and modules);
• Extensive participation in Design & Architecture of current & new systems
• Hands on Software development- coding
• Technically responsible for the software in projects.
• Ensures mutual consistency and efficient integration of the separate components in modular, easy-to-maintain hardware/software that meets the product specification.
• Acts in line with departmental and project processes
• Manages a team of developers, this includes mentoring team, administrative responsibilities.
• Guides the Development Engineers in the design and implementation of the parts of a subsystem.
• Advises Product Teams regarding choices of what has to be achieved in hardware and what in software and advises on make-or-buy decisions.
• Determines required hardware/software interface in close consultation with the technical experts;
• Advises on internal development.
• Has an important say in the choice of development environment and has ultimate responsibility for the software top-level design.
• Manage daily activities and ensure team is engaged and propelled to do more, should lead by example.
• Experience on application security testing and remediation.