Lead Data Engineer - Operations

Lead Data Engineer - Operations

Duties and Responsibilities:

• Work with a distributed Data Operations team with a heavy focus on data sourcing, availability, timeliness and reliability
• Lead the monitoring and alerting of data issues and their resolution, including identifying areas of improvement
• Proactively troubleshoot data availability issues and escalate with internal teams or partners to drive timely issue resolution while collaborating closely and communicating with stakeholders
• Manage data sourcing connections and data pipeline orchestration related operational tasks
• Monitor, update and track all tasks through the ServiceNow platform in a timely and responsive manner
• Plan for and lead ongoing initiatives with data sourcing partners to increase operational efficiency
• Support compliance with best practices related to data availability and security procedures
• Apply proven communication and problem-solving skills to resolve support data issues as they arise
• Participate in design and upcoming release discussions with the development teams to ensure impact on users is clearly understood and operational knowledge is built

Education and Experience:

• 5+ years of experience in an operational role dealing with data management, data integration or similar activities and/or responsibilities.
• Bachelors Degree and/or relevant field or equivalent experience

Required Skills/Certifications:

• Strong analytical and problem-solving skills - Ability to determine data patterns and perform root cause analysis to resolve production reporting bugs
• Familiarity with the data, analytics and BI space and knowledge of Power BI
• Experience working with Microsoft data integration platforms such as Azure Data Factory, SSIS, Synapse
• Strong experience with SQL (Python experience a plus)
• Familiarity with Azure DevOps for source code management a plus
• Understanding of data management (e. g. permissions, security, and monitoring)
• Experience working with and building strong relationships with customers and external partners
• Excellent written and verbal communication skills, including logical structuring and delivering presentations
• Knowledge of working with helpdesk tools or platforms like ServiceNow is a plus
• Experience with cloud services is a plus (Azure) is a plus
• Experience in working with and managing offshore resources is desirable
• Eagerness to learn and think critically to design improved processes

Preferred Experience with:

• Estimating and Planning
• Work breakdown for the team
• Data pipelines
• Data Transformations
• Code/Unit Test
• PR & Code Reviews
• Performance & Load Testing
• Functional & Regression Testing
• Tier 2 support/consulting
• Production Support
• Functional ask to technical design
• Data Engineering
• Agile Methodologies
• CI/CD
• Metadata driven frameworks
• Technical documentation
• Azure Synapse Spark
• Python
• Complex SQL
• Parquet & Delta file processing
• ETL Optimizations
• Azure DevOps