Hiring Lead Data Engineer|Logistics Domain|Noida

Lead Data Engineer

Lead Data Engineer

Duties and Responsibilities:

• Work with a distributed team with primary focus on the management of resources, team assignments, and fostering career growth
• Input into the hiring of team members for the locally based team
• Support compliance with best practices related to data availability and security procedures
• Apply proven communication and problem-solving skills to resolve support data issues as they arise
• Demonstrate skills in abstract development frameworks
• Demonstrate accountability to assigned work & timelines
• Demonstrated leadership skills.
• Demonstrated technical competency for the role.
• Demonstrated timely delivery on assigned tasks and effective communication on project status and escalation when needed.

Education and Experience:

• 5+ years of experience in a management role dealing with resourcing, career growth or similar activities and/or responsibilities.
• 12+ Years or equivalent degree + experience

Primary Skills:

Azure Cloud, Databricks, Azure Data Factory, Azure Synapse Analytics, SQL/TSQL, PySpark, Python, logistic domain

Required Skills/Certifications:

• Strong analytical and problem-solving skills - Ability to determine data patterns and perform root cause analysis to resolve production reporting bugs
• Familiarity with the data, analytics and BI space and knowledge of Power BI
• Experience working with Microsoft data integration platforms such as Azure Data Factory, SSIS, Synapse
• Experience with SQL (Python experience a plus)
• Familiarity with Azure DevOps for source code management a plus
• Understanding of data management (e. g. permissions, security, and monitoring)
• Experience working with and building strong relationships with customers and external partners
• Excellent written and verbal communication skills, including logical structuring and delivering presentations
• Knowledge of working with helpdesk tools or platforms like ServiceNow is a plus
• Experience with cloud services (Azure) is a plus
• Experience in working with an onshore client is desirable
• Eagerness to learn and think critically to design improved processes

Preferred Experience with:

• Estimating and Planning
• Work breakdown for the team
• Data pipelines
• Data Transformations
• Code/Unit Test
• PR & Code Reviews
• Performance & Load Testing
• Functional & Regression Testing
• Tier 2 support/consulting
• Production Support
• Functional ask to Technical design
• Data Engineering
• Agile Methodologies
• CI/CD
• Metadata driven frameworks.
• Technical documentation
• Azure Synapse Spark
• Python
• Complex SQL
• Parquet & Delta file processing
• ETL Optimizations
• Azure DevOps

Location: