Home
Jobs
1 Job openings at Percipience Software
Lead Data Engineer

Hyderabad

10 - 20 years

INR 25.0 - 40.0 Lacs P.A.

Work from Office

Full Time

Percipience is seeking an experienced and talented software engineers as Sr. Lead Azure Extract, Transform, Load (ETL) Lead Developer, (Sr. Data Engineer-ETL) in Hyderabad, India. This role is in our Hyderabad (5 days a week Onsite, local candidates ONLY), India office. The Lead Data Engineer - ETL Lead (MS Azure / SSIS only) will be part of the Business Intelligence (BI) team that is responsible for integrations and analytics supported by IT across Product and Engineering areas. The right candidate has technical experience in all the capabilities of the Azure Data Factory (ADF) or equivalent ETL platform and a proven track record of working with minimal supervision, leading teams, designing solutions, driving best practices and processes, with hands-on experience in developing ETL projects, configuration, automation, & support. This individual will: a) Be a key member of the BI team; b) Design and build ETL projects working independently and in partnership with a global team of PMs, business analysts, and developers (onsite and offshore); c) Provide vision for enhancements, technical design, and participate in design and code reviews to ensure governance principles and best practices are followed; What You'll Do: Hands-on role (100%) - working on critical ETL design, development, QA and fixes Lead and execute the complete ETL development lifecycle, including requirements gathering, solution design, data / ETL mapping, configuration, development, testing, and deployment; take ownership of escalated or complex issues and follow through to resolution. Create clear, structured and effective documentation that will enable developers within the team to maintain ETL. Develop a deep understanding of all data models to populate, and JSON schemas to map to and develop ETL pipelines for. Proactively seek opportunities for process improvement: identify and resolve process bottlenecks, data and governance issues, and inconsistencies to help improve operational efficiencies. Troubleshoot and performance tune existing pipelines Suggest improvements inspired by ideas from the global Azure community and the broader data engineering community. Follow Agile principles to projects. Conduct regular knowledge sharing sessions with developers to drive adoption of ADF based integrations. Implement best practice and architecture recommendations to leadership. Perform code repository, change management functions associated with large scale high-impact configurations. Create, manage and enforce application configuration and Software Development Lifecycle (SDLC) standards. Occasional support during weekends, after-hours and holidays, when needed. Work on new ADF / BI projects, enhancements as well as production support. Preferred candidate profile / What You Have (as applicable for Lead dev role): Must have 10+ years of experience with Azure ADF or SSIS ONLY . Must have 5+ years of experience in Azure Cloud infrastructure Platform. Must have 8-10+ years of experience in writing and optimizing complex SQL queries to ensure high performance and efficiency Develop and maintain scalable data pipelines and build new API integrations to integrate data from various sources, ensuring consistency, accuracy and reliability. Hands-on experience of data warehousing concepts such as Slowly Changing Dimensions, Change Data Capture and experience in ETL implementations. Experience in data ingestion for Data Lakehouse, data mesh, data engineering, star schema dimensional databases. Experience with a source control management tool such as Git or Azure DevOps Nice to Haves: Experience as a Lead managing a team of 5-10 ETL developers / data engineers with minimal supervision. Azure ADF or equivalent ETL certification. Experience with Power BI configuration and system administration or related reporting tools. Ability to work seamlessly as part of a multi-site, multicultural, development and testing team, onshore and offshore, internal and external resources. Utilize Python for data manipulation, automation, etc. Experience of US Property and Casualty Insurance is very desirable Role & responsibilities

cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Job Titles Overview