ETL Developer - Enterprise Datawarehouse_Pune

Luxoft

5 - 8 years

0 Lacs

Pune Maharashtra India

Posted:1 month ago| Platform:

Apply

Skills Required

etl developer development design data azure architecture coding testing debugging software engineering query documentation support audit reports integration collaborative agile relational logical saas analytics layers powerbi report dashboard dax devops sql indexes scripting python git github bitbucket governance communication finance

Work Mode

On-site

Job Type

Full Time

Job Description

Project Description:Our client is an EU subsidiary of a Global Financial Bank working in multiple markets and asset classes.DWH / ETL developer will work closely with the Development Lead to design, build interfaces and integrate data from a variety from internal and external data sources into the new Enterprise Data Warehouse environment. The ETL Developer will be responsible for developing ETL primarily utilizing Microsoft & Azure technologies within industry recognized ETL standards, architecture, and best practices.Responsibilities:• Act as a technical expert in the designing, coding, unit testing, supporting, and debugging of data warehouse software components in all aspects of SDLC• Apply cloud and ETL engineering skills to solve problems and design approaches• Troubleshoot and debug ETL pipelines and creating unit tests for ETL pipelines.• Assess query performance and actively contribute to optimizing the code• Write technical documentation and specifications• Support internal audit by submitting required evidence• Create reports and dashboards in the BI portal• Work with Development Lead, DWH Architect and QA Engineers to plan, implement and deliver best ETL strategies• Work with business analysts to understand requirements to create technical design specifications, gaining a sound understanding of business processes for related applications so that integration processes fulfill the end-user requirements• Communicate effectively in a collaborative, complex and high performing team environment as per Agile principlesMandatory Skills Description:• Proven work experience as an ETL Developer• Advanced knowledge of relational databases and dimensional Data Warehouse modelling concepts• Good understanding of physical and logical data modeling• Very good understanding of modern SaaS / PaaS data solutions in a cost conscious approach• Expert level of knowledge of Microsoft Data stack• Experience in developing and deploying data oriented solutions in Cloud (Azure / Synapse Analytics / Fabric)• Experience in designing and implementing data transformation and ETL layers using Data Factory, Notebooks• Experience with PowerBI for report & dashboard creation. PowerQuery and/or DAX is an advantage.• Experience in / understanding of Azure Data Lake Storage• Knowledge / use of CI/CD tools and principles, preferably Azure DevOps or Bamboo• Strong SQL knowledge, able to create complex SQL queries and good understanding of stored procedures, views, indexes, functions, etc.• Good working knowledge of at least one scripting language. Python is an advantage.• Experience with GIT repositories and working with branches. GitHub, Azure DevOps or Bitbucket experience are preferable.• Ability to troubleshoot and solve complex technical problems• Good understanding of software development best practices• Working experience in Agile projects; preferably using JIRA• Experience in working in high priority projects preferably greenfield project experience• Able to communicate complex information clearly and concisely.• Able to work independently and also to collaborate across the organization• Highly developed problem-solving skills with minimal supervision• Understanding of data governance and enterprise concepts preferably in banking environmentVerbal and written communication skills in English are essential.Nice-to-Have Skills Description:Microsoft Fabric• Snowflake• Background in SSIS / SSAS / SSRS• Azure DevTest Labs, ARM templates• Azure PurView• Banking / finance experience