Sr Data Engineer

4 - 9 years

6 - 11 Lacs

Posted:-1 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

What you ll do:
The Sr Data Engineer will play a vital role for Digital Finance and Innovation (DFI) team wherein the candidate will contribute in terms of creating the advanced version of Core Finance Data Hub for finance business. The candidate will be responsible for data management, data pipeline creation, ensuring data quality integrity, support data analytics, ensure performance and scalability of current and future data models. This role will be part of DFI wherein the person need to closely work with group s data architecture data platform team, product owner team and project management team to ensure we develop DFI finance data platforms in accordance with group s best practices.
" Responsible for Creation of ETL Pipelines in Python/Pyspark and SQL in Snowflake.
Responsible for designing and building new Data Models and optimizing existing data models. Exploit elasticity and agility of the cloud. Ownership of physical Data models of serving layer Responsible and accountable for pipelines reliability and availability. Responsible of Data analysis for troubleshooting and exploration Understand the meaning, domain and the context of the data. Documentation of the code Collaborate with Product Owner and Scrum master to understand the requirement and convert the requirement into technology deliverables Assist other team members and ensure team s success Develops solutions to gather data to deliver Business Tools that add value to the business Designing, creating, deploying, and managing Data Architecture/Data models. Defining, in alignment with analytics team, how the data will be stored, consumed, integrated and managed within Snowflake or other data hub repositories, as well as any applications using or processing that data. Handling the linkages and transformations between different databases, merging and aggregating data Conducts scalable data research. Designs, modifies, and builds new data wrangling processes. Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity. Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization. Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it. Writes unit/integration tests and documents work. Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues. Works closely with a team of frontend and backend engineers, product managers, and analysts. Defines company data assets (data models), spark, sparkSQL, and SnowSQL jobs to populate data models. Design/develop data integrations framework."
Qualifications:
BE in Computer Science, Electrical , Electronics/ Any other equivalent Degree
4+ years of relevant experience in a Data Engineer role with strong python skills, who has attained a Graduate degree in Computer Science/IT.
Skills:
Experience with data modeling, Stored Procedure development and PBI development.
Experience with working on large scale data hubs. Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases Experience with Data Manipulation in bigdata platform likeSnowflake is a plus(however not mandatory) Experience building and optimizing data pipelines and data sets. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. A successful history of manipulating, processing and extracting value from large, disconnected datasets. Experience supporting and working with cross-functional teams in a dynamic environment." "Should have hands on very strong hand on Python development Strong Proficiency in SQL Must have experience is building data connections and models for at least one BI platform like Power BI Cloud knowledge especially Azure is an added plus Knowledge of programming for ML solutions" "Should be able to conceptualize and develop prototypes quickly, working with a cross-discipline team of Design, Product, Data Science, and Analytics team Excellent communication presentation skills to work with Global, regional local management teams across the globe Strong problem-solving skills and ability to deal with ambiguities Exposure to Industrial and manufacturing businesses is an added plus Curiosity to explore the groundbreaking technologies and bake them into solutions Zeal and drive to take end-to-end ownership Exposure to working in Agile way of working environments preferred"

Mock Interview

Practice Video Interview with JobPe AI

Start Business Intelligence Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Eaton Technologies logo
Eaton Technologies

Appliances, Electrical, and Electronics Manufacturing

Dublin Ireland

RecommendedJobs for You

chennai, tamil nadu, india