Data Engineer

5 years

0 Lacs

Posted:2 months ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Position Summary:Here at MetLife , we are seeking an experienced Data Engineer to join our team and help on our building data platform solution (known as the Data Exchange or “DAX”). This role will mainly help design, build, and optimise data pipelines on our Snowflake data platform(“DAX”). You will work with Matillion to develop scalable and efficient data pipelines that support our business needs. A strong understanding of data modeling principles is essential to build robust data pipelines based on our Data Architecture. Additionally, familiarity with DevOps models, CI/CD workflows and best practices is important. Key Responsibilities:Build modern data platform/lake components on cloud.Analysis and design of data pipelines that bring in various internal and external data into the data platform in the cloud based on the business use case. Design, develop, and maintain high-performance ELT pipelines using Matillion ETL to process structured and semi-structured data in Snowflake.Implement transformation and data quality rules using modern transformation tools and languages for data to conform to enterprise guidelines.Deep understanding of various stages of data model in the data platform (medallion architecture) etc. and implement it accordingly.Ways of Working – Adoption of the Agile ways of working in the software delivery lifecycle and continuous learning of new methods and technology Candidate Qualifications: Education:Bachelor of Computer Science or equivalent Experience:5+ years data engineering or data application development experience (ETL/ELT/BI)3+ years cloud-based application or data platform developmentExpert level knowledge on building Data Pipelines using various technologies including but not limited to Snowflake Data CloudAWS Cloud ServicesMatillionGIT/GIT HUB + JenkinsIngestion of structured / unstructured data / semi-structured data into the data lakeHands on experience doing data Transformation/Cleansing using programming languages such as Spark/Python/R/SQL.Proficiency in software development lifecycle including CI/CD, test driven development, domain driven design and Agile ways of working (including shift-left).Working experience on Project delivery using Agile methodologies. Skills and Competencies:Competencies Communication: Ability to communicate effectively to ensure results are achievedCollaboration: Proven track record collaborating and working effectively in a global and multi-cultural environment Diverse environment: Can-do attitude and ability to work in a high paced environment Tech Stack Development & Delivery Methods: Agile (Scaled Agile Framework)DevOps and CI/CD:CI/CD (Azure DevOps, Git, Jenkins) Data Platform and Data Management:Snowflake, Python, Spark, SQL, ETL, Matillion Security and Monitoring: Familiarity withRole-Based Access ControlData Masking mechanism and Tokenisation

Mock Interview

Practice Video Interview with JobPe AI

Start DevOps Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

Kolkata, Mumbai, New Delhi, Hyderabad, Pune, Chennai, Bengaluru