Data Engineer

Xebia It Architects

5 - 10 years

25 - 30 Lacs

gurugram chennai bengaluru

Posted:3 days ago| Platform:

Apply

Skills Required

cloud etl aws python

Work Mode

Hybrid

Job Type

Full Time

Job Description

Data Engineer:

Responsibilities

Ingest data from various internal and external sources into AWS Redshift and S3 buckets, utilizing appropriate methods including DMS, Zero-ETL, Kinesis, Glue, Lambda, Lake Formations, Cross account replication and/or SFTP.
Building infrastructure as code using, AWS CDK
Create and utilize GitLab CI/CD pipelines to promote code through test and production environments.
Build glue ETL pipelines to structure and curate data.
Conduct code reviews on all code deployments.
Maintain AWS environment to manage costs, eliminate vulnerabilities and keep the systems working smoothly.
Coordinate and/or complete resolution of production issues.
Drive path to production processes, including documentation and approval processes.
Partner with business team on data governance

Qualifications / Preferred Qualifications

Bachelor of Science degree in Computer Science or equivalent
At least 5 years of post-degree professional experience
3+ years of experience with AWS CDK
3+ years development experience building and maintaining AWS ETL pipelines.
Hands-on experience with AWS services such as S3, Lambda Functions, Step Functions, CDK, AWS Glue and IAM role configuration
Experience with cloud data migration tools such as DMS and Cross Account Replication
Strong knowledge and experience with Python
Familiar with best practices for data ingestion and data design
Track record of advancing new technologies to improve data quality and reliability.
Continuously improve quality, efficiency, and scalability of data pipelines
Self-motivated, work independently, and have direct experience with all aspects of the software development lifecycle, from design to deployment.
Excellent written and spoken communication skills are required as we work in a collaborative cross-functional environment and interact with the full spectrum of business divisions.
Expert skills working with queries/applications, including performance tuning, utilizing indexes, and materialized views to improve query performance.
Identify necessary business rules for extracting data along with functional or technical risks related to data sources (e.g. data latency, frequency, etc.)
Develop initial queries for profiling data, validating analysis, testing assumptions, driving data quality assessment specifications, and define a path to deployment.

More Jobs at Xebia It Architects

Servicenow Consultant

Bengaluru

3 - 8 yrs

INR 10 - 18 Lacs

Teradata Developer

Bengaluru

4 - 8 yrs

INR 18 - 30 Lacs

Service Now Specialist

Bengaluru

5 - 8 yrs

INR 15 - 25 Lacs

Automation Testing

Bengaluru

7 - 10 yrs

INR 20 - 30 Lacs

Fulltime Trainer - AIML

Jaipur

4 - 9 yrs

INR 5 - 8 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.