Data Engineer

Careernet

8 - 12 years

35 - 50 Lacs

bengaluru

Posted:1 day ago| Platform:

Apply

Skills Required

cloud data engineer etl sql python unit testing

Work Mode

Work from Office

Job Type

Full Time

Job Description

Key Skills:

Roles and Responsibilities:

Design and implement data collection pipelines from various sources including labs, factories, and suppliers.
Define data pipeline checks to ensure confidence in downstream data use cases.
Implement and maintain data quality checks for both development and production environments, ensuring schema compliance for downstream datasets.
Participate in schema definition, change reviews, and schema evolution processes.
Define and implement ETL workflows to transform raw datasets into structured datasets for downstream use cases, utilizing Python and SQL.
Collaborate with DevOps and data analyst teams to establish alerting policies related to infrastructure and data quality.
Adhere to best practices in software engineering and data management.
Demonstrate expertise in areas such as Python data stack, ETL processes, SQL, databases (both SQL and NoSQL), data lakes, and cloud infrastructure.

Skills Required:

Must-Have Skills:

ETL - Moving data, cleaning it, and saving it for use.
Data Engineering - Building systems to collect and manage data.
Python - A programming language used to work with data.
SQL - A language used to get and manage data from databases.

Nice-to-Have Skills:

Unit Testing - Writing small tests to make sure your code works properly.
Cloud - Working with online systems (like AWS or Azure) to store and use data.

Education:

More Jobs at Careernet

Devops Engineer

Pune

6 - 11 yrs

INR 10 - 20 Lacs

Servicenow Developer

Chennai, Bengaluru, Hyderabad

4 - 6 yrs

INR 10 - 18 Lacs

RDS Engineer

Bengaluru

6 - 9 yrs

INR 8 - 18 Lacs

Senior ML Software Engineer

Bengaluru

7 - 11 yrs

INR 30 - 40 Lacs

ICC System Architect

Bengaluru

12 - 17 yrs

INR 22 - 37 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Data Engineer Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.