Data Engineer

NexGen Tech Solutions

3 years

0 Lacs

bengaluru karnataka india

Posted:2 days ago| Platform:

Apply

Skills Required

data python etl gcp azure design reliability scalability verification compliance governance security storage dataflow checks programming sql java scala orchestration airflow composer containerization docker

Work Mode

On-site

Job Type

Full Time

Job Description

Job Title:

Experience Required:

Location:

Must Have : Python, ETL, GCP, Pyspark

The candidate should possess a valid driver's license and passport.

About the Role-

Azure Data Engineer

Key Responsibilities-

Design, develop, and maintain data pipelines and ETL processes on GCP.
Implement robust data ingestion frameworks from various sources (batch and streaming).
Perform data validation and verification to ensure data accuracy and consistency.
Collaborate with data scientists, analysts, and other stakeholders to deliver high-quality datasets.
Optimize data workflows for performance and cost-efficiency.
Ensure compliance with data governance, security, and privacy policies

Required Skills & Qualifications-

3+ years of experience as a Data Engineer.
Strong expertise in
Google Cloud Platform (BigQuery, Cloud Storage, Dataflow, Pub/Sub, etc.)
.
Hands-on experience in building data ingestion pipelines (batch/stream).
Proficiency in data validation, data quality checks, and verification frameworks.
Strong programming skills in Python/SQL (Java or Scala is a plus).
Experience with orchestration tools like Airflow, Cloud Composer, or similar.
Good understanding of data modeling, warehouse concepts, and best practices.

Preferred Qualifications-

Experience with CI/CD for data pipelines.
Knowledge of data security and compliance standards.
Familiarity with containerization (Docker/Kubernetes).

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.