Data Engineer

SRM360 Consulting Pvt Ltd

0 years

0 Lacs

hyderabad telangana india

Posted:16 hours ago| Platform:

Apply

Skills Required

data design sql python support analytics etl gcp storage dataflow efficiency governance security resolve pipeline architecture query optimization workflow orchestration airflow composer git agile learning aws communication collaboration

Work Mode

On-site

Job Type

Full Time

Job Description

Data Engineer

Key Responsibilities

Design, develop, and maintain scalable
data pipelines
and ETL/ELT processes.
Work extensively on
GCP services
including BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Composer.
Optimize data models and queries for performance and cost efficiency in
BigQuery
.
Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements.
Ensure data quality, governance, and security across all data pipelines and storage systems.
Troubleshoot and resolve data pipeline issues in real time.
Contribute to architecture design discussions and provide best practices for data engineering.

Required Skills

Strong hands-on experience with
Google Cloud Platform (GCP)
, particularly
BigQuery
.
Proven expertise in building and maintaining
data pipelines
.
Strong
SQL
skills for query optimization and large-scale data manipulation.
Proficiency in
Python
or
Java
for developing scalable ETL/ELT solutions.
Good understanding of
data modeling, partitioning, and performance tuning
.
Experience with workflow orchestration tools (e.g., Airflow/Cloud Composer) is a plus.
Familiarity with CI/CD, version control (Git), and agile methodologies.

Good to Have

Exposure to
streaming data pipelines
(Pub/Sub, Kafka).
Knowledge of
machine learning pipelines
integration.
Experience with
other cloud platforms (AWS/Azure)
.

Soft Skills

Strong analytical and problem-solving skills.
Excellent communication and collaboration abilities.
Ability to work independently and as part of a team in a fast-paced environment.

More Jobs at SRM360 Consulting Pvt Ltd

Lead Analyst/Developer – One Identity Manager (OIM)

Bhopal, Madhya Pradesh, India

5.0 - 5.0 yrs

Salary: Not disclosed

Java Software Engineer

hyderabad, telangana, india

Experience: Not specified

Salary: Not disclosed

Software Engineer in Test

hyderabad, telangana, india

4.0 - 4.0 yrs

Salary: Not disclosed

Data Engineer

hyderabad, telangana, india

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.