GCP Data Engineer

Cognizant

6 - 12 years

3 - 7 Lacs

gurgaon

Posted:15 hours ago| Platform: GlassDoor logo

Apply

Skills Required

gcp data storage composer pipeline databricks pyspark etl writing tuning sql aggregation reporting workflow orchestration apache airflow scheduling monitoring git agile development design support processing scalability security documentation engineering

Work Mode

On-site

Job Type

Part Time

Job Description

Skills-GCP Data Engineer

Experience: 6 to 12 years

Location: AIA-Gurgaon

Hands-on experience with GCP services, specifically BigQuery, Cloud Storage, and Composer for data pipeline orchestration
Proficiency in Databricks platform with PySpark for building and optimizing large-scale ETL/ELT processes
Expertise in writing and tuning complex SQL queries for data transformation, aggregation, and reporting on large datasets
Experience integrating data from multiple sources such as APIs, cloud storage, and databases into a central data warehouse
Familiarity with workflow orchestration tools like Apache Airflow or Cloud Composer for scheduling, monitoring, and managing data jobs
Knowledge of version control systems (Git), CI/CD practices, and Agile development methodologies

Overall Responsibilities

Design, develop, and maintain scalable data pipelines using GCP, Pyspark, and associated tools
Write efficient, well-documented SQL queries to support data transformation, data quality, and reporting needs
Integrate data from diverse sources, including APIs, cloud storage, and databases, to create a reliable central data repository
Develop automated workflows and schedules for data processing tasks utilizing Composer or Airflow
Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and deliver solutions
Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and reliability
Maintain data security, privacy standards, and documentation compliance
Stay informed about emerging data engineering technologies and apply them effectively to improve workflows

More Jobs at Cognizant

Workday: Walk-in drive 10th May Pune with CTS(Full time)

Pune, Mumbai (All Areas)

3 - 8 yrs

INR 7 - 17 Lacs

Java Full Stack Developer

Chennai

5 - 10 yrs

INR 10 - 20 Lacs

Walkin For Freshers @hyderabad

Hyderabad

Experience: Not specified

INR 0 - 2 Lacs

React JS Developer

Hyderabad

2 - 7 yrs

INR 9 - 14 Lacs

Java Developer

Bengaluru

5 - 10 yrs

INR 15 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.