Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in chennai
>
Awign
>
Sr. GCP Data Engineer

Sr. GCP Data Engineer

Awign

7 - 12 years

0 Lacs

chennai tamil nadu india

Posted:1 week ago| Platform: Foundit logo

Apply

Skills Required

gsutil airflow cloud monitoring dags

Work Mode

On-site

Job Type

Full Time

Job Description

: Sr. GCP Data Engineer

Experience

: 7 to 12 Years

Work location

: Chennai, Bangalore, Hyderabad, Pune-Hybrid

Shift Timing

: 2 to 11 PMI

nterview proces

s : L1 and L2 round

5+ years experience
Should have experience in GCP BigQuery, DataProc(PySpark)
Good to have experience on Informatica

Requirements

How do you upload files to GCS
Using Google Cloud Console (UI) drag and drop files into a bucket.
Using gsutil CLI:
How do you query data in BigQuery

Write SQL queries in:

BigQuery Console (UI)
bq CLI ? bq query SELECT ...

APIs or client libraries (Python, Java, etc.)Cluster monitoring with Cloud Monitoring & alerts.Upload the script to the DAGs folder in Composer's GCS bucket ? Composer automatically deploys it.

What is the purpose of a Dataproc job Dataproc job is a task you submit to a cluster to process data, such as:
Spark job (Scala/Python/Java)
Hive query
Pig script
Hadoop MapReduce job
How do you handle errors in Dataproc jobs
Job retry policies (set retries in workflow templates).
Error logs in Cloud Logging (examine stdout/stderr).
Graceful failure handling with workflow DAG (e.g., skip/stop).
How do you create an Airflow DAG in Cloud Composer
Write a Python script defining the DAG (dag_id, schedule_interval, default_args).
Define tasks using operators (e.g., PythonOperator, BashOperator, BigQueryOperator)

More Jobs at Awign

Invigilator

Ahmedabad, Gujarat, India

Experience: Not specified

Salary: Not disclosed

Invigilator

Rajkot, Gujarat, India

Experience: Not specified

Salary: Not disclosed

Invigilator

Surat, Gujarat, India

Experience: Not specified

Salary: Not disclosed

Electrical Designer

Gujarat, India

8 - 8 yrs

Salary: Not disclosed

Android HAL

Tamil Nadu, India

5 - 5 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.