GCP Data Engineer

The It Mind Services

5 - 12 years

5 - 12 Lacs

Bengaluru Karnataka India

Posted:1 day ago| Platform: Foundit logo

Apply

Skills Required

GCP BigQuery Airflow CI/CD Data Lakehouse

Work Mode

On-site

Job Type

Full Time

Job Description

Experience in ETL and Data Warehousing
Excellent leadership and communication skills
Strong hands-on experience with Data Lakehouse architecture
Proficient in GCP BigQuery, Cloud Storage, Airflow, Dataflow, Cloud Functions, Pub/Sub, Cloud Run
Built solution automations using various ETL tools
Delivered at least 2 GCP Cloud Data Warehousing projects
Worked on at least 2 Agile/SAFe methodology-based projects
Experience with PySpark and Teradata
Skilled in using DevOps tools like GitHub, Jenkins, Cloud Native tools
Experienced in handling semi-structured data formats like JSON, Parquet, XML
Written complex SQL queries for data analysis and extraction
Deep understanding of Data Warehousing, Data Analysis, Data Profiling, Data Quality, and Data Mapping
Global delivery model experience (15+ team members)
Collaborated with product/project managers, developers, DBAs, and data governance teams for requirements, design, and deployment
Responsibilities:
Design and implement data pipelines using GCP services
Manage deployments and ensure efficient orchestration of services
Implement CI/CD pipelines using Jenkins or native tools
Guide a team of data engineers in building scalable data pipelines
Develop ETL/ELT pipelines using Python, Beam, and SQL
Continuously monitor and optimize data workflows
Integrate data from various sources using GCP services and orchestrate with Cloud Composer (Airflow)
Set up monitoring and alerting using Cloud Monitoring, Datadog, etc.
Mentor junior developers and data engineers
Collaborate with developers, architects, and stakeholders on robust data solutions
Lead data migration from legacy systems (Oracle, Teradata, SQL Server) to GCP
Facilitate Agile ceremonies (sprint planning, scrums, backlog grooming)
Interact with clients on analytics programs and ensure governance and communication with program leadership

More Jobs at The It Mind Services

Data Analyst - SAP Data Sourcing

Hyderabad, Pune, Bengaluru

7 - 12 yrs

INR 15 - 22 Lacs

Rpa Developer - Auotmation Anywhere/Power Automate

Hyderabad, Pune, Bengaluru

4 - 8 yrs

INR 12 - 20 Lacs

It Recruiter

Hyderabad

Experience: Not specified

INR 0 - 0 Lacs

Hiring For Java Full stack Developer with React-Hyderabad/chennai-FTE

Hyderabad, Chennai

4 - 9 yrs

INR 13 - 23 Lacs

Python Automation Professional

Bengaluru

7 - 9 yrs

INR 8 - 12 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Gcp Bigquery Interview Now

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.