GCP + Pyspark Developer

5 - 12 years

7 - 11 Lacs

Posted:2 days ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

skilled and proactive GCP Big Data Engineer

Key Responsibilities:



  • Design, develop, and maintain scalable ETL/ELT data pipelines on GCP using PySpark and other tools.



  • Leverage BigQuery, Cloud Storage, Cloud Composer, and related GCP services for data ingestion, transformation, and loading.


  • PySpark scripts



  • Optimize data pipelines for performance, scalability, and cost-effectiveness.



  • Ensure robust data validation, governance, and quality checks across all workflows.



  • Collaborate with data scientists, analysts, and product teams to define and implement end-to-end data solutions.



  • Monitor production pipelines and proactively resolve issues to ensure reliability and uptime.



  • Apply CI/CD practices for managing and deploying data engineering code.


Mandatory Skills:



  • 5 12 years of overall experience in data engineering.


  • 4 years of hands-on experience with GCP


  • PySpark


  • BigQuery


  • Python


  • Cloud Composer (Apache Airflow)



  • Solid understanding of data modeling, warehouse architecture, and best practices.



  • Familiarity with version control systems (e.g., Git) and DevOps tools.


Preferred Qualifications:


  • GCP Professional Data Engineer certification.



  • Experience with additional GCP tools like Pub/Sub, Dataflow, and Dataproc.



  • Understanding of data security and compliance standards (e.g., GDPR, HIPAA).



  • Exposure to other programming languages such as Java or Scala is a plus.


Education:



  • Bachelor s or Master s degree in Computer Science, Information Technology, Engineering, or related field.



Gcp, Pyspark, Sql

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Rarr Technologies logo
Rarr Technologies

Information Technology

San Francisco

RecommendedJobs for You

thane, navi mumbai, mumbai (all areas)

hyderabad, pune, chennai, bengaluru