Posted:18 hours ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

As an experienced Data Engineer Architect, you will be responsible for designing, architecting, and optimizing large-scale enterprise data platforms. Your deep expertise in Databricks, PySpark, Google Cloud Platform (GCP), Unity Catalog, ETL processes, and Terraform will be crucial in delivering scalable and secure data engineering solutions. Key Responsibilities: - Architect and design modern, scalable, and secure data engineering platforms on Google Cloud Platform (GCP). - Define, implement, and optimize ETL/ELT pipelines using Databricks, PySpark, and Unity Catalog for governance and cataloging. - Establish and enforce data architecture standards, frameworks, and best practices across projects. - Lead end-to-end delivery of enterprise solutions, covering data ingestion, transformation, storage, and consumption layers. - Collaborate with stakeholders to translate business requirements into scalable data solutions. - Implement and manage data governance frameworks ensuring compliance, quality, and security. - Drive automation and infrastructure deployment using Terraform and other DevOps tools. - Provide technical leadership, mentorship, and guidance to engineering teams. Required Skills & Expertise: - 10+ years of experience in data engineering, with at least 3+ years in an architect role. - Strong hands-on expertise in Databricks, PySpark, and ETL/ELT processes. - Proven experience with Google Cloud Platform services (BigQuery, Dataflow, Pub/Sub, etc.). - Proficiency in Unity Catalog for governance and cataloging. - Strong understanding of data architecture principles (Data Lake, Medallion, Data Vault 2.0). - Hands-on experience with Terraform (IaC) and cloud automation. - Familiarity with DevOps/CI/CD pipelines for data solutions. - Ability to define and execute architecture roadmaps, aligning with business and technical needs. - Excellent communication and leadership skills. Preferred Qualifications: - GCP Professional Data Engineer or Architect Certification. - Experience implementing enterprise data governance frameworks. - Knowledge of multi-cloud environments (AWS, Azure) is a plus.,

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You

gurgaon, haryana, india

noida, uttar pradesh, india

gurugram, haryana, india

coimbatore, tamil nadu, india

hyderabad, telangana, india

gurgaon, haryana, india

chennai, tamil nadu