Director / Associate Director Data Engineering

10 - 15 years

0 Lacs

Posted:2 days ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

You will be the Director / Associate Director Data Engineering responsible for leading the architecture, delivery, and team management of various data engineering projects in a client-facing role. Your primary focus will be on designing modern data platforms, creating scalable data pipelines, and overseeing teams working across different technologies and cloud environments such as AWS, Azure, or GCP. Your responsibilities will include defining data architectures, modernization strategies, and transformation roadmaps in collaboration with enterprise clients. You will lead the design and implementation of cloud-native data pipelines, data lakes, and data warehouses while managing project budgets, timelines, and stakeholder communications. Building and mentoring high-performing data engineering teams across cloud platforms will also be a crucial aspect of your role, along with enforcing engineering standards, governance, and best practices to ensure the quality, scalability, and performance of all data solutions. To excel in this position, you should have at least 10-15 years of experience in data engineering or data platform development, with a minimum of 3+ years in director-level or senior leadership roles. Demonstrated success in delivering large-scale, cloud-based data solutions is essential, along with strong people leadership, client management, and delivery ownership skills. Your expertise should encompass building ETL/ELT pipelines using tools like Spark, PySpark, Python, SQL, Airflow, dbt, and others. You should possess a solid understanding of data lake/lakehouse/warehouse architectures, experience with batch and real-time streaming data processing, and proficiency in data modeling, data partitioning, and performance tuning techniques. Additionally, you must have hands-on experience with one of the major cloud providers - AWS, Azure, or Google Cloud Platform (GCP), and a deep understanding of cloud-native data architecture, including storage, compute, networking, and security considerations. Familiarity with services like Redshift, Glue, S3, Lambda, EMR, Kinesis (AWS), Data Lake, Synapse, ADF, Databricks, Event Hub (Azure), or BigQuery, Dataflow, Pub/Sub, Composer (GCP) is required. Knowledge of data cataloging, data quality, lineage, and governance frameworks, as well as understanding security and compliance requirements in data platforms, will be beneficial. Preferred qualifications for this role include certifications in cloud platforms (AWS, Azure, or GCP), experience with CI/CD pipelines, DevOps for data, and infrastructure as code (Terraform/CloudFormation), exposure to analytics and BI tools like Power BI, Tableau, Looker, and familiarity with data mesh, data fabric, or modern data architecture patterns. If you possess the skills, leadership qualities, and technical expertise mentioned above, we encourage you to apply to be a part of our dynamic team as the Director / Associate Director Data Engineering.,

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You