Director - Data Engineering

15 years

0 Lacs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

  • Lead the design and architecture of modern data platforms, including Data Lakehouse, Data Mesh, and event-driven architectures, across various cloud environments, with a strong preference for AWS.
  • Architect and implement data solutions that leverage GraphDBs for complex relationship mapping and VectorDBs for semantic search and AI applications, ensuring optimal performance and scalability.
  • Drive and execute end-to-end cloud migration strategies for legacy data assets, ensuring a seamless transition with zero downtime.
  • Architect and implement real-time data ingestion and processing pipelines using technologies such as Apache Kafka, Spark Streaming, and Apache Flink to support real-time analytics and applications.
  • Define and enforce ETL/ELT coding standards to ensure data consistency, reusability, and long-term maintainability of data pipelines.
  • Establish and champion comprehensive data governance frameworks, including data lineage, compliance, and security practices.
  • Lead the strategic and functional architecture of data platforms, focusing on the deployment and integration of solutions rather than the development of AI models.
  • Collaborate with business stakeholders to translate complex business requirements into scalable and sustainable architectural designs.
  • Lead, mentor, and guide a team of engineers, fostering a culture of technical excellence and innovation.

Required Skills and Qualifications

  • Bachelor's degree in Information Technology, Computer Science, or a related field.
  • 15+ years of experience in a data engineering or architectural leadership role.
  • Proven expertise in cloud platforms, with a strong focus on AWS.
  • Extensive experience with modern data architectures, including Kappa/Lambda, Data Lakehouse, and Data Mesh.
  • Deep technical proficiency in data engineering tools such as Apache Spark, Apache Flink, Kafka, and PySpark.
  • Proven experience with GraphDBs (e.g., Neo4j, Amazon Neptune) or VectorDBs (e.g., Pinecone, Milvus).
  • Demonstrated understanding of strategic and functional architecture, with a focus on solution deployment and infrastructure design in a cloud environment.
  • Strong understanding of data governance principles, including data lineage, MDM, and security.
  • Excellent communication and leadership skills, with the ability to translate complex technical concepts to both technical and non-technical audiences.

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You