Data Platform Architect

10 years

0 Lacs

Posted:1 week ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Overview

This role is responsible for

defining and leading the architecture of a comprehensive data platform

. It involves setting the strategic vision for data ingestion, processing, storage, and consumption, while ensuring scalability, security, and performance. The position requires

Responsibilities

Key Responsibilities: -

  • Architectural Vision & Strategy: Own the overall architecture across data ingestion, processing, storage, and consumption layers.
  • System Design: Deliver detailed architectural diagrams, design documents, and technical specifications; set standards for service interactions.
  • Technology Evaluation & Governance: Research and prototype emerging technologies; establish and enforce technical standards and best practices.
  • Cross-Functional Leadership: Partner with engineering, product, and business stakeholders as the primary technical advisor for all data initiatives.
  • Non-Functional Excellence: Drive strategies for scalability, security, data governance, performance, and cost optimization.
  • Prototyping & Frameworks: Develop proof-of-concepts and foundational frameworks to accelerate engineering delivery.

Requirements

Required Qualifications: -

  • Experience: 10+ years in software engineering, with at least 4 years in a dedicated Architect role.
  • Architectural Expertise: Proven track record in designing and architecting large-scale, distributed data systems from the ground up.
  • Technical Depth:
    • Strong knowledge of the modern data stack, including Apache Spark, Kubernetes, and object storage systems like MinIO or Amazon S3.
    • Hands-on experience with open table formats such as Apache Iceberg, Delta Lake, or Hudi, with a deep understanding of their internal workings.
  • Leadership & Communication: Ability to think strategically, influence without authority, and clearly communicate complex technical concepts to both technical and non-technical audiences.
  • Documentation Skills: Experience creating formal architectural artifacts, including ADRs, design documents, and sequence diagrams.

Preferred Qualifications: -

Experience designing multi-tenant data platforms.Expertise with interactive MPP query engines like Trino or Presto.Knowledge of data governance and data cataloging solutions.Experience with both batch and stream processing architectures (e.g., Kafka, Flink).Familiarity with Infrastructure as Code (Terraform, Pulumi).

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You

chennai, tamil nadu, india