Principal Data Engineer

Job Description

This role is for one of Weekday's clients Min Experience: 8 years Location: Pune JobType: full-time Requirements Title: Principal Data Engineer Job Description: Job Summary: Lead the design, development, and optimization of enterprise-scale data pipelines and architectures to drive data-driven decision-making. Architect efficient data tables and schemas to enhance query performance, ensuring seamless integration with cross-functional teams Key Responsibilities: Data Pipeline Design and implement high-performance data pipelines using ETL processes, batch/streaming frameworks (e.g., Apache Spark, Airflow), and cloud platforms (AWS) Optimize data ingestion, transformation, and storage workflows to meet scalability, reliability, and latency requirements Data Architecture & Query Efficiency Architect database schemas and dimensional models (e.g., star/snowflake) to maximize query performance and reduce latency Implement indexing strategies, partitioning, and materialized views to optimize data retrieval Collaboration & Governance Partner with data scientists, product managers, and engineers to align data infrastructure with business needs Establish data governance frameworks, ensuring compliance with security, privacy, and quality standards Mentor junior engineers and foster best practices in data engineering Innovation & Leadership Stay ahead of industry trends (e.g., AI/ML integration, real-time analytics) and advocate for emerging technologies Lead technical strategy for data infrastructure, balancing innovation with operational stability Technical Expertise: 8+ years of experience in data engineering, with a focus on ETL, data modelling, and cloud-based architectures Proficiency in SQL, Python, and tools like Spark and Snowflake Strong knowledge of database design, dimensional modeling, and query optimization Leadership & Collaboration Proven ability to lead teams, mentor engineers, and drive technical initiatives Experience translating business requirements into scalable technical solutions Preferred Qualification - Expertise in machine learning model deployment or real-time analytics Familiarity with DevOps practices (CI/CD, Docker, Kubernetes) Our Core Values Data Fanatics: Our edge is always found in the data Partner Obsessed: We are obsessed with partner success Team of Doers: We have a bias for action Game Changers: We encourage innovation Show more Show less