Principal Data Engineer

8 years

0 Lacs

Posted:2 months ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Job Description: Job Summary: Lead the design, development, and optimization of enterprise-scale data pipelines and architectures to drive data-driven decision-making. Architect efficient data tables and schemas to enhance query performance, ensuring seamless integration with cross-functional teams Key Responsibilities: Data Pipeline Design and implement high-performance data pipelines using ETL processes, batch/streaming frameworks (e.g., Apache Spark, Airflow), and cloud platforms (AWS). Optimize data ingestion, transformation, and storage workflows to meet scalability, reliability, and latency requirements. Data Architecture & Query Efficiency Architect database schemas and dimensional models (e.g., star/snowflake) to maximize query performance and reduce latency. Implement indexing strategies, partitioning, and materialized views to optimize data retrieval. Collaboration & Governance Partner with data scientists, product managers, and engineers to align data infrastructure with business needs. Establish data governance frameworks, ensuring compliance with security, privacy, and quality standards. Mentor junior engineers and foster best practices in data engineering Innovation & Leadership Stay ahead of industry trends (e.g., AI/ML integration, real-time analytics) and advocate for emerging technologies. Lead technical strategy for data infrastructure, balancing innovation with operational stability. Technical Expertise: 8+ years of experience in data engineering, with a focus on ETL, data modelling, and cloud-based architectures. Proficiency in SQL, Python, and tools like Spark and Snowflake. Strong knowledge of database design, dimensional modeling, and query optimization. Leadership & Collaboration Proven ability to lead teams, mentor engineers, and drive technical initiatives. Experience translating business requirements into scalable technical solutions. Preferred Qualification – Expertise in machine learning model deployment or real-time analytics. Familiarity with DevOps practices (CI/CD, Docker, Kubernetes). Our Core Values Data Fanatics: Our edge is always found in the data Partner Obsessed: We are obsessed with partner success Team of Doers: We have a bias for action Game Changers: We encourage innovation Pattern is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Show more Show less

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

Chennai, Tamil Nadu, India