Sr Data Engineer

About The Role

Senior Data Engineer

Key Responsibilities

• Architect and implement end-to-end data infrastructure including ingestion, transformation, storage, and access layers to support enterprise-scale analytics and machine learning.
• Define and enforcedata engineering standards, design patterns, and best practices across the CoE.
• Lead theevaluation and selection of tools, frameworks, and platforms (cloud, open source, commercial) for scalable and secure data processing.
• Work with data scientists to enable efficient feature extraction, experimentation, and model deployment pipelines.
• Design forreal-time and batch processing architectures, including support for streaming data and event-driven workflows.
• Own thedata quality, lineage, and governance frameworks to ensure trust and traceability in data pipelines.
• Collaborate with central IT, data platform teams, and business units to align on data strategy, infrastructure, and integration patterns.
• Mentor and guide junior engineers as the team expands, creating a culture of high performance and engineering excellence.
  

Qualifications

• 10+ years of hands-on experience in data engineering, data architecture, or platform development.
• Strong expertise inbuilding distributed data pipelines using tools like Spark, Kafka, Airflow, or equivalent orchestration frameworks.
• Deep understanding ofdata modeling, data lake/lakehouse architectures, and scalable data warehousing (e.g., Snowflake, BigQuery, Redshift).
• Advanced proficiency inPython and SQL, with working knowledge of Java or Scala preferred.
• Strong experience working oncloud-native data architectures (AWS, GCP, or Azure) including serverless, storage, and compute optimization.
• Proven experience in architectingML/AI-ready data environments, supporting MLOps pipelines and production-grade data flows.
• Familiarity withDevOps practices, CI/CD for data, and infrastructure-as-code (e.g., Terraform) is a plus.
• Excellent problem-solving skills and the ability to communicate technical solutions to non-technical stakeholders.