At Meazure Learning
To provide life-long learners across the globe the freedom to pursue their academic dreams and career aspirations safely, securely, and conveniently.”
Hungry, Humble, and Smart.
The Role:
Principal Data Engineer
The Responsibilities:
Enterprise Data Architecture & Infrastructure:
- Design, develop, and maintain scalable and reliable data pipelines that process and transform large datasets from a variety of sources.
- Build hybrid data ecosystems integrating on-prem SQL Server Data Warehouse (DW) with cloud-native platforms for seamless migration and interoperability
- Define and lead enterprise data architecture strategy across multi-cloud environments (Azure, AWS etc..).
- Architect, design, and optimize large-scale, high-performance data platforms leveraging Azure Synapse, Delta Lake, Databricks, and Amazon Redshift.
- Implement Medallion architecture and scalable data Lakehouse solutions on Azure Data Lake Storage Gen2 and AWS S3.
- Develop semantic models and optimized datasets to enable analytics in Power BI Premium and AWS QuickSight.
- Architect and manage data models, databases, and data warehouse/Lakehouse solutions ensuring performance, scalability, and data integrity.
- Drive adoption of Data Mesh principles, enabling decentralized ownership and domain-oriented data architecture.
Data Engineering, Integration & Automation:
- Design and orchestrate robust ETL/ELT pipelines using Azure Data Factory, AWS Glue, SSIS, and modern orchestration frameworks.
- Modernize legacy ETL frameworks (SSIS) into cloud-native ADF or Glue pipelines for scalability and reusability.
- Integrate structured, semi-structured, and unstructured data across systems for large-scale data transformations.
- Build and maintain SSAS Tabular and Multidimensional Cubes, integrating with Power BI and modern BI ecosystems.
- Implement data ingestion, transformation, and serving pipelines following Medallion and modular architecture.
- Enable real-time and streaming data processing using Kafka, Kinesis, or Azure Event Hubs.
- Drive CI/CD adoption for data platforms using Azure DevOps, GitHub Actions, or AWS Code Pipeline for automated validation and deployments.
- Implement automated data testing, lineage tracking, and observability frameworks to improve transparency and reliability.
Data Modeling, Quality & Governance:
- Lead design of enterprise data models using Star, Snowflake, and Data Vault 2.0 methodologies across SQL Server DW and Azure Synapse.
- Define and implement data quality, validation, and governance frameworks to ensure accuracy and compliance.
- Lead implementation of metadata management and data catalogs using Azure Purview or AWS Glue Data Catalog.
- Ensure data lineage, RBAC, and encryption standards are consistently enforced across environments.
Collaboration & Leadership:
- Mentor and provide guidance to junior and mid-level data engineers, fostering a collaborative and growth-oriented environment.
- Lead the evaluation and adoption of emerging technologies such as Microsoft Fabric, Databricks, and real-time analytics platforms.
- Partner with data scientists, analysts, and other engineering teams to develop robust, scalable data solutions.
- Collaborate with stakeholders in other departments to identify data needs, provide technical expertise, and deliver data-driven solutions.
- Collaborate with business stakeholders and data analysts to understand requirements and ensure data infrastructure supports the company’s data needs.
- Architect and manage data models, databases, and data warehouse solutions that ensure data integrity, performance, and scalability.
Performance, Reliability & Optimization:
- Monitor, troubleshoot, and optimize the performance of data pipelines and data infrastructure, ensuring high availability and low latency.
- Drive performance tuning and optimization of SQL Server DW, Synapse, and Redshift workloads for efficiency and scalability).
- Implement data observability solutions for proactive issue detection, latency reduction, and pipeline reliability.
- Continuously enhance scalability and resilience through containerized and serverless architectures (Kubernetes, Lambda, Azure Functions).
- Drive process automation and continuous improvement, ensuring efficient resource utilization and minimal downtime.
Innovation & Strategy:
- Stay current with emerging data engineering trends, including data mesh, data fabric, observability, and AI-driven data management.
- Advocate new data management paradigms and automation strategies that enhance enterprise agility.
- Lead the design and implementation of innovative data solutions that support Meazure Learning’s business strategy.
Additional Position Information:
- Remote India Opportunity
- Core Hours: 2 PM – 11 PM (IST)
- Core Days Worked: Monday - Friday
The Desired Attributes:
Experience:
15+ years of experience in data engineering, with a strong focus on designing and building data pipelines, ETL, ELT processes, and data warehousing solutions.Technical Expertise:
Advanced proficiency in SQL, MPP performance tuning, and large-scale data transformations using Python, PySpark etc. Strong knowledge of Snowflake and Data Vault 2.0 modeling techniques.Data Architecture Knowledge:
Strong understanding of data architecture, data modeling, and database design principles, as well as hands-on experience with relational, NoSQL, and big data technologies.Problem Solving & Critical Thinking:
Strong analytical and problem-solving skills, with the ability to troubleshoot complex data engineering issues and propose innovative solutions.Collaboration & Leadership:
Experience leading cross-functional teams, mentoring junior engineers, and collaborating with business stakeholders to design and implement data solutions.Adaptability & Growth Mindset:
Willingness to adapt and continuously learn in a fast-paced and evolving data landscape. Ability to identify areas for process improvement and implement changes accordingly.Communication Skills:
Excellent communication skills, both written and verbal, with the ability to convey complex technical concepts to non-technical stakeholders.
The Total Rewards - The Benefits:
- Competitive Pay
- Healthy Work Culture
- Career Growth Opportunities
- Learning and Development Opportunities
- Company Sponsored Health Insurance
- Referral Award Program
- Company Provided IT Equipment (for remote team members)
- Transportation Program (on-site team members)
- Company Provided Meals (on-site team members)
- 14 Company Provided Holidays
- Generous Leave Program
Learn more at www.meazurelearning.com
Meazure Learning is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: Meazure Learning is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at Meazure Learning are based on business needs, job requirements, and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. Meazure Learning will not tolerate discrimination or harassment based on any of these characteristics.
