Posted:1 month ago|
Platform:
Work from Office
Full Time
Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design. A Senior Data Engineer designs and oversees the entire data infrastructure, data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective.
Key Responsibilities :
Oversee the entire data infrastructure to ensure scalability, operation efficiency and resiliency.
- Mentor junior data engineers within the organization.
- Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
- Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).
- Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
- Optimize data pipelines in the Azure environment for performance, scalability, and reliability.
- Ensure data quality and integrity through data validation techniques and frameworks.
- Develop and maintain documentation for data processes, configurations, and best practices.
- Monitor and troubleshoot data pipeline issues to ensure timely resolution.
- Stay current with industry trends and emerging technologies to ensure our data solutions
remain cutting-edge.
- Manage the CI/CD process for deploying and maintaining data solutions.
Maimsd Technology
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
thiruvananthapuram, kerala
Salary: Not disclosed
Mumbai, Maharashtra, India
4.5 - 8.0 Lacs P.A.
haryana
Salary: Not disclosed
telangana
Salary: Not disclosed
vadodara, gujarat
Salary: Not disclosed
maharashtra
Salary: Not disclosed
Bengaluru, Karnataka, India
1.0 - 11.5 Lacs P.A.
Pune, Maharashtra, India
Salary: Not disclosed
Telangana
Experience: Not specified
Salary: Not disclosed
Telangana
Experience: Not specified
Salary: Not disclosed
