Senior Data Engineer

Ciklum

5 - 6 years

25 - 30 Lacs

chennai

Posted:1 day ago| Platform:

Apply

Skills Required

product engineering data management infrastructure management active directory business intelligence microsoft analytics sql python

Work Mode

Work from Office

Job Type

Full Time

Job Description

As a Senior Data Engineer, become a part of a cross-functional development team engineering experiences of tomorrow
You will design, develop, and optimize advanced data solutions leveraging the Microsoft Fabric platform
You will be responsible for building robust, scalable data pipelines, integrating diverse and large-scale data sources, and enabling sophisticated analytics and business intelligence capabilities
This role requires extensive hands-on expertise with Microsoft Fabric, a deep understanding of Azure data services, and mastery of modern data engineering practices

Responsibilities:

Lead the design and implementation of highly scalable and efficient data pipelines and data warehouses using Microsoft Fabric and a comprehensive suite of Azure services (Data Factory, Synapse Analytics, Azure SQL, Data Lake).
Develop, optimize, and oversee complex ETL/ELT processes for data ingestion, transformation, and loading from a multitude of disparate sources, ensuring high performance with large-scale datasets.
Ensure the highest level of data integrity, quality, and governance throughout the entire Fabric environment, establishing best practices for data management.
Collaborate extensively with stakeholders, translating intricate business requirements into actionable, resilient, and optimized data solutions.
Proactively troubleshoot, monitor, and fine-tune data pipelines and workflows for peak performance and efficiency, particularly in handling massive datasets.
Architect and manage workspace architecture, implement robust user access controls, and enforce data security in strict compliance with privacy regulations.
Automate platform tasks and infrastructure management using advanced scripting languages (Python, PowerShell) and Infrastructure as Code (Terraform, Ansible) principles.
Document comprehensive technical solutions, enforce code modularity, and champion best practices in version control and documentation across the team.
Stay at the forefront of Microsoft Fabric updates, new features, and contribute significantly to continuous improvement initiatives and the adoption of cutting-edge technologies.

Requirements:

Minimum of 5+ years of progressive experience in data engineering, with at least 3 years of hands-on, in-depth work on Microsoft Fabric and a wide array of Azure data services.
Exceptional proficiency in SQL, Python, and advanced data transformation tools (eg, Spark, PySpark notebooks).
Mastery of data warehousing concepts, dimensional modeling, and advanced ETL best practices.
Extensive experience with complex hybrid cloud and on-premises data integration scenarios.
Profound understanding of data governance, security protocols, and compliance standards.
Excellent problem-solving, analytical, and communication skills, with the ability to articulate complex technical concepts clearly to both technical and non-technical audiences.

Desirable:

Experience with Power BI, Azure Active Directory, and managing very large-scale data infrastructure.
Strong familiarity with Infrastructure as Code and advanced automation tools.
bachelors degree in Computer Science, Engineering, or a related field (or equivalent extensive experience).

What's in it for you

Strong community: Work alongside top professionals in a friendly, open-door environment
Growth focus: Take on large-scale projects with a global impact and expand your expertise
Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications
Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies
Care: we've got you covered with company-paid medical insurance, mental health support, and financial & legal consultations

More Jobs at Ciklum

Dot Net + Python Developer

Chennai

1 - 3 yrs

INR 3 - 5 Lacs

Senior Lead Generation Specialist

Chennai, Tamil Nadu, India

5 - 8 yrs

Salary: Not disclosed

Middle Dot Net Developer

Chennai

6 - 8 yrs

INR 8 - 10 Lacs

Senior Java Software Engineer

Pune, Chennai

8.0 - 13.0 yrs

INR 0 - 0 Lacs

Presales Consultant - RFI Specialist

Chennai, Tamil Nadu, India

5.0 - 7.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Business Intelligence Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.