Manager/Senior Manager - Data Engineering

Manager/Senior Manager - Data Engineering (8-12 Years)

Cognitio Analytics | Gurgaon (Hybrid)

Location:

Experience:

Website:

Employment Type:

About Cognitio Analytics:

Cognitio Analytics

Total Rewards Data Factory

Great Place to Work

Role: Manager/Senior Manager - Data Engineering

We are seeking an experienced Data Engineering Lead (8–12 years) to drive the design, development, and optimization of our cloud-based data platforms. This role involves leading a team of data engineers, managing end-to-end project execution, and collaborating closely with cross-functional stakeholders.

Key Responsibilities:

• Lead the design, build, testing, and deployment of scalable data pipelines and models on the production data platform.
• Define and implement processes for operational excellence across agile development and data engineering workflows.
• Oversee data infrastructure including data warehouses, data lakes, and integration components for efficient ETL/ELT.
• Collaborate with clients, vendors, leadership, and internal teams for smooth delivery and ongoing support.
• Contribute to roadmap planning and prioritization with business owners.
• Ensure adherence to best practices in data modeling, data quality, governance, reusability, and security.
• Evaluate and adopt modern tools, technologies, and frameworks to enhance team efficiency.
• Lead project planning, execution, tracking, and quality control for data engineering initiatives.
• Establish and track KPIs to measure team performance and solution effectiveness.
• Stay updated with advancements in Azure Cloud and data engineering technologies.

Qualifications:

• 8–12 years of experience in Data Engineering, analytics, data warehousing, and data management.
• Experience managing data engineers through planning, execution, monitoring, and delivery cycles.
• Strong knowledge of cloud-based data tools and platforms, especially Azure.
• Experience building scalable systems supporting data transformation, metadata, security, governance, and workload management.
• Expertise in designing and optimizing models for RDBMS, NoSQL, and data warehouse environments.
• Proven ability to lead complex data engineering initiatives and drive innovation.
• Excellent communication, stakeholder management, and leadership skills.

Must Have Skills:

• SQL, Python, PySpark, Spark SQL, Spark, Distributed Systems
• Databricks, ADLS Gen2, Azure DevOps, Azure Data Factory
• ETL/ELT pipelines, Data Warehousing, Datamarts, Data Modeling, Data Governance
• Agile practices, SDLC, DevOps, CI/CD for data workflows
• Deep understanding of Microsoft Azure (preferred)
• Hands-on Azure Databricks (ingestion, transformation, workflow orchestration, job optimization)
• Experience with ADLS Gen2 setup and best-practice data lake architectures
• Familiarity with big data frameworks (e.g., Apache Spark)
• Knowledge of Azure Key Vault for secure secret and certificate management

Good to Have:

• Event Hubs
• Workflow orchestration tools
• Cosmos DB
• Power BI
• Professional Services background
• Scala or Java

Gurgaon (Hybrid)

Cognitio Analytics is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, sex, national origin, age, religion, marital status, sexual orientation, gender identity, gender expression, veteran status, disability, or any other protected category. All employees must adhere to Cognitio’s Security and Privacy policies to ensure protection of company and client data. Our compensation ranges are designed to be market competitive and form part of a total rewards package that includes bonuses, equity options, benefits, and additional opportunities. Individual compensation is determined by experience, skills, and role fit.