Data Lead - 8+ Years - Hybrid - Kochi, Chennai, Coimbatore

Notice Period-Immediate Joiner or Max 10 days (Do not share long notice period profile.)

Permanent Payroll - Anlage Infotech

Client - Orion Innovation

Location- Kochi - Chennai - Coimbatore - HYBRID (2/3 days in a week)

Role & responsibilities

Key Responsibilities:

• Lead the design and implementation of robust data pipelines and architectures using Azure Databricks,

ADF, and PySpark.

• Provide technical leadership and mentoring to a team of data engineers.
• Drive the adoption of best practices in data engineering, coding standards, and data quality assurance.
• Collaborate with cross-functional teams including data science, product, business, and analytics to define

and deliver data-driven solutions.

• Own end-to-end delivery of data initiatives, ensuring projects are delivered on time and within scope.
• Architect scalable solutions using Azure cloud-native services, ensuring performance, security, and cost

optimization.

• Establish and monitor SLAs for data pipelines, orchestrate job schedules, and ensure high availability.
• Act as a key stakeholder in data governance, data cataloging, and metadata management efforts.
• Drive continuous improvement in development processes, automation, and CI/CD pipelines.

Required Qualifications:

• Bachelors or Master’s degree in Computer Science, Engineering, or a related discipline.
• 5+ years of experience in data engineering, with 2+ years in a leadership or team lead capacity.
• Proven expertise in:

• Azure Databricks (including Delta Lake, Spark optimizations)
• Azure Data Factory
• PySpark
• Hands-on experience with Azure Data Lake, SQL, and distributed data processing.
• Solid understanding of data architecture patterns, data modeling, and performance tuning.
• Strong experience in stakeholder management and cross-functional collaboration.
• Experience with CI/CD tools (Azure DevOps, GitHub Actions, etc.) and DevOps practices.
• Knowledge of cloud cost optimization, security, and compliance in Azure.

Preferred Qualifications:

• Experience with Azure Synapse Analytics, Azure Functions, Event Hubs, or Stream Analytics.
• Familiarity with Agile/Scrum methodologies.
• Exposure to data governance frameworks and tools like Purview.
• Understanding of business KPIs and ability to translate business needs into technical solutions.
• Excellent communication, leadership, and people management skills.