Team Description :
   The Channel Data Insights team develops and produces digital behavioural data and analytics for Digital Experience platforms within Investec Bank Ltd and PLC. 
  Key Responsibilities : 
  We are seeking an experienced Data Engineer to join the CXT/CDX Data & Insights team. The role encompasses end-to-end data engineering responsibilities: data ingestion, transformation, modelling, and warehousing. The successful candidate will build scalable, self-service data products using Azure-based technologies aligned with Investec's Data Experience Framework and One Data Platform (ODP) standards. You will be instrumental in delivering high-quality data solutions to business and end users across the Bank, either via self-service products or in collaboration with the Analytics squad to deliver modelled data products. This role involves technical mentorship and collaboration with global CDX teams to ensure design efficacy and solution impact. While cloud-first (primarily Azure), the role may occasionally interact with legacy on-premises systems that are being decommissioned. You will work closely with teams such as Architecture, DevOps, Database Administration, and Application teams, across both India and global offices . 
  
Data Engineering & Platform Development
   - Build and manage metadata-driven data ingestion pipelines using Azure Data Factory and Databricks 
  Maintain and enhance the Channel Data Analytics Platform 
  Develop business-focused data products and data marts 
  Build and maintain Azure Analysis Services models (multidimensional and tabular) 
  Execute all stages of the data engineering lifecycle using IDX methodology 
  Implement DevOps practices for deployment pipelines 
  Use IaC tools (Bicep, Azure CLI, PowerShell) to automate infrastructure provisioning 
  
Collaboration & Stakeholder Engagemen
 t   Partner with business users and analysts to translate insights into technical solutions 
  Work with Architecture and Application teams to implement scalable, robust pipelines 
  Participate in code reviews and knowledge-sharing sessions across squads 
  
Governance, Documentation & Standards
   Develop and maintain technical documentation, checklists, and operational procedures 
  Promote data security, CI/CD practices, and mitigate human error 
  Share in support and operational duties within the engineering team 
  
Innovation & Cloud Migration
   Support and influence the migration of on-prem systems to Azure 
  Stay current with evolving cloud technologies and drive adoption of best practices 
  
  
Core Skills & Knowledge
   
10+ years of experience in data engineering roles
   
Proficient in Azure Data Factory, Databricks, Synapse Analytics, ADLS Gen2
   
Strong SQL and Python skills, including stored procedures and data wrangling
   
Expertise in Apache Spark, PySpark, and Pandas
   
Experience in building and tuning large-scale ETL processes
   
Skilled in data warehouse modelling (Kimball, Data Vault 2.0)
   
Experience with Azure Bicep templates, DevOps pipelines, and GIT
   
Strong understanding of distributed data mesh principles
   
Familiarity with Unity Catalog and Azure Analysis Services
   
Performance tuning in Spark Agile methodology experience
   
Effective communicator across technical and non-technical teams
   
Preferred skills C# / .NET Core / .NET Framework JavaScript frameworks: ReactJS, Angular Microservices architecture and event-driven design Mobile development (React Native, Swift, Android Java) Containerization tools: Docker, Podman AI tools and technologies.
   
  
Required Qualifications
   
Bachelor's degree in computer science or related field from an accredited university and/or equivalent work experience
   
Microsoft Azure certifications (Mandatory AZ900, DP900, DP201, DP202), Preferred (Databricks Fundamentals, Databricks Azure Databricks Platform Architect)