Team Description :
The Channel Data Insights team develops and produces digital behavioural data and analytics for Digital Experience platforms within Investec Bank Ltd and PLC.
Key Responsibilities :
We are seeking an experienced Data Engineer to join the CXT/CDX Data & Insights team. The role encompasses end-to-end data engineering responsibilities: data ingestion, transformation, modelling, and warehousing. The successful candidate will build scalable, self-service data products using Azure-based technologies aligned with Investec's Data Experience Framework and One Data Platform (ODP) standards. You will be instrumental in delivering high-quality data solutions to business and end users across the Bank, either via self-service products or in collaboration with the Analytics squad to deliver modelled data products. This role involves technical mentorship and collaboration with global CDX teams to ensure design efficacy and solution impact. While cloud-first (primarily Azure), the role may occasionally interact with legacy on-premises systems that are being decommissioned. You will work closely with teams such as Architecture, DevOps, Database Administration, and Application teams, across both India and global offices .
Data Engineering & Platform Development
- Build and manage metadata-driven data ingestion pipelines using Azure Data Factory and Databricks
Maintain and enhance the Channel Data Analytics Platform
Develop business-focused data products and data marts
Build and maintain Azure Analysis Services models (multidimensional and tabular)
Execute all stages of the data engineering lifecycle using IDX methodology
Implement DevOps practices for deployment pipelines
Use IaC tools (Bicep, Azure CLI, PowerShell) to automate infrastructure provisioning
Collaboration & Stakeholder Engagemen
t Partner with business users and analysts to translate insights into technical solutions
Work with Architecture and Application teams to implement scalable, robust pipelines
Participate in code reviews and knowledge-sharing sessions across squads
Governance, Documentation & Standards
Develop and maintain technical documentation, checklists, and operational procedures
Promote data security, CI/CD practices, and mitigate human error
Share in support and operational duties within the engineering team
Innovation & Cloud Migration
Support and influence the migration of on-prem systems to Azure
Stay current with evolving cloud technologies and drive adoption of best practices
Core Skills & Knowledge
10+ years of experience in data engineering roles
Proficient in Azure Data Factory, Databricks, Synapse Analytics, ADLS Gen2
Strong SQL and Python skills, including stored procedures and data wrangling
Expertise in Apache Spark, PySpark, and Pandas
Experience in building and tuning large-scale ETL processes
Skilled in data warehouse modelling (Kimball, Data Vault 2.0)
Experience with Azure Bicep templates, DevOps pipelines, and GIT
Strong understanding of distributed data mesh principles
Familiarity with Unity Catalog and Azure Analysis Services
Performance tuning in Spark Agile methodology experience
Effective communicator across technical and non-technical teams
Preferred skills C# / .NET Core / .NET Framework JavaScript frameworks: ReactJS, Angular Microservices architecture and event-driven design Mobile development (React Native, Swift, Android Java) Containerization tools: Docker, Podman AI tools and technologies.
Required Qualifications
Bachelor's degree in computer science or related field from an accredited university and/or equivalent work experience
Microsoft Azure certifications (Mandatory AZ900, DP900, DP201, DP202), Preferred (Databricks Fundamentals, Databricks Azure Databricks Platform Architect)