Senior Technical Lead

Bengaluru

Posted:4 days ago

Job Description

Job Summary
  • Senior Data Engineers experienced in Hadoop/Teradata
  • Also share some senior profiles for DAP/EDP (Dbt, Snowflake, AWS) would be great
Key Responsibilities
  • Build pipelines consuming Cards data from commbank.data.
  • Develop Snowflake models and transformations.
  • Build production PySpark processing.
  • Map HPS card/account data into Collections structures.
  • Build data interfaces required by PCC.
  • Implement data-quality and reconciliation controls.
  • Handle late, missing, duplicated and corrected data.
  • Build restartable and recoverable processing.
  • Implement monitoring and alerting.
  • Optimise Snowflake SQL and PySpark workloads.
  • Support migration rehearsals and parallel runs.
  • Investigate production data defects.
  • Participate in design and code reviews
Skill Requirements
    • Snowflake.
    • PySpark.
    • Python.
    • Advanced SQL.
    • AWS and S3.
    • Data pipelines and ETL/ELT.
    • Data modelling.
    • Data quality and reconciliation.
    • Git and CI/CD.
    • Production troubleshooting.
    • Hadoop
    • Teradata
Must Have Skill
Amazon Web Services (AWS),Data Build Tool (DBT),Data Modelling,Hadoop,Snowflake,Teradata
Good to Have Skill
Other Requirements
  • EMR / EMR Serverless.
  • Step Functions or Lambda.
  • Banking experience.

Skills Required

Hadoop AWS Pyspark Data Quality Reconciliation SQL Python ETL Data Modelling GIT Ci/cd Troubleshooting

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
HCLTech logo
HCLTech

Information Technology Services

New Delhi

RecommendedJobs for You

infinite Computer Solution logo

Senior Technical Lead

infinite Computer Solution

India

infinite Computer Solution logo

Senior Technical Lead

infinite Computer Solution

Pune