Senior Software Engineer/GCP Data Engineer

Hsbc

2 - 7 years

15 - 16 Lacs

pune

Posted:-1 days ago| Platform:

Apply

Skills Required

automation data modeling plsql informatica apache troubleshooting analytics monitoring python auditing

Work Mode

Work from Office

Job Type

Full Time

Job Description

Design and Develop Scalable Data Pipelines: Architect and implement end-to-end data workflows using Apache Airflow for orchestration, integrating multiple data sources and sinks across cloud and on-prem environments.
BigQuery Data Modeling and Optimization: Build and optimize data models in Google BigQuery for performance and cost-efficiency, including partitioning, clustering, and materialized views to support analytics and reporting use cases.
ETL/ELT Development and Maintenance: Design robust ETL/ELT pipelines to extract, transform, and load structured and semi-structured data, ensuring data quality, reliability, and availability.
Cloud-Native Engineering on GCP: Leverage GCP services like Cloud Storage, Pub/Sub, Dataflow, and Cloud Functions to build resilient, event-driven data workflows.
CI/CD and Automation: Implement CI/CD for data pipelines using tools like Cloud Composer (managed Airflow), Git, and Terraform, ensuring automated deployment and versioning of workflows.
Data Governance and Security: Ensure proper data classification, access control, and audit logging within GCP, adhering to data governance and compliance standards.
Monitoring and Troubleshooting: Build proactive monitoring for pipeline health and data quality using tools such as Stackdriver (Cloud Monitoring) and custom Airflow alerting mechanisms.
Collaboration and Stakeholder Engagement: Work closely with data analysts, data scientists, and business teams to understand requirements and deliver high-quality, timely data products.

More Jobs at Hsbc

Consultant Specialist

Pune

4 - 9 yrs

INR 22 - 27 Lacs

Consultant Specialist

Pune

7 - 12 yrs

INR 22 - 27 Lacs

Agile, Scrum/Consultant Specialist

Pune

8 - 10 yrs

INR 13 - 14 Lacs

Appian Development/Senior Consultant Specialist

Pune

5 - 10 yrs

INR 8 - 13 Lacs

Senior Audit Manager - DBS Ops (Mumbai and Gurgaon)

Pune

5 - 10 yrs

INR 8 - 12 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.