Senior GCP Data Engineer

Job Description

Job Title : Senior GCP Data Engineer Qualification : Any Graduate or Above Relevant Experience : 5 to 8 Years Must Have Skills : Data Engineering,Teradata,GCP/Azure Good to Have Skills: Python Roles and Responsibilities : Design and implementation of data pipelines using GCP services for one or more projects • Manage Deployments of data applications and ensure efficient orchestration of services. • Implement CI/CD pipelines using Jenkins or cloud native tools to automate data pipeline deployment, testing, and integration with other services, ensuring quick iterations and deployments. • Guide a team of data engineers in building and maintaining scalable, high-performance data pipelines. • Build data pipelines and ETL/ELT processes leveraging Python, Beam and SQL scripts. • Willingness and ability to learn and adapt to new technologies as needed during client engagements. • Continuously monitor and optimize data workflows for performance and cost-effectiveness. • Design workflows to integrate data from various sources using GCP services and orchestrate complex tasks with Cloud Composer (Apache Airflow). • Set up monitoring, logging, and alerting using Cloud Monitoring, Datadog, or other tools to ensure visibility into pipeline performance and quickly identify and resolve issues. • Guide and mentor junior developers and data engineers, helping them overcome technical challenges and ensuring high-quality code and solutions. • Work closely with application developers, data architects, and business stakeholders to define and deliver robust data-driven solutions. • Work on data migration from various databases/legacy DW systems build on Oracle, Teradata, SQL server etc to GCP cloud data platform, • Facilitate agile processes like sprint planning, daily scrums, and backlog grooming. • Interact with clients stakeholders on assigned data, BI and analytics programs • Work closely with program leadership team on stakeholder management, governance and communication. Location : Bangalore/Hyderabad/Chennai CTC Range : 20 LPA - 24 LPA (Lakhs Per Annum) Notice period : Immediate Shift Timing : General Mode of Interview : Virtual Mode of Work : Hybrid Jyoti Team Lead Black and White Business solutions PVT Ltd Bangalore, Karnataka, INDIA. jyotirekha@blackwhite.in I www.blackwhite.in