EY - GDS Consulting - AI and DATA - GCP-Azure-DBT - Senior

Job Description

We are looking for a highly skilled and experienced Data Engineer with 3 to 7 years of experience to join our team in Bengaluru. The ideal candidate will have a strong background in building data pipelines using Google Cloud Platform (GCP) and hands-on experience with BigQuery, GCP SDK, and API scripting. ### Roles and Responsibility Design, develop, and implement data pipelines using BigQuery and GCP SDK. Build and orchestrate data fusion pipelines for data migration from various databases. Develop scripts in Python and write technical architecture documentation. Implement monitoring architecture and test GCP services. Participate in Agile and DevOps concepts, including CI/CD pipelines and test-driven frameworks. Collaborate with cross-functional teams to deliver high-quality solutions. ### Job Requirements Bachelor's degree in Computer Science, Information Technology, or related field. Minimum 3 years of experience in data engineering, preferably with GCP. Strong understanding of application architecture and programming languages. Experience with AWS and/or Azure and/or GCP, along with a proven track record of building complex infrastructure programmatically. Strong scripting and programming skills in Python and Linux Shell. Experience with Agile and DevOps concepts, as well as CI/CD pipelines and test-driven frameworks. Certification in Google Professional Cloud Data Engineer is desirable. Proactive team player with good English communication skills. Good understanding of Application Architecture. Experience working on CMMI / Agile / SAFE methodologies. Experience working with AWS and/or Azure and/or GCP and a proven track record of building complex infrastructure programmatically with IaC tooling or vendor libraries. Strong communication and written skills. Experience creating technical architecture documentation. Experience in Linux OS internals, administration, and performance optimization.