Cloud Data Engineer

Role Overview: You will be responsible for building end-to-end data applications by integrating backend APIs with analytical front-ends. With over 3 years of IT experience, you are expected to have a good understanding of analytics tools for effective data analysis. Your ability to learn new tools and technologies will be crucial for this role. You should have prior experience working with at least one Structural (SQL/Oracle/Postgres) and one NoSQL database. A strong understanding of Data Warehouse (DW), Data Mart, and Data Modelling concepts is essential, and you should have been part of a Data Warehouse design team in at least one project. Key Responsibilities: - Develop high performance and scalable solutions using Google Cloud Platform (GCP) to extract, transform, and load big data. - Design and build production-grade data solutions using Java/Python for ingestion to consumption. - Design and optimize data models on GCP cloud utilizing GCP data stores like BigQuery. - Optimize data pipelines for performance and cost efficiency in large-scale data lakes. - Write complex and highly-optimized queries across extensive datasets to create data processing layers. - Collaborate closely with Data Engineers to select the right tools for delivering product features by conducting Proof of Concepts. - Research new use cases for existing data and work as a collaborative team player with business, BAs, and other Data/ML engineers. Qualifications Required: - Good understanding of Design Best practices for OLTP and OLAP Systems. - Exposure to load testing methodologies, debugging pipelines, and delta load handling. - Experience in creating Dag Files using Python and SQL for ETL processes. - Familiarity with exploratory analysis of logs. Experience as an Apache Beam developer with Google Cloud BigTable and Google BigQuery is desirable. - Proficiency in Google Cloud Platform (GCP) and writing batch and stream processing jobs using Apache Beam Framework (Dataflow). - Experience with Spring Boot, knowledge of Microservices, Pub/Sub, Cloud Run, and Cloud Function will be beneficial for this role.,