Cloud Specialist - ETL

You should have at least 5 years of IT experience with a good understanding of analytics tools for effective data analysis. You must be capable of leading teams and have prior experience working in production deployment and production support teams. Proficiency in Big Data tools such as Hadoop, Spark, Apache Beam, Kafka, etc., and object-oriented/object function scripting languages like Python, Java, C++, Scala, etc., is required. Experience with DW tools like BQ, Redshift, Synapse, or Snowflake, as well as ETL and Data Warehousing, is essential. You should have a solid understanding of relational and non-relational databases such as MySQL, MS SQL Server, Postgres, MongoDB, Cassandra, etc., and familiarity with cloud platforms like AWS, GCP, and Azure. Experience with workflow management tools like Apache Airflow is also necessary. As part of your responsibilities, you will be required to develop high-performance and scalable solutions using GCP for extracting, transforming, and loading big data. You will design and build production-grade data solutions from ingestion to consumption using Java or Python, as well as optimize data models on the GCP cloud using data stores like BigQuery. Handling the deployment process, optimizing data pipelines for performance and cost efficiency for large-scale data lakes, and writing complex queries across extensive datasets are also key tasks. Collaboration with Data Engineers to select the appropriate tools for delivering product features through POCs, engaging with business stakeholders, BAs, and other Data/ML engineers, and exploring new use cases for existing data are also part of the role. Preferred qualifications include familiarity with design best practices for OLTP and OLAP systems, participation in DB and pipeline design, exposure to load testing methodologies, debugging pipelines, and delta load handling, as well as involvement in heterogeneous migration projects.,