Developer - GCP & Data Engineer

As a Data Engineer, you will be responsible for designing and developing scalable data engineering solutions using Google Cloud Platform (GCP) and PySpark. Your main focus will be on optimizing Spark jobs for performance, scalability, and efficient resource utilization. You will also be involved in developing, maintaining, and enhancing ETL pipelines using BigQuery, Apache Airflow, and Cloud Composer. Collaborating with data scientists, analysts, and DevOps teams to translate business requirements into technical solutions will be a key aspect of your role. Ensuring data integrity and security by implementing data governance, compliance, and security best practices will be crucial. Monitoring production workloads, troubleshooting performance issues, and implementing enhancements will also be part of your responsibilities. You will be expected to implement and enforce coding standards, best practices, and performance tuning strategies. Additionally, supporting migration activities from on-premises data warehouses to GCP-based solutions will be part of your duties. Mentoring junior developers and contributing to knowledge-sharing within the team will be essential. Staying up to date with emerging cloud technologies, tools, and best practices in the data engineering ecosystem is also a key requirement. The ideal candidate should have + years of total experience in data engineering with + years of hands-on experience with Google Cloud Platform (GCP), including BigQuery, Apache Airflow, and Cloud Composer. Strong expertise in developing and optimizing large-scale data processing solutions using PySpark and Python is necessary. In-depth knowledge of SQL for data transformation and performance optimization is also required. Proficiency in big data technologies such as Hadoop, HDFS, Hive, and YARN is essential. Experience with distributed computing principles, data partitioning, and fault tolerance is preferred. Hands-on experience with CI/CD pipelines, version control (Git), and automation tools is a plus. Strong problem-solving, analytical, and troubleshooting skills are important for this role. Experience working in Agile/Scrum environments is beneficial. Excellent communication and collaboration skills are necessary to work with offshore and onshore teams. In this role, you will have the opportunity to work in a collaborative environment where your contributions create value. You will develop innovative solutions, build lasting relationships with colleagues and clients, and have access to global capabilities to bring your ideas to life. Your career will evolve in a company built to grow and last, supported by leaders who care about your well-being and provide opportunities for skill development and growth. Join us, one of the world's largest IT and management consulting companies, and become a part of a team dedicated to making a difference in the technology industry.,