Data Engineer(Ab-initio & GCP)

Job Summary We are looking for highly skilled Data Engineers with 3 to 5 years of experience in building and managing advanced data solutions. The ideal candidate should have extensive experience with SQL, Ab-Initio, Teradata and Google Cloud Platform (GCP). Key Responsibilities • Be the part of the team towards design, development, and optimization of large-scale data pipelines, ensuring they meet business and technical requirements. • Implement data solutions using SQL, Ab-Initio, Teradata and GCP; ensuring scalability, reliability, and performance. • Mentor and guide the colleagues in the development and execution of ETL processes and data integration solutions. • Take ownership of end-to-end data workflows, from data ingestion to transformation, storage, and accessibility. • Lead performance tuning and optimization efforts for complex SQL queries and Teradata database systems. • Design and implement data governance, quality, and security best practices to ensure data integrity and compliance. • Manage the migration of legacy data systems to cloud-based solutions on Google Cloud Platform (GCP). • Ensure continuous improvement and automation of data pipelines and workflows. • Troubleshoot and resolve issues related to data quality, pipeline performance, and system integration. • Stay up-to-date with industry trends and emerging technologies to drive innovation and improve data engineering practices within the team.

Required Skills • 4 to 6 years of experience in data engineering or related roles. • Strong expertise in SQL, Teradata, and Ab-Initio. • Proficient and good hands on experience in using the Ab-Initio development products - GDE, Conduct>IT, Control Center, Continuous Flows, EME, M-HUB, etc. • Hands-on experience over Unix/Shell scripting. • Proficient in scheduling and analyzing jobs using Autosys (or any similar) Scheduler. • In-depth experience with Google Cloud Platform (GCP), including tools like BigQuery, Cloud Storage, Dataflow, etc. • Proven track record of leading teams and projects related to data engineering and ETL pipeline development. • Experience with data warehousing and cloud-native storage solutions. • Strong analytical and problem-solving skills. • Experience in setting up and enforcing data governance, security, and compliance standards.

Preferred (good to have) Skills • Familiarity with other cloud platforms/services (AWS, Azure). • Familiarity with any other ETL tools like Informatica, Datastage, Alteryx, etc. • Knowledge of Big Data technologies like Hadoop, Spark, Hive, Scala, etc. • Strong communication skills and the ability to collaborate effectively with both technical and non-technical teams.