Ab-Initio DWH/ETL Engineers

We are looking for a highly skilled Senior Data Engineer with 4 to 6 years of experience in building and managing advanced data solutions. The ideal candidate should have extensive experience with SQL, Ab-Initio, Teradata and Google Cloud Platform (GCP).

Key Responsibilities

• Be the part of the team towards design, development, and optimization of large-scale data pipelines, ensuring they meet business and technical requirements.
• Implement data solutions using SQL, Ab-Initio, Teradata and GCP; ensuring scalability, reliability, and performance.
• Mentor and guide the colleagues in the development and execution of ETL processes and data integration solutions.
• Take ownership of end-to-end data workflows, from data ingestion to transformation, storage, and accessibility.
• Lead performance tuning and optimization efforts for complex SQL queries and Teradata database systems.
• Design and implement data governance, quality, and security best practices to ensure data integrity and compliance.
• Manage the migration of legacy data systems to cloud-based solutions on Google Cloud Platform (GCP).
• Ensure continuous improvement and automation of data pipelines and workflows.
• Troubleshoot and resolve issues related to data quality, pipeline performance, and system integration.
• Stay up-to-date with industry trends and emerging technologies to drive innovation and improve data engineering practices within the team.

Required Skills

• 4 to 6 years of experience in data engineering or related roles.
• Strong expertise in SQL, Teradata, and Ab-Initio.
• Proficient and good hands on experience in using the Ab-Initio development products - GDE, Conduct>IT, Control Center, Continuous Flows, EME, M-HUB, etc.
• Hands-on experience over Unix/Shell scripting.
• Proficient in scheduling and analyzing jobs using Autosys (or any similar) Scheduler.
• In-depth experience with Google Cloud Platform (GCP), including tools like BigQuery, Cloud Storage, Dataflow, etc.
• Proven track record of leading teams and projects related to data engineering and ETL pipeline development.
• Experience with data warehousing and cloud-native storage solutions.
• Strong analytical and problem-solving skills.
• Experience in setting up and enforcing data governance, security, and compliance standards.

Preferred (good to have) Skills

• Familiarity with other cloud platforms/services (AWS, Azure).
• Familiarity with any other ETL tools like Informatica, Datastage, Alteryx, etc.
• Knowledge of Big Data technologies like Hadoop, Spark, Hive, Scala, etc.
• Strong communication skills and the ability to collaborate effectively with both technical and non-technical teams.