Job
Description
Job Title: GCP Data Engineer – Data Migration & Transformation Location: Chennai Experience Level: 4+ Years Key Responsibilities: Design and build robust, scalable data pipelines and architectures on GCP, especially BigQuery. Migrate and transform large-scale data systems and datasets to GCP with a focus on performance, scalability, and reliability. Automate data lineage extraction and ensure data integrity across multiple systems and platforms. Collaborate with architects and stakeholders to implement GCP-native and 3rd-party tools for data ingestion, integration, and transformation. Develop and optimize complex SQL queries in BigQuery for data analysis and transformation. Operationalize data pipelines using tools like Apache Airflow (Cloud Composer), DataFlow, and Pub/Sub. Enable machine learning capabilities through well-structured, ML-friendly data pipelines. Participate in Agile processes and contribute to technical design discussions, code reviews, and documentation. Required Skills & Experience: 5+ years of experience in Data Warehousing , Data Engineering , or similar roles. Minimum 2 years of hands-on experience working with GCP BigQuery . Proficiency in Python , SQL , Apache Airflow , and GCP services including BigQuery, DataFlow, Cloud Composer, Pub/Sub, and Cloud Functions. Experience with data pipeline automation , data modeling, and building reusable data products. Solid understanding of data lineage , metadata integration , and data cataloging (preferably GCP Data Catalog and Informatica EDC). Proven ability to analyze complex datasets and derive actionable insights. Demonstrated experience building and deploying analytics platforms on cloud environments (GCP preferred). Preferred Skills: Strong analytical and problem-solving capabilities. Exposure to machine learning pipeline architecture and model deployment workflows. Excellent communication skills and ability to work collaboratively with cross-functional teams. Familiarity with Agile methodologies and DevOps best practices. Self-driven, innovative mindset with a commitment to delivering high-quality solutions. Experience with documenting complex data engineering systems and developing test plans. Show more Show less
