Senior Data Engineer

CGI is looking for a talented and motivated Data Engineer with strong expertise in Python, Apache Spark, HDFS, and MongoDB to build and manage scalable, efficient, and reliable data pipelines and infrastructure • Youll play a key role in transforming raw data into actionable insights, working closely with data scientists, analysts, and business teams. Core Duties & Responsibilities: Data Pipeline Development Build and maintain scalable, high-performance data pipelines using Python and Apache Spark . Handle ingestion, transformation, and preparation of large-scale datasets from diverse sources. Data Infrastructure Management Manage distributed storage systems like HDFS and MongoDB to ensure reliable and efficient data access. Monitor and tune the performance of data infrastructure for speed, scalability, and availability. Quality & Governance Implement data validation checks and monitoring tools to ensure data accuracy and reliability. Enforce data governance , security, and privacy best practices in all engineering processes. Cross-Functional Collaboration Work closely with data scientists , analysts , and business stakeholders to understand data needs and deliver solutions. Contribute to team discussions, code reviews, and architectural decisions. Code & Process Optimization Write clean, modular , and well-documented code . Debug and optimize workflows, addressing performance bottlenecks as they arise.