Lead Analyst

As a Lead Big Data Developer at CGI, you will play a crucial role in designing, building, and optimizing large-scale data pipelines and processing systems. Here is a summary of your role, key responsibilities, and qualifications required: Role Overview: - Lead the design and development of scalable, efficient, and reliable data pipelines using PySpark, Python, and SQL. - Collaborate with data architects, analysts, and business stakeholders to understand data requirements and translate them into technical solutions. - Optimize data workflows for performance, scalability, and cost efficiency in big data environments. - Implement data ingestion, transformation, and aggregation processes from multiple sources. - Ensure data quality, integrity, and consistency through validation, testing, and monitoring frameworks. - Provide technical leadership and mentorship to junior and mid-level developers. Key Responsibilities: - Design and develop scalable data pipelines using PySpark, Python, and SQL. - Collaborate with stakeholders to understand data requirements and translate them into technical solutions. - Optimize data workflows for performance, scalability, and cost efficiency. - Implement data ingestion, transformation, and aggregation processes. - Ensure data quality, integrity, and consistency through validation and monitoring. - Provide technical leadership and mentorship to junior developers. - Stay updated with the latest technologies and trends in the big data ecosystem. Qualifications Required: - 8+ years of experience in data engineering or big data development, with at least 3+ years in a lead or senior role. - Strong proficiency in Python, PySpark, and SQL. - Experience with cloud platforms and data orchestration tools. - Understanding of data modeling, ETL design, and performance optimization. - Excellent communication and leadership skills. - Bachelors or masters degree in computer science, Information Technology, or related field. Join CGI, a company that values ownership, teamwork, respect, and belonging. As a CGI Partner, you will have the opportunity to shape your career, develop innovative solutions, and access global capabilities to scale your ideas. Embrace new opportunities and benefit from expansive industry and technology expertise. Your work creates value, and you will be supported by leaders who care about your well-being and provide opportunities for growth and skill development. Come be a part of one of the largest IT and business consulting services firms in the world.,