Job
Description
Position summary As a Senior Data Engineer in the Automotive Insights - Supply Chain and Technology and Aftermarket department at S&P Global, you will leverage advanced data engineering techniques to manage and optimize data pipelines within the automotive industry. Your primary responsibilities will include designing, building, and maintaining scalable data architectures, ensuring data quality and integrity, and enabling efficient data access for analytics and machine learning applications. You will collaborate with cross-functional teams to integrate data-driven solutions into our products and services, enhancing our clients' ability to navigate supply chain challenges, technological advancements, and aftermarket trends. This role demands a blend of technical expertise, industry knowledge, and innovative thinking to drive impactful results and contribute to the continuous evolution of the automotive sector. What You'll Do - Utilize Python libraries such as Pandas, NumPy, and SciPy to analyze and manipulate large automotive datasets. - Design, build, and maintain scalable data architectures and pipelines on AWS to support large-scale solutions. - Focus on the productization of data solutions, ensuring they are robust and scalable. - Lead and develop a small but strong team of Data Engineers, fostering growth and ensuring high performance. - Collaborate with the cloud team to implement best practices, focusing on cost monitoring, optimization, security protocols, and automation. - Maintain and optimize forecasting models to predict industry trends and supply chain dynamics. - Build data-driven products aimed at generating revenue and enhancing client offerings. - Implement web scraping techniques as needed to gather and integrate external data sources. - Work closely with stakeholders to understand their needs and integrate data-driven solutions into our products and services. - Ensure data quality and integrity, aligning taxonomies and data structures for consistency and accuracy. - Apply big data technologies and DevOps practices to enhance data solutions. - Uphold data governance standards to ensure compliance and data integrity. Who you are - Possess over 6 years of experience in data engineering, with a strong focus on cloud-based solutions and large-scale data processing. - Proficient in building and optimizing data pipelines to handle large-scale datasets. - Experienced in developing and deploying scalable data solutions on AWS. - Knowledgeable in web scraping techniques and tools. - Proven experience in leading and developing a team of Data Engineers. - Adept at working in multicultural teams, demonstrating excellent collaboration and communication skills. - Skilled in database management, big data technologies, DevOps practices, and data governance. - Passionate about leveraging data to drive strategic insights and innovation within the automotive industry.
