Job
Description
As a Data Engineer at NIQ Digital Shelf, your role involves using your strong Python data programming skills to create and maintain data pipelines for image comparison. You will be a part of the Digital Purchases data team in NielsenIQ, where you will focus on designing, programming, deploying, and maintaining large-scale data processing workflows with an emphasis on reliability, performance, and maintainability. Key Responsibilities: - Write large-scale data pipelines using Python and Polars - Implement engineering best practices, write code with unit and integration tests, and have experience with CI/CD - Design complex pipelines involving decision-making Qualifications: - First significant experience in writing large-scale data pipelines using Python and Polars - Proficiency in engineering best practices, unit testing frameworks (e.g., pytest), and CI/CD pipelines - Experience with PostgreSQL (PSQL) for data modeling, queries, and optimization Good-to-Have Technologies: - DuckDB for embedded analytical database - Kubernetes for container orchestration and deployment - Cloud data environments (e.g., GCP, AWS, Azure) - Familiarity with image processing or computer vision tools for visual data matching As a part of NIQ, you will enjoy a flexible and rewarding work environment with peer-to-peer recognition platforms. Additionally, you can benefit from wellness plans designed for you and your family, financial wellness tools for future planning, and career development opportunities to upskill yourself. NIQ is a leading consumer intelligence company that provides a comprehensive understanding of consumer buying behavior and new pathways to 2023. With operations in 100 markets covering more than 90% of the world's population, NIQ is committed to diversity, equity, and inclusion in the workplace. All employment decisions are made without regard to various characteristics, and individuals dedicated to inclusivity and equity are encouraged to join NIQ in making a meaningful impact. Join NIQ as a Data Engineer to contribute to the company's mission of delivering advanced analytics and consumer insights through state-of-the-art platforms. As a Data Engineer at NIQ Digital Shelf, your role involves using your strong Python data programming skills to create and maintain data pipelines for image comparison. You will be a part of the Digital Purchases data team in NielsenIQ, where you will focus on designing, programming, deploying, and maintaining large-scale data processing workflows with an emphasis on reliability, performance, and maintainability. Key Responsibilities: - Write large-scale data pipelines using Python and Polars - Implement engineering best practices, write code with unit and integration tests, and have experience with CI/CD - Design complex pipelines involving decision-making Qualifications: - First significant experience in writing large-scale data pipelines using Python and Polars - Proficiency in engineering best practices, unit testing frameworks (e.g., pytest), and CI/CD pipelines - Experience with PostgreSQL (PSQL) for data modeling, queries, and optimization Good-to-Have Technologies: - DuckDB for embedded analytical database - Kubernetes for container orchestration and deployment - Cloud data environments (e.g., GCP, AWS, Azure) - Familiarity with image processing or computer vision tools for visual data matching As a part of NIQ, you will enjoy a flexible and rewarding work environment with peer-to-peer recognition platforms. Additionally, you can benefit from wellness plans designed for you and your family, financial wellness tools for future planning, and career development opportunities to upskill yourself. NIQ is a leading consumer intelligence company that provides a comprehensive understanding of consumer buying behavior and new pathways to 2023. With operations in 100 markets covering more than 90% of the world's population, NIQ is committed to diversity, equity, and inclusion in the workplace. All employment decisions are made without regard to various characteristics, and individuals dedicated to inclusivity and equity are encouraged to join NIQ in making a meaningful impact. Join NIQ as a Data Engineer to contribute to the company's mission of delivering advanced analytics and consumer insights through state-of-the-art platforms.
