Software Engineer III - Data

About the Team

• ID Graph + Firmographics + MCD (IDnF)
• Data Acquisition from public sources
• Technographics and Psychographics
• B2B Intent Network (3Pi)
• Signals (Job Postings, News Feeds)
• People & Privacy data (MPD)

Role Overview

Responsibilities

• Design and maintain scalable data pipelines using distributed data processing frameworks (e.g., Spark, Airflow).
• Ingest, clean, transform, and validate large volumes of structured and unstructured data from public and third-party sources.
• Partner with internal stakeholders to deliver critical datasets.
• Contribute to maintaining the

  Master People Database (MPD)

  and ensure its integrity, deduplication, and enrichment.
• Optimize query performance and storage using tools like Snowflake or BigQuery.
• Collaborate in defining and implementing privacy-compliant data handling in accordance with

  GDPR/CCPA...

  requirements.
• Identify and fix data quality issues; write and maintain unit/integration tests for pipeline components.
• Own small to medium-sized projects end-to-end with guidance from senior engineers.

Minimum Qualifications

• 3-6 years of experience as a Data Engineer, Big Data Engineer, or similar role.
• Proficiency in Java, Python, Spark, and SQL.
• Experience with at least one distributed data processing framework (e.g., Apache Spark, Apache Flink).
• Experience working with cloud platforms like AWS, GCP, or Azure (preferably AWS).
• Familiarity with orchestration tools like Apache Airflow or similar.
• Understanding of data modeling, schema design, and data governance principles.
• Experience with data versioning, monitoring, and logging tools.
• Strong communication and collaboration skills in cross-functional teams.

Preferred Qualifications

• Experience with data ingestion from web scraping or public APIs (e.g., job boards, websites, news sources).
• Exposure to modern data stack tools like

  dbt

  , Delta Lake, Hive, Hadoop.
• Prior experience with

  identity resolution

  or

  entity matching

  pipelines.
• Understanding of

  privacy compliance frameworks

  such as GDPR and CCPA.
• Experience working in product-focused teams and delivering data for customer-facing features.

Why Join Us

• Be part of a mission-critical team building data assets that power every layer of our product.
• Work in a modern data stack environment with real-world scale and complexity.
• Collaborate with a globally distributed team of data experts.
• Own high-impact projects from ideation to production.