Data Engineer

Job Description

About the role: As a Data Engineer, you will be instrumental in managing our extensive soil carbon dataset and creating robust data systems. You are expected to be involved in the full project lifecycle, from planning and design, through development, and onto maintenance, including pipelines and dashboards. You’ll interact with Product Managers, Project Managers, Business Development and Operations teams to understand business demands and translate them into technical solutions. Your goal is to provide an organisation-wide source of truth for various downstream activities while also working towards improving and modernising our current platform. Key responsibilities: Design, develop, and maintain scalable data pipelines to process soil carbon and agricultural data Create and optimise database schemas and queries Implement data quality controls and validation processes Adapt existing data flows and schemas to new products and services under development Required qualifications: BS/B. Tech in Computer Science or equivalent practical experience, with 5-7 years as a Data Engineer or similar role. Strong SQL skills and experience optimising complex queries Proficiency with relational databases, preferably MySQL Experience building data pipelines, transformations, and dashboards Ability to troubleshoot and fix performance and data issues across the database Experience with AWS services (especially Glue, S3, RDS) Exposure to big data eco-system – Snowflake/Redshift/Tableau/Looker Python programming skills Excellent written and verbal communication skills in English An ideal candidate would also have: High degree of attention to detail to uncover data discrepancies and fix them Familiarity with geospatial data Experience with scientific or environmental datasets Some understanding of the agritech or environmental sustainability sectors Show more Show less