Data Ops Software Engineer

• We re hiring a Fullstack Software Engineer to help develop the Cloud Data Hub our AWS-based data platform for managing petabytes of enterprise data.
• You ll focus on building end-to-end platform features that empower customers to design, deploy, and monitor their own data pipelines. This role spans both backend services (Python) and frontend components (React or similar), delivering intuitive, robust self-service tooling for data engineering workflows.

Responsibilities

• Design, develop, and maintain backend services and APIs in Python to enable self-service pipeline creation, orchestration, and monitoring.
• Build frontend features (e.g., dashboards, forms, monitoring views) that help customers easily design and manage data pipelines.
• Develop frameworks, templates, and tooling using AWS services (Glue, Lambda, Step Functions) to support scalable, secure ETL/ELT workflows.
• Integrate AWS services (S3, Glue, IAM) to deliver secure and reliable data movement and cataloging.
• Implement robust monitoring, validation, and alerting features to ensure data quality, integrity, and lineage across customer pipelines.
• Enable connectivity and integrations with external systems such as Snowflake, Azure, and SAP.
• Collaborate closely with UX designers and other engineers to deliver intuitive, well-documented user experiences.
• Participate in architecture discussions, sprint planning, code reviews, and CI/CD workflows.

What should you bring along

Requirements

• Strong experience with Python for backend development, ideally in a cloud-native, serverless context.
• Proficiency with frontend development in frameworks such as React, Vue, or Angular.
• Solid understanding of AWS services (Glue, S3, Lambda, IAM, Step Functions) and their use in data workflows.
• Experience designing and consuming REST APIs.
• Familiarity with data engineering concepts like data modeling, schema evolution, and partitioning strategies for large-scale storage.
• Proven ability to build shared tools, libraries, or frameworks that enable other engineers or customers to work more effectively.
• Commitment to writing well-tested, maintainable code, with experience in unit and integration testing.
• Familiarity with version control (Git) and CI/CD best practices.
• Strong communication skills and a collaborative, customer-focused mindset.

Must have technical skills

• Python, ideally in a cloud-native, serverless context
• React, Vue, or Angular
• AWS services Glue, S3, Lambda, IAM, Step Functions
• REST APIs
• Data engineering concepts like data modeling, schema evolution, and partitioning strategies
• GitHub

Good to have technical skills

• Experience integrating with Snowflake, Azure, or SAP systems.
• Familiarity with Glue Data Catalog, AWS Secrets Manager, or other security best practices.
• Experience building data quality monitoring dashboards or developer tooling for pipeline management.
• Experience with Infrastructure as Code tools such as Terraform for managing AWS resources.