Data Engineer

Job Description

We are seeking a skilled and motivated Data Engineer with over 3 years of experience in cloud-based data engineering environments. The ideal candidate will have strong expertise in data modeling, cloud infrastructure (Azure and/or AWS), CI/CD, and Infrastructure as Code (IaC) tools. Experience with Prophesy for data pipeline development is a strong plus. If you're passionate about scalable data solutions, cloud-native applications, and modern DevOps practices, we’d love to hear from you. Key Responsibilities: Design, develop, and maintain scalable and efficient data pipelines. Build and support cloud-native data engineering solutions on Azure, AWS, or both. Manage version control and CI/CD pipelines using GitHub and Azure DevOps. Develop and optimize data models, data warehouses, and ETL/ELT processes. Collaborate with cross-functional teams in an Agile environment to deliver data-driven solutions. Apply Terraform or other IaC tools for infrastructure automation and deployment. Support and enable machine learning workflows through data provisioning and pipeline optimization. Troubleshoot and resolve data-related issues with a focus on performance, quality, and reliability. Required Qualifications: 3+ years of hands-on experience in data engineering with a strong focus on cloud applications (Azure and/or AWS). Hands-on experience with Prophesy for data pipeline development. Experience with GitHub and Azure DevOps for source control and CI/CD automation. Strong knowledge of data modeling, data warehousing, and query performance optimization. Experience using Terraform or similar IaC tools in a production environment. Understanding of machine learning workflows from a data engineering perspective. Excellent problem-solving skills, attention to detail, and the ability to manage multiple priorities. Comfortable working in a fast-paced, agile team environment. Preferred Qualifications (Nice to Have): Experience with orchestration tools such as Airflow or AWS Step Functions / Azure Data Factory. Familiarity with SQL, Python, or Scala for data manipulation. Show more Show less