Data Engineer

Responsibilities

• Develop and expand our core data platform in MS Azure, Fabric building robust data infrastructure and scalable solutions.
• Enhance datasets and transformation toolsets on the MS Azure platform, leveraging distributed processing frameworks to modernize processes and expand the codebase
• Design and maintain ETL pipelines to ensure data is transformed, cleaned, and standardized for business use.
• Collaborate with cross-functional teams to deliver high-quality data solutions, contributing to both UI and backend development while translating UX/UI designs into functional interfaces.
• Develop scripts for building, deploying, and maintaining data systems, while utilizing tools for data exploration, analysis, and visualization throughout the project lifecycle.
• Utilize SQL and NoSQL databases for effective data management and support Agile practices with tools like Jira and GitHub.
• Contribute to technology standards and best practices in data warehousing and modeling, ensuring alignment with overall data strategy.
• Lead and motivate teams through periods of change, fostering a collaborative and innovative work environment.
  

• 3-6 years of cloud-based data engineering experience, with expertise in Microsoft Azure and other cloud platforms.
• Proficient in SQL and experienced with NoSQL databases, message queues, and streaming platforms like Kafka.
• Strong knowledge of Python and big data processing using PySpark, along with experience in CI/CD pipelines (Jenkins, GitHub, Terraform).
• Familiar with machine learning libraries such as TensorFlow and Keras, and skilled in data visualization tools like Power BI/Fabric and Matplotlib.
• Expertise in data wrangling, including cleaning, preprocessing, and transformation, with a solid foundation in statistics and probability.
• Excellent communication skills for engaging with technical and non-technical audiences across all organizational levels.
• Experience in UI development, translating UX/UI designs into code, data warehousing concepts, API development and integration, and workflow orchestration tools is desired.
  

• Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, Mathematics, Statistics, or a related field
• Relevant certifications in data science and machine learning are a plus
  

About The Team