Data Engineer

Job Description

Data Engineer As a Data Engineer you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage. Reporting to the Lead Data Engineer or Principal Data Engineering, you will work closely with data scientists, analysts, and other stakeholders to ensure that data systems are reliable, scalable, and secure. Your work will be crucial in enabling data-driven decision-making across the organization. Your key responsibilities * Data Pipeline Architecture and Development o Design, construct, install, test, and maintain highly scalable data pipelines with a focus on machine learning models and analytics. * Data Integration o Work closely with data scientists, ML engineers, and stakeholders to ensure that data is accessible, consistent, and reliable for ongoing projects. * API and Data Services o Develop and maintain APIs for data access and manipulation, and Integrate with external data services as needed. * Data Storage o Manage and optimize data storage solutions, including relational databases, Search Engines like Elasticsearch, and NoSQL databases, to support the requirements of machine learning models. o Understand data engines and structure to effectively design solutions for transactional, analytics, and search purposes. * Data Quality and Governance Show more Show less