Cloud Data Engineer

Job Description

We are looking for a Cloud Data Engineer to join our growing team of data professionals. The hire will be responsible for expanding and optimizing our data pipeline architecture and optimizing data flow and collection for cross-functional teams. The Cloud Data Engineer will support our software developers, database architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. The right candidate will be optimizing or even redesigning our companys data architecture to support our next generation products and data initiatives. This position requires the skill to: Develop, construct, test and maintain ETL/ELT architectures. Work with Architects to ensure development work aligns with business requirements. Data acquisition and ingestion for data at rest or streaming data. Develop data set processes and also use programming languages and tools. Identify ways to improve data reliability, efficiency and quality. Conduct research for industry and business questions. Use large data sets to address business issues. Possibly deploy sophisticated analytics programs, machine learning and statistical methods. Prepare data for predictive and prescriptive modelling. Find hidden patterns using data. Use data to discover tasks that can be automated. Deliver updates to stakeholders based on analytics. Job duties and responsibilities: Experience with implementing cloud data warehouses Snowflake, AWS Redshift, Azure SQL Data Warehouse or Google Big Query experience considered. Experience with building data pipelines using Azure Data Factory, Matillion, DBT, Python Spark. Candidates must have direct work experience developing and deploying at least one project where they implemented the entire cloud data pipeline. Strong understanding of SQL (1-3 years). Experience developing with Python (1-3 Years). Experience with DevOps i.e. (Git +CI/CD). Experience with Docker containers, including containerizing services and deploying containers in a cloud environment knowledge of the following would be an asset. Must be an excellent communicator in terms of status and raising issues that might impact projects to either project or account management. Excellent verbal and written communication skills. Capable of working autonomously with minimal oversight. Willing to raise issues to Hashmap or Client Management as required and clearly define the issues and potential solutions. Capable of adapting written processes when required and capturing improvements to the process for later review. Minimum Qualifications: Education: A Bachelors degree from an accredited college or university with major course work in computer science, MIS or a related field. Experience: 1-3 years of relevant work experience. Standard benefits: Employee will be eligible for employee benefits and insurance programs generally available for full time employees like health and vacation etc.