Data Engineer

Role & responsibilities

• Overall 12+ years of experience with at least 5+ years of experience in working with SQL on MySQL and PostgreSQL databases.
• Must be skilled in working with advanced SQL functions such as CTEs, window functions, procedural SQL, stored procedures, triggers etc.
• Significant experience in setting up, securing, and administering databases on premise or cloud (MS Azure).
• Demonstrated experience in managing data and related infrastructure on MS Azure.
• Demonstrated experience in building and orchestrating performant, secure, and cost-effective data pipelines.
• Experience in building BI reports using MS PowerBI (DAX and Power Query) is required.
• Advanced knowledge of ETL tools such as MS Data factory, Airflow etc.
• Demonstrated experience in working with a variety of data sources such as databases (SQL/NoSQL), APIs, data lakes, spreadsheets etc. is required.

Preferred candidate profile

Bachelors degree in Information Systems, Computer Science, or related discipline; Masters degree strongly preferred.

Minimum of five (5) years experience working in analytical and data related roles such as data engineer, Sr BI Developer etc. preferably in an education environment; or an equivalent combination of education, training, and experience.

• Experience with MS Fabric and related technologies is an asset.
• Experience with MS Purview is an asset.
• Experience in developing data models, schema and architecture of data warehouse or a data lake is required.
• Demonstrated programming skills in Python and Spark for data engineering/processing tasks.
• Strong analytical, problem solving and data analysis skills.
• Ability to manage multiple concurrent tasks and competing demands under tight deadlines.
• Ability to ensure data privacy and confidentiality.
• Familiarity with working in an agile environment.