Senior Data Engineer

Role Overview: As a member of the team, you will have a primary focus on automating testing and DevOps using Microsoft Azure data PaaS services. You will be responsible for designing, building, modifying, and supporting data pipelines in a medallion architecture setting, leveraging DataBricks and PowerBI. Additionally, you will work with Python and automate the running of unit and integration tests on all created code throughout the development lifecycle. Your role will also involve supporting and troubleshooting environmental issues during application deployment in various environments. Key Responsibilities: - Design, build, modify, and support data pipelines using Microsoft Azure data PaaS services in a medallion architecture setting - Utilize DataBricks and PowerBI for data pipeline development - Automate running of unit and integration tests on all created code - Assist the Operations Team in troubleshooting environmental issues during application deployment - Create prototypes to validate proposed ideas and gather input from stakeholders - Implement low-level designs based on high-level design specifications - Collaborate with Team Leads to define business requirements, estimate development costs, and finalize work plans - Benchmark application code proactively to prevent performance and scalability concerns - Work with the Quality Assurance Team on issue reporting, resolution, and change management - Assist other teams in resolving issues related to applications or integration of multiple components Qualifications Required: - Working experience with Python - Bachelor's Degree or equivalent combination of education and experience - Excellent grasp of test-driven development and continuous integration processes (Note: No additional details of the company were provided in the job description),