Pyspark + Data warehousing and Azure

You should have a low level design and development skills, being able to design a solution for given use cases. You will be responsible for agile delivery, showcasing design and code on a daily basis. As an experienced PySpark developer, you must have proficiency in Scala coding, with primary focus on PySpark. Your experience should include designing job orchestration, sequence, metadata design, audit trail, dynamic parameter passing, and error/exception handling. You should possess strong experience in unit, integration, and UAT support, along with the ability to design and code reusable components and functions. Additionally, you will be required to review designs and code, providing constructive feedback with proper justification. A willingness to learn new tools and technologies, as well as experience with DevOps and CI/CD, are considered advantageous.,