Senior Python Developer

Your key responsibilities

• Designing, building, and deploying data pipelines and workflows using Databricks (notebooks) or Azure Data Platform (Synapse or ADF).
• Developing and optimizing PySpark and SparkSQL for data processing and analytics.
• Experience with Delta Table formats (Databricks or Synapse).
• ETL design, development and migration of existing on-prem ETL routines to Cloud Service
• Interact with senior leaders, understand their business goals, contribute to the delivery of the workstreams
• Design and optimize model codes for faster execution

Skills and attributes for success

• Overall 4+ years of IT experience with 2+ Relevant experience in PySpark with Synapse or ADF or Databricks and good hands-on with exposure to latest ADF Version.
• Hands on Notebook development and query optimization in PySpark.
• Hands-on experience on Azure functions & Azure synapse (Formerly SQL Data Warehouse)
• Should have project experience in Azure Data Lake / Blob (Storage purpose)
• Should have basic understanding on Batch Account configuration, various control options
• Sound knowledge in Logic Apps & SQL Server.
• Should be able to coordinate independently with business stake holders and understand the business requirements, implement the requirements using Spark notebooks.