Azure + Databricks- Associate 2

Role Overview: As an Azure Senior Developer at PwC - AC, you will be responsible for the end-to-end implementation of Cloud data engineering solutions. Your role will involve utilizing your expertise in Azure cloud services such as Storage services (Blob, ADLS, PaaS SQL), Azure Data factory, Azure Databricks, Snowflake, and SQL. You will play a key role in planning, organizing, and providing automated cloud solutions as part of an agile team. Key Responsibilities: - Work on the implementation of Cloud data engineering solutions using Azure cloud services like Storage services, Azure Data factory, Azure Databricks, Snowflake, and SQL - Extract data from various source systems like flat files, XML sources, JSON, Parquet files, Big data appliances, RDBMS, etc. - Contribute to Data Management concepts and Data Modelling - Participate in the preparation of Detail Level Design documents, Unit Test plans, and Code review reports - Develop Unit and Integration Test cases and ensure verification - Create documentation related to Project Architecture, Project end User Manual, and Operations Hand off guide - Utilize Big Data frameworks and related technologies, with mandatory experience in Spark - Have a clear understanding of Data Warehouse lifecycle - Demonstrate proficiency in SQL, including joins, groups, functions, and Stored procedures - Possess strong analytical and troubleshooting skills - Implement quality processes effectively - Communicate effectively and collaborate within the team - Understand Cloud data migration processes and integration methods - Familiarity with Application DevOps tools like Git, CI/CD Frameworks, and experience in Jenkins or Gitlab - Stay updated with industry trends and certifications in Azure / Databricks - Experience in building stream-processing systems using solutions such as Storm or Spark-Streaming - Knowledge in additional tools like Azure functions, Logi Apps, Microsoft Purview, Cosmos DB, and Python Qualifications Required: - BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA - 2+ years of hands-on experience in working with Azure ADLS, Databricks, Azure Data factory, SQL, Data Flows, and Snowflake - Strong knowledge of Big Data frameworks and related technologies, with mandatory experience in Spark - Understanding of Data Management concepts and Data Modelling - Experience in Data extraction from various source systems - Proficiency in SQL, Unit and Integration Test creation, and documentation creation - Good understanding of Data Migration and integration processes - Excellent communication skills and ability to work collaboratively - Certifications in Azure / Databricks would be an added advantage Additional Information: Travel Requirements: Travel to client locations may be required as per project requirements. Line of Service: Advisory Horizontal: Technology Consulting Designation: Senior Associate Location: Bangalore, India,