Data Engineer(Azure)

Role: Senior Associate

Tower: Data, Analytics & Specialist Managed Service

Experience: 6 - 10 years

Key Skills: Azure

Educational Qualification: BE / B Tech / ME / M Tech / MBA

Work Location: Bangalore

Job Description

As a Senior Associate, you will work as part of a team of problem solvers, helping to solve complex business issues from strategy to execution. PwC Professional skills and responsibilities for this management level include but are not limited to:

• Use feedback and reflection to develop self-awareness, personal strengths, and address development areas.
• Flexible to work in stretch opportunities/assignments.
• Demonstrate critical thinking and the ability to bring order to unstructured problems.
• Ticket Quality and deliverables review, Status Reporting for the project.
• Adherence to SLAs, experience in incident management, change management and problem management.
• Seek and embrace opportunities which give exposure to different situations, environments, and perspectives.
• Use straightforward communication, in a structured way, when influencing and connecting with others.
• Able to read situations and modify behavior to build quality relationships.
• Uphold the firm's code of ethics and business conduct.
• Demonstrate leadership capabilities by working, with clients directly and leading the engagement.
• Work in a team environment that includes client interactions, workstream management, and cross-team collaboration.
• Good team player, take up cross competency work and contribute to COE activities.
• Escalation/Risk management.

Position Requirements:

Required Skills:

Azure Cloud Engineer:

Job description:

Candidate is expected to demonstrate extensive knowledge and/or a proven record of success in the following areas:

• Should have minimum 6 years hand on experience building advanced Data warehousing solutions on leading cloud platforms.
• Should have minimum 3-5 years of Operate/Managed Services/Production Support Experience
• Should have extensive experience in developing scalable, repeatable, and secure data structures and pipelines to ingest, store, collect, standardize, and integrate data that for downstream consumption like Business Intelligence systems, Analytics modelling, Data scientists etc.
• Designing and implementing data pipelines to extract, transform, and load (ETL) data from various sources into data storage systems, such as data warehouses or data lakes.
• Should have experience in building efficient, ETL/ELT processes using industry leading tools like Informatica, Talend, SSIS, AWS, Azure, Spark, SQL, Python etc.
• Should have Hands-on experience with Data analytics tools like Informatica, Collibra, Hadoop, Spark, Snowflake etc.
• Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
• Work together with data scientists and analysts to understand the needs for data and create effective data workflows.
• Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
• Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.
• Perform data transformation and processing tasks to prepare the data for analysis and reporting in Azure Databricks or Azure Synapse Analytics for large-scale data transformations using tools like Apache Spark.
• Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
• Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
• Monitoring and troubleshooting data pipelines and resolving issues related to data processing, transformation, or storage.
• Implementing and maintaining data security and privacy measures, including access controls and encryption, to protect sensitive data
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
• Should have experience in Building and maintaining Data Governance solutions (Data Quality, Metadata management, Lineage, Master Data Management and Data security) using industry leading tools
• Scaling and optimizing schema and performance tuning SQL and ETL pipelines in data lake and data warehouse environments.
• Should have Hands-on experience with Data analytics tools like databricks
• Should have Experience of ITIL processes like Incident management, Problem Management, Knowledge management, Release management, Data DevOps etc.
• Should have Strong communication, problem solving, quantitative and analytical abilities.

Nice to have:

• Azure certification