Data Engineer - Analytics aaS Associate - Operate

Role Overview: At PwC, our managed services team specializes in providing outsourced solutions to clients across various functions. As a Data Engineer Offshore, you will be responsible for designing, implementing, and maintaining scalable ETL pipelines and systems using technologies such as Teradata, DataStage, AWS, Databricks, SQL, Spark, Kafka, and more. Your role will involve collaborating with cross-functional teams to deliver data solutions that meet business requirements and ensure data quality, integrity, and security. Key Responsibilities: - Design, develop, and maintain scalable ETL pipelines using DataStage and other ETL tools. - Utilize AWS cloud services for data storage, processing, and analytics. - Implement and optimize Delta Live Tables and Delta Tables for efficient data storage and querying. - Work with Databricks to analyze, process, and transform data, ensuring high performance and reliability. - Integrate Kafka and Spark Streaming for real-time data processing applications. - Collaborate with teams to gather requirements and deliver data solutions. - Monitor and troubleshoot data workflows for smooth operations. - Document data processes, architecture designs, and technical specifications. Qualifications: - Bachelor's degree in Computer Science, Information Technology, or a related field. - Proven experience as a Data Engineer or in a similar role. - Strong proficiency in SQL and experience with relational databases like Teradata. - Hands-on experience with AWS services such as S3, EMR, Redshift, and Lambda. - Proficiency in using Databricks for data engineering tasks. - Experience with Delta Live Tables, Delta Tables, Apache Spark, Kafka, and Spark Streaming. - Strong problem-solving skills, attention to detail, and excellent communication skills. Additional Company Details: A career in the Managed Services team at PwC offers you the opportunity to collaborate with diverse teams to help clients implement new capabilities, achieve operational efficiencies, and leverage technology. The Data, Testing & Analytics as a Service team combines industry expertise, technology, data management, and managed services experience to drive sustained outcomes for clients and enhance business performance. You will have the chance to contribute to designing, building, and operating innovative software and services that manage interactions across the value chain.,