IN_Senior Associate

Job Description

Data Engineer Profile PWC is looking for hands-on data engineers who can produce beautiful & functional code to solve complex analytics problems. If you are an exceptional developer with an aptitude to learn and implement using new technologies, and who loves to push the boundaries to solve complex business problems innovatively, then we would like to talk with you. Strong interpersonal skills and ability to manage and work with cross-functional teams. Being able to perform on multiple levels both as an individual contributor as well as driving initiatives. Go-getter attitude with a mindset of thinking innovative Experience building and optimizing big data data pipelines, architectures and data sets involving petabyte and terabyte of data. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Expand and grow data platform capabilities to solve new data problems and challenges Apply complex big data concepts with a focus on collecting, parsing, managing, and analyzing large sets of data to turn information into insights Technical Skill set- Must Have Extensive experience on big data platforms including Hadoop, Spark, Hive, Presto, Kudu. Hands-on experience in design and development of hybrid cloud architecture Extensive experience in at least one of the cloud platforms among Azure (Azure Data Factory, Databricks, Sybase Analytics, Azure functions, Azure stream analytics) OR AWS (S3, lambda, glue, Quick sight, EMR,EC2,Redshift ,Athena and Presto) Hands-on experience in developing large scale distributed applications in either java or python programming language Hands-on experience in either one of the real time streaming applications- KAFKA OR Azure event hub OR AWS Kinesis Advanced SQL programming skills Design DWH model, ensuring data design follows the prescribed reference architecture framework while reflecting appropriate business rules built for logical, physical and conceptual model. Experience in performance tuning of complex ETL mappings for relational and non-relational workloads Well versed with relational and no-Sql databases like MySQL, PostgreSQL, Mongo DB and Cassandra Hands-on experience in migration from on-premise systems to cloud. Good to have Hands-on experience on microservice architecture Knowledge on spring boot framework Knowledge on developing scalable web applications Developing distributed applications using cloud platforms. Mandatory skill sets Pyspark, SQL, Databricks Preferred skill sets Pyspark, SQL, Databricks Years of experience required 5 - 8