Data Engineer - AWS

Job Description

Hey Jobseekers, we are looking for AWS Data Engineer with glue & Pyspark experience Experience : 4 to 10 YearsLocation : Hyderabad / Chennai / Noida / Pune / Bangalore kindly reply with below details nishikanth.konda@innovasolutions.com CTC :-ECTC :-Notice Period :-Preferred Location :- Hands on experience in Dimensional, Data vault and relation modellingExpertise in Data warehousing and ETL Design and implementationHands on experience with Programming language like Python/ScalaGood understanding of Spark architecture along with internalsHand on experience using AWS services like Glue(Pyspark), Lambda, S3, Athena, RDS, IAM, Lake formationExperience on Mulesoft is good to haveHands on experience on implementing different loading strategies like SCD1 and SCD2, Table/ partition refresh, insert update, Swap Partitions, Experience in consuming and writing data from and to Flat files, RDMBS systems, MPPS, JSON and XML, Service, Streams, queues, CDC etc.Experience in Parallel Loading and Dependencies orchestrationsAwareness of scheduling and orchestration toolsAwareness of OS Compute, Networking, internal working and architecture of DB and ETL Server and its impact on ETL Design, Data transfer and Data processingExperience on RDBMS systems and conceptsExpertise in writing and complex SQL queries and developing Database components including creating views, stored procedures, triggers etc.Create test cases and perform unit testing of ETL JobsAnalytical mind with a problem-solving and debugging skills.Excellent Communication SkillsAwareness of Replication, Synchronization and Disaster Management techniquesHand on experience in Data Quality ManagementAwareness of data governance concepts and implementationHand on experience using AWS services like Glue, Lambda, S3, Athena, RDS, IAM, Lake formation ThanksNishikanth