Job
Description
PySpark, ANSI SQL, HDFS, Hive, Python, Scala, Java, Airflow, Any ETL tool, Shell Scripts, Control-M, Git, CI & CD, Unix File System, RDBMS Empirical understanding of data systems (BI analytics, data blending, data warehousing, data ETL, etc.) on process automation and standardization Good experience in requirement gathering/ analysis, coding, Unit testing, SIT Support Knowledge working on both Agile and waterfall models Develop end to end framework 4+ Years of relevant Experience in ETL and Data Engineering Strong Knowledge in Spark, Python Strong experience in Hive/SQL, PL/SQL Good Understanding of ETL & DW Concepts, Unix Scripting Design, implement and maintain Data Pipeline to meet the business requirements. Convert the Business need into Technical complex PySpark Code. Ability to write complex SQL queries for reporting purpose. Strong written and verbal communication, and proficiency in reporting analysis tools. Understanding of any ETL tool Understanding of any BI tool Cloud Computing AWS/AzureGood understanding of SDLC Core Compliance Domain knowledge Experience in the Agile Scrum Methodology
