Data Engineer Lead

Job Description

JD: 1) Must have 8+ years of experience in Python / Java, Spark, Scala, Hive, Microsoft Azure Cloud Services (Data Bricks platform and developer tools) 2) 4 to 8 years of experience in Data Warehouse, ETL, Snowflake and Report Testing 3) Strong in writing SQL scripts & Database knowledge on Oracle, SQL Server, Snowflake 4) Hands on working experience with any of the ETL tools, preferably Informatica and Report / Dashboard tools 5) Ability to work independently and 12:30 pm to 9:30 pm timings Good to have, Data Processing Ability to build optimized and cleaned ETL pipelines using Databricks flows, Scala, Python, Spark, SQL Testing and Deployment Preparing pipelines for deployment Data Modeling Knowledge of general data modeling concepts to model data into a lakehouse Building custom utilities using Python for ETL automation Experience working in agile(scrum) environment and usage of tools like JIRA. Must haves Data Bricks: 4/5 Pyspark with Scala: 4/5 SQL: 3/5