Big Data Lead

Role Overview: As a Big Data Lead with 7-12 years of experience, you will be responsible for software development using multiple computing languages. Your role will involve working on distributed data processing systems and applications, specifically in Business Intelligence/Data Warehouse (BIDW) programs. Additionally, you should have previous experience in development through testing, preferably on the J2EE stack. Key Responsibilities: - Develop software using multiple computing languages - Work on distributed data processing systems and applications, particularly in Business Intelligence/Data Warehouse (BIDW) programs - Utilize technologies such as Spark, Scala, Kafka, Hadoop, Hbase, Pig, and Hive - Implement Data Lake as an alternative to Data Warehouse - Hands-on experience with Data frames using Spark SQL and proficiency in SQL - Lead at least 2 end-to-end implementations in either Data Warehouse or Data Lake Qualifications Required: - Strong foundation in distributed systems and computing systems - Hands-on engineering skills - Understanding of best practices and concepts in Data Warehouse Applications - Experience with NoSQL data stores, data modeling, and data management - Good interpersonal communication skills - Excellent oral and written communication and analytical skills - Previous experience in development through testing, preferably on the J2EE stack,