Big Data Lead

Job Title / Primary Skill:

Management Level: G150

Years of Experience:

Job Location:

Must Have Skills:

Educational Qualification:

Job Overview

Overall Experience 8+ years in IT, Software Engineering or relevant discipline.

Designs, develops, implements, and updates software systems in accordance with the needs of the organization.

Evaluates, schedules, and resources development projects; investigates user needs; and documents, tests, and maintains computer programs.

We look for developers to have good knowledge of Scala programming skills and Knowledge of SQL

Technical Skills:

• Scala, Python -> Scala is often used for Hadoop-based projects, while Python and Scala are choices for Apache Spark-based projects.
• SQL -> Knowledge of SQL (Structured Query Language) is important for querying and manipulating data
• Shell Script -> Shell scripts are used for batch processing of data, it can be used for scheduling the jobs and shell scripts are often used for deploying applications
• Spark Scala -> Spark Scala allows you to write Spark applications using the Spark API in Scala
• Spark SQL -> It allows to work with structured data using SQL-like queries and Data Frame APIs.
• We can execute SQL queries against Data Frames, enabling easy data exploration, transformation, and analysis.