Spark Developer

Job Description: As a Spark Expert, you will be required to demonstrate expert proficiency in Spark and possess the ability to design and implement efficient data processing workflows. Your experience with Spark SQL and DataFrames, along with a good exposure to Big Data architectures and understanding of the Big Data ecosystem, will be crucial. Additionally, your expertise in framework building on Hadoop, strong DB knowledge with SQL tuning experience, and familiarity with Python APIs and exposure to Kafka will be valuable assets. Key Responsibilities: - Demonstrate expert proficiency in Spark - Design and implement efficient data processing workflows - Utilize Spark SQL and DataFrames effectively - Understand Big Data architectures and the Big Data ecosystem - Build frameworks on Hadoop - Possess strong DB knowledge with SQL tuning experience - Utilize Python APIs and have exposure to Kafka Qualification Required: - Proficiency in Spark - Experience with Spark SQL and DataFrames - Strong understanding of Big Data architectures and ecosystem - Familiarity with Hadoop framework building - Good DB knowledge with SQL tuning experience - Exposure to Python APIs and Kafka Additional Details: The company values your ability to work with clients in identifying business challenges and contributing to client deliverables by refining, analyzing, and structuring relevant data. Moreover, being aware of the latest technologies and trends, having logical thinking and problem-solving skills, and the ability to collaborate effectively are important. Assessing current processes, identifying improvement areas, suggesting technology solutions, and possessing industry domain knowledge will be beneficial. Note: The technical requirements and preferred skills have been omitted as they are repetitive in nature.,