BigData Lead

As a Big Data Engineer, your role encompasses designing, building, and optimizing an efficient big-data processing pipeline. You will be responsible for creating user-friendly interfaces for front-end clients and integrating various internal and external data sources. Your expertise in languages and technologies such as Spark, Scala/Java, Node.js, ElasticSearch, SQL, GraphQL, Kafka, and Kubernetes will be crucial for designing and implementing big data solutions. You will also be tasked with creating simple and coherent data models for complex data and optimizing ETL jobs. Programming Spark jobs using Scala/Java while adhering to best practices is a key aspect of your responsibilities. Identifying technical debt and proposing solutions to address them, as well as actively participating in design and code discussions with colleagues, are vital components of your role. Key Responsibilities: - Designing, building, and optimizing an efficient big-data processing pipeline - Creating user-friendly interfaces for front-end clients - Integrating various internal and external data sources - Designing and implementing big data solutions - Creating simple and coherent data models for complex data - Optimizing ETL jobs over complex data - Programming Spark jobs using Scala/Java while following best practices - Identifying technical debt and providing solutions to eliminate them - Participating in design and code discussions with colleagues Qualifications Required: - Experienced in at least one object-oriented programming language (e.g., C#, C++, Java, or other) - Work experience with system-, platform-, or engine development preferred - Experience or knowledge of Node.js/TS, Spark/Scala, and Kubernetes - Some experience or knowledge of ElasticSearch, GraphQL, Kafka/RabbitMQ, or other technologies - Familiarity with Agile development methods (Scrum/Kanban) In addition to the technical qualifications, as a Big Data Engineer, you are expected to be self-motivated, responsible for organizing your time effectively, and possess a great deal of drive, strong commitment, and a good sense of humor. Being a team player who enjoys working in a multi-disciplinary and cooperative environment is essential. Good communication skills and proficiency in English, both spoken and written, are also important for this role. Education Qualification: BE/B.Tech/MCA/M.Sc/M.Tech,