Data Scientist

Job description : 5+ years highly skilled Data Scientist, responsible for designing, developing, and maintaining large-scale data processing systems using cutting-edge technologies like Spark Streaming, Kafka, or similar technologies. The ideal candidate will have a strong background in object-oriented programming, data architecture, and cloud-based data management. The successful candidate will work closely with cross-functional teams to deliver complex data projects. Your role: Implement Real-time Data Processing Solutions: Design, develop, and deploy real-time data processing solutions using Spark Streaming and/or Kafka to handle high-volume, high-velocity data streams. Stream Processing Frameworks: Ability to develop / work on / maintain a near real-time stream processing frameworks to handle high-volume, high-velocity data streams, leveraging Spark Streaming and/or Kafka. Advanced Data Storage: Knowledge of advanced data storage formats like Apache Hudi or Apache Iceberg to optimize data storage, management, and retrieval. Code Quality and Maintainability: Develop and maintain high-quality, maintainable code using object-oriented programming principles, ensuring scalability, efficiency, and reliability. ETL Process Design and Implementation: Experience with designing and implementing ETL (Extract, Transform, Load) processes managing data pipelines, data transformation, and data loading. Collaboration and Communication: Collaborate with cross-functional teams, including data engineering, data analytics, software developers, testers, cloud architects and business stakeholders to deliver complex data projects, ensuring alignment with business objectives and technical requirements. Data Architecture and Security: Participate in designing and implementing data architectures, ensuring data security, governance, and compliance with organizational standards. What we need: masters or Ph.D. in Computer Science, Statistics, Mathematics, or related fields. 5+ years of experience in data science, data engineering, or related fields. Strong expertise in Spark Streaming and/or Kafka Hands on knowledge of Apache Hudi, Apache Iceberg, and AWS Glue. Very good proficiency in object-oriented programming languages (Java, Scala, Python). Experience with cloud-based data management (AWS, GCP, Azure). Strong understanding of data architecture, data modeling, and data governance. Excellent problem-solving skills, with the ability to work in a fast-paced environment. Strong communication and collaboration skills, with experience working in cross-functional teams. Experience with Agile development methodologies and version control systems (eg, Git).