Specialist Software Engineer (Big Data Engineer)

As a Big Data Analyst at Socit Gnrale, your role will involve analyzing, organizing, and processing raw data using Bigdata technologies and Scala. You will be responsible for performing data validation, cleaning, and transformation using Big data technologies, Spark, and Scala. Additionally, you will be required to ingest and manage data in HDFS/Hive, analyze data using Spark, and produce meaningful insights for the business team. Your tasks will also include combining raw information from different sources, exploring ways to enhance data quality and reliability, and developing code using Software Craftmanship best practices such as Continuous delivery and Clean coding principles. Key Responsibilities: - Analyze, organize, and process raw data using Bigdata technologies and Scala - Perform data validation, cleaning, and transformation using Big data technologies, Spark, and Scala - Ingest and manage data in HDFS/Hive, analyze data using Spark, and produce meaningful insights for the business team - Combine raw information from different sources, explore ways to enhance data quality and reliability - Develop code using Software Craftmanship best practices such as Continuous delivery and Clean coding principles - Assist the business operations team with data samples to create proof of concepts - Ensure the new data sets are feeding the Business Intelligence setup i.e Dashboards on PowerBI - Liaise with BA to ensure subjects are getting prioritized, communicate to PO about progress and potential issues Qualifications Required: - 4 to 8 years of expertise and hands-on experience in Spark with Scala and Big data technologies - Good working experience in Scala and object-oriented concepts - Good working experience in HDFS, Spark, Hive, and Oozie - Technical expertise with data models, data mining, and partitioning techniques - Hands-on experience with SQL database - Understanding of CI/CD tools (Maven, Git, Jenkins) and SONAR - Knowledge of Kafka and ELK stack is a plus. Familiarity with Data visualization tools like PowerBI will be an added advantage - Strong communication and coordination skills with multiple stakeholders. Ability to assess existing situations, propose, and follow up on improvement actions - Good team spirit, ability to work in international/intercultural environments with lots of interactions with onsite stakeholders - Professional attitude: Self-motivated, fast learner, team player, independent If you choose to join Socit Gnrale, you will be part of an organization that believes in the power of individuals to drive change. The company encourages innovation, action, and a positive impact on the future. You will have the opportunity to grow in a stimulating and caring environment, contribute to initiatives that make a difference, and develop your expertise. Additionally, employees have the chance to dedicate several days per year to solidarity actions, supporting various causes and sharing skills with charities. Please note that the above details are extracted from the provided job description reference number 25000G3H.,