Big Data Engineer

As a Big Data Engineer, you will be responsible for working on collecting, storing, processing, and analyzing huge sets of data. Your primary focus will be on choosing optimal solutions for these purposes, then maintaining, implementing, and monitoring them. Additionally, you will integrate these solutions with the architecture used across the company. Key Responsibilities: - 6+ years" experience in Big Data Hadoop, MapReduce, Hive, Sqoop, and Spark with hands-on expertise in designing and implementing high data volume solutions (ETL & Streaming). - Experience in building stream-processing systems using solutions like Storm, Spark-Streaming, and Kafka streams. - Extensive experience working with Big Data tools such as Pig, Hive, Athena, Glue, Snowflake, and EMR. - Familiarity with NoSQL databases like HBase, Cassandra, and MongoDB. - Knowledge of various ETL techniques and frameworks such as Flume. - Experience with messaging systems like Kafka or RabbitMQ. - Good understanding of Lambda Architecture, including its advantages and drawbacks. Qualifications Required: - 6+ years" experience in Big Data technologies including Hadoop, MapReduce, Hive, Sqoop, and Spark. - Hands-on experience in designing and implementing high data volume solutions. - Experience in building stream-processing systems and working with Big Data tools. - Familiarity with NoSQL databases and various ETL techniques. - Knowledge of messaging systems and understanding of Lambda Architecture. If there are any additional details about the company in the job description, kindly provide them for a more comprehensive overview.,