Big Data Developer

Responsibilities

• Participate in the design and implementation phases for data projects to help translate high-level business requirements into technical solutions.
• Provide technically sound solutions for the ingestion, storage, transformation, and presentation of enterprise data, including ETL design, data storage strategies, data access, and security.
• Driving the design of scalable solutions while considering recoverable and resiliency requirements.
• Participate in DevOps-related activities, including involvement with continuous integration, automated deployment, automated testing, and continuous monitoring to enhance performance and product quality.
• Provide timely support for troubleshooting and resolving production issues.
  

Requirements

• Experience with any of the following: Big Data technologies, Analytics, Hadoop ecosystems, Data Lakes, or Data Migration.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Experience with Java, Scala, and Spark.
• Strong database integration and management skills.
• Strong ETL skills, including database performance tuning and optimisation.
• Familiar with Shell scripting skills and Unix/Linux knowledge.
• Exceptional analytical and problem-solving skills.
• Running diagnostic tests and performing debugging procedures.
• Documenting application development processes, procedures, and standards.
• Excellent leadership and interpersonal skills.
• Strong communication and teamwork skills.
• Able to analyse complex situations and derive workable actions.
• Flexibility to adjust to multiple demands, shifting priorities, ambiguity, and rapid change.
• Knowledge of DevOps and related tooling such as Jenkins, Ansible, etc.
• Experience with Big Data technologies such as Apache Hadoop, HBase, Hive, Spark, Flink, or Flume.
• Strong coding skills in one of Python/Java/Scala.
• Familiar with event management technologies such as Apache Kafka or Apache Airflow.
• Familiar with container technologies such as Docker or Kubernetes.
• Demonstrable experience coaching junior members of your teams.