Senior Big Data Engineer

As an Applications Development Programmer Analyst at our company, your role will involve participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. **Key Responsibilities:** - Utilize your knowledge of applications development procedures and concepts to identify and define necessary system enhancements. - Identify and analyze issues, make recommendations, and implement solutions based on your understanding of business processes, system processes, and industry standards to solve complex issues. - Analyze information to recommend solutions and improvements, conduct testing and debugging, write basic code for design specifications, and assess risk when making business decisions. **Qualifications Required:** - Hands-on experience in designing, developing, and optimizing scalable distributed data processing pipelines using Apache Spark and Scala. - 3 to 6+ years of experience in big data development, focusing on Apache Spark, Scala/Python, and distributed systems. - Advanced knowledge of Scala, good understanding of Python for data engineering tasks, solid understanding of data modeling principles and ETL processes in big data environments. - Strong analytical and problem-solving skills in analyzing and solving performance issues in Spark jobs and distributed systems. - Familiarity with Git, Jenkins, and other CI/CD tools for automating the deployment of big data applications. - Experience with streaming platforms such as Apache Kafka or Spark Streaming. To be considered for this position, you should hold a Bachelor's degree/University degree or equivalent experience. This job description provides an overview of the work performed, and other job-related duties may be assigned as required.,