Job Title: Data Engineer with Scala & Spark Job Description: As a Data Engineer with Scala & Spark, you will be responsible for designing, developing, and maintaining Scala applications. You will collaborate with cross-functional teams to define, design, and ship new features, as well as maintain and improve existing codebases. Your role will also involve troubleshooting, debugging, and optimizing application performance. You should have a strong understanding of functional programming concepts and be proficient in Scala, as well as have experience with related technologies. Responsibilities: 1. Design, implement, and maintain Scala applications. 2. Collaborate with cross-functional teams to define and develop new features. 3. Write clean, maintainable, and efficient code. 4. Troubleshoot, debug, and optimize application performance. 5. Contribute to the entire development lifecycle, including concept, design, build, deploy, test, release, and support. 6. Stay up-to-date with the latest industry trends and technologies to ensure the application's competitiveness. 7. Participate in code reviews and provide constructive feedback to team members. Skills and Qualifications: 1. Bachelor's degree in Computer Science, Engineering, or a related field. 2. Proven experience as a Scala Developer using Spark or similar role. 3. Strong understanding of functional programming concepts. 4. Proficiency in Scala programming language. Strong Analytical skills. 6. Familiarity with build tools such as Maven. 7. Knowledge of database systems (SQL and NoSQL) and experience with data modeling. 8. Understanding of distributed computing principles. 9. Familiarity with microservices architecture. 10. Experience with version control systems, preferably GIT. 11. Excellent problem-solving and communication skills. 12. Ability to work both independently and collaboratively in a team environment. 13. Knowledge of Agile development methodologies. Nice to Have: 1. Experience with cloud platforms such as AWS, Azure, or GCP. 2. Knowledge of containerization technologies like Docker and orchestration tools like Kubernetes. 3. Familiarity with continuous integration and continuous deployment (CI/CD) pipelines. 4. Experience with other programming languages such as Java or Python.
