Data Engineer - Scala

As a Senior Data Engineer/Developer, you will play a crucial role in designing, developing, and maintaining scalable data pipelines and API integrations to cope with increasing data volume and complexity. Your collaboration with analytics and business teams will enhance data models, thereby improving data accessibility and promoting data-driven decision-making throughout the organization. **Key Responsibilities:** - Design, construct, install, test, and maintain highly scalable data management systems & Data Pipelines. - Ensure that systems align with business requirements and industry standards. - Develop high-performance algorithms, prototypes, predictive models, and proof of concepts. - Explore new data acquisition opportunities and potential applications for existing data. - Create data set processes for data modeling, mining, and production. - Integrate new data management technologies and software engineering tools. - Develop custom software components and analytics applications. - Implement and update disaster recovery procedures. - Collaborate with data architects, modelers, and IT team members to achieve project goals. - Offer senior-level technical consulting to peer data engineers during the design and development of complex data projects. **Qualifications:** - Bachelor's degree in computer science, Engineering, or a related field, or equivalent work experience. - 5-8 years of proven experience as a Senior Data Engineer or in a similar role. - Proficiency with big data tools such as Hadoop, Spark, Kafka, Ansible, Chef, Terraform, Airflow, and Protobuf RPC, etc. - Expertise in SQL for data manipulation (DML) and validation (DB2). - Familiarity with data pipeline and workflow management tools. - Experience with object-oriented/object function scripting languages like Python, Java, Go lang, etc. - Strong problem-solving and analytical skills. - Excellent verbal and interpersonal communication skills. - Ability to provide technical leadership to the team.,