Senior Data Engineer (Scala and Spark Expert)

Job Summary Synechron is seeking a seasoned Senior Data Engineer with expertise in Scala and Spark to join our Data Engineering team. This role is critical in processing and transforming large datasets, contributing to Synechrons business objectives by harnessing the power of big data technologies. The Associate Specialist will leverage their extensive experience in data engineering to drive innovative solutions and ensure efficient data processing. Software Requirements Required Software Skills: Proficiency in Scala and Spark for data processing and development. Working knowledge of SQL and experience with relational databases. Preferred Software Skills: Familiarity with other big data technologies and frameworks. Overall Responsibilities Lead and execute data engineering projects using Scala and Spark, ensuring high-quality data solutions. Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. Develop and maintain scalable data pipelines and processing systems. Conduct code reviews to ensure the quality and maintainability of the codebase. Stay updated with the latest advancements in big data technologies and incorporate them into existing solutions. Troubleshoot and resolve technical issues, providing technical support to team members. Technical Skills (By Category) Programming Languages: RequiredScala, SQL PreferredKnowledge of additional programming languages used in big data environments. Databases/Data Management: EssentialExperience with SQL databases and data management principles. Frameworks and Libraries: EssentialApache Spark Development Tools and Methodologies: RequiredFamiliarity with Agile methodologies. Experience Requirements 7+ years of experience in big data, with significant exposure to Scala and Spark. Proven track record in data engineering and processing large-scale datasets. Day-to-Day Activities Participate in daily stand-up meetings and project planning sessions. Collaborate with cross-functional teams to gather data requirements and design solutions. Develop, test, and deploy data processing applications using Scala and Spark. Conduct code reviews and provide feedback to other developers. Stay informed about the latest trends in big data technologies. Provide technical support and troubleshoot issues as they arise. Qualifications Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. Relevant certifications in data engineering or big data technologies are preferred. Commitment to continuous professional development and staying updated on industry trends. Professional Competencies Strong critical thinking and problem-solving capabilities. Effective teamwork and leadership abilities. Excellent communication and stakeholder management skills. Adaptability to new technologies and learning orientation. Innovation mindset to drive creative solutions and improvements. Effective time and priority management skills.