Job
Description
As a Vice President, Big Data Scala Engineer, you will be responsible for leading the design, development, and implementation of next-generation big data platforms and applications. Your technical expertise in Scala, Spark, and other big data technologies will be crucial in driving innovation, mentoring engineers, and collaborating with cross-functional teams. You will play a key role in translating business requirements into technical architectures and leading their execution. **Key Responsibilities:** - **Technical Leadership:** - Lead the architecture, design, and development of high-performance, scalable, and reliable big data processing systems using Scala and Apache Spark. - Drive technical vision and strategy for big data initiatives, ensuring alignment with overall company goals and industry best practices. - Evaluate and recommend new technologies and tools to enhance big data capabilities and maintain a competitive edge. - **Engineering & Development:** - Design, develop, and optimize data pipelines for ingestion, transformation, and storage of massive datasets from various sources. - Implement robust and efficient data processing jobs using Scala and Spark (batch and streaming). - Ensure data quality, integrity, and security across all big data platforms. - **Team Leadership & Mentorship:** - Mentor and guide a team of talented big data engineers, fostering a culture of technical excellence, continuous learning, and collaboration. - Conduct code reviews, provide constructive feedback, and contribute to the professional growth of team members. - Participate in the recruitment and hiring of top engineering talent. - **Collaboration & Stakeholder Management:** - Partner with product managers, data scientists, and other engineering teams to understand business requirements and translate them into technical solutions. - Communicate complex technical concepts and solutions effectively to both technical and non-technical stakeholders. - Work closely with DevOps and SRE teams to ensure operational excellence, monitoring, and troubleshooting of big data systems. - **Strategy & Innovation:** - Contribute to the strategic roadmap for big data engineering, identifying opportunities for innovation and improvement. - Stay abreast of emerging trends and technologies in the big data ecosystem and incorporate them into our platform where appropriate. **Qualifications:** - **Education:** - Bachelor's or Master's degree in Computer Science, Engineering, or a related field. - **Experience:** - 12+ years of progressive experience in software development, with at least 5+ years focusing on big data technologies. - 3+ years of experience in a leadership or senior architectural role. - Extensive hands-on experience with Scala for big data processing. - Demonstrated expertise with Apache Spark (Spark Core, Spark SQL, Spark Streaming). - Strong experience with distributed systems and big data ecosystems. - Proficiency with cloud platforms and their big data services. - Experience with containerization technologies and CI/CD pipelines. - Solid understanding of data warehousing concepts, ETL/ELT processes, and data modeling. - Familiarity with functional programming paradigms in Scala. **Skills:** - Exceptional problem-solving and analytical skills. - Strong leadership, communication, and interpersonal skills. - Ability to work independently and collaboratively in a fast-paced, dynamic environment. - Proactive and results-oriented with a strong sense of ownership. **Preferred Qualifications:** - Experience with real-time data processing and stream analytics. - Knowledge of machine learning frameworks and their application in big data. - Contributions to open-source big data projects. - Experience in the financial services industry. If you are a passionate and experienced Big Data leader looking to make a significant impact, we encourage you to apply! Please note that the company's additional details were not provided in the job description.,
