Data Processing Principal Engineer

As the Lead Developer for a next-generation data processing engine, your role involves overseeing the architecture, design, and implementation of an advanced system that leverages accelerated computing technology. You will collaborate with cross-functional teams to enhance Datapelagos" parallel and distributed execution engine, focusing on accelerated computing. Your specific responsibilities include: - Leading the execution engine team in designing, implementing, and deploying an enterprise-grade acceleration engine for data processing. - Developing, testing, and maintaining key components of the execution engine. - Identifying areas for differentiation and enhancements within the execution engine. - Coordinating with other teams to facilitate code reviews, design reviews, performance evaluations, and continuous improvement initiatives. To qualify for this role, you should have: - A Bachelor's degree in EE/CS or equivalent with over 15 years of experience, or a Master's degree with over 10 years of experience. - Extensive experience (10+ years) in developing core components of enterprise-grade databases or analytics execution engines for large-scale data processing workloads, with a preference for platforms like Apache Spark, Gluten, Velox, and DataFusion. - Proficiency in creating high-performance parallel implementations of data processing operators and functions (e.g., joins, aggregations, sorts). - Previous experience leading teams of 10 or more members in the design, development, and release of high-performance data processing engines for large-scale deployments. - Strong programming skills in C, C++, and Rust, along with a robust development background on Linux platforms. This opportunity offers a challenging yet rewarding environment where you can contribute to the advancement of cutting-edge data processing technology.,