Data Analytics / MPP Engineer

As a member of Apple's Data Services Data Analytics and Engineering team, your role will involve designing, architecting, engineering, and mentoring in Big Data and MPP technologies. You will have the opportunity to lead the development and management of new solutions using cutting-edge technologies like SingleStore, Vertica, Clickhouse, and Doris across different environments. Your responsibilities will include creating scalable and robust systems that adapt to evolving business requirements, optimizing system/datastore performance, developing proofs of concept for emerging technologies, and recommending tools and processes to accelerate the development and maintenance of Analytics workloads. Additionally, you will collaborate with various stakeholders to provide guidance on architectural decisions and address complex technical challenges related to scaling and performance tuning. Key Responsibilities: - Design, architect, engineer, and mentor in Big Data and MPP technologies - Lead the development and management of new solutions using technologies like SingleStore, Vertica, Clickhouse, and Doris - Develop scalable and robust systems - Measure, compare, optimize, and tune system/datastore performance - Create proofs of concept for emerging technologies - Recommend and implement tools and processes to accelerate the development and maintenance of Analytics workloads - Collaborate with stakeholders to provide guidance on architectural decisions and address technical challenges Qualifications: Preferred: - Experience with data visualization tools such as Tableau, Looker, and Apache Superset - Knowledge of open-source Vector databases such as Milvus and Weaviate - Proficiency in application development using any programming language with a focus on designing and building tools and frameworks for managing and scaling Big Data technologies Minimum: - Strong educational background in Computer Science or Software Engineering - 8 to 12 years of professional experience managing complex, distributed, and multi-tier Big Data/Analytics environments - Proven experience as a database SRE, specifically with MPP technologies like SingleStore, ClickHouse, Vertica, Doris - In-depth knowledge of datastore performance tuning, query optimization, and troubleshooting along with DR setup/backup and recovery procedures - Extensive experience working with public cloud platforms (AWS & GCP) and Kubernetes container deployments - Expertise in automation, including the development of tools and scripts to monitor server-side components and improve operational efficiency - Familiarity with architectural and design considerations related to scalability, reusability, and flexibility - Strong problem-solving and critical thinking skills with a passion for solving challenging engineering problems and triaging complex operational issues in collaboration with various engineering and customer teams,