Data Analytics / MPP Engineer

Job Description

Are you passionate about building highly scalable, distributed applications that efficiently handle large volumes of data? Do you thrive on mastering various Big Data and MPP technologies and selecting the best ones for each application? If you are excited by the challenge of working in a fast-paced environment where your technical skills are tested daily and you want your work to impact millions of Apple users, we want to hear from you In this role, you will join Apples Data Services Data Analytics and Engineering team as a highly motivated, detail-oriented, and energetic individual with excellent communication skills Your responsibilities will include:Design, architect, engineer and mentor in Big Data and MPP technologies, platforms and applications Lead the design, development and management of new solutions using the latest technologies and data platforms such as SingleStore, Vertica, Clickhouse, Doris across various environments, including physical & virtual machines, containers, and cloud platforms Develop scalable, robust systems that adapt to evolving business requirements Measure, Compare, Optimise and Tune the System / Datastore performanceCreate proofs of concept for emerging technologies, performance benchmarking and architect scalable applications Recommend and implement tools and processes to accelerate the development, deployment and maintenance of Analytics workloads Collaborate with application owners, developers, and project managers, leveraging your expertise to provide guidance on architectural decisions and address complex technical challenges related to scaling and performance tuning Strong educational background in Computer Science or Software Engineering. 8 to 12 years of professional experience managing complex, distributed and multi-tier Big Data / Analytics environments. Proven experience as a database SRE, specifically with MPP technologies such as SingleStore, ClickHouse, Vertica, Doris, etc In-depth knowledge of datastore performance tuning, query optimisation and troubleshooting along with DR setup / Backup and recovery procedures. Extensive experience working with public cloud platforms (AWS & GCP) and Kubernetes container deployments. Expertise in automation, including the development of tools and scripts to monitor server-side components and improve operational efficiency. Familiarity with architectural and design considerations related to scalability, reusability, and flexibility. Demonstrate strong problem-solving and critical thinking skills, along with a solid ability to quickly evaluate and apply new technologies. A passion for solving challenging engineering problems and triaging complex operational issues in collaboration with various engineering and customer teams. Preferred Qualifications Experience with data visualisation tools such as Tableau, Looker and Apache Superset. Knowledge of open-source Vector databases such as Milvus, Weaviate, etc. is a plus. Proficient in Application development using any programming language, with a focus on designing and building tools and frameworks for managing and scaling Big Data technologies.