Engineering Expert - Business Data Cloud - Data Product Runtime Team

Job Description

We help the world run better Job Title: Engineering Expert - Business Data Cloud - Data Product Runtime Team Job Description: As a n Engineering Expert, you will be instrumental in the expansion of our Foundation Services team in Bangalore. Your profound expertise in distributed data processing, Spark optimization, and data transformation pipelines will drive scalable data solutions, reinforcing SAP Business Data Clouds pivotal role in SAPs Data & AI strategy. Responsibilities: Lead the design and execution of optimized data processing solutions . Spearhead Spark optimization strategies to maximize performance and scalability in data processing. Architect and refine pluggable data transformation pipelines for efficient processing of large datasets. Implement GitOps practices to advance CI/CD pipelines and operational efficiency. Apply advanced SQL skills to refine data transformations across vast datasets. Integrate AI & ML technologies into high-performance data solutions, staying informed on emerging trends. Utilize SAP HANA Spark to drive innovation in data engineering processes. Mentor junior engineers, fostering a culture of continuous improvement and technical excellence. Collaborate effectively with global stakeholders to achieve successful project outcomes. Qualifications: Extensive experience in data engineering, distributed data processing, and expertise in SAP HANA or similar databases. Proficiency in Python (PySpark) is essential; knowledge of Scala and Java is advantageous. Advanced understanding of Spark optimization and scalable data processing techniques. Proven experience in architecting data transformation pipelines. Knowledge of Kubernetes, GitOps , and modern cloud stacks . Strong understanding of AI & ML technologies and industry trends. Effective communication skills within a global, multi-cultural environment. Proven track record of leadership in data processing and platform initiatives.