Senior Architect - Databricks & AWS Cloud

Solution Architect Data Platforms & Solution Delivery

Solution Architect

Key Responsibilities:

• Work with stakeholders to gather and analyze business, data, and technical requirements for new and evolving data solutions.
• Develop conceptual, logical, and physical solution architectures for data platforms, data products, analytics, and AI/ML projects.
• Guide projects through the entire solution lifecycle, from requirements and design to build, testing, and deployment.
• Integrate data from multiple sources (SAP and non-SAP), ensuring interoperability and seamless data flow.
• Define solution-level security, access controls, and compliance requirements in partnership with data governance and security teams.
• Lead efforts in performance optimization, cost management, and solution scalability.
• Produce clear technical documentation and solution architecture diagrams to support implementation and knowledge transfer.
• Stay up-to-date with advances in cloud, data engineering, and analytics technologies and recommend improvements.
• Collaborate across teamsincluding data engineers, data scientists, DevOps, and business stakeholdersto ensure effective delivery and adoption of solutions.

Experience & Technical Proficiency

Experience:

• Minimum 7+ years in solution architecture, data architecture, or platform engineering roles.
• Proven experience delivering end-to-end data and analytics solutions in large-scale, complex environments.

Technical Proficiency:

• Solution Architecture & Data Platforms:

• Designing data platforms and architecture (conceptual, logical, physical)
• Cloud-native and hybrid data solutions (Databricks Lakehouse, AWS)
• Integration of SAP and non-SAP data sources

• Databricks Lakehouse Platform:

• Medallion Architecture
• Delta Lake & DLT Pipelines
• PySpark Workbooks
• Spark SQL & SQL Warehouse
• Unity Catalog (data governance, lineage)
• Genie (query performance, indexing)
• Security & Role-Based Access Control

• Programming:

  Python, SQL, PySpark, Spark, Scala

• AWS Cloud Services:

  IAM, S3, Lambda, EMR, Redshift, Bedrock

• Solution Delivery:

• Familiarity with DevOps and CI/CD processes
• Solution documentation and architecture diagramming
• Performance tuning and cost optimization

• Other:

• Experience with data modeling (ER, dimensional)
• Knowledge of data security and compliance frameworks
• Strong communication, presentation, and stakeholder management skills

Preferred Qualifications:

• Certifications in Databricks, AWS, or Solution Architecture
• Experience with SAP ERP, S/4HANA, DataSphere, ABAP, and CDS views
• Exposure to data mesh or data product management concepts
• Background in manufacturing or enterprise analytics environments