Data Solution Architect

Data Solution Architect

Responsibilities

• Architect and design scalable solutions for big data analytics on cloud platforms
• Provide strategic vision for data ingestion, processing, security, governance and analytics scalability
• Serve as a technical leader, offering guidance across engineering and development teams
• Define and implement architectures for data warehouses and lakes based on business needs
• Evaluate and introduce architecture patterns such as Lambda, Kappa or Data Mesh into projects
• Optimize and monitor architecture for centralized, distributed, federated or decentralized data management
• Implement solutions leveraging AI/ML and Generative AI technologies for data-driven automation
• Collaborate with multi-disciplinary teams to ensure seamless integration of new technologies
• Develop prototypes using programming languages such as Python, Scala or Java for concept validation
• Implement and ensure DevOps and CI/CD best practices are followed throughout development
• Lead efforts around data security, protection and governance compliance

Requirements

• 12-16 years of experience in IT, including 2 or more production architecture designs or solution review activities over the past 2 to 3 years
• Knowledge of multiple architecture patterns such as DWH, Data Lake, Virtualization, Lambda, Kappa or Data Mesh
• Expertise in centralized, distributed, decentralized or federated data management approaches
• Background in AI/ML and Gen AI-related technologies
• Proficiency in at least one cloud platform such as Azure, AWS, GCP or Snowflake
• Understanding of Big Data technologies including Spark, Spark Streaming, Hadoop, Kafka, Hive, NoSQL databases like HBase or Cassandra and orchestration tools (Airflow, Oozie)
• Competency in at least 2 Data Management domains such as BI & Visualization, Data Integration, Data Engineering, Generative AI, Data Governance, Data Quality, Security and Storage
• Familiarity with DevOps and CI/CD tools like GitLab, Jenkins, Azure DevOps and containerization technologies
• Hands-on skills in Python, R, Scala, Java or .NET for prototype and PoC development