Tech Lead, Data Architecture

In this role, you will design, develop, and lead the adoption of Snowflake-based solutions to ensure scalable, efficient, and secure data systems that empower our business analytics and decision-making processes.

As a Snowflake Advisor, you will collaborate with cross-functional teams, lead data initiatives, and act as the subject matter expert for Snowflake across the organization.

What you will do:

• Define and implement best practices for data modelling, schema design, query optimization in Snowflake
• Develop and manage ETL/ELT workflows to ingest, transform and load data into Snowflake from various resources
• Integrate data from diverse systems like databases, APIs, flat files, cloud storage etc. into Snowflake
• Use tools like Streamsets, Informatica or dbt to streamline data transformation processes
• Monitor or tune Snowflake performance including warehouse sizing, query optimizing and storage management
• Manage Snowflake caching, clustering and partitioning to improve efficiency
• Analyze and resolve query performance bottlenecks
• Monitor and resolve data quality issues within the warehouse
• Collaborate with data analysts, data engineers and business users to understand reporting and analytic needs
• Work closely with DevOps team for automation, deployment and monitoring
• Plan and execute strategies for scaling Snowflake environments as data volume grows
• Monitor system health and proactively identify and resolve issues
• Implement automations for regular tasks
• Enable seamless integration of Snowflake with BI Tools like Power BI and create dashboards
• Support ad hoc query requests while maintaining system performance
• Create and maintain documentation related to data warehouse architecture, data flow, and processes
• Provide technical support, troubleshooting, and guidance to users accessing the data warehouse
• Optimize Snowflake queries and manage performance
• Keep up to date with emerging trends and technologies in data warehousing and data management
• Good working knowledge of Linux operating system
• Working experience on GIT and other repository management solutions
• Good knowledge of monitoring tools like Dynatrace, Splunk
• Serve as a technical leader for Snowflake-based projects, ensuring alignment with business goals and timelines
• Provide mentorship and guidance to team members in Snowflake implementation, performance tuning and data management
• Collaborate with stakeholders to define and prioritize data warehousing initiatives and roadmaps
• Act as point of contact for Snowflake-related queries, issues and initiatives

What you will need to have:

• Must have 8 to 10 years of experience in data management tools like Snowflake, Streamsets, Informatica
• Should have experience on monitoring tools like Dynatrace, Splunk
• Should have experience on Kubernetes cluster management
• CloudWatch for monitoring and logging and Linux OS experience
• Ability to track progress against assigned tasks, report status, and proactively identify issues
• Demonstrate the ability to present information effectively in communications with peers and project management team
• Highly organized and works well in a fast paced, fluid and dynamic environment

What would be great to have:

• Experience in EKS for managing Kubernetes cluster
• Containerization technologies such as Docker and Podman
• AWS CLI for command-line interactions
• CI/CD pipelines using Harness
• S3 for storage solutions and IAM for access management
• Banking and Financial Services experience
• Knowledge of software development life cycle best practices