Job
Description
As a Data Engineering Lead/Architect with 10+ years of experience, you will play a crucial role in architecting and designing data solutions to meet business requirements effectively. You will collaborate with cross-functional teams to design scalable and efficient data architectures, models, and integration strategies. Your technical leadership will be essential in implementing data pipelines, ETL processes, and data warehousing solutions. Your expertise in Snowflake technologies will be key in building and optimizing data warehouses. You will develop and maintain Snowflake data models and schemas, following best practices such as cost analysis, resource allocation, and security configurations. Additionally, you will leverage Azure cloud services and Databricks platforms to manage and process large datasets efficiently, building and maintaining data pipelines on Azure services. Implementing best practices for data warehousing, ensuring data quality, consistency, and reliability will be part of your responsibilities. You will create and manage data integration processes, including real-time and batch data movement between systems. Your mastery in writing complex SQL and PL/SQL queries will enable you to extract, transform, and load data effectively, optimizing SQL queries and database performance for high volume data processing. Continuous monitoring and enhancement of data pipelines and data storage systems will be crucial for performance tuning and optimization. You will troubleshoot and resolve data-related issues to minimize downtime while documenting data engineering processes, data flows, and architectural decisions. Collaboration with data scientists, analysts, and stakeholders is essential to ensure data availability and usability. Your role will also involve implementing data security measures and adhering to compliance standards to protect sensitive data. In addition to your technical skills, you will be expected to showcase abilities such as driving data engineering strategies, engaging in sales and proposal activities, developing customer relationships, leading a technical team, and mentoring other team members. You should be able to clarify and translate customer requirements into Epics/Stories, removing ambiguity and aligning others to your ideas/solutions. To qualify for this role, you should have a Bachelor's or Master's degree in computer science, Information Technology, or a related field, along with over 10 years of experience in Data Engineering with a strong focus on architecture. Your proven expertise in Snowflake, Azure, and Databricks technologies, comprehensive knowledge of data warehousing concepts, ETL processes, data integration techniques, and exceptional SQL and PL/SQL skills are essential. Certifications in relevant technologies like Snowflake and Azure will be a plus. Strong problem-solving skills, the ability to work in a fast-paced, collaborative environment, and excellent communication skills are also required to convey technical concepts to non-technical stakeholders effectively.,