Data Engineering Tech Lead

As the Data Engineering Technology Lead, your main objective is to establish and implement new or revised data platform ecosystems and programs in coordination with the Technology team. You will lead the data engineering team in implementing business requirements by designing, building, and maintaining batch or real-time data pipelines in the data platform. Your responsibilities will also include optimizing the data infrastructure for accurate extraction, transformation, and loading of data from various sources, developing ETL processes, automating data workflows, and preparing raw data in Data Warehouses for technical and non-technical stakeholders. Key Responsibilities: - Design, build, and maintain batch or real-time data pipelines - Optimize data infrastructure for accurate data extraction and transformation - Develop ETL processes and automate data workflows - Prepare raw data in Data Warehouses for technical and non-technical stakeholders - Partner with data scientists and functional leaders to deploy machine learning models - Ensure data accuracy, integrity, privacy, security, and compliance - Monitor data systems performance and implement optimization strategies - Collaborate with management teams to integrate functions and resolve high-impact problems/projects Qualifications Required: - 12+ years of total experience with at least 7 years in a relevant Data engineering role - Advanced SQL skills and experience with relational databases - Proficiency in object-oriented languages like Python/Pyspark - Experience with data ingestion tools such as Talend & Ab Initio - Familiarity with data lakehouse architecture like Iceberg/Starburst - Proficiency in scripting languages like Bash - Knowledge of data pipeline and workflow management tools - Strong project management and organizational skills - Bachelor's degree/University degree or equivalent experience required, Master's degree preferred Please note that this job description provides a high-level overview of the work performed, and other job-related duties may be assigned as required.,