Data Engineering Lead

As a Data Engineering Lead at Metyis, you will play a crucial role in independently leading and managing the execution of data engineering projects. You will be responsible for engineering complete technical solutions to solve concrete business challenges in areas such as digital marketing, eCommerce, Business Intelligence, and self-service analytics. Your key responsibilities will include: - Collecting functional and non-functional requirements, considering technical environments, business constraints, and enterprise organizations. - Supporting clients in executing their Big Data strategies by designing and building operational data platforms, including ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs, web services, and training and scoring machine learning models. - Troubleshooting and quality checking work done by team members. - Collaborating closely with partners, strategy consultants, and data scientists in a flat and agile organization where personal initiative is highly valued. - Sharing data engineering knowledge by giving technical trainings. - Communicating and interacting with clients at the executive level. - Guiding and mentoring team members. To excel in this role, you should possess the following qualifications: - 7-10 years of professional hands-on experience. - A broad practice in multiple software engineering fields. - Experience in managing and leading data engineering/warehousing projects. - Proficiency in Python, SQL, and Distributed programming languages, preferably Spark. - Experience working on Cloud, with Azure being a plus. - Experience in setting up data lakes using the entire Big Data and DWH ecosystem. - Familiarity with data workflows and ETL, with knowledge of Apache Airflow being a plus. - Comfort with Unix OS type systems, Bash, and Linux. - Basic knowledge of web services, APIs, Containers, Docker, Version Control, Testing and development cycle, preferably git (Gitlab or GitHub), security practices, Agile software development practices, Object-oriented programming, data processing, databases theory and practice, distributed data processing, concepts of functional programming, enterprise data warehousing, business intelligence, ETL principles. - Good written and oral communication skills in English language. At Metyis, you will have the opportunity to interact with C-level clients, lead your team in creating new business solutions, seize opportunities in our entrepreneurial environment, and become part of a fast-growing international and diverse team. Join us in making an impact and growing together as Partners for Impact.,