Job
Description
We are seeking a Data Engineer to join our Enterprise Data team in a hybrid work mode. As a self-starter, you will be responsible for designing and developing data solutions using the latest technologies and patterns. Your role will involve working on strategic data projects at a regional and global level by leveraging your expertise in data, infrastructure, and technologies. Responsibilities: - Design, architect, and develop solutions utilizing cloud big data technology to process and analyze large datasets to meet business requirements. - Create systems to ingest, cleanse, and normalize diverse datasets from internal and external sources, including previously unstructured data. - Collaborate with internal and external stakeholders to understand requirements, anticipate future needs, and identify opportunities for data development. - Gain insights from a variety of data sources by unifying, enriching, and analyzing data. - Develop data management and persistence solutions using relational and non-relational databases to enhance data processing capabilities. - Lead the development of proof of concepts (POCs) to validate solution proposals and drive platform evolution. - Establish data lake solutions to store structured and unstructured data from various sources and guide colleagues in transitioning to modern technology platforms. - Contribute to continuous integration and continuous deployment (CI/CD) processes and adhere to best practices in data engineering. - Mentor team members and support organizational growth. Soft Skills: - Ability to work independently, manage workloads, and prioritize effectively. - Strong team player with reliability, self-motivation, and discipline, capable of handling multiple projects simultaneously. - Excellent communication and collaboration skills to work effectively in a team environment. Technical Skills: - Minimum 8 years of work experience and a bachelor's degree in Information Science, Computer Science, Mathematics, Statistics, or a related field. - Hands-on experience in data engineering with proficiency in technologies like Cloud Computing (AWS, Azure), Micro Services, Streaming Technologies, Network, and Security. - Extensive experience in data development using Python, Spark, Azure SQL Server, Cosmos DB, Azure Data Lake Storage, and other related tools. - Proven track record in designing data management solutions and data pipelines for various applications. - Familiarity with building and enhancing data curation pipelines to integrate data from multiple sources with a focus on data quality and integrity. - Experience in maintaining and monitoring data engineering capabilities, ensuring high platform availability and performance. - Proficiency in source code control systems and CI/CD tools. If you are a motivated Data Engineer with a passion for cutting-edge technologies and a desire to drive business success through data-driven solutions, we encourage you to apply for this exciting opportunity.,
