Senior Data Engineer

Responsibilities

This is an individual contributor role that is responsible for the designing and developing of data solutions that are strategic for the business and built on the latest technologies and patterns. This a global role that requires partnering with both the regional IT teams as well as the other global engineering teams.

• Contribute to the design of information infrastructure, and data management processes to move the organization to a more sophisticated, agile and robust target state data architecture
• Develop systems that ingest, cleanse and normalize diverse datasets, develop data pipelines from various internal and external sources and build structure for previously unstructured data
• Interfaces with internal colleagues and external professionals to determine requirements, anticipate future needs, and identify areas of opportunity to drive data development
• Develop good understanding of how data will flow & stored through an organization across multiple applications such as CRM, Broker & Sales, Finance, HR, MDM, ODS, Data Lake, & EDW
• Develop data solutions that enable non-technical staff to make data-driven decisions
• Design & develop data management and data persistence solutions for application use cases leveraging relational, non-relational databases and enhancing our data processing capabilities
• Develop POCs to influence platform architects, product managers and software engineers to validate solution proposals and migrate
• Develop data lake solutions to store structured and unstructured data from internal and external sources and provide technical guidance to help migrate colleagues to modern technology platform

Sounds like you To apply you need to be:

Experience & Education

• Bachelors degree in Information Science, Computer Science, Mathematics, Statistics or a quantitative discipline in science, business, or social science.
• Hands-on engineering lead who is curious about technology, should be able to quickly adopt to change and one who understands the technologies supporting areas such as Cloud Computing (AWS, Azure(preferred), etc.), Micro Services, Streaming Technologies, Network, Security, etc.

Technical Skills & Competencies

• 6+ years of experience as a data developer using Python-spark, Databricks, Azure Event Hubs, Azure Data Lake Storage, Azure Search etc.
• Hands-on experience on Cube.js for building the Semantic Layer for the data platform.
• Hands-on experience of building Data Pipelines in Cloud and well versed with CICD and DevOps process.
• Experience of handling un-structured data, working in a data lake environment, leveraging data streaming and developing data pipelines driven by events/queues
• Experience building and maintaining a data warehouse/ data lake in a production environment with efficient ETL design, implementation, and maintenance
• Team player, Reliable, self-motivated, and self-disciplined individual capable of executing on multiple projects simultaneously within a fast-paced environment working with cross functional teams