Overview
Ethoca, a Mastercard Company is seeking a Lead Data Engineer to join our team to drive on premise solutions together with Azure cloud enablement while exploring big data solutions within our technology landscape. The role is visible and critical as part of a high performing team it will appeal to you if you have an effective combination of domain knowledge, relevant experience, and the ability to execute on the details. You will bring cutting edge software and full stack development skills with advanced knowledge of cloud and data lake experience while working with massive data volume. You will own this our teams are small, agile and focused on the needs of the high growth fintech marketplace. You will be working across functional teams to deliver on the cloud strategy. We are committed in making our systems resilient and responsive yet easily maintainable on premise and on cloud. Role Own the development of ETL/ELT, data movement, streaming and non-streaming data with a solid background in development of reports/dashboards, applications, services, user interfaces while maintaining and scaling existing solutions. Existing solutions are built on data that resides in both SAP HANA data warehouse and Snowflake warehouse, we expect the successful candidate will always pay attention to detail: configuration, maintenance, security and reliability of data and Data Services in the different environments as we build out a state-of-the-art analytics foundation (on premise and on cloud). Tenured in the fields of Computer Science/Engineering or Software Engineering Bachelor's degree in Computer Science, or a related technical field including programming Experience with cloud infrastructure management and automation (preferably Azure) Experience with software development and configuration automation is a must have Expertise in designing, analyzing, and troubleshooting large-scale systems Capability to debug, optimize code, and automate routine tasks Extensive experience in Machine Learning and Artificial Intelligence Hands-on experience with building data lake solutions, streaming analytics solutions and code development across environments (i.e. DevOps) All About You
Extensive data warehousing/data lake development experience with strong data modeling and data integration experience Strong SQL and higher-level programming languages with solid knowledge of data mining, machine learning algorithms and tools Good understanding of data warehouse/data lake design patterns and best practices Solid understanding of data ingestion (i.e. streaming platforms like Kafka) Strong experience with data integration tools ETL/ELT tools (i.e. Apache NiFi, Azure Data Factory, Pentaho, Talend) Experience
working:
In a Data Warehousing and BI environment with understanding of warehousing concepts Cloud platforms particularly MS Azure Snowflake Computing Knowledge of Source Control System (SCS) preferably Git source control Application frameworks (i.e. Springboot) Strong understanding of database change management process (DCM) Systematic problem-solving approach, with effective communication skills and a sense of drive Strong understanding and working knowledge of Continuous Integration and Continuous Deployment concepts Excellent written and verbal communication skills with top notch problem solving and analytical skills Plan and own deployments, migrations and upgrades to minimize service impacts with mitigation plans Understand and tune performance across all physical and logical dimensions Support Ethocas architects and analysts as they design and build effective, agile applications Use your experience to help shape and scale the future of our development and production infrastructure Nice to have:
Scripting experience with one or more of the following:oJava and Java Script, Python, RExperience working with analytics and data processing engines like Apache Spark/StormExperience with application developmentExperience working with SAP HANA or across cloud platformsA single page application framework (SPA) Example: VueJS or ReactJS (Javascript)Understanding of Cloud Foundry application platformWorking knowledge of data mining, machine learning algorithms and toolsETL tools experienceReporting/Dashboarding tool/s experienceIdeally you have experience in banking, e-commerce, credit cards or payment processing and exposure to both SaaS and premises-based architectures. In addition, you have a post-secondary degree in computer science, mathematics, or quantitative science.
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
-
Abide by Mastercards security policies and practices;
-
Ensure the confidentiality and integrity of the information being accessed;
-
Report any suspected information security violation or breach, and
-
Complete all periodic mandatory security trainings in accordance with Mastercards guidelines.
