Data Engineer

Software Real-Time Data Engineer III - Streaming data

Position Responsibilities Summary:

• Configure and validate infrastructure related to our internal SAAS Real-Time Data Streaming Platform in Azure.
• Develop and validate the Streaming Pipeline and data models.
• Enrich data with Azure Stream Analytics.
• Use Machine Learning techniques like classification and regression.
• Develop systems to support applying AI/ML techniques .
• Provide support to our development teams and work with our Data Organization
• Work with our Application Architects.
• Documentation: writes knowledge articles and other documentation

General Responsibilities:

• Serving as a regional point of contact in our Data Streaming team together with members in other regions.
• Work in close coordination with the architecture, development, data and operations team such that the platform functions within expectation.
• Support the development Streaming Pipeline and data models.
• Look for opportunities to improve our end-to-end stream by means of architecture and technology-based changes.

Education and/or Requirements Required:

The incumbent should possess minimum associate or bachelors degree in computer science and proven work experience.

Candidates must have proven excellent communications and interpersonal skills.

Candidates should have strong organizational acumen.

Skill Requirements:

Works constructively and collaboratively with other team members and across organizations to accomplish organizational goals and objectives. Applies methodologies, processes, and tools to enhance work effectiveness and to implement process improvements. Leverages

experiences and acquires and shares new skills and knowledge to enhance organizational capability and individual competence.

Fosters teamwork by identifying and removing obstacles to ensure organization results are achieved.

Proven affinity with Microsoft Azure Cloud and specifically with Azure Event Hub, Azure Stream Analytics.

Knowledge and experience with Apache Flink or Kafka Streams API, Apache Spark, Apache Nifi and Azure HDInsight are a plus.

Proven ability to develop in Java. Alternatives like Scala or Kotlin would be a plus.