Senior Specialist - Machine Learning

Job Description

The Data Engineer will serve as a technical expert in the fields ofdesign and develop AI data pipelines to manage both large unstructuredand structured datasets, with a focus on building data pipelines for enterprise AI solutions Job Description Working closely with data scientists and domain experts to design anddevelop AI data pipelines using agile development process. Developing pipelines for ingesting and processing large unstructuredand structured datasets from a variety of sources, with a specificemphasis on creating solutions for AI solutions to ensure efficient andeffective data processing. Work efficiently with structured and unstructured data sources. Work with cloud technologies such as AWS to design and implement scalable data architectures Supporting the operation of the data pipelines involves troubleshooting and bug fixing, as we'll as implementing change requeststo ensure that the data pipelines continue to meet user requirements. Your Profile Masters or bachelors Degree in Computer Science/Mathematics/Statistics or equivalent. Minimum of 3 years of relevant work experience in data engineering Extensive hands-on experience in conceptualizing, designing, andimplementing data pipelines. Proficiency in handling structured dataOracle unstructured data formats (eg, PPT, PDF, Docx), databases(RDMS, Oracle/PL SQL, MySQL, NoSQL such as Elasticsearch, MongoDB,Neo4j, CEPH) and familiarity with big data platforms (HDFS, Spark,Impala). Experience in working with AWS technologies focussing on buildingscalable data pipelines. Strong background in Software Engineering Development cycles(CI/CD) with proficiency in scripting languages, particularly Python. Good understanding and experience with Kubernetes / OpenshiftPlatform. Front-end Reporting Dashboard and Data Exploration tools -Tableau Good understanding of data management, data governance, and datasecurity practices. Highly motivated, structured and methodical with high degree ofself-initiative Team player with good cross-cultural skills to work in internationalteam Customer and Result orientated