Big Data Operations Engineer

Job Description

Broad knowledge and experience in: Understanding of Big Data Engineering/processing, Business Intelligence and Advanced analytics Developing ETL/ELT processes Knowledge in databases and Data warehouse modeling Knowledge in Cloud based data engineering and Machine Learning Models Knowledge in building APIs for application integration Experience with various frameworks and processes, such as Agile Determine transformation requirements and develop processes to bring structured and unstructured data from the source to a new physical Data Model Work with Data Scientists to implement strategies for cleaning and preparing data for analysis, to develop data imputation algorithms, and optimize performance of big data and machine learning systems Above average skills in: Big Data Engineering and Processing using Hadoop stack (Hadoop, Hive, HDFS, Spark and HBase etc.) Develop ETL/ELT processing using Apache Ni-Fi Strong background on SQL and databases Programming Skills in Python or Scala Data Analysis and Validation skills Demonstrated ability to: Work in a dynamic, fast-paced, work environment Self-motivated with the ability to work under minimal direction To adapt to new technologies and learn quickly A passion for data and information with strong analytical, problem solving, and organizational skills Work in multi-functional groups, with diverse interests and requirements, to a common objective Communicate very well with distributed teams (written, verbal and presentation)