Job Description

Job Description : Data Engineer at Mirabel Technologies should be an avid programmer of Java, Python, R or Scala with expertise in implementing complex algorithms. Data Engineer will work on collecting, storing, processing, and analyzing huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company in various products. Skillset : 1. Proficient understanding of distributed computing principles 2. Ability to build, run and manage large clusters 3. Hadoop v2, MapReduce, HDFS 4. Java, Python 5. Large Scale crawling: Scrapy, Nutch and custom crawling solutions 6. Experience with Apache Solr Lucene 7. NoSQL databases, such as MongoDB, HBase, Cassandra 8. Knowledge of various ETL techniques and frameworks, such as Flume 9. Experience with NLP tools and systems for POS, NER, and Information extraction 10. Experience with Machine Learning - Regression, Classification, Decision Trees. 11. Experience with Linux / AWS. Experience : 4-5 years Key skills: NLP, LLM, AWS Sagemaker, Deep Learning, and No Sql Database.