Data Engineer

DemandMatrix

7 years

25 - 30 Lacs

India

Posted:1 month ago| Platform:

Apply

Skills Required

data engineering unix algorithms aws gcp nosql mongodb elasticsearch power analytics ai graphs processing network extraction spark hadoop linux pyspark etl sqoop querying design code apache python

Work Mode

On-site

Job Type

Full Time

Job Description

Only a solid grounding in computer engineering, Unix, data structures and algorithms would enable you to meet this challenge.
7+ years of experience architecting, developing, releasing, and maintaining large-scale big data platforms on AWS or GCPUnderstanding of how Big Data tech and NoSQL stores like MongoDB, HBase/HDFS, ElasticSearch synergize to power applications in analytics, AI and knowledge graphsUnderstandingof how data processing models, data location patterns, disk IO, network IO, shuffling affect large scale text processing - feature extraction, searching etcExpertise with a variety of data processing systems, including streaming, event, and batch (Spark, Hadoop/MapReduce)5+ years proficiency in configuring and deploying applications on Linux-based systems5+ years of experience Spark - especially Pyspark for transforming large non-structured text data, creating highly optimized pipelinesExperience with RDBMS, ETL techniques and frameworks (Sqoop, Flume) and big data querying tools (Pig, Hive)Stickler of world class best practices, uncompromising on the quality of engineering, understand standards and reference architectures and deep in Unix philosophy with appreciation of big data design patterns, orthogonal code design and functional computation models Skills:- Apache Hadoop, PySpark, Python, Design patterns, Data Structures and Algorithms

More Jobs at DemandMatrix

Data Engineer

India

7.0 - 7.0 yrs

INR 25 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

DemandMatrix

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Data Engineer