Data Engineer,

5 - 9 years

6 - 11 Lacs

Posted:10 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Role & responsibilities

5+ years of overall IT experience, which includes hands on experience in Big Data technologies.

  • Mandatory - Hands on experience in

    Python and PySpark.

  • Build pySpark applications using

    Spark Dataframes

    in

    Python

    .

  • Worked on optimizing spark jobs that processes huge volumes of data.

  • Hands on experience in version control tools like

    Git

    .

  • Worked on

    Amazons Analytics

    services like Amazon EMR, Amazon Athena, AWS Glue.

  • Worked on Amazon’s Compute services like Amazon Lambda, Amazon EC2 and Amazon’s Storage service like S3 and few other services like SNS.

  • Good to have knowledge of datawarehousing concepts – dimensions, facts, schemas- snowflake, star etc.

  • Have worked with columnar storage formats- Parquet,Avro,ORC etc. Well versed with compression techniques – Snappy, Gzip.

  • Good to have knowledge of AWS databases (atleast one) Aurora, RDS, Redshift, ElastiCache, DynamoDB.

Bigdata, AWS, python, Pyspark, AWS services - IAM, lambda, EMR, glue

Preferred candidate profile

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Tekskills logo
Tekskills

Information Technology and Services

San Diego

RecommendedJobs for You

noida, hyderabad, bengaluru

hyderabad, pune, bengaluru