Data Engineer

Iris Software

2 - 5 years

5 - 9 Lacs

noida

Posted:-1 days ago| Platform:

Apply

Skills Required

pyspark dbms sql big data python hive developer tools continuous integration scala glue amazon redshift ci/cd data warehousing emr spark devops shell scripting hadoop snowflake impala data bricks lambda expressions athena bash agile aws unix

Work Mode

Work from Office

Job Type

Full Time

Job Description

Solid experience, knowledge and skills in Data Engineering, BI/software development such as ELT/ETL, data extraction and manipulation in Data Lake/Data Warehouse environment.

Proven experience in data modelling, analysis, and profiling.
Experience of working in diverse data domains.
Continuous improvement and performance optimisation practice ensuring high levels of performance, availability and integrity.
Proven consulting and mentoring experience.
Experience in working within an Agile environment.
Experience in applying DevOps practices, SDLC, CI/CD principles to build automated pipelines and deployment.

Other capabilities

Hands on in SQL and its Big Data variants (Hive-QL, Databricks)
Python and Spark and one or more of its API (PySpark, Spark SQL, Scala), Bash/Shell scripting
Experience with Source code control - GitHub, VSTS etc.
Knowledge and exposure to Big Data technologies Hadoop stack such as HDFS, Hive, Impala, Spark etc, and cloud Big Data warehouses - RedShift, Snowflake etc.
Experience with UNIX command-line tools.
Exposure to AWS technologies including EMR, Glue, Athena, Data Pipeline, Lambda, etc

Mandatory Competencies

Python - Python
Database - SQL
Beh - Communication
Big Data - Big Data - Pyspark
Development Tools and Management - Development Tools and Management - CI/CD

More Jobs at Iris Software

Python Automation Tester with Robot Framework

Noida, Gurugram

7 - 12 yrs

INR 22 - 37 Lacs

.Net - Intern

Noida, Uttar Pradesh

Experience: Not specified

Salary: Not disclosed

ETL Tester

Pune, Delhi / NCR

5 - 8 yrs

INR 14 - 24 Lacs

Java Architect

Noida

14 - 18 yrs

INR 25 - 40 Lacs

QA Tester - Intern

Noida, Uttar Pradesh

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.