Data Engineer

a . 2 + years experience in bigdata technologies like pyspark , hadoop , trino , druid

b. Strong experience on query optimisation in trino /pyspark

c. Strong hands on in Airflow / scheduler

Role & responsibilities

Preferred candidate profile

Data Engineer

Responsibilities:

About the Role: H ands-on Data Engineers to build and maintain scalable data solutions and services . The role includes :

a. Maintain , develop data engineering pipelines to ensure seamless data flow for BI applications

b. Create data models to ensure seamless query system

c. Develop or onboard opensource tools to make the data platform up to date

d. Optimize queries and scripts over large-scale datasets (TBs) with a focus on performance and cost-efficiency •

e. Implement data governance and security best practices in kubernetes environments

f. Collaborate across teams to translate business requirements into robust technical solutions