Senior Data Engineer

About The Role:

a senior Data Engineer with hands-on expertise in Databricks

Location: Chennai

Qualifications:

• B.Tech/BS degree in Computer Science, Computer Engineering, Statistics, or other Engineering disciplines
• Min. 5 years of Professional work Experience, with

  1+

  years

  of

  hands-on

  experience

  with

  Databricks

• Highly proficient in

  SQL

  &

  Data

  model

  (conceptual and logical) concepts
• Highly proficient with Python & Spark (3+ year)
• Knowledge of Distributed computing and cloud databases like Redshift, Big query etc.

• 2+

  years

  of Hands-on experience with one of the top cloud platforms -

  AWS/GCP/Azure.

• Experience with Modern Data stack tools like Airflow, Terraform, dbt, Glue, Dataproc etc.
• Exposure to Hadoop & Shell scripting a plus
• Min 2 years, Databricks 1 year desirable, Python & Spark 1+ years, remove data model, SQL only, any cloud exp 1+ year

Responsibilities

• Design, implementation, and improvement of processes & automation of Data infrastructure
• Tuning of Data pipelines for reliability & performance
• Building tools and scripts to develop, monitor, troubleshoot ETLs
• Perform scalability, latency, and availability tests on a regular basis.
• Perform code reviews and QA data imported by various processes.
• Investigate, analyze, correct and document reported data defects.
• Create and maintain technical specification documentation.

Eucloid