Senior Data Engineer

About The Role:

Eucloid is looking for a senior Data Engineer with hands-on expertise in Databricks to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of different components. Candidate will also involve in projects like integrating data from various sources, managing big data pipelines that are easily accessible with optimized performance of overall ecosystem. The ideal candidate is an experienced data wrangler who will support our software developers, database architects and data analysts on business initiatives. You must be self-directed and comfortable supporting the data needs of cross-functional teams, systems, and technical solutions

Qualifications:

B.Tech/BS degree in Computer Science, Computer Engineering, Statistics, or other Engineering disciplines

Min. 5 years of Professional work Experience, with 1+ years of hands-on experience with Databricks

Highly proficient in SQL & Data model (conceptual and logical) concepts

Highly proficient with Python & Spark (3+ year)

Knowledge of Distributed computing and cloud databases like Redshift, Big query etc.

2+ years of Hands-on experience with one of the top cloud platforms - AWS/GCP/Azure.

Experience with Modern Data stack tools like Airflow, Terraform, dbt, Glue, Data proc etc.

Exposure to Hadoop & Shell scripting a plus

Min 2 years, Databricks 1 year desirable, Python & Spark 1+ years, remove data model, SQL only, any cloud exp 1+ year

Responsibilities:

Design, implementation, and improvement of processes & automation of Data infrastructure

Tuning of Data pipelines for reliability & performance

Building tools and scripts to develop, monitor, troubleshoot ETLs

Perform scalability, latency, and availability tests on a regular basis.

Perform code reviews and QA data imported by various processes.

Investigate, analyze, correct and document reported data defects.

Create and maintain technical specification documentation.

Eucloid offers a high growth path along with great compensation, which is among the best in the industry. Please reach out to divya.joshi@eucloid.com if you want to apply.