Technical Consultant

Technical Consultant

Exp- 4 to 8yr

Location -Bengaluru

JD-

1. Databricks hands-on with Phyton / Scala.

2. Experience in Building / optimizing delta lake.

3. Spark SQL, Data Frames, and building reusable frameworks for reconciliation.

4. Better knowledge of Spark UI and long-running jobs troubleshooting / Optimization.

5. ETL tool experience Talend / Informatica.

6. 6-10 years of experience in full range of data engineering, covering best practices.

7. Fully conversant with big-data processing approaches and schema-on-read methodologies is a must.

8. Knowledge of Azure Data Factory pipeline/Databricks/Azure Data Lake/Azure DW/Database is a must.

9. Experience building and deploying a range of data engineering pipelines into production, including using DevOps automation best practices for CI/CD

10. Familiarity with databases and analytics technologies in the industry including Data Warehousing/ETL, Relational Databases, or MPP

11. Experience with performance tuning, troubleshooting, and debugging SparkTM and other big data solutions