Databricks Engineer

Data Bricks JD

Key responsibilities

• Data pipeline development:

  Design, develop, and deploy scalable ETL (Extract, Transform, Load) pipelines using Databricks, Spark, and other cloud-native tools.

• Platform optimization:

  Optimize data processing workflows for performance, scalability, and cost efficiency within the Databricks environment.

• Data modeling and architecture:

  Contribute to the design and implementation of data models, schemas, and architectures for data lakes and data lakehouses.

• Data quality and governance:

  Implement data quality checks, validation routines, and ensure data security and compliance standards are met.

• Collaboration:

  Work closely with data scientists, analysts, and other stakeholders to understand requirements and deliver data solutions.

• Troubleshooting and monitoring:

  Monitor and debug production jobs, troubleshoot performance issues, and ensure the reliability of data pipelines.

• Technical leadership:

  Provide guidance and mentorship to junior team members and participate in code reviews.

• Documentation:

  Develop and maintain documentation for data flows, processes, and solutions.

Essential skills

• Proficiency in the Databricks platform, including Spark and Delta Lake.
• Strong programming skills in Python and SQL.
• Experience with cloud services like Azure, AWS, or GCP.
• Knowledge of data engineering principles and best practices for pipeline design and optimization.
• Familiarity with CI/CD and DevOps practices.

Location: Pan India

Exp: 3 Yrs - 12 Yrs

Salary: As per company standards

Interested can share your resume along with some details -

Total years of exp:

Relevant years of exp:

Current Location:

Preferred Location:

Current Organization:

Highest Education:

Notice period:

Current CTC:

Expected CTC:

to: harima.ext@deloitte.com