Data Engineer with Databricks

Job Title: Databricks & AWS Lakehouse Engineer

Budget : Max 25 LPA

Gurugram

Client: HCL

Strong hands-on skills in Python (primary), Spark SQL, pipeline engineering, CI/CD automation

• 7–10 years of data engineering experience, with 5+ years on Databricks and Apache Spark.

• Expert-level hands-on experience with Databricks and AWS (S3, Glue, EMR, Kinesis, Lambda, IAM, CloudWatch).
• Primary language:

  Python

  ; strong skills in

  Spark SQL

  .
• Deep understanding of Lakehouse architecture, Delta Lake, Parquet, Iceberg.
• Strong experience with Databricks Workflows, Unity Catalog, Runtime upgrades, and cost optimization.
• Experience with Databricks native monitoring tools and Datadog integration.
• Security and compliance expertise across data governance and infrastructure layers.
• Experience with CI/CD automation using Terraform, CloudFormation, and Git.
• Hands-on experience with disaster recovery and multi-region architecture.
• Strong problem-solving, debugging, and documentation skills.