AWS-Databricks Engineer

AWS Databricks Developer

Key Responsibilities:

• Overall, 5 to 8 years of experience in IT Industry. Min 6 years of experience working on Data Engineering.
• Design and develop solution in combination of Cloudera, Palantir and Databricks.
• Develop Python-based automation scripts to optimize workflows and processes.
• Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
• Define architecture for data-driven solutions.
• Ensure scalability, security, and performance of deployed solutions.
• Collaborate with business teams, data engineers, and developers to align solutions with business goals.

Mandatory Skills:

• Databricks

  :
• Expertise in design jobs and workloads.

• Python

  : Hands-on experience in automation and scripting.

• Cloudera

  : Strong knowledge of

  Spark, Hive, Impala, HDFS, Kafa, HBase and Cluster management

  .

• Palantir:

  Hands on experience with

  analytics, data fusion and developing analytical workflows

• DevOps Basics

  : Familiarity with

  Jenkins

  CI/CD pipelines

  .