AWS Databricks with Pyspark

Location:

Experience:

Key Responsibilities:

• Strong experience in

  AWS Databricks

  for ETL development and managing big-data pipelines.
• Proficiency with

  Amazon S3 / Data Lake

  and integration into cloud architectures.
• Familiarity with

  Apache NiFi

  for data ingestion, transformation, and routing.
• Experience in

  PySpark

  .
• Solid understanding of

  cloud-based data engineering and storage systems

  .
• Strong problem-solving skills to troubleshoot and optimize ETL workflows

Preferred Skills:

• Experience with other AWS services like

  AWS Glue, Amazon Redshift, Amazon Kinesis, Athena, Lambda

  .
• Understanding of streaming data and real-time data integration.
• Ability to collaborate with cross-functional teams, including data scientists and business analysts.
• Good communication skills for presenting and explaining technical solutions.

Application Process:

Interested candidates, email resume and cover letter to velkiruba.s@sunware.in