Apache spark with cloud Professional

Krazy Mantra HR Solutions Pvt. Ltd

5 - 7 years

6 - 9 Lacs

chennai coimbatore bengaluru

Posted:2 days ago| Platform:

Apply

Skills Required

python cloud technologies scala programming java spark kubernetes snowflake scala big data technologies pyspark microsoft azure adls gen2 data engineering docker nosql apache data modeling gcp cloud infrastructure hadoop key vault aws gcp cloud

Work Mode

Work from Office

Job Type

Full Time

Job Description

We are looking for a skilled professional with expertise in Apache Spark and cloud technologies to join our team. The ideal candidate will have 5-7 years of experience.

Roles and Responsibility

Design, develop, and implement scalable data processing pipelines using Apache Spark.
Collaborate with cross-functional teams to integrate Spark applications with cloud services like Azure and AWS.
Develop and maintain large-scale data warehouses and data lakes using Synapse and Snowflake.
Implement data engineering tools and technologies to optimize data processing workflows.
Troubleshoot and resolve complex technical issues related to Spark and cloud infrastructure.
Participate in code reviews and contribute to improving the overall quality of the codebase.

Job Requirements

Strong proficiency in Python, Java, or Scala programming languages.
Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
Knowledge of cloud computing platforms including Azure, AWS, and GCP.
Familiarity with containerization using Docker and Kubernetes.
Understanding of data modeling concepts and database design principles.
Excellent problem-solving skills and attention to detail.
Skills: Pyspark, Spark SQL programming, Azure services like ADLS Gen2, AZ copy, Synapse, Kubernetes, Key vault or equivalent knowledge in AWS/GCP cloud/Snowflake, Airflow scheduling, Data Engineering tools and technologies, Scripting.
Notice Period: 0-30 days.
Education: BE.B.TECH, ME.M.TECH/BCA.
Location: Bangalore/Hyderabad/Pune / Chennai / Coimbatore / Noida.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.