Scala Spark

Job Title: Scala Spark

(1–3 Years Experience)

Location:Hyderabad

Work Mode : Work From Office

Job Summary:

We are looking for a skilled Scala Spark with 1 to 3 years of experience to design, develop, and optimize large-scale data processing applications. The ideal candidate will have hands-on experience with Scala programming and Apache Spark to work on big data pipelines and analytics solutions.

Key Responsibilities:

• Design, develop, and maintain Spark applications using Scala
• Build and optimize batch and streaming data pipelines
• Process large-scale datasets using Apache Spark (Spark SQL, DataFrames, Datasets)
• Collaborate with data engineers, analysts, and architects
• Optimize Spark jobs for performance, scalability, and reliability
• Work with distributed storage systems such as HDFS, S3, or ADLS
• Debug and troubleshoot data processing issues
• Ensure data quality, consistency, and reliability
• Document technical designs, workflows, and code

Required Skills & Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field
• 1–3 years of hands-on experience in Scala development
• Strong experience with Apache Spark
• Good understanding of distributed computing concepts
• Experience with Spark SQL, RDDs, DataFrames, and Datasets
• Proficiency in SQL for data querying and transformations
• Familiarity with Linux/Unix environments
• Experience using Git or other version control systems

Preferred Skills (Good to Have):

• Experience with Spark Streaming / Structured Streaming
• Exposure to Kafka or other messaging systems
• Experience with Hadoop ecosystem tools (Hive, HBase, Airflow)
• Knowledge of cloud platforms (AWS, Azure, GCP)
• Familiarity with Docker and CI/CD pipelines
• Understanding of data warehousing and ETL best practices

Job Type: Full-time

Pay: ₹200,000.00 - ₹300,000.00 per year

Work Location: In person