Spark Senior Developer

As a Spark Developer, you will play a crucial role in designing, developing, and optimizing large-scale data processing pipelines using Apache Spark. Your responsibilities will include designing and implementing scalable, high-performance data pipelines, optimizing Spark applications for efficient processing of large datasets, collaborating with cross-functional teams to understand data requirements, integrating Spark jobs with various data sources, monitoring and troubleshooting Spark jobs, writing clean and well-documented code, implementing best practices for data processing, security, and storage, and staying up to date with the latest trends in big data technologies. To excel in this role, you should have 6 to 10 years of experience as a Senior Developer or 3 to 6 years of experience as a Junior Developer in big data development, with hands-on experience in Apache Spark. Proficiency in programming languages like Python, Java, or Scala is essential, along with a strong understanding of distributed computing concepts and frameworks. Experience with Hadoop, Hive, or related big data technologies, familiarity with cloud platforms such as AWS, Azure, or GCP, knowledge of ETL processes and tools, and experience in performance tuning and optimization of Spark jobs are also required. Preferred qualifications for this position include experience with real-time data processing using Spark Streaming or Apache Kafka, knowledge of SQL and database design principles, familiarity with machine learning workflows and libraries, certification in big data technologies or cloud platforms, and a location preference for Mumbai. If you possess strong problem-solving skills, analytical thinking, and a passion for working with big data technologies, we encourage you to apply for this exciting opportunity.,