Job
Description
About Client Hiring for One of the Most Prestigious Multinational Corporations Job Title : Big Data Engineer (Spark, Scala) , SQL Experience : 6 to 10 years Key Responsibilities : Design, develop, and optimize scalable big data pipelines using Apache Spark and Scala. Build batch and real-time data processing workflows to ingest, transform, and aggregate large datasets. Write high-performance SQL queries to support data analysis and reporting. Collaborate with data architects, data scientists, and business stakeholders to understand requirements and deliver high-quality data solutions. Ensure data quality, integrity, and governance across systems. Participate in code reviews and maintain best practices in data engineering. Troubleshoot and optimize performance of Spark jobs and SQL queries. Monitor and maintain production data pipelines and perform root cause analysis of data issues. Technical Skills : 6 to10 years of overall experience in software/data engineering. 4+ years of hands-on experience with Apache Spark using Scala. Strong proficiency in Scala and functional programming concepts. Extensive experience with SQL (preferably in distributed databases like Hive, Presto, Snowflake, or BigQuery). Experience working in Hadoop ecosystem (HDFS, Hive, HBase, Oozie, etc.). Knowledge of data modeling, data architecture, and ETL frameworks. Familiarity with version control (Git), CI/CD pipelines, and DevOps practices. Experience with cloud platforms (AWS, Azure, or GCP) is a plus. Strong analytical and problem-solving skills. Excellent communication and collaboration abilities. Notice period : Till 60 days Location : BLR//BBSR/PUNE Mode of Work :WFO(Work From Office) Thanks & Regards, SWETHA Black and White Business Solutions Pvt.Ltd. Bangalore,Karnataka,INDIA. Contact Number:8067432433 rathy@blackwhite.in |www.blackwhite.in
