10 Scala Spark Jobs

Responsibilities: Design, develop, and maintain scalable and efficient data pipelines using PySpark , Scala Spark , Databricks , Python , and SQL . Write optimized, reusable, and high-quality code for data processing and transformation. Optimize SQL queries for high-performance data extraction, manipulation, and analysis. Demonstrate strong expertise in Databricks , including workflow management , job orchestration , and data exploration . Collaborate with cross-functional teams to gather and understand business and data requirements. Implement best practices for ETL , data pipeline optimization , and query performance tuning . Develop and maintain comprehensive documentation for all data pi...

Role Overview: You should have 5+ years of experience and must possess skills in DataBricks, Delta Lake, pyspark or scala spark, and unity catalog. It would be beneficial to have Azure/AWS Cloud skills. Your main responsibility will be to ingest and transform batch and streaming data on the Databricks Lakehouse Platform. Excellent communication skills are required for this role. Key Responsibilities: - Oversee and support the process by reviewing daily transactions on performance parameters - Review performance dashboard and scores for the team - Support the team in improving performance parameters by providing technical support and process guidance - Record, track, and document all queries ...

In this role at Agoda, you will be leading the team technically to enhance the scalability, stability, accuracy, speed, and efficiency of the existing ML systems and processes. You will be responsible for building, administering, and scaling ML processing pipelines. You should be comfortable working with technologies such as Python3, Scala Spark, scripting (Bash/Python), Hadoop, SQL, S3, etc. Additionally, you should have a good understanding of ML models like LightGBM, Random Forest, CNN, Regression models, etc. Your responsibilities will include designing, building, testing, and deploying new libraries, frameworks, or full systems for the core systems while maintaining high standards of te...

Mandate Skills: Scala Spark Responsibility: Overall, more than 5 Yrs of experience in Big Data projects. Experience in Big Data technologies including Scala Spark Who have a good understanding of data structures and algorithms Has worked in Implementation projects building data pipelines transformation logics and data models Strong experience in SQL.

Mandate Skills: Scala Spark Responsibility: Overall, more than 5 Yrs of experience in Big Data projects. Experience in Big Data technologies including Scala Spark Who have a good understanding of data structures and algorithms Has worked in Implementation projects building data pipelines transformation logics and data models Strong experience in SQL.

Mandate Skills: Scala Spark Responsibility: Overall, more than 5 Yrs of experience in Big Data projects. Experience in Big Data technologies including Scala Spark Who have a good understanding of data structures and algorithms Has worked in Implementation projects building data pipelines transformation logics and data models Strong experience in SQL.

You should have 5+ years of experience with skills in DataBricks, Delta Lake, pyspark or scala spark, unity catalog. Good to have skills in Azure/AWS Cloud. You will be responsible for ingesting and transforming batch and streaming data on the Databricks Lakehouse Platform. Excellent communication skills are required. Your responsibilities will include overseeing and supporting processes by reviewing daily transactions, reviewing performance dashboards, supporting the team in improving performance parameters, recording and tracking all queries received, ensuring standard processes are followed, resolving client queries within defined SLAs, developing understanding of processes/products for t...

You should have 3-6 years of experience as a developer on the Palantir Foundry platform. Along with this, a strong understanding of data integration, data modeling, and software development principles is required. Proficiency in languages like Python, PySpark, and Scala Spark is essential. Experience with SQL and relational databases is also a must. Your responsibilities will include designing, developing, and deploying models and applications within the Palantir Foundry platform. You will be integrating data from various sources to ensure the robustness and reliability of data pipelines. Customizing and configuring the platform to meet business requirements will also be part of your role. T...

As a Data Analytics focused Senior Software Engineer at PubMatic, you will be responsible for developing advanced AI agents to enhance data analytics capabilities. Your expertise in building and optimizing AI agents, along with strong skills in Hadoop, Spark, Scala, Kafka, Spark Streaming, and cloud-based solutions, will play a crucial role in improving data-driven insights and analytical workflows. Your key responsibilities will include building and implementing a highly scalable big data platform to process terabytes of data, developing backend services using Java, REST APIs, JDBC, and AWS, and building and maintaining Big Data pipelines using technologies like Spark, Hadoop, Kafka, and Sn...

Developing Scala Spark pipelines that are resilient, modular and tested. Help automate and scale governance through technology enablement Enable users finding the right data for the right use case Participate in identifying and proposing solutions to data quality issues, and data management solutions Support technical implementation of solutions through data pipeline development Maintain technical processes and procedures for data management Very good understanding of MS Azure Data Lake and associated setups ETL knowledge to build semantic layers for reporting Creation / modification of pipelines based on source and target systems User and access Management and Training end users