18873 Scala Jobs - Page 43

5–8 years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks. Handson expertise with streaming and messaging systems such as Apache Kafka (publish subscribe architecture), Confluent Cloud, RabbitMQ or Azure Event Hub. Experience creating producers, consumers and topics and integrating them into downstream processing. Deep understanding of relational databases and CDC. Proficiency in SQL Server, Oracle or other RDBMSs; experience capturing change events using Debezium or native CDC tools and transforming them for downstream consumption. Proficiency in programming languages such as Python, Scala or Java and solid knowledge of SQL...

Job Title: Data Engineer Location: AHMEDABAD Key Responsibilities: Design, develop, and maintain ETL pipelines: Efficiently extract, transform, and load (ETL) large datasets from various data sources to the data warehouse or data lakes. Build and optimize data transformation workflows: Work closely with data scientists, analysts, and software engineers to design data pipelines that handle large volumes of structured and unstructured data. Data representation and UI integration: Implement data visualization solutions using tools and techniques (e.g., GraphQL or similar) for a drag-and-drop interface, enabling non-technical users to access and manipulate data. Collaborate with cross-functional...

Team Overview: Data Science and Artificial Intelligence represents the next phase in the advancement of our digital transformation and is a significant evolution for MasterCard. We continue to evolve our Data Science and AI strategy to support aggressive growth plans, and we are seeking a Lead Software Engineer to join our team. Are you an expert developer with the vision to guide complex projects from ideation to implementation? If so, we want you on our team! Roles & Responsibilities: Develop complete understanding of end-to-end technical architecture and dependency systems. Participate in team prioritization discussions with Product/Business stakeholders. Estimate and own delivery tasks (...

ALM Services with Data warehouse skills The Mastercard Account Level Management platform empowers real-time card level decisioning As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend Role o Develop high quality, secure and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO o Leverage technologies and solutions to innovate with increasingly large data sets o Drive automation and efficiency in Data ingestion, data movement and data access w...

Role: Data Engineer Scala No. of Positions: 3 Experience: 4 - 8 Years Employment Type: Permanent / contractual Work Mode: Onsite (5 Days Work from Office) Work Location: Hyderabad / Bangalore Work Timings: 11:00 AM 8:00 PM IST Role Overview: We are looking for an experienced Data Engineer (Scala) to join our team in a client-facing, individual contributor role . The ideal candidate should have strong hands-on experience in Scala and PySpark and be comfortable working in an onsite, fast-paced environment. Key Responsibilities: Design, develop, and optimize scalable data processing solutions using Scala and PySpark Build and maintain robust data pipelines for large-scale data processing Work c...

NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ, is an Advent International portfolio company with operations in 100+ markets, covering more than 90% of the world’s population. For more information, visit NIQ.com. Job Description As a Senior Data Engineer, you’ll be part of a team of smart, highly ...

Job Title: Lead AI Engineer (LLM G Document AI) Location: Chennai – Ambattur Industrial Estate (Work from Office) Company: iTech India Pvt. Ltd. (US HQ, India Offshore Center) Our AI work focuses on: • Document AI C OCR (invoices, legal documents, resumes, plant drawings) • LLM-based apps (RAG, copilots, intelligent search, summarization) • API-first SaaS products and on-prem enterprise solutions Role Summary We’re looking for a hands-on Lead AI Engineer (6–10 years) who can: • Lead design and delivery of LLM G Document AI solutions end-to-end • Own AI services in production (APIs, pipelines, monitoring) • Mentor a team of AI engineers and work directly with clients (US C India) This is a te...

DESCRIPTION Whole Foods Market is seeking an Data Engineering Manager to lead the ownership and technical evolution of a mission-critical enterprise analytics and operational platform that powers WFM's core business operations across Finance, Merchandising, Pricing, Supply Chain, and Marketing. As the Data Engineering Manager for Enterprise Data Platform, you will lead an 8-person engineering team responsible for platform operations, system reliability, and continuous improvement of this complex ERP system that serves 1,600+ active users across 43 business-critical applications. You'll own end-to-end platform health—from 24/7 incident response and production support to architectural evolutio...

Job Title : Data Engineer Exp : 6 - 9 Yrs Location : Pan India Description Key Responsibilities : Data Pipeline Development Design, develop, and maintain scalable and robust data pipelines for collecting, processing, and transforming large datasets. Implement ETL (Extract, Transform, Load) processes to ensure efficient movement of data across multiple systems. Database Management Design, implement, and optimize relational and non-relational databases to support business needs. Ensure data quality, consistency, and accuracy by building validation checks, monitoring systems, and automating data reconciliation processes. Cloud And Infrastructure Management Work with cloud platforms (AWS, Azure,...

ReQ Scala, Pyspark Location: Hyderabad / Bangalore Experience: 5yrs 15 yrs Mode: Contract to Hire - (Intially 3-6 months Shell Infotech payroll after that you will be Perm with client) *****Pls send me your resume along Photo Graph and PAN Number is mandatory for client Submittal***** ****************** Need resource who can join in Immediatley/ 15 days****************** JD Below Build and Maintain distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time Create metrics and apply business logic using Spark, Scala Model, design, develop, code, test, debug, document and deploy application tproduction through standard processes Harmonize, transfor...

Role Overview: As a Consultant Reporting and Technology Enablement at Maersk, you will lead a team of Finance Business Partners to provide Functional Managers with finance/business information and analysis, supporting continuous improvement of business performance and decision-making. Your success in this role will be defined by delivering impactful results such as increasing the number of automated reports, driving the adoption of innovative technologies, and reducing time and cost spent on reporting processes. Key Responsibilities: - Team Upskilling and Mentorship: - Deliver targeted training sessions to enhance the skills of the reporting team in tools such as Power BI, Excel, Power Query...

In this role at Salesforce, you will be part of a team of exceptional engineers working on developing innovative features that will have a positive impact on users, the company, and the industry. Your responsibilities will include designing, implementing, and testing to ensure high-quality products are delivered. You will also have the opportunity to mentor junior engineers and provide technical guidance to the team. **Key Responsibilities:** - Build new components in a dynamic market technology to enhance scalability and efficiency - Develop high-quality, production-ready code for millions of users - Make design decisions based on performance, scalability, and future expansion - Contribute ...

In your role as a Senior Engineer in the Data - IT squad at Deutsche Bank, Pune, India, you will work with change initiatives to design solutions aligning with architecture principles and driving the Bank towards its target state. You will collaborate closely with cloud engineers to develop data ingestion and processing solutions on Google Cloud Platform (GCP). **Key Responsibilities:** - Understand and act as a subject matter expert for the systems landscape in Private Bank / Wealth Management - Document business and technology requirements for change projects - Provide architectural and functional expertise during solution development - Collaborate with technology stakeholders to understan...

As a Scientist at Uber Eats, you will have the opportunity to join the Search Team and make a significant impact on improving the search experience for millions of users worldwide. Your role will involve utilizing your expertise in data analysis, machine learning, and statistical modeling to optimize search algorithms, thus enhancing user satisfaction and operational efficiency. Key Responsibilities: - Conduct comprehensive analyses of large datasets to identify trends, patterns, and areas for enhancing search performance. - Design, implement, and optimize search algorithms to improve the relevance and accuracy of search results. - Mentor and lead junior team members while contributing acros...

As a Software Engineer at Fanatics, you will have the opportunity to work on cutting-edge projects related to data platforms and privacy compliance. You will play a crucial role in designing and implementing components of the consent management framework, building privacy compliance reporting features, and contributing to the data certification framework. Additionally, you will work on developing data lineage tracking capabilities and maintaining APIs for integrating data quality, privacy, and governance tools. Your responsibilities will also include implementing data classification and privacy-preserving transformation pipelines, collaborating with cross-functional teams, participating in c...

Role Overview: As a Lead Engineer at Salesforce, you will have the opportunity to work with a group of world-class engineers to build breakthrough features that will have a significant impact on users, the company's bottom line, and the industry. Your role will involve architecture, design, implementation, and testing to ensure high-quality products are delivered to customers. You will contribute to building new components in an ever-evolving market technology and make design decisions based on performance, scalability, and future expansion. Collaboration with the team to ensure the stability and scalability of the CRM platform will be a key part of your responsibilities. Key Responsibilitie...

You are seeking a highly skilled and hands-on Senior Big Data Cloud QA Engineer to join the growing quality engineering team. This role is ideal for someone with strong technical proficiency in coding, test automation, cloud environments, and big data pipelines. Your responsibility will include ensuring end-to-end quality across cloud-based big data solutions through rigorous testing, framework development, and process improvement. - Design, develop, and execute comprehensive test plans, test scenarios, test cases, and test reports for big data cloud applications. - Perform manual and automated testing for big data pipelines, cloud services, APIs, and backend components. - Write and maintain...

Job Description: You will be responsible for working as an Azure Data Engineer with expertise in Databricks, SQL, PySpark, and ADF. Your key responsibilities will include: - Having a minimum of 5 years of experience in Data Analytics as an Azure Data engineer - Designing and developing solutions in Azure Data Factory, Databricks, SQL, Synapse, Snowflake, Python, and PySpark - Demonstrating a good understanding of Data warehouse concepts and ETL processes - Building pipelines in Azure Data Lake - Possessing knowledge of Azure DevOps and Agile methodology will be an added advantage Qualifications Required: - Must have experience with ADF, ADB, PySpark, Scala, MS Azure, and SQL Job Description:...

As a Big Data Engineer at Barclays, you will play a crucial role in revolutionizing the digital landscape and enhancing customer experiences. Your responsibilities will include: - Developing and delivering high-quality software solutions utilizing industry-aligned programming languages, frameworks, and tools to ensure scalability, maintainability, and performance optimization. - Collaborating cross-functionally with product managers, designers, and other engineers to define software requirements, devise solution strategies, and align with business objectives. - Participating in code reviews, promoting a culture of code quality, and sharing knowledge with peers. - Staying informed of industry...

Role Overview: As a Machine Learning Researcher specializing in security at Arkose Labs, you will apply your expertise in machine learning and cybersecurity to develop innovative solutions to detect, prevent, and respond to security threats and fraud. You will conduct independent research, collaborate with cross-functional teams, and stay abreast of the latest advancements in the field. Key Responsibilities: - Develop and implement ML and deep learning models to detect and mitigate security threats. - Developing new product features using statistical/machine learning-based algorithms to identify bot and fraud traffic. - Conduct data cleaning, preprocessing, and exploratory data analysis. App...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

Role Overview: Capgemini Invent is looking for a Data Engineer with 5+ years of experience in data engineering to join their team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines to support ML models. You will work closely with data scientists and ML engineers to ensure high-quality data inputs for ML applications. Additionally, you will be involved in data preprocessing, cleansing, exploratory data analysis, and managing datasets comprising text, image, audio, and video data. Key Responsibilities: - Design, develop, and maintain scalable data pipelines for ML models - Perform data preprocessing, cleansing, and labeling - Conduct...

Description Note:- Although the role category specified in the GPP is Remote, the requirement is for Hybrid working model from Cummins Pune Office. Job Summary Supports, develops and maintains a data and analytics platform. Effectively and efficiently process, store and make data available to analysts and other consumers. Works with the Business and IT teams to understand the requirements to best leverage the technologies to enable agile data delivery at scale. Key Responsibilities Implements and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured). Implements methods to continuously monitor a...

As a Software Engineer, you will be responsible for designing, developing, and implementing high-quality, scalable, and maintainable software solutions utilizing Scala, JavaScript, or Java as primary programming languages. You will translate complex business requirements into technical designs and scalable architectures, writing clean, efficient, and well-documented code following best practices and coding standards. Additionally, you will actively participate in code reviews, collaborate with cross-functional teams, and lead troubleshooting and debugging efforts to ensure optimal performance and stability of applications. Your role will also involve contributing to the continuous improvemen...

Job Summary We are seeking a skilled and innovative Data Processing Engineer to join our team. As a Data Processing Engineer, you will be responsible for the design, development and validation of software for Data Processing Engineering across both cloud and on-premises environments.. You will be responsible for contributing to the design, and development and testing of code. The software applications you build will be used by our internal product teams partners and customers. We are looking for a hands-on lead engineer who is familiar with Python, Spark, Scala and Java. Any cloud experience is an advantage. You should be passionate about learning, be creative and have the ability to work wi...