15124 Scala Jobs - Page 34

Hands on knowledge of SPARK, scala, etc. Hands on knowledge of RDBMS like MS-SQL/Oracle Knowledge of CI/CD tools like uDeploy Understanding of Vanguard and its landscape will be additional advantage

Design and Develop Scalable Data Pipelines Build and maintain robust data pipelines using Python to process, transform, and integrate large-scale data from diverse sources Orchestration and Automation Implement and manage workflows using orchestration tools such as Apache Airflow to ensure reliable and efficient data operations Data Warehouse Management Work extensively with Snowflake to design and optimize data models, schemas, and queries for analytics and reporting Queueing Systems Leverage message queues like Kafka, SQS, or similar tools to enable real-time or batch data processing in distributed environments Collaboration Partner with Data Science, Product, and Engineering teams to unde...

What youll do As a Software Engineer on the Agreement Desk team, you will work with various technologies to develop and maintain code for a Platform which helps in creating and managing Requests in agreement space. A successful person in this role will have a flexible attitude combined with an aptitude for interacting with cross functional teams to learn and deliver. This position is an individual contributor role reporting to the Senior Manager of Engineering. Responsibility Write clean, high-quality, maintainable, and testable code, primarily using React and C# Develop within an Agile/Scrum framework, leveraging tools such as automated unit testing, CI/CD pipelines, code reviews, and versi...

Overview The role will work in developing Machine Learning (ML) and Artificial Intelligence (AI) projects. Specific scope of this role is to develop ML and GenAI solution in support of ML/AI projects using big analytics toolsets in a CI/CD environment. Analytics toolsets may include DS tools/Spark/Databricks along with LLM frameworks like LangChain / LlamaIndex, and other technologies offered by Microsoft Azure or open-source toolsets. This role will also help automate the end-to-end cycle with Azure Machine Learning Services and Pipelines. Responsibilities Understand the existing Proof of concepts that were built to showcase capability of LLMs to deliver the accurate response to any natural...

Duration: 6 months (Possible Extension) Skill Required: Databricks, Python, Pyspark, Sql ETL Experience Range in Required Skills: 10 Above Azure Data Engineer with extensive experience on solution designing - Domain Data sets, data products hands on experience in Azure Databricks, Python, Pypark ETL Pipelines, Should know have working experience with Atlas framework. Should know and worked in medallion architecture. 1. Design, build, and maintain scalable and efficient data pipelines using Databricks. Integrate data from various sources (for eg. Azure storage account, SFTP, Fabric) using Apache Spark within Databricks. 2. Implement processes and checks to ensure the accuracy and completeness...

Key Responsibilities Design and develop ETL/ELT pipelines for both batch and real-time data processing . Build and optimize data models , data lakes , and data warehouse architectures to support analytics and machine learning workloads. Ensure data quality , governance , and security across all workflows and environments. Collaborate with data scientists, analysts, and solution architects to enable data-driven decision-making . Integrate data from diverse sources, including databases, APIs, and streaming platforms . Monitor and optimize data pipelines for scalability , reliability , and performance efficiency . Contribute to best practices , technical documentation, and the development of re...

Role Proficiency: Act creatively to develop applications and select appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions account for others' developmental activities Outcomes: Interpret the application/feature/component design to develop the same in accordance with specifications. Code debug test document and communicate product/component/feature development stages. Validate results with user representatives; integrates and commissions the overall solution Select appropriate technical options for development such as reusing improving or reconfiguration of existing components or creating own solu...

At Seismic, we're proud of our engineering culture where technical excellence and innovation drive everything we do. We're a remote-first data engineering team responsible for the critical data pipeline that powers insights for over 2,300 customers worldwide. Our team manages all data ingestion processes, leveraging technologies like Apache Kafka, Spark, various C# microservices services, and a shift-left data mesh architecture to transform diverse data streams into the valuable reporting models that our customers rely on daily to make data-driven decisions. Additionally, we're evolving our analytics platform to include AI-powered agentic workflows. Who You Are Have working knowledge of one ...

Job Title - + + Management Level: Location: Kochi, Coimbatore, Trivandrum Must have skills: Python/Scala, Pyspark/Pytorch Good to have skills: Redshift Job Summary You’ll capture user requirements and translate them into business and digitally enabled solutions across a range of industries. Your responsibilities will include: Responsibilities Roles and Responsibilities Designing, developing, optimizing, and maintaining data pipelines that adhere to ETL principles and business goals Solving complex data problems to deliver insights that helps our business to achieve their goals. Source data (structured→ unstructured) from various touchpoints, format and organize them into an analyzable format...

Roles and Responsibilities: Designing, development of core components/services which are flexible, extensible, multi-tier, scalable, high performance. Providing technical leadership and mentoring to junior developers Developing use cases and design alternatives in accordance with business requirements Interact with Product Owner and Business analyst across geographies to leverage expertise and take up development to next level Participating in code reviews, working with business analyst and testers to effectively document and validate all implementations Ability to understand and discuss technical concepts, schedule tradeoffs and opportunistic new ideas with technical employees. Working with...

As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team to ensure that th...

Title : BigData Developer Location : Bangalore Position type : Full time Requirement: No Remote: All 5 days work from office. Working experience of Hadoop, Hive SQLs, Spark, Bigdata Eco System Tools. • Should be able to tweak queries and work on performance enhancement. • The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in production after testing. • The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies. Occasionally, the candidate may have to be responsible as a primary contact and/or driver for small to medium size projects...

Role Description As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team ...

Role Description As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team ...

Who We Are The next step of your career starts here, where you can bring your own unique mix of skills and perspectives to a fast-growing team. Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering AI & Data, Digital Commerce, Marketing & Design solutions and Advisory services. At Metyis, our long-term partnership model brings long-lasting impact and growth to our business partners and clients through extensive execution capabilities. With our team, you can experience a collaborative environment with highly skilled multidisciplinary experts, where everyone has room to build bigger and bolder ideas. Being part of Metyis means you c...

Hive/Python/Spark Technical hands on data processing Database SQL knowledge for retrieval of data - transformation queries such as joins (full, left , right) , ranking , group by Database SQL/Oracle Good Communication skills. Additional skills - GitHub , Jenkins , shell scripting would be added advantage, large-scale data processing model implementation, and performance tracking Mandatory Competencies Big Data - Big Data - HIVE Big Data - Big Data - Pyspark Big Data - Big Data - SPARK Data Science and Machine Learning - Data Science and Machine Learning - Data Analyst Database - Oracle - PL/SQL Packages Programming Language - Python - Python Shell Beh - Communication and collaboration

The Professional, Data Engineering job designs, builds and maintains moderately complex data systems that enable data analysis and reporting. With limited supervision, this job collaborates to ensure that large sets of data are efficiently processed Required Candidate profile Minimum requirement of 5 years of relevant work experience. Typically reflects 7 years or more of relevant experience. Design, develop, and maintain scalable ETL pipelines for multi-scale datasets.

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – MS Fabric – Senior The opportunity We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. To qualify for the role, you must have We are looking for a Data Engineer with 5-10 years of experience in data warehousing, ETL/ELT proces...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – MS Fabric – Senior The opportunity We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. To qualify for the role, you must have We are looking for a Data Engineer with 5-10 years of experience in data warehousing, ETL/ELT proces...

Gen24 Flybiz offers comprehensive services for aspiring pilots, airlines, and training organisations. In 2025, the Avion Flight Training Centre Mumbai - operated by Gen24 - will be opened. At our facility, pilots can train on state-of-the-art Full Flight Simulators (FFS) and Flight Navigation Procedures Trainer (FNPTII) devices. Currently, our centre operates two Airbus A320neo Full Flight Simulators from Avion and an A320 FNPTII for APS MCC training, built by Simnest. Over the coming years, we will expand to six to eight Full Flight Simulators, including additional Airbus A320s and Boeing 737 MAX devices, providing comprehensive training solutions for airlines and individual pilots. About t...

Azure Data Engineer at N Consulting Ltd | Jobs at N Consulting Ltd Pimpri-Chinchwad, India 5 - 15 /year Required Details: Total Experience Relevant Experience Current Company: Current Designation: Current CTC LPA Monthly Take home: Expected CTC LPA: Expected Take home: Notice Period: Current Location Expected Location: Home Pincode: Offer In hand: PAN Number (upload profiles to the portal): DOB (upload profiles to the portal): Reason for Job Change: Degree Specialization: CGPA Education start date: Passed Out: University: UAN: Linkedin profile link: 3 different interview slots: Current Company address and pincode: Duration: 6 months (Possible Extension) Skill Required: Databricks, Python, Py...

Job Title: Developer Locations: CHENNAI,BANGALORE,HYDERABAD,KOLKATA,KOLKATA We are looking for a skilled Developer with strong hands-on experience in Scala, Java, and Python, who is passionate about building scalable data-driven solutions. The ideal candidate will have a solid background in big data technologies and cloud platforms, particularly AWS and GCP. Key Responsibilities Design, develop, and maintain scalable applications using Scala, Java, and Python. Build and optimize data pipelines and ETL workflows using big data platforms such as Cloudera. Work with Apache Spark for data processing and transformation. Develop and maintain Hive tables and manage Oozie workflows. Collaborate with...

SUMMARY Wissen Technology is Hirin g for Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge tech...

Job Summary: We are seeking an experienced and dynamic Senior Analyst Data Strategy to join the Strategy & Consulting (S&C) Global Network AI team . In this role, you will help organizations unlock the value of their data by defining and implementing data and AI-driven strategies . You will collaborate with business, technology, and analytics teams to shape data foundations, improve governance, and enable enterprise-scale artificial intelligence and analytics adoption. Key Responsibilities: Design and execute data and AI strategies aligned with client business goals and transformation roadmaps. Conduct data maturity assessments , identify improvement areas, and develop actionable recommendat...

Job Summary: We are seeking an experienced and dynamic Senior Analyst Data Strategy to join the Strategy & Consulting (S&C) Global Network AI team . In this role, you will help organizations unlock the value of their data by defining and implementing data and AI-driven strategies . You will collaborate with business, technology, and analytics teams to shape data foundations, improve governance, and enable enterprise-scale artificial intelligence and analytics adoption. Key Responsibilities: Design and execute data and AI strategies aligned with client business goals and transformation roadmaps. Conduct data maturity assessments , identify improvement areas, and develop actionable recommendat...