15085 Scala Jobs - Page 22

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

Position Overview: We are seeking a skilled Data Engineer with 36 years of experience to join our dynamic Data Engineering team . The ideal candidate will design, build, and optimize large-scale data pipelines and warehouses that enable real-time analytics and business intelligence across Tanla’s CPaaS ecosystem. You’ll work on diverse datasets, including Call Detail Records ( CDR )/ Telecom , and collaborate closely with cross-functional teams to ensure data reliability, scalability, and performance. Key Responsibilities: • Design and implement ETL/ELT pipelines for large-scale data processing and analytics. • Develop and optimize analytical SQL queries for performance and scalability. • Ex...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to interface with the client for quality assurance, issue resolution and ensuring high customer satisfaction. You will understand requirements, create and review designs, validate the architecture and ensure high levels of service offerings to clients in the technology domain. You will participate in project estimation, provide inputs for solution delivery, conduct technical risk planning, perform code reviews and unit test plan reviews. You will lead and guide your teams towards developing opti...

Role & responsibilities Preferred Skillset: Spark, Scala, Linux Based Hadoop Ecosystem (HDFS, Impala, Hive, HBase, etc.), SQL, Jenkins, and Unix Commands . Experience in Big data technologies , real time data processing platform( Spark Streaming - Kafka ) experience in Cloudera would be an advantage . Consistently demonstrates clear and concise written and verbal communication. Ability to multi-task and weekend support for production releases. Hands-on experience on Unix Command. Strong foundation in computer science fundamentals: Data structure, Algorithms, and coding. Experienced in Performance optimization techniques.

• Determine the design and workout strategy for new projects. Lead the Project lifecycle closely following Governance models. • Identify and resolve issues reported within defines SLAs part of routine maintenance of existing applications built in SharePoint online. • Report extraction and automations to support different metrics, that are maintained in the applications. • Work with Stakeholders on the enhancements in the existing applications. Project Planning, Tracking, & Reporting • Workout budgetary estimates during kick off, after understanding the high-level requirements. • Support the team in project planning activities, identify risks proactively, escalating thru appropriate channels ...

Job Summary- Data Scientist with good hands-on experience of 3+ years in developing state of the art and scalable Machine Learning models and their operationalization, leveraging off-the-shelf workbench production. Job Responsibilities- Hands on experience in Python data-science and math packages such as NumPy, Pandas, Sklearn, Seaborn, PyCaret, Matplotlib Proficiency in Python and common Machine Learning frameworks (TensorFlow, NLTK, Stanford NLP, PyTorch, Ling Pipe, Caffe, Keras, SparkML and OpenAI etc.) Experience of working in large teams and using collaboration tools like GIT, Jira and Confluence Good understanding of any of the cloud platform- AWS, Azure or GCP Understanding of Commerc...

Job Summary- Data Scientist with good hands-on experience of 5+ years in developing state of the art and scalable Machine Learning models and their operationalization, leveraging off-the-shelf workbench production. Job Responsibilities- Hands on experience in Python data-science and math packages such as NumPy, Pandas, Sklearn, Seaborn, PyCaret, Matplotlib Proficiency in Python and common Machine Learning frameworks (TensorFlow, NLTK, Stanford NLP, PyTorch, Ling Pipe, Caffe, Keras, SparkML and OpenAI etc.) Experience of working in large teams and using collaboration tools like GIT, Jira and Confluence Good understanding of any of the cloud platform- AWS, Azure or GCP Understanding of Commerc...

1.Relevant accredited certifications for Azure, AWS, Cloud Engineering, and/or Databricks Data Engineering expertise in Big Data Management using Cloudera, Python, Hive, Scala, Data Warehouse, Data Lake, AWS, Azure 1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks 2 Ensure data pipelines run smoothly and efficiently 3 Developing scalable and re-usable frameworks for ingesting of data sets 4 Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times 5 Working with event based / streaming technologies to ingest and process data 6 ...

Design, develop, and maintain scalable data pipelines and systems. Collaborate with data scientists and software engineers to integrate data solutions. Optimize and improve existing data systems for performance and reliability. Implement data security and privacy measures to protect sensitive information. Monitor and troubleshoot data pipeline issues to ensure data integrity. Required Qualifications Bachelors degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer or in a similar role. Strong knowledge of SQL and database management systems. Experience with data pipeline and workflow management tools. Proficiency in programming languages such as Pyth...

Collaborative Solution Development- Engage with a diverse range of stakeholders, including analysts, software engineers, product managers, and customers, to understand their requirements and craft effective solutions. State-of-the-Art Pipelines and Architecture- Design, develop, deploy and operate high-quality production ELT pipelines and data architectures. Integrate data from various sources and formats, ensuring compatibility, consistency, and reliability. Design scalable architectures. Champion Data Best Practices- Proactively establish and advocate for best practices in performance, code quality, data validation, data governance, and discoverability across Adyen through mentoring, train...

Design and implement foundational frameworks for ingestion, orchestration, schema validation, and metadata management. Build robust, scalable pipelines for Change Data Capture (CDC) using Debezium integrated with Kafka and Spark. Optimize data serving layers powered by Trino, including metadata syncing, security filtering, and performance tuning. Partner with SRE and Infra teams to build autoscaling, self-healing, and cost-optimized Spark jobs on AWS EMR. Implement observability features logs, metrics, alerts for critical platform services and data pipelines. Define and enforce standards for schema evolution, lineage tracking, and data governance. Automate platform operations using CI/CD pip...

Strong expertise in Python (including data processing/manipulation libraries such as pandas, PySpark). Hands-on experience in designing and maintaining ETL pipelines. Proficiency with AWS cloud services (Glue, Lambda, EMR, ECS, Lake Formation, etc.). Experience with orchestration tools such as Airflow and AWS Step Functions. Exposure to databases like Redshift, Aurora, Postgres, or Snowflake.

Strong expertise in Python (including data processing/manipulation libraries such as pandas, PySpark). Hands-on experience in designing and maintaining ETL pipelines. Proficiency with AWS cloud services (Glue, Lambda, EMR, ECS, Lake Formation, etc.). Experience with orchestration tools such as Airflow and AWS Step Functions. Exposure to databases like Redshift, Aurora, Postgres, or Snowflake.

Strong expertise in Python (including data processing/manipulation libraries such as pandas, PySpark). Hands-on experience in designing and maintaining ETL pipelines. Proficiency with AWS cloud services (Glue, Lambda, EMR, ECS, Lake Formation, etc.). Experience with orchestration tools such as Airflow and AWS Step Functions. Exposure to databases like Redshift, Aurora, Postgres, or Snowflake.

𝗝𝗼𝗯 𝗧𝗶𝘁𝗹𝗲: Sr. Data Engineer 𝗝𝗼𝗯 𝗟𝗼𝗰𝗮𝘁𝗶𝗼𝗻: Chennai, Tamil Nadu, India 𝗝𝗼𝗯 𝗗𝘂𝗿𝗮𝘁𝗶𝗼𝗻: Permanent 𝗝𝗼𝗯 𝗧𝘆𝗽𝗲: On-Site 𝗧𝗵𝗲 𝗖𝗵𝗮𝗹𝗹𝗲𝗻𝗴𝗲: We are seeking a skilled Sr. Data Engineer with 5-8 years of experience in building and managing data pipelines. The ideal candidate will have a strong proficiency in relational and NoSQL databases, as well as experience with data warehouses and real-time data streaming. This role requires excellent problem-solving skills, attention to detail, and the ability to work effectively in a team environment. 𝗥𝗼𝗹𝗲𝘀 & 𝗥𝗲𝘀𝗽𝗼𝗻𝘀𝗶𝗯𝗶𝗹𝗶𝘁𝗶𝗲𝘀: Design, build, and maintain efficient and scalable data pipelines to support data integration and transformation across various sources. Work ...

Primary Responsibilities: Drive client value by: Creating innovative solutions driven by exploratory data analysis from diverse datasets Responsible for developing/delivering end-to-end Machine Learning projects/solutions that have a high degree of value, ambiguity, scale and complexity Ability to coach/guide follow data scientists and accountable for delivering advanced analytics products Using an analytical approach to design, develop, and implement data enrichments, predictive models, and advanced algorithms that lead to expanded value extraction from data Leading efforts for applied use of machine learning to drive process optimization and transformation Applying knowledge of data modeli...

Summary Position Summary Artificial Intelligence & Engineering AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions insights are powered by engineering for business advantage, helping transforming mission-critical operations. Join our AI & Engineering team to help in transforming technology platforms, driving innovation, and helping help make a significant impact on our clients' success achievements. You’ll work alongside talented professionals reimagining and re-engineering operations and processes that are could be critical...

About The Role : Job Title Engineer , Analyst LocationPune, India Corporate TitleAnalyst Role Description Technology underpins our entire business. Our Technology, Data and Innovation (TDI) strategy is focused on strengthening engineering expertise, introducing an agile delivery model, as well as modernising the bank's IT infrastructure. We continue to invest and build a team of visionary tech talent, providing you with the training, freedom and opportunity to do pioneering work. As an [Engineer] you will develop and deliver significant components of engineering solutions to satisfy complex and diverse business goals. You will engage and partner with the business whilst working within a broa...

Summary Position Summary Artificial Intelligence & Engineering AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions insights are powered by engineering for business advantage, helping transforming mission-critical operations. Join our AI & Engineering team to help in transforming technology platforms, driving innovation, and helping help make a significant impact on our clients' success achievements. You’ll work alongside talented professionals reimagining and re-engineering operations and processes that are could be critical...

Who we are About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies from the world s largest enterprises to the most ambitious startups use Stripe to accept payments, grow their revenue, and accelerate new business opportunities. Our mission is to increase the GDP of the internet, and we have a staggering amount of work ahead. That means you have an unprecedented opportunity to put the global economy within everyone s reach while doing the most important work of your career. About the team Stripe s Change Data Capture (CDC) system powers the company s data infrastructure by streaming real-time database changes into the Stripe Data Lake. That low-latenc...

The Platform Engineering team is a collection of highly skilled individuals ranging from development to operations with a security first mindset who strive to push the boundaries of technology. We champion a DevSecOps culture and raise the bar on how and when we deploy applications to production. Our core principals are centered around automation, testing, quality, and immutability all via code. The role is responsible for building self-service capabilities that improve our security posture, productivity, and reduce time to market with automation at the core of these objectives.The individual collaborates with teams across the organization to ensure applications are designed for Continuous D...

Summary Position Summary Artificial Intelligence & Engineering AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions insights are powered by engineering for business advantage, helping transforming mission-critical operations. Join our AI & Engineering team to help in transforming technology platforms, driving innovation, and helping help make a significant impact on our clients' success achievements. You’ll work alongside talented professionals reimagining and re-engineering operations and processes that are could be critical...

Your role and responsibilities The ability to be a team player The ability and skill to train other people in procedural and technical topics Strong communication and collaboration skills Required education Bachelor's Degree Required technical and professional expertise Able to write complex SQL queries ; Having experience in Azure Databricks Preferred technical and professional experience Excellent communication and stakeholder management skills

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the pl...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform * Responsibilities * Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS * Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on ...