172 Bigdata Jobs - Page 2

In this role as a Software Engineer III- Big Data/Java/Scala at JPMorgan Chase within the Liquidity Risk (LRI) team, you will play a crucial role in designing and implementing a cutting-edge cloud-native liquidity risk management platform for the organization. The Liquidity Risk Technology team is committed to providing a comprehensive solution for managing liquidity risk and meeting regulatory reporting requirements across more than 50 markets. You will be involved in developing advanced liquidity calculation engines, integrating AI and ML into liquidity risk processes, and enhancing digital-first reporting capabilities. The platform aims to process 40-60 million transactions and positions ...

Job Description We are looking for a skilled Big Data QA Engineer to join our team and ensure the quality and reliability of our data processing pipelines. This role involves designing and executing both automated and manual tests for batch workflows, validating data integrity across transformation stages, and maintaining a robust Python-based test automation framework. The ideal candidate will have hands-on experience with AWS services, big data formats, and a strong understanding of testing methodologies in a data-centric environment. Preferred Skills and Experience: Design, develop, and execute automated and manual batch test cases for data processing pipelines. Validate data integrity an...

Role Overview: As a Software Development Engineer-II (Backend) at Innovaccer, you will be responsible for building efficient and reusable applications and abstractions. You will collaborate with other engineers to create delightful feature experiences that address our customer's pain points. Your role will involve identifying and communicating back-end best practices, participating in the project life-cycle, analyzing and improving product performance, scalability, stability, and security, and enhancing engineering standards, tooling, and processes. Key Responsibilities: - Building efficient and reusable applications and abstractions - Identifying and communicating back-end best practices - ...

As a Staff Software Engineer Front End at Avensys, you will have the opportunity to collaborate with cross-functional teams to deliver high-quality products on the web. You will lead by example in writing quality code that meets requirements and adheres to architectural and front-end coding standards. Additionally, you will contribute to optimizing applications using best practices for performance and propose upgrades to align with modern security and development practices. Your role will involve building shared component libraries, creating modular and reusable components, and architecting reliable, performant, and scalable solutions. You will also identify areas for improvement, drive web ...

As a Staff Software Engineer Front End at Avensys in Gurgaon, you will have the opportunity to collaborate with cross-functional teams to develop high-quality web products. Your responsibilities will include: - Driving collaboration with Product, Product Design, and Engineering teams to deliver high-quality web products. - Leading by example in writing quality code that meets requirements and adheres to architectural and front-end coding standards. - Contributing to optimizing applications using best practices for performance. - Proposing upgrades and updates to align with modern security and development best practices. - Contributing to building shared component libraries and creating modul...

Roles and Responsibilities : Design, develop, test, deploy and maintain large-scale big data solutions using Scala and Spark. Lead a team of engineers to deliver high-quality software products on time and within budget. Collaborate with cross-functional teams to identify business requirements and translate them into technical specifications. Ensure scalability, reliability, security, performance, and quality of the software systems. Job Requirements : 7-12 years of experience in designing and developing big data solutions using Scala or similar technologies. Strong expertise in Spark (Scala) programming language with hands-on experience working on large datasets. Proven track record of leadi...

As a Staff Software Engineer - Front End at Avensys, headquartered in Singapore, you will play a crucial role in collaborating with cross-functional teams to develop high-quality web products. Your responsibilities will include: - Driving collaboration with Product, Product Design, and Engineering teams to deliver top-notch products on the web. - Leading by example in writing quality code that meets requirements and adheres to architectural and front-end coding standards. - Contributing to building a culture focused on optimizing applications for performance. - Proposing upgrades and updates to maintain modern security and development practices. - Contributing to shared component libraries b...

Job roles and responsibilities: Understand Customer challenges and propose solutions based on latest Esri GIS technology trends. Design and Present Solution Architecture based on customer needs. Execute, Deliver and Demonstrate PoC based on Customer Needs Prepare Approach Notes and guide team for Enterprise Deployment Work as Consultant / Advisor to customer organizations and help them in driving their vision. Engage in business development and design compelling solution-based value propositions by identifying clients challenges and needs and developing solutions which meet those needs. Consistently conduct research and pursue professional development to ensure competitive knowledge and tran...

Warm welcome from SP Staffing Services! Reaching out to you regarding permanent opportunity for MNC!! Skill: Big Data Engineer Job Location: Chennai/Bangalore/NewDelhi Experience: 5-8 yrs Interested can share your resume to sangeetha.spstaffing@gmail.com with the below inline details. Full Name as per PAN: Mobile No: Alt No/ Whatsapp No: Total Exp: Relevant Exp in Big data: Rel Exp in Pyspark: Rel Exp in Spark: Rel Ex in Python: Current CTC: Expected CTC: Notice Period (Official): Notice Period (Negotiable)/Reason: Reason for Job Change: Offer in Pipeline (Current Status): Any gaps in education/career: If having gaps, how many months/year: Availability for virtual interview on weekdays betwe...

Role Overview: You will be responsible for working with Bigdata and GCP technologies such as Dataproc, Dataflow, SQL, and Spark. Your role will involve handling various aspects of Big Data using these technologies. Key Responsibilities: - Utilize Bigdata and GCP to implement Dataproc, Dataflow, SQL, and Spark solutions - Work on processing and analyzing large datasets efficiently - Collaborate with team members to develop and optimize data pipelines Qualification Required: - Must have experience with Bigdata and GCP technologies - Proficiency in Dataproc, Dataflow, SQL, and Spark - 3 to 12 years of relevant experience (Note: No additional details of the company were provided in the job descr...

As a candidate for the role, you will be responsible for handling Bigdata and GCP related tasks. Your key responsibilities will include: - Working with Bigdata technologies such as Dataproc, Dataflow, SQL, and Spark - Utilizing GCP for efficient data processing and analysis It is essential that you possess the following qualifications: - Proficiency in Bigdata and GCP technologies - Experience with Dataproc, Dataflow, SQL, and Spark Please note that the job reference number for this position is 13154.,

As a Data Platform developer at Barclays, you'll play a crucial role in the evolution of the digital landscape, driving innovation and excellence. By harnessing cutting-edge technology, you will revolutionize digital offerings to ensure unparalleled customer experiences. You'll work collaboratively with fellow engineers, business analysts, and stakeholders to deliver technology stacks that meet business requirements and deliver quality solutions. Your role will involve solving complex technical problems that require strong analytical skills and detailed analysis. **Key Responsibilities:** - Hands-on coding experience, preferably in Python - Strong knowledge and hands-on experience of AWS dev...

As an ideal candidate for this role, you should have a strong educational background with a UG/PG degree in Computer Science Engineering or Electronics and Communication Engineering. Your hands-on experience in Computer Science Domains will be crucial for excelling in this position. Key Responsibilities: - Possess domain knowledge in various areas such as Big Data, Cloud Computing, Data Mining, Dependable and Secure Computing, and Image Processing. - Demonstrate expertise in Mobile Computing, Network Security, Web Mining, Software Engineering. - Familiarity with Embedded Systems, VLSI, IoT, Power Electronics, and Wireless Communication. - Ability to read and comprehend research articles. - E...

You will be part of the Engineering team at Innovaccer, where every line of code contributes to accelerating customers" success by transforming complex challenges into innovative solutions. Collaboratively, you will turn data points into valuable insights, shaping the future of healthcare with meaningful impact. **Role Overview:** As a Software Development Engineer-II (Backend) at Innovaccer, your role involves building efficient and reusable applications and abstractions. You will work with a team of engineers to create delightful feature experiences that address customer pain points. You will also identify and communicate back-end best practices and actively participate in the project life...

Cotiviti Hyderabad is hiring a Full Stack Software Engineer with deep expertise in backend data engineering and a strong foundation in distributed systems . This role focuses on building reliable data pipelines, optimizing large-scale data processing, and developing backend services with optional contributions to frontend, cloud, or low-code platforms. Youll play a key role in driving high-performance application development, ensuring data accuracy, and fostering Agile and DevOps best practices across teams. Key Responsibilities Develop scalable, high performance backend applications and Distributed data pipelines using Python and PySpark Design and optimize complex SQL queries , stored proc...

• Maintain architecture principles, guidelines • Data Ware • Programming Language: Python/Java • Big Data • Data Analytics • GCP Services Strong Google Cloud Platform Data Components BigQuery, BigTable, CloudSQL, Dataproc, Data Flow, Data Fusion

As a Software Engineer at Wells Fargo, your role involves participating in low to moderately complex initiatives and projects within the technology domain. You will be responsible for tasks such as installation, upgrades, and deployment efforts. Additionally, you will identify opportunities for service quality and availability improvements, design, code, test, debug, and document projects associated with the technology domain. Your responsibilities also include reviewing and analyzing technical assignments related to low to medium risk deliverables, providing recommendations for issue resolution, and collaborating with technology colleagues, internal partners, and stakeholders. Key Responsib...

Role Overview: You are seeking an experienced Senior Big Data Cloud Quality Assurance Engineer to join a dynamic team. Your role involves ensuring the quality and performance of big data applications and services deployed in cloud environments. You will collaborate with developers, product managers, and stakeholders to define testing strategies, develop test plans, and execute comprehensive testing processes. Key Responsibilities: - Design and implement test plans and test cases for big data applications in cloud environments. - Perform functional, performance, and scalability testing on large datasets. - Identify, record, and track defects using bug tracking tools. - Collaborate with develo...

Desired Skills and Experience: Experience with architecting, designing and implementing end-to-end cloud infrastructure solutions across leading Cloud platforms with a special focus on Azure and Google Cloud Platform Proven experience in architecting private cloud/data center solutions using virtualization technologies like VMware, with strong expertise in implementing DevOps/DevSecOps practices and automation strategies Hands-on experience of leading cloud and infrastructure strategy / current state assessment workshops with client stakeholders and defining target operating model (TOM) / Cloud Center of Excellence driving large-scale cloud migration planning including infrastructure right s...

You're ready to gain the skills and experience needed to grow within your role and advance your career and JPMorgan Chase has the perfect software engineering opportunity for you. As a Software Engineer II - Big Data/Java/Scala at JPMorgan Chase within the Liquidity Risk (LRI) team, you will be instrumental in designing and implementing the next generation buildout of a cloud native liquidity risk management platform. Our technology organization is committed to providing comprehensive solutions for managing the firm's liquidity risk and fulfilling our regulatory reporting obligations across more than 50 markets. The program will involve strategic development of advanced liquidity calculation...

Role Overview: Transport is at the core of modern society and the Electromobility organization within Volvo Group is seeking a Group Manager for Data Analytics to play a key role in developing the team and building capability & capacity to deliver various programs within Electromobility. As the Group Manager, you will lead a talented team of engineers to develop cutting-edge technologies and solutions that propel Electromobility forward. Key Responsibilities: - Contribute to the data life cycle during the product development journey to create world-class solutions for electromobility systems - Provide insights for product development, uptime, and continuous improvement by understanding custo...

Job Overview : We are seeking an experienced ETL Tester to validate data extraction, transformation, and loading processes across various data platforms The ideal candidate will have strong hands-on experience in ETL processes, SQL, Data Warehousing, and will work closely with developers, analysts, and data engineering teams to ensure data accuracy, quality, and reliability Key Responsibilities : Understand business and data requirements to design test scenarios and test cases for ETL processes Perform data validation and data integrity testing across multiple source and target systems Validate data transformations, mappings, and business logic applied during ETL Execute SQL queries for data...

This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

Job Description This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL

Job Description This position isresponsible for hands-on design&implementation expertiseinSpark and Python (PySpark) along with other Hadoop ecosystems like HDFS, Hive, Hue, Impala, Zeppelinetc. The purpose of positionincludes- Analysis, design and implementation of business requirements using SPARK& Python. Cloudera Hadoopdevelopment around Big Data. Solid SQL experience. Development experience with PySpark&SparkSql with good analytical & debugging skills. Development work for building new solutions around Hadoop and automation of operational tasks. Assisting team and troubleshooting issues. Required Skills PYTHON , HADOOP , SQL , SHELL SCRIPTING, Spark SQL