10 Hdfs Jobs

Join us as a Developer at Barclays, where you'll take part in the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unparalleled customer experiences. As a part of the team, you will deliver technology stack, using strong analytical and problem solving skills to understand the business requirements and deliver quality solutions. You'll be working on complex technical problems that will involve detailed analytical skills and analysis. This will be done in conjunction with fellow engineers, business analysts and business stakeholders. To be successful as a Developer you should have expe...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using th...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, ...

Job Requirements About the Role The Data Engineer plays a critical role in developing and maintaining data engineering projects that support the organization's data collection systems and processing pipelines. This role is responsible for writing efficient, scalable code to build optimized and highly available data pipelines, enabling deeper analysis and reporting by the Data & Analytics team. The Data Engineer collaborates with analysts and data scientists, leveraging tools such as Tableau, Python, and Spark to deliver impactful data solutions. Key Responsibilities Primary Responsibilities Minimum 23 years of hands-on experience in data engineering. Proven expertise in SQL, Spark, and the H...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

Job Description: 5 years of in depth hands on experience of developing testing deployment and debugging of Spark Jobs using Scala in Hadoop Platform In depth knowledge of Spark Core working with RDDs Spark SQL In depth knowledge on Spark Optimization Techniques and Best practices Good Knowledge of Scala Functional Programming Try Option Future Collections Good Knowledge of Scala OOPS Classes Traits and Objects Singleton and Companion Case Classes Good Understanding of Scala Language Features Type System Implicit Givens Hands on experience of working in Hadoop Environment HDFS Hive AWS S3 EMR Working experience on Workflow Orchestration tools like Airflow Oozie Working with API calls in Scala...

As an Applications Development Sr Programmer Analyst in the Information Management team of Services Technologies, you will be focusing on Big Data and public cloud adoption projects. Your role involves the establishment and implementation of new or revised application systems and programs in coordination with the Technology team, with the primary objective of contributing to applications systems analysis and programming activities. **Key Responsibilities:** - Conduct feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish new or revised applications systems and programs to meet specific business needs or user area...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work in a dynamic environ...

Looking for a professional with 5+ years of experience in AWS infrastructure, HDFS, AWS EMR, Python, Shell scripting, and DevOps tools like Jenkins and Ansible Strong deployment knowledge and automation skills required

Looking for a professional with 5+ years of experience in AWS infrastructure, HDFS, AWS EMR, Python, Shell scripting, and DevOps tools like Jenkins and Ansible Strong deployment knowledge and automation skills required