575 Hdfs Jobs - Page 8

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

Role & responsibilities Experience designing and deploying large scale distributed data processing systems with few technologies such as PostgreSQL or equivalent databases, SQL, Hadoop, Spark, Tableau Proven ability to define and build architecturally sound solution designs. Demonstrated ability to rapidly build relationships with key stakeholders. Experience of automated unit testing, automated integration testing and a fully automated build and deployment process as part of DevOps tooling. Must have the ability to understand and develop the logical flow of applications on technical code level. Strong interpersonal skills and ability to work in a team and in global environments. Should be p...

The Data Engineer will serve as a technical expert in the fields ofdesign and develop AI data pipelines to manage both large unstructuredand structured datasets, with a focus on building data pipelines for enterprise AI solutions Job Description In your new role you will: Working closely with data scientists and domain experts to design anddevelop AI data pipelines using agile development process. Developing pipelines for ingesting and processing large unstructuredand structured datasets from a variety of sources, with a specificemphasis on creating solutions for AI solutions to ensure efficient andeffective data processing. Work efficiently with structured and unstructured data sources. Wor...

Role - Data Engineer Experience - 2+yrs Location - Bangalore Roles and Responsibilities: Create and maintain optimal data pipeline architecture Create and maintain events/streaming based architecture/design Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data technologies. Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industr...

We have an opportunity with one of our clients and below is the detailed job description: Experience Range - 5 to 12 Yrs Job Location - Coimbatore & Chennai Event Date - 14-Jun-25 | Face to Face | Coimbatore Interested candidates must be available for the event on 14-June-25 Job Description: 1. 5-12 Years of in Big Data & Data related technology experience 2. Expert level understanding of distributed computing principles 3. Expert level knowledge and experience in Apache Spark 4. Hands on programming with Python 5. Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop 6. Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming 7. Experience...

Job Summary: The Associate Data Engineer works on different projects of data engineering to support the use cases, data ingestion pipeline and identify potential process or data quality issues. For the SaaS Integration team, the resource will contribute to the design, development, and maintenance of API integrations across enterprise SaaS platforms including Reltio, OneTrust, and Adobe CDP. This will include developing and maintaining RESTful APIs to integrate internal systems with Reltio (MDM), OneTrust (Privacy & Compliance), and Adobe CDP (Customer Data Platform), participating in technical design reviews and contributing to solution architecture discussions and collaborating with product...

Sr/ Lead Engineer Hadoop Let's be unstoppable together! At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We're a global company dedicated to fostering inclusivity and belonging. We value and celebrate the unique experiences, cultures, and viewpoints that each individual brings. By embracing a wide range of backgrounds, skills, expertise, and beyond, we create a stronger, more innovative environment for our employees, clients, and communities. Circana is proud to be Certified by Great Place To Work. Th...

Let's be unstoppable together! At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives. We're a global company dedicated to fostering inclusivity and belonging. We value and celebrate the unique experiences, cultures, and viewpoints that each individual brings. By embracing a wide range of backgrounds, skills, expertise, and beyond, we create a stronger, more innovative environment for our employees, clients, and communities. Circana is proud to be Certified by Great Place To Work. This prestigious award is b...

5+ years of strong experience on Bigdata, HDFS, Hive 3+ years of strong experience on ETL testing, 3+ years of strong experience on SQL 2+ years of experience on health care domain

-Hands-on exp with Hadoop Eco-system (HDFS, Hive, Spark) -Exp on Hive / HDFS, PySpark, Spark, JupiterNotebook, ELT Talend, Control-M, Unix/Script, Python, CI/CD, Git / Jira, Hadoop, TOM, Oozie, Snowflake -Implementation of the Data Quality Controls

Sigmoid empowers enterprises to make smarter, data-driven decisions by blending advanced data engineering with AI consulting. We collaborate with some of the world's leading data-rich organizations across sectors such as CPG-retail, BFSI, life sciences, manufacturing, and more to solve complex business challenges. Our global team specializes in cloud data modernization, predictive analytics, generative AI, and DataOps, supported by 10+ delivery centers and innovation hubs, including a major global presence in Bengaluru and operations across the USA, Canada, UK, Netherlands, Poland, Singapore, and India. Recognized as a leader in the data and analytics space, Sigmoid is backed by Peak XV Part...

As a skilled Senior Engineer at Impetus Technologies, you will utilize your expertise in Java and Big Data technologies to design, develop, and deploy scalable data processing applications. Your responsibilities will include collaborating with cross-functional teams, developing high-quality code, and optimizing data processing workflows. Additionally, you will mentor junior engineers and contribute to architectural decisions to enhance system performance and scalability. Key Responsibilities: - Design, develop, and maintain high-performance applications using Java and Big Data technologies. - Implement data ingestion and processing workflows with frameworks like Hadoop and Spark. - Collabora...

At ClearTrail, you will be part of a team dedicated to developing solutions that empower those focused on ensuring the safety of individuals, locations, and communities. For over 23 years, ClearTrail has been a trusted partner of law enforcement and federal agencies worldwide, committed to safeguarding nations and enhancing lives. We are leading the way in the future of intelligence gathering through the creation of innovative artificial intelligence and machine learning-based lawful interception and communication analytics solutions aimed at addressing the world's most complex challenges. **Key Responsibilities:** - Designing and developing high-performance, scalable applications using Java...

Role Overview: As an Associate Product Support Engineer focused on Hadoop distributed systems, your primary responsibility will be to provide technical support to enterprise clients. You will troubleshoot and resolve issues within Hadoop environments to ensure the stability and reliability of customers" infrastructures. Collaborating with experienced engineers, you will work closely with clients to understand their problems and deliver effective solutions with empathy and professionalism. Key Responsibilities: - Address customer issues related to Hadoop clusters and core components such as HDFS, YARN, MapReduce, and Hive. - Perform basic administrative tasks including installation, configura...