866 Hdfs Jobs

Experience : 5.00 + years Salary : Confidential (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Office (Pune) Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Nexus Cognitive) (*Note: This is a requirement for one of Uplers client - Nexus Cognitive) What do you need for this opportunity Must have skills required: Ambari Metrics, Experience with Ansible, Hands-on with Grafana, or equivalent for provisioning and configuration management., or equivalent platforms., Performance Optimization, Prometheus, Terraform, and encryption frameworks., Atlas, Cloudera Stack Knowledge, Deep Hortonworks Exp...

Job Summary Synechron is seeking a Data Engineer to design, develop, and maintain scalable data pipelines and ETL processes that support data-driven decision-making across the organization. This role involves working with both structured and unstructured data, ensuring data quality, security, and performance. The Data Engineer will collaborate with data scientists, analysts, and application teams to deliver reliable data solutions that enable business insights and operational efficiency, contributing to our strategic growth initiatives. Software Requirements Required Skills: Proficiency in SQL (version 2016+, advanced querying and optimization) Strong programming experience in Python (2+ yea...

Infosys Hirings for HADOOP DEVELOPER EXPERIENCE: 5-10 YEARS LOCATION: PAN INDIA SKILLS REQUIRED: HADOOP, HDFS, HIVE, BIGDATA EDUCATION : BTECH/BE/MTECH/ME/BSC/MSC/BCA/MCA

Role Overview We are seeking an experienced GCP Data Engineer with strong expertise in designing, developing, and managing large-scale data pipelines on Google Cloud Platform. The ideal candidate will have hands-on experience in Big Data technologies (Hadoop, PySpark, BigQuery) and will collaborate closely with cross-functional teams and clients to deliver high-quality data solutions. Key Responsibilities Design, build, and maintain data pipelines and ETL workflows on GCP. Develop and optimize PySpark scripts and Spark-based data processing solutions. Work with BigQuery to manage datasets, write complex SQL queries, and optimize data performance. Utilize the Hadoop ecosystem (HDFS, Hive, Map...

Strong Python programming skills. Experience in workflow orchestration using Apache Airflow. Experience in productionizing machine learning models in Domino run-time environment. Experience in building data pipelines using Python and PySpark. Strong SQL skills and experience in extracting data from different databases (Hive, SnowFlake, etc.), performing data transformation, etc. Preferable experience working with Hadoop ecosystem - HDFS, Hive. Experience working with a job scheduler, preferably Control-M. Experience with Unix-based command line interface and Bash scripts. Experience in developing and querying APIs - Restful, OpenAPI, etc. Strong understanding of DevOps and CI/CD principles; ...

Required Technical Skill Set: Bigdata, Hadoop, Apache, Spark, Hive, Scala, Kafka Must-Have: Prior experience of working with HDFS Hive/HQL Shell Scripting Spark Arcadia Kafka Daily status reporting Attending scrum calls Good to Have: Good communication skills Good in troubleshooting Agile knowledge is a must Good team player Minimum Qualification: 15 years of full-time education Minimum percentile of 50% in 10th, 12th, UG & PG (if applicable)

Spark/Scala - Job Description Qualifications: Bachelor of Engineering Desired Skills: Scala, Spark, Unix Must-Have Skills Minimum 4+ years of experience in development of Spark Scala. Experience in designing and developing solutions for Big Data using Hadoop ecosystem technologies such as HDFS, Spark, Hive, Parquet File format, YARN, MapReduce, Sqoop. Good experience in writing and optimizing Spark jobs, Spark SQL, and handling both batch and streaming data processing. Experience in writing and optimizing complex Hive and SQL queries to process large datasets, including proficiency with UDFs, tables, joins, and views. Experience in debugging Spark code. Working knowledge of basic UNIX comman...

Hands-on development experience in programming languages such as Java and Scala using Maven, Apache Spark Frameworks , and Unix Shell scripting. Comfortable with Unix File System as well as HDFS commands. Experience with query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, and HBase DB. Should be flexible. Good communication and customer management skills. Desired Candidate Profile Qualifications : Undergraduate

Job Description : Strong experience in Big Data Testing and ETL/Data Warehouse Testing . Hands-on experience with Hadoop ecosystem tools such as HDFS, Hive, Spark, Kafka, Sqoop, or NiFi. Strong proficiency in SQL , HiveQL , or Spark SQL for validating large datasets. Good understanding of ETL concepts , data pipelines, and data transformation logic. Knowledge of distributed computing concepts and large-scale data processing. Experience with relational databases (Oracle, SQL Server, MySQL) for data source validation. Ability to create and execute detailed test plans , test cases , and test data . Strong analytical, debugging, and problem-solving skills. Good communication and collaboration sk...

Role Overview: As an Applications Development Senior Programmer Analyst, you will be responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. Key Responsibilities: - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas - Monitor and control all phases of development process ...

Role Overview: Maxwell GeoSystems is looking for an experienced professional to join their team as a Senior Technical Analyst. Your primary responsibility will be to assist in the development and implementation of Company-wide SOA Reporting. You will work closely with a multi-functional team to plan, design, and integrate software services for data handling and transformation using the latest web technologies. Key Responsibilities: - Assisting in the development and implementation of Company-wide SOA (Service-oriented Architecture) for instrumentation and construction monitoring SaaS (Software as a Service). - Overseeing planning, runtime design, and integration of software service for data ...

Position Summary Description and Requirements Continuing with the tradition of innovation, MetLife, as part of its Data and Analytics function, established a dedicated center for advanced analytics & research in India. DnA Hyderabad a.k.a Global Advanced analytics and Research Center (GARC) is part of larger Data and analytics organization (DnA) of MetLife focused on scaling data governance, data management, data engineering, data science/machine learning/ artificial intelligence, visualization, techno-project management capabilities, enabling a more cost-effective analytics operating model, and increasing data and analytics maturity across the MetLife global community. Driven by passion and...

It's fun to work in a company where people truly BELIEVE in what they are doing! We're committed to bringing passion and customer focus to the business. Technical Project Manager at Fractal.ai Bengaluru Company overview Fractal is a strategic AI and analytics partner to the most admired Fortune 500 companies globally, helping them power every human decision in the enterprise at scale by bringing AI, Engineering and Design together. Fractal has close to 3000 consultants spread across 16 global locations including the United States, UK/EU, APAC, and India The experience should be as per the responsibilities listed below. Responsibilities Lead technical projects end-to-end right from design to ...

Pro-Active Hire*. Loc: Manyata Tech Park. Exp: 5-8 yrs AI/ML Engineer. - JD - Skills Required: • Exp. with Data Engineering & Data/ML pipelines for Analytics & AI/ML Models • Working with large sets of structured & unstructured data from disparate sources • Foundational acquaintance of Data Science & AI/ML models • SQL, Python, Spark, PySpark • Big Data systems - Hadoop Ecosystem (HDFS, Hive, MapReduce) • Analytics dB like Druid, Data visualization/exploration tools like Superset • Understanding cloud (AWS, Azure, or GCP) • GIT Secondary Skills (preferred): • Apache Airflow, Apache Oozie, Nifi • GCP exp., Big Query, GCP Big Data Ecosystem • Trino/Presto • Familiar with forecasting algorithms...

About The Role Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Hadoop Good to have skills : Python (Programming Language) Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : AWS Architecture Good to have skills : API Management Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will engage in the development and configuration of software systems, either managing the entire process or focusing on specific stages of the product lifecycle. Your day wil...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education , Summary As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work in a...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education , Summary As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work in a...

Role Overview: You will be responsible for Hadoop Administration, with a focus on maintaining, troubleshooting, and monitoring Hadoop clusters and various components. Your role will involve installing, configuring, and integrating analytical tools with Hadoop. Additionally, you will be expected to troubleshoot application problems across different environments and platforms. Key Responsibilities: - Minimum 4 years of experience in Hadoop Administration, specifically in production support projects - Installation, configuration, maintenance, troubleshooting, and monitoring of Hadoop clusters and components such as HDFS, HBase, Hive, Sentry, Hue, Yarn, Sqoop, Spark, Oozie, ZooKeeper, Flume, and...

As a member of Concrew, you will be part of a team that values excellence and is dedicated to success. We are seeking individuals who are driven to succeed and possess the discipline necessary to achieve their goals. At Concrew, we prioritize the growth and development of our team members, offering an environment that fosters creativity and innovation. Key Responsibilities: - Hands-on experience with Hadoop-based implementations, including HDFS, MapReduce, and Hive, or equivalent SQL on Hadoop technology. Qualifications: - A degree in Engineering or Arts. If you are passionate about leveraging your skills in Hadoop technology and thrive in a dynamic and collaborative work environment, we enc...

Must Have: SQL: Ability to read, write, test, and maintain complex SQL queries . BigQuery: Working knowledge, including aspects like internal vs external tables, partitioning, clustering, etc. Python: Hands-on expertise in writing Python application code . Big Data Engineering: Experience in Big Data Engineering projects. Good to Have (Added Advantage) Knowledge/experience with DBT and Alembic (availability of these skills will be a big push) Experience Requirement: 3-5 yrs

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Integration Advisor to join our team in Bangalore, Karntaka (IN-KA), India (IN). Key Responsibilities Data Pipeline Development: Design, develop, test, deploy, and maintain robust, scalable ETL/ELT data pipelines using Python/PySpark across Cloudera and Databricks platforms. Cloudera & Hadoop Management: Administer and maintain Cloudera clusters, managing core components such as HDFS, YARN, Hive, Impala, Spark, Kafka, and NiFi, ensuring high availability and per...

Role Description : As a Senior Big Data Platform Engineer at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise. Roles & Responsibilities: Designing, developing and maintaining large-scale big ...

Responsibilities: * Design, develop, test and maintain PySpark applications using Python and Spark technologies. * Collaborate with cross-functional teams on Big Data projects utilizing Hive, Hadoop and HDFS. Office cab/shuttle Health insurance Food allowance Provident fund Annual bonus

Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation. Job Description Solid experience, knowledge and skills in Data Engineering, BI/software development such as ELT/ETL, data extraction and manipulation in Data Lake/Data Warehouse environment. Proven experience in data modelling, analysis, and profiling. Experience of working in diverse data domains. Continuous improvement and performance optimisation practice ensuring high levels of performance, availability and integrity. Proven consulting and mentoring experience. Experience in working within an Agile environment. Experience in applying DevOps practices, SDLC, CI/CD principles to build automated pip...