886 Hdfs Jobs - Page 2

Required Technical Skill Set: Bigdata, Hadoop, Apache, Spark, Hive, Scala, Kafka Must-Have: Prior experience of working with HDFS Hive/HQL Shell Scripting Spark Arcadia Kafka Daily status reporting Attending scrum calls Good to Have: Good communication skills Good in troubleshooting Agile knowledge is a must Good team player Minimum Qualification: 15 years of full-time education Minimum percentile of 50% in 10th, 12th, UG & PG (if applicable)

Spark/Scala - Job Description Qualifications: Bachelor of Engineering Desired Skills: Scala, Spark, Unix Must-Have Skills Minimum 4+ years of experience in development of Spark Scala. Experience in designing and developing solutions for Big Data using Hadoop ecosystem technologies such as HDFS, Spark, Hive, Parquet File format, YARN, MapReduce, Sqoop. Good experience in writing and optimizing Spark jobs, Spark SQL, and handling both batch and streaming data processing. Experience in writing and optimizing complex Hive and SQL queries to process large datasets, including proficiency with UDFs, tables, joins, and views. Experience in debugging Spark code. Working knowledge of basic UNIX comman...

Hands-on development experience in programming languages such as Java and Scala using Maven, Apache Spark Frameworks , and Unix Shell scripting. Comfortable with Unix File System as well as HDFS commands. Experience with query languages such as Oracle SQL, Hive SQL, Spark SQL, Impala, and HBase DB. Should be flexible. Good communication and customer management skills. Desired Candidate Profile Qualifications : Undergraduate

Job Description : Strong experience in Big Data Testing and ETL/Data Warehouse Testing . Hands-on experience with Hadoop ecosystem tools such as HDFS, Hive, Spark, Kafka, Sqoop, or NiFi. Strong proficiency in SQL , HiveQL , or Spark SQL for validating large datasets. Good understanding of ETL concepts , data pipelines, and data transformation logic. Knowledge of distributed computing concepts and large-scale data processing. Experience with relational databases (Oracle, SQL Server, MySQL) for data source validation. Ability to create and execute detailed test plans , test cases , and test data . Strong analytical, debugging, and problem-solving skills. Good communication and collaboration sk...

Role Overview: As an Applications Development Senior Programmer Analyst, you will be responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. Key Responsibilities: - Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas - Monitor and control all phases of development process ...

Role Overview: Maxwell GeoSystems is looking for an experienced professional to join their team as a Senior Technical Analyst. Your primary responsibility will be to assist in the development and implementation of Company-wide SOA Reporting. You will work closely with a multi-functional team to plan, design, and integrate software services for data handling and transformation using the latest web technologies. Key Responsibilities: - Assisting in the development and implementation of Company-wide SOA (Service-oriented Architecture) for instrumentation and construction monitoring SaaS (Software as a Service). - Overseeing planning, runtime design, and integration of software service for data ...

Position Summary Description and Requirements Continuing with the tradition of innovation, MetLife, as part of its Data and Analytics function, established a dedicated center for advanced analytics & research in India. DnA Hyderabad a.k.a Global Advanced analytics and Research Center (GARC) is part of larger Data and analytics organization (DnA) of MetLife focused on scaling data governance, data management, data engineering, data science/machine learning/ artificial intelligence, visualization, techno-project management capabilities, enabling a more cost-effective analytics operating model, and increasing data and analytics maturity across the MetLife global community. Driven by passion and...

It's fun to work in a company where people truly BELIEVE in what they are doing! We're committed to bringing passion and customer focus to the business. Technical Project Manager at Fractal.ai Bengaluru Company overview Fractal is a strategic AI and analytics partner to the most admired Fortune 500 companies globally, helping them power every human decision in the enterprise at scale by bringing AI, Engineering and Design together. Fractal has close to 3000 consultants spread across 16 global locations including the United States, UK/EU, APAC, and India The experience should be as per the responsibilities listed below. Responsibilities Lead technical projects end-to-end right from design to ...

Pro-Active Hire*. Loc: Manyata Tech Park. Exp: 5-8 yrs AI/ML Engineer. - JD - Skills Required: • Exp. with Data Engineering & Data/ML pipelines for Analytics & AI/ML Models • Working with large sets of structured & unstructured data from disparate sources • Foundational acquaintance of Data Science & AI/ML models • SQL, Python, Spark, PySpark • Big Data systems - Hadoop Ecosystem (HDFS, Hive, MapReduce) • Analytics dB like Druid, Data visualization/exploration tools like Superset • Understanding cloud (AWS, Azure, or GCP) • GIT Secondary Skills (preferred): • Apache Airflow, Apache Oozie, Nifi • GCP exp., Big Query, GCP Big Data Ecosystem • Trino/Presto • Familiar with forecasting algorithms...

About The Role Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Hadoop Good to have skills : Python (Programming Language) Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop and configure software systems either end-to-end or for a specific stage of product lifecycle. Apply knowledge of technologies, applications, methodologies, processes and tools to support a client, project or entity. Must have skills : AWS Architecture Good to have skills : API Management Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will engage in the development and configuration of software systems, either managing the entire process or focusing on specific stages of the product lifecycle. Your day wil...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education , Summary As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work in a...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education , Summary As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work in a...

Role Overview: You will be responsible for Hadoop Administration, with a focus on maintaining, troubleshooting, and monitoring Hadoop clusters and various components. Your role will involve installing, configuring, and integrating analytical tools with Hadoop. Additionally, you will be expected to troubleshoot application problems across different environments and platforms. Key Responsibilities: - Minimum 4 years of experience in Hadoop Administration, specifically in production support projects - Installation, configuration, maintenance, troubleshooting, and monitoring of Hadoop clusters and components such as HDFS, HBase, Hive, Sentry, Hue, Yarn, Sqoop, Spark, Oozie, ZooKeeper, Flume, and...

As a member of Concrew, you will be part of a team that values excellence and is dedicated to success. We are seeking individuals who are driven to succeed and possess the discipline necessary to achieve their goals. At Concrew, we prioritize the growth and development of our team members, offering an environment that fosters creativity and innovation. Key Responsibilities: - Hands-on experience with Hadoop-based implementations, including HDFS, MapReduce, and Hive, or equivalent SQL on Hadoop technology. Qualifications: - A degree in Engineering or Arts. If you are passionate about leveraging your skills in Hadoop technology and thrive in a dynamic and collaborative work environment, we enc...

Must Have: SQL: Ability to read, write, test, and maintain complex SQL queries . BigQuery: Working knowledge, including aspects like internal vs external tables, partitioning, clustering, etc. Python: Hands-on expertise in writing Python application code . Big Data Engineering: Experience in Big Data Engineering projects. Good to Have (Added Advantage) Knowledge/experience with DBT and Alembic (availability of these skills will be a big push) Experience Requirement: 3-5 yrs

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Integration Advisor to join our team in Bangalore, Karntaka (IN-KA), India (IN). Key Responsibilities Data Pipeline Development: Design, develop, test, deploy, and maintain robust, scalable ETL/ELT data pipelines using Python/PySpark across Cloudera and Databricks platforms. Cloudera & Hadoop Management: Administer and maintain Cloudera clusters, managing core components such as HDFS, YARN, Hive, Impala, Spark, Kafka, and NiFi, ensuring high availability and per...

Role Description : As a Senior Big Data Platform Engineer at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise. Roles & Responsibilities: Designing, developing and maintaining large-scale big ...

Responsibilities: * Design, develop, test and maintain PySpark applications using Python and Spark technologies. * Collaborate with cross-functional teams on Big Data projects utilizing Hive, Hadoop and HDFS. Office cab/shuttle Health insurance Food allowance Provident fund Annual bonus

Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation. Job Description Solid experience, knowledge and skills in Data Engineering, BI/software development such as ELT/ETL, data extraction and manipulation in Data Lake/Data Warehouse environment. Proven experience in data modelling, analysis, and profiling. Experience of working in diverse data domains. Continuous improvement and performance optimisation practice ensuring high levels of performance, availability and integrity. Proven consulting and mentoring experience. Experience in working within an Agile environment. Experience in applying DevOps practices, SDLC, CI/CD principles to build automated pip...

At Index Exchange, we're reinventing how digital advertising worksat scale. As a global advertising supply-side platform, we empower the world's leading media owners and marketers to thrive in a programmatic, privacy-first ecosystem. We're a proud industry pioneer with over 20 years of experience accelerating the ad technology evolution. Our proprietary tech is trusted by some of the world's largest brands and media owners and plays a crucial role in keeping the internet open, accessible, and largely free. We process more than 550 billion real-time auctions every day (in comparison, Google processes 8.5 billion searches per day) with ultra-low latency. Our platform is vertically integrated f...

Need Analytics in Python with GCP: Skils - SQL, GCP BQ, ETL pipelines using Pyhon/Airflow, Experience on Spark/Hive/HDFS,Data modeling for Data conversion. Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills Common Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow, Experience on Spark/Hive/HDFS, Data modeling for Data conversion Resources Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills

Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organizations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realize their ambitions. We are currently seeking an experienced professional to join our team i...

Job Description The Senior Associate People Senior Associate L1 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solutions. Utilize a deep understanding of data integration and big data design principles in creating custom solutions or implementing package solutions. You will independently drive design discussions to insure the necessary health of the overall solution Your Impact: Data Ingestion, Integration and Transformation Data Storage and Computation Frameworks, Performance Optimizations Analytics & Visualizations Infrastructure & Cloud Computing Data Management Platforms Build functionality for data ingesti...

Role:Hadoop Developer Experience Range:5 to 8 Location:(Chennai,Bangalore,Hyderabad,Mumbai,Ahmedabad) Required Technical Skill Set HDFS, Hive, Spark, Sqoop, Flume, Oozie, Unix Script, Autosys Must-Have 1. Good understanding of Hadoop concepts including file system and Map Reduce. 2. Hands on experience on Spark framework, Unix scripting, Hive queries, wriring UDF in Hive. Theortical knowledge and POC alone will not suffice. 3. Good knowledge in Software Development Life Cycle and Project Development Lifecycle. 4. Associate should be able to work independently and should have strong debugging skill in both Hive and Spark. Associate should have experience developing large scale systems, experi...