575 Hdfs Jobs - Page 12

The role requires strategic thinking and planning, providing expertise throughout the entire product development life cycle with a strong sense of quality ownership to ensure that quality is integrated from the initial stages. You will be responsible for ensuring that all development tasks meet quality criteria through proper planning, designing, quality assurance, and issue tracking. It is crucial to be accountable for mitigating business risks by executing and validating infrastructural changes in a timely and precise manner. Collaborating closely with development and infrastructure teams is essential to create enhancement and application fix plans. You will work under minimal supervision ...

As a Senior Big Data Developer with 4 to 8 years of experience, you will be based in Bangalore and work in a hybrid mode. Your primary responsibilities will involve working with Big Data technologies and associated tools such as Hadoop, Unix, HDFS, Hive, Impala, etc. You should be proficient in using Spark/Scala and have experience in data Import/Export using Sqoop or similar tools. Additionally, you will be expected to have experience using Airflow, Jenkins, or similar automation tools. Excellent knowledge of SQL Server and database structures is essential, along with the ability to write and optimize T-SQL queries and stored procedures. Experience working with Jira, Confluence, GitLab, and...

Role: Scala Data Engineer Location: Bangalore (Hybrid, 3 days office/week) Experience: 4 6 years Employment Type: Full-Time Key Responsibilities: Develop, maintain, and optimize data pipelines using Scala & Spark Work with HDFS, Hive, Yarn to manage large datasets efficiently Build and manage workflows with Oozie Apply unit testing practices to ensure code quality and reliability Collaborate with Data & AI team to deliver scalable solutions Skills Required: Strong programming skills in Scala & Spark Hands-on with HDFS, Hive, Oozie, Yarn Solid experience in Unit Testing Good understanding of data engineering best practices Candidate Details (to be shared while applying): Total Experience Rele...

Understanding & familiarity with all Hadoop Ecosystem components and Hadoop Administrative Fundamentals Experience working with NoSQL in at least one of the data stores - HBase, Cassandra, MongoDB Experience in HDFS, Hive, Impala Must have strong technical skills in Neo4j. Experience is schedulers like Airflow, Nifi etc. Experienced in Hadoop clustering and Auto scaling. Develop standardized practices for delivering new products and capabilities using Big Data technologies, including data acquisition, transformation, and analysis. Define and develop client specific best practices around data management within a Hadoop environment on Azure cloud Monitoring health, tuning, and growth of such o...

":" Experience: Minimum 4+ years (relevant experience mandatory) Key Skills Required Strong hands-on experience with Scala (mandatory) and Apache Spark Experience with Hadoop ecosystem HDFS, Hive, Impala, Sqoop Data ingestion and pipeline development for large-scale systems Proficiency in Java and distributed data processing Knowledge of data warehousing and query optimization Job Description We are seeking a skilled Data Engineer (Spark & Scala) with hands-on expertise in big data technologies and large-scale data processing. The role involves building and optimizing data ingestion pipelines , working with the Hadoop ecosystem , and ensuring high-performance data workflows. Responsibilities...

2+ yrs exp as Data Engineer with strong skills in Big Data (HDFS/S3, Spark/Flink, Hive, HBase, Kafka/Kinesis), SQL & NoSQL (Elasticsearch, Cassandra, MongoDB), Airflow/Luigi, AWS/GCP, Java/Scala, stream processing & data modeling.

Expertise in Hadoop ecosystem, PySpark, Python,SQL,develop,maintain scalable data pipelines ETL workflows.Ensuring data quality,optimizing performance,collaborating stakeholders,managing HDFS/Hive/HBase,supporting data-driven cloud (GCP preferred).

• Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark • Scala is Mandatory

As a skilled professional with over 7 years of experience, you will be responsible for reviewing and understanding business requirements to ensure timely completion of development tasks with rigorous testing to minimize defects. Collaborating with a software development team is crucial to implement best practices and enhance the performance of Data applications, meeting client needs effectively. In this role, you will collaborate with various teams within the company and engage with customers to comprehend, translate, define, and design innovative solutions for their business challenges. Your tasks will also involve researching new Big Data technologies to evaluate their maturity and alignme...

As a Software Engineer with expertise in big data technologies, you will be responsible for working with technologies such as Hadoop, Hive, and Spark to process and analyze large datasets. You will collaborate with cross-functional teams to gather requirements and implement solutions that align with business needs. Additionally, you will participate in all phases of the software development lifecycle, including planning, development, testing, and deployment. Your role will also involve implementing CI/CD pipelines using tools like Jenkins to automate build, test, and deployment processes. You should be adaptable to new technologies and methodologies, demonstrating a continuous learning minds...

Job role - Hadoop developer Experience - 2 to 10 years Location - PAN INDIA This Job Opportunity is for TOP Leading MNCs / Permanent role . Role- Hadoop Developer / Module Lead Technical skills- Hadoop, Spark, Scala, Impala, Hive, Kafka Must-Have Extensive experience and hands on implementation experience with Spark, Scala, Impala, Hive, Kafka, SQOOP Good-to-Have Extensive knowledge with Data frames, Data Sets and RDDs.

As a Big Data/Hadoop Trainer, your main responsibility will be conducting training sessions on Big Data and Hadoop. You will be tasked with creating assignments and projects that are centered around Hadoop to enhance the learning experience of the participants. To excel in this role, you should have a minimum of 2 years of hands-on experience in Hadoop/Big Data Technology within the corporate sector. Your profile should showcase excellent knowledge of Hadoop, Big Data, HDFS, MapReduce, Pig, Hive, Sqoop, ZooKeeper, Hbase, and Java. Additionally, possessing strong communication and presentation skills is essential in effectively delivering the training content. We are looking for candidates wi...

Were Hiring: Tech Lead – Big Data Technologies Location: Pune | Work Mode: Work from Office (WFO) Company: Leading MNC | Immediate Joiners Preferred Are you a Big Data expert with 6–9 years of experience and a passion for leading high-impact projects? We’re looking for a Tech Lead skilled in: Hadoop, Spark, Hive, Kafka, Sqoop, Oozie, Flume Java/Scala, SQL/NoSQL (PostgreSQL, MongoDB) System monitoring tools (Grafana, Ganglia), scripting & automation Role involves end-to-end ownership of data pipeline architecture, code reviews, performance tuning, and leading a talented team.

Unison Consulting Pte Ltd is looking for a skilled Big Data Developer to join the team. In this role, you will be responsible for creating and maintaining big data solutions to support data-driven decision-making and analytics for our clients. You will work with both structured and unstructured data using cutting-edge technologies and platforms. As a Big Data Developer, your responsibilities will include designing, developing, and maintaining big data solutions utilizing technologies like Hadoop, HDFS, Spark, and Hive. You will be tasked with handling large volumes of data from various sources, implementing efficient ETL processes, developing data models and governance frameworks, and conduc...

As a Data Engineer, you will be responsible for designing and developing scalable data engineering solutions using Google Cloud Platform (GCP) and PySpark. Your main focus will be on optimizing Spark jobs for performance, scalability, and efficient resource utilization. You will also be involved in developing, maintaining, and enhancing ETL pipelines using BigQuery, Apache Airflow, and Cloud Composer. Collaborating with data scientists, analysts, and DevOps teams to translate business requirements into technical solutions will be a key aspect of your role. Ensuring data integrity and security by implementing data governance, compliance, and security best practices will be crucial. Monitoring...

Company Description Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com Job Description We are look...

Company Description Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and fostering innovation for its clients by harnessing world-class people and data-driven strategy. We believe that the power of people and AI can have a meaningful impact on your world, creating more fulfilling work and projects for our people and clients. For more information, visit www.blend360.com Job Description We are look...

Organization: At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things. Job Title: Sr. Data Engineer Location: Bangalore - Manyata Tech Park Business & Team: RBS (HB Domain) ---Search & Find Impact & contribution: You will play a pivotal role in driving business outcomes through effective data management and a...

Organization: At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things. Job Title: Staff. Data Engineer Location: Bangalore - Manyata Tech Park Business & Team: RBS (HB Domain) ---Search & Find Impact & contribution: You will play a pivotal role in driving business outcomes through effective data management an...

Data Software Engineer Job Description: 1. 5-12 Years of in Big Data & Data related technology experience 2. Expert level understanding of distributed computing principles 3. Expert level knowledge and experience in Apache Spark 4. Hands on programming with Python 5. Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop 6. Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming 7. Experience with messaging systems, such as Kafka or RabbitMQ 8. Good understanding of Big Data querying tools, such as Hive, and Impala 9. Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files 10. Good under...

Times Internet is the largest digital products company and the digital venture of Times of India, India's largest media and entertainment group. TIL websites are among the fastest growing Web / Mobile based networks worldwide. Since its inception in 1999, Times Internet has led the Internet revolution in India and has emerged as India's foremost web entity, running diverse portals and niche websites. The Database Professional will participate in the design, implementation, automation, optimization, and ongoing operational administration related tasks backend system running on MySQL/MariaDB/ MongoDB/RedisDB/Hadoop database infrastructure. Candidates should be ready to take the instant support...

Job Description: About Us At Bank of America, we are guided by a common purpose to help make financial lives better through the power of every connection. Responsible Growth is how we run our company and how we deliver for our clients, teammates, communities, and shareholders every day. One of the keys to driving Responsible Growth is being a great place to work for our teammates around the world. We're devoted to being a diverse and inclusive workplace for everyone. We hire individuals with a broad range of backgrounds and experiences and invest heavily in our teammates and their families by offering competitive benefits to support their physical, emotional, and financial well-being. Bank o...

As a Python Senior Developer, you should have a minimum of 5 years of experience in Python programming. You must possess extensive experience in handling complex projects and demonstrate strong leadership skills to lead projects independently. Your effective communication and teamwork skills will be crucial in collaborating with team members. Your role will require good analytical skills and proficiency in web-based development technologies. It is essential to have expertise in Agile development methodology and strong problem-solving abilities. You should also possess a deep knowledge of Design patterns, Security, Performance tuning, and App monitoring. Experience in API Design, security pat...

As the Head of Technology - New Initiatives at Matrimony.com, you will be at the forefront of driving innovation in our WedTech domain through a groundbreaking project. Your role will be pivotal in orchestrating the convergence of cutting-edge technology with matrimonial services, leading a minimum of one product tech team towards technological supremacy. Your key responsibilities will include: - Developing and implementing a strategic tech roadmap that aligns with industry advancements and business benchmarks. - Overseeing the product engineering lifecycle of our flagship product, ensuring scalability and efficiency from prototype to production readiness. - Building and nurturing a high-cal...

You are an experienced PySpark ETL Lead responsible for driving data integration efforts in analytics and data warehousing projects. Your role includes developing and managing PySpark scripts, creating ETL workflows, and ensuring efficient data processing and integration across systems. You should be strong in PySpark and Python for ETL and data processing, with experience in ETL pipeline design, data integration, and data warehousing. Proficiency in SQL and working with large datasets is required, along with familiarity with workflow schedulers such as Airflow and Cron. Hands-on experience with Big Data tools like Hive, HDFS, and Spark SQL is essential. It would be beneficial if you have ex...