1357 Hbase Jobs - Page 13

Role Description: As a Senior Technical Lead - Cloud Data Platform (AWS) at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities : Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaini...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

Greetings from Mouri Tech!!! Please find the JD for the role of Solution Architect. Role & responsibilities Seeking an accomplished End-to-End (E2E) Data Architect to lead the design and implementation of large-scale Big Data solutions. The ideal candidate will combine deep expertise in modern data platforms with proven experience in high-volume, mission-critical telecom or financial services environments. Prior exposure to the Ericsson Wallet Platform is highly preferred. Key Responsibilities Define the end-to-end data architecture and data engineering roadmap across Hadoop, Spark, Kudu, HBase, and Impala ecosystems. Design and optimize data ingestion, transformation, storage, and real-time...

Role & responsibilities Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions. Candidates with prior exposure to the Ericsson Wallet Platform will be given preference. Key Responsibilities Develop, test, and deploy high-performance data pipelines using Hadoop, Spark, Kudu, and HBase. Implement ETL/ELT workflows and ensure data integrity and scalability. Work closely with Data Architects and Analysts to translate business requirements into technical solutions. Troubleshoot, tune performance, and automate data operations. Contribute to best practices and mentor junior developers. Core Big Data Technologies: Hadoop, Spark, Kudu, HBase Prof...

Role Description As a Technical Lead - Cloud Data Platform (AWS) at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining securi...

Role & responsibilities: Designing and developing large-scale data processing systems. Use the expertise in big data technologies to ensure that the systems are efficient, scalable, and secure Ensuring that the developed systems are running smoothly. Monitor system performance, diagnose and troubleshoot issues, and make necessary changes to optimize system performance Processing, cleaning, and integrating large data sets from various sources to ensure that the data is accurate, complete, and consistent Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders. Planning and documenting comprehensive technical specifications for features or system...

Role Description As a Technical Lead - Cloud Data Platform (AWS) at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining securi...

Should be capable of developing/configuring data pipelines in a variety of platforms and technologies Possess the following technical skills SQL, Python, Pyspark, Hive, ETL, Unix, Control-M (or similar scheduling tools) Can demonstrate strong experience in writing complex SQL queries to perform data analysis on Databases SQL server, Oracle, HIVE etc. Experience with GCP (particularly Airflow, Dataproc, Big Query) is an advantage Have experience with creating solutions which power AI/ML models and generative AI Ability to work independently on specialized assignments within the context of project deliverables Take ownership of providing solutions and tools that iteratively increase engineerin...

We are looking for a skilled Hadoop Developer with 3 to 6 years of experience to join our team in Chennai. The ideal candidate will have expertise in Scala, SQL, Unix, and Hive & Spark. Roles and Responsibility Design, develop, and implement scalable data processing solutions using Hadoop technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines using Scala and Spark. Troubleshoot and resolve complex technical issues related to Hadoop applications. Participate in code reviews and contribute to improving overall code quality. Stay up-to-date with the latest trends and technologies in Hadoop developmen...

Python, big data (Hive, spark or snowflake, Kafka), SQL/ SQLServer. Experience in Python for data processing.

Immediate Openings onPyspark Experience : 5+ Skill:-Pyspark Location :- Bangalore Notice Period :- Immediate. Pyspark Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, Scala Performance Turing Optimize SQL, PySpark for performance Airflow workflow scheduling tool for creating data pipelines GitHub source control tool & experience with creating/ configuring Jenkins pipeline

Role Description As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secur...

Role Description As a Technical Lead - Cloud Data Platform (GCP) at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team...

As a Senior Java Developer at Servient in Pune, India, your role involves designing and implementing eDiscovery software solutions. You will have the exciting opportunity to work with the latest technologies in Big Data such as Hadoop, HBASE, and SOLR. Key Responsibilities: - Translate functional requirements and conceptual designs into detailed designs for new features - Provide estimates for development effort - Implement proof of concept, prototypes, and production-grade software - Develop software adhering to best coding practices - Assist QA in troubleshooting software issues and implementing bug fixes Skills and Experience Required: - Minimum 3 years of experience with J2EE, JAVA, Stru...

As a Data Engineer at Valorem Reply, you will be responsible for designing and contributing to the architecture of database systems, including both normalized transactional systems and dimensional reporting systems. Your expertise with SQL Server and Microsoft technologies, as well as experience in implementing Big Data solutions using Databricks, will be essential for success in this role. You will play a key role in providing data solutions to support business applications and reporting systems, working closely with customers to deliver effective solutions. Proficiency in Power BI and Azure Data Services is a must to excel in this position. Key Responsibilities: - Design and implement arch...

As a Java Developer, you will be responsible for developing data-centric, web-based applications using Core Java and object-oriented design principles. You should have knowledge and experience in technologies like JSF, JSP, JavaScript, Node.js, AJAX, HTML, CSS, Graph DB Titan/Janus, Elastic Search, Tomcat/JBOSS. Your key responsibilities will include: - Building REST APIs and Web Services - Working on Agile software development - Writing reusable, testable, and efficient code - Implementing low-latency, high-availability, and high-performance applications - Designing and implementing security and data protection - Providing analysis of problems and recommending solutions - Participating in s...

As a passionate and curious engineer at CodeHall, you will have the opportunity to work with the right tools, frameworks, and libraries to build solutions for real-world problems efficiently. If you enjoy tinkering and have experience writing code using modern toolsets, frameworks, and platforms, we are looking for individuals like you to join our team. **Role Overview:** You will be part of a team that collects peta-bytes of retail data and is seeking data analysts to derive meaningful insights for our clients. In addition to creating dashboards and reports, you will be responsible for forensic data analysis, troubleshooting data issues, and ensuring data integrity. **Key Responsibilities:*...

Role Overview: You will be a senior-level Data Engineer with Machine Learning Analyst capabilities, responsible for leading the architecture, development, and management of scalable data solutions. Your expertise in data architecture, big data pipeline development, and data quality enhancement will be crucial for processing large-scale datasets and supporting machine learning workflows. Key Responsibilities: - Design, develop, and maintain end-to-end data pipelines for ingestion, transformation, and delivery across various business systems. - Ensure robust data quality, data lineage, data reconciliation, and governance practices. - Architect and manage data warehouse and big data solutions s...

As the Engineering Lead Analyst at our company, you will be responsible for leading various engineering activities to design, acquire, and deploy hardware, software, and network infrastructure in coordination with the Technology team. Your main objective will be to ensure that quality standards are met within the existing and planned framework. **Responsibilities:** - Serve as a technology subject matter expert for internal and external stakeholders - Provide direction for all firm mandated controls and compliance initiatives - Define necessary system enhancements for deploying new products and process enhancements - Recommend product customization for system integration - Identify problem c...

As a Big Data Engineer, you will be responsible for working on collecting, storing, processing, and analyzing huge sets of data. Your primary focus will be on choosing optimal solutions for these purposes, then maintaining, implementing, and monitoring them. Additionally, you will integrate these solutions with the architecture used across the company. Key Responsibilities: - 6+ years" experience in Big Data Hadoop, MapReduce, Hive, Sqoop, and Spark with hands-on expertise in designing and implementing high data volume solutions (ETL & Streaming). - Experience in building stream-processing systems using solutions like Storm, Spark-Streaming, and Kafka streams. - Extensive experience working ...

As a Senior Data Engineer (Scala) at EY in the Advisory - Data and Analytics team, you will play a crucial role in leveraging your expertise in the Financial Services domain to solve complex issues and capitalize on opportunities that deliver better outcomes for businesses. Your primary responsibilities will include: - Demonstrating strong knowledge in Spark, with a good understanding of the Spark framework and performance tuning. - Proficiency in Scala & SQL to effectively work with data. - Exposure to at least one of the Cloud technologies - GCP/ Azure/ AWS. - Designing, building, and maintaining scalable data pipelines and solutions to efficiently manage and process large datasets. - Taki...

Openings for Senior Test Engineer with a product based company in bangalore. Total exp: 2-5 years Notice period: 30 Days to 60 Days Job location: Bangalore Mode of employment: Permanent and Work from office Skills: Backend testing experience in unix environment Good experience automation testing and manual testing Good communication skills Experience in all level of testing (System, Integration and Regression Testing) Experience in shell scripting Good experience into telecom domain If you are interested please reach out to akshatha.vr@pelatro.com along with the below details. Required details: Total exp: Relevant exp: Notice period duration: Current CTC: Expected CTC: Reason for Change of c...

Looking to onboard a skilled Hadoop Admin with 5-12 years of experience to join our team in Bangalore. The ideal candidate will have a strong background in Big Data technologies and programming languages such as Python, Scala. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop and Spark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and resolve complex technical issues related to data processing and storage. Ensure high availability and performance of data systems and applications. Participate in code reviews and contrib...

Design and implement an end-to-end data solution architecture tailored to enterprise analytics and operational needs. Build, maintain, and optimize data pipelines and transformations using Python, SQL, and Spark . Manage large-scale data storage and processing with Iceberg, Hadoop, and HDFS . Develop and maintain dbt models to ensure clean, reliable, and well-structured data. Implement robust data ingestion processes , integrating with third-party APIs and on-premise systems. Collaborate with cross-functional teams to align on business goals and technical requirements. Contribute to documentation and continuously improve engineering and data quality processes. Qualifications 4+ years of expe...

What will you do? Design and development of complex systems, large-scale enhancements from start to finish Design, develop, and implement robust, high volume applications using Java, SQL, NoSQL, Spring, Hadoop and other related technologies Work independently to determine methods and procedures on new or special assignment to find solutions to complex problems. Identify appropriate risks and develop mitigation plan. Create re-useable processes that help implement each solution. Work with stakeholders to understand the business needs and gather requirements to develop appropriate applications. Prepare business and technical documentation. Research market to identify upcoming technology to imp...