957 Hbase Jobs - Page 9

Primary skills: Snowflake, SQL Secondary skills; Any ETL, Data modeling Around 7+ years of experience in snowflake Excellent in DQH concepts Designing data pipelines: Data engineers design, build, and maintain data pipelines to ingest data from sources like databases, cloud storage, or streaming platforms Good experience in Data models Building data architecture: Data engineers plan, create, and maintain data architectures that are aligned with business needs Collecting data: Data engineers obtain data from suitable sources before working on the database Identifying patterns and creating models: Data engineers use descriptive data models to extract historically relevant insight from data Dat...

As a part of DataWeave's Product Engineering team, you will play a crucial role in developing and maintaining advanced sales optimization solutions for Digital Commerce businesses, consumer brands, delivery intermediaries, and marketplaces. Our machine learning-enabled SaaS platform caters to over 400 global brands and retailers, providing them with actionable insights through Digital Shelf Analytics and Dynamic Pricing solutions. Your responsibilities will include ensuring the quality of code developed by the team, overseeing the delivery of solutions into production, and mentoring developers while contributing to capacity planning and career development. Collaborating with technical projec...

Hiring, Data Engineer 4+ years of hands-on experience Experience in building and optimizing Big Data data pipelines, architectures, and data sets. Experience with big data tools: Hadoop, Spark Optimization, Spark-Streaming, Hive, Kafka, Hbase, Airflow, etc. Hands-on in SQL

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : NAMinimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications function seamlessly within the business environment. You will also engage in testin...

The Applications Development Senior Programmer Analyst position is an intermediate level role that involves collaborating with the Technology team to establish and implement new or updated application systems and programs. Your main objective will be to contribute to applications systems analysis and programming activities. Responsibilities include conducting tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, and model development. You will also be responsible for monitoring and controlling all phases of the development process, providing user and operational support, analyzing complex problems, and recommending security mea...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. As a Senior Data Engineer at EY's GDS Assurance Digital, your mission is to develop, implement, and integrate technology solutions that better serve audit clients and engagement teams. You will have the opportunity to develop a deep audit-related technical knowledge and outstanding database, data analytics, and programming skills. The role in...

The Engineering Lead Analyst is a senior-level position responsible for leading various engineering activities, including the design, acquisition, and deployment of hardware, software, and network infrastructure in coordination with the Technology team. Your primary goal in this role is to lead efforts to ensure that quality standards are being met within the existing and planned framework. As an Engineering Lead Analyst, your responsibilities will include serving as a technology subject matter expert for internal and external stakeholders, providing direction for all firm-mandated controls and compliance initiatives, projects within the group, and creating a technology domain roadmap. You w...

We are hiring for Java Big Data Developer Role : Java Big Data Developer Location : Chennai, Pune , Mumbai, Noida Employment : Full-time, Permanent Experience : 6-9 years and 9-13 years Notice Period : Immediate to 15 Days Key Responsibilities Design, develop, and optimize Big Data applications using Java / J2EE, Spring Boot, and Big Data frameworks . Work with distributed data processing systems like Hadoop, Spark, Hive, HBase, and Kafka . Build real-time data pipelines and streaming solutions (Kafka / Spark Streaming / Flink). Develop, test, and maintain scalable ETL and data ingestion pipelines. Collaborate with cross-functional teams to deliver data-driven solutions. Optimize performance...

Lead Software Engineer Backend Were seeking a Lead Software Engineer to join one of our Data Layer teams. As the name implies, the Data Layer is at the core of all things data at Zeta. Our responsibilities include: Developing and maintaining the Zeta Identity Graph platform, which collects billions of behavioural, demographic, environmental, and transactional signals to power people-based marketing. Ingesting vast amounts of identity and event data from our customers and partners. Facilitating data transfers across systems. Ensuring the integrity and health of our datasets. And much more. As a member of this team, the data engineer will be responsible for designing and expanding our existing...

Position Purpose The Senior Spark Developer will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand underlying data. Additionally, the candidate should have an interest in exploring open-source applications distributed by Apache, Kubernetes, OpenSearch and Oracle. Responsibilities Direct Responsibilities Integrate and upgrade the Quantexa tool with our existing systems for enhanced anti-money laundering measures. Develop and maintain Spark-based...

Excellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc Excellent Knowledge and hands-on experience of at least 4+ years in Scala and PySpark Excellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatory Strong Unix and Shell Scripting Skills Excellent Inter-personal skills and for experienced candidates Excellent leadership skills Mandatory for anyone to have Good knowledge of any of the CSPs like Azure,AWS or GCP; Certifications on Azure will be additional Plus. Mandatory Skills: PySpark. Experience: 5-8 Years.

Long Description Experienceand Expertise inany of the followingLanguagesat least 1 of them : Java, Scala, Python Experienceand expertise in SPARKArchitecture Experience in the range of 6-10 yrs plus Good Problem SolvingandAnalytical Skills Ability to Comprehend the Business requirementand translate to the Technical requirements Good communicationand collaborative skills with fellow teamandacross Vendors Familiar with development of life cycle includingCI/CD pipelines. Proven experienceand interested in supportingexistingstrategicapplications Familiarity workingwithagile methodology Mandatory Skills: Scala programming.: Experience: 5-8 Years.

The candidate must possess in-depth functional knowledge of the process area and apply it to operational scenarios to provide effective solutions. He/she must be able to identify discrepancies and propose optimal solutions by using a logical, systematic, and sequential methodology. It is vital to be open-minded towards inputs and views from team members and to effectively lead, control, and motivate groups towards company objects. Additionally, he/she must be self-directed, proactive, and seize every opportunity to meet internal and external customer needs and achieve customer satisfaction by effectively auditing processes, implementing best practices and process improvements, and utilizing ...

CostMasters is looking for Internship to join our dynamic team and embark on a rewarding career journeyinvalid title Support the team with daily tasks, research, and documentation while gaining practical exposure to industry practices Assist in project execution, data collection, and report preparation under supervision Participate in meetings, training sessions, and brainstorming activities to enhance learning and contribute fresh ideas Ensure timely completion of assigned tasks with accuracy and professionalism Collaborate with colleagues, adapt to feedback, and uphold organizational policies and standards Demonstrate eagerness to learn, develop new skills, and build a foundation for futur...

CostMasters is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological advancements that will improve the qu...

DIATOZ SOLUTIONS PVT LTD is looking for Data Engineer Apache NiFi & Groovy to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological adv...

Myridius x Aethereus is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological advancements that will impro...

We are seeking a skilled Databricks Engineer to join our team in Bengaluru, India. In this role, you will be responsible for designing, implementing, and maintaining data pipelines and analytics solutions using the Databricks platform. You will work closely with cross-functional teams to deliver high-quality, scalable data solutions that drive business insights and decision-making. Develop and optimize ETL processes using Databricks and Apache Spark Design and implement data models and schemas for efficient data storage and retrieval Collaborate with data scientists and analysts to build and deploy machine learning models Ensure data quality, consistency, and reliability across all data pipe...

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Primary Skills: Core Java, Spring Boot, Java2/EE, Microsservices Hadoop Ecosystem (HBase, Hive, MapReduce, HDFS, Pig, Sqoop etc) Spark Good to have Python Preferred technical and professional experience None

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs.Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelor...

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Strong proficiency in Java, Spring Framework, Spring boot, RESTful APIs, excellent understanding of OOP, Design Patterns. Strong knowledge of ORM tools like Hibernate or JPA, Java based Micro-services framew...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...