1356 Hbase Jobs - Page 8

* 7+ years experience in data eng, data platforms & analytics, 10+ years of consulting experience ? Completed Data Engineering Professional certification & required classes ? Minimum 6-8+ projects delivered with hands-on experience in development on databricks ? Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with deep expertise in at least one ? Deep experience with distributed computing with Spark with knowledge of Spark runtime internals ? Familiarity with CI/CD for production deployments ? Working knowledge of MLOps ? Current knowledge across the breadth of Databricks product and platform features ? Familiarity with optimizations for performance and scalability

4 Years Data Engineering Experience 5 years of consulting experience Completed Data Engineering Professional certification & required classes Minimum 2-3 projects delivered with hands-on experience in Databricks Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache Spark on Databricks Experience in Spark and or Hadoop, Flink, Presto, other popular big data engines Familiarity with Databricks multi-hop pipeline architecture

2 Years Data Engineering Experience, 3 years of consulting experience Completed Data Engineering Associate certification & required classes Minimum 1 project delivered with hands-on experience in development on Databricks Completed Apache Spark Programming with Databricks, Data Engineering with Databricks, Optimizing Apache Spark on Databricks SQL delivery experience, and familiarity with Bigquery, Synapse or Redshift Proficient in Python, knowledge of additional databricks programming languages (Scala)

As a Senior Big Data Engineer at NTT DATA in Bangalore, Karnataka (IN-KA), India, you will be responsible for designing and developing big data platforms, utilizing your expertise in Data Engineering. Your role will involve working with data processing technology stacks such as Spark, HBase, Hive, and other Hadoop ecosystem technologies, utilizing Scala or Java for development. You will also be expected to have a deep understanding of streaming data architectures for real-time and low-latency data processing. Key Responsibilities: - Design and develop big data platforms - Utilize data processing technology stacks like Spark, HBase, Hive, and other Hadoop ecosystem technologies - Develop usin...

As a Big Data Architect, you will be responsible for designing and implementing scalable and reliable big data solutions. Your key responsibilities will include: - Demonstrating proficiency in Spark, Scala, Hadoop MapReduce/HDFS, PIG, HIVE, and AWS cloud computing. - Utilizing hands-on experience with tools such as EMR, EC2, Pentaho BI, Impala, ElasticSearch, Apache Kafka, Node.js, Redis, Logstash, statsD, Ganglia, Zeppelin, Hue, and KETTLE. - Sound expertise in Machine learning, Zookeeper, Bootstrap.js, Apache Flume, FluentD, Collectd, Sqoop, Presto, Tableau, R, GROK, MongoDB, Apache Storm, and HBASE. - Hands-on experience in Core Java & Advanced Java development. To qualify for this role, ...

a . 2 + years of experience in bigdata technologies like Pyspark , Hadoop , Trino , druid b. Strong experience on query Optimisation in Trino /Pyspark c. Strong hands on in Airflow / scheduler d. Expertise in python About the Role: Hands-on Data Engineers to build and maintain scalable data solutions and services . The role includes : a. Maintain , develop data engineering pipelines to ensure seamless data flow for BI applications b. Create data models to ensure seamless query system c. Develop or onboard opensource tools to make the data platform up to date d. Optimize queries and scripts over large-scale datasets (TBs) with a focus on performance and cost-efficiency e. Implement data gover...

Essential for this role: Education and Qualifications: • Bachelor’s degree in IT, Computer Science, Software Engineering, Business Analytics or equivalent. • Minimum seven plus years of experience in data analytics field • Experience with Azure/AWS Databricks • Experience in building and optimizing data pipelines, architectures and data sets • Excellent experience in Scala or Python, PySpark and SQL • Ability to troubleshoot and optimize complex queries on the Spark platform • Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques • Expertise in designing and deploying data applications on cloud solutions, such as Azure or AWS • Hands on...

Strong hands-on experience of at least 10+ years in Java/J2EE/Spring framework/Spring boot Experience with the following: Microservices architectures (using Spring boot / Micronaut / Ratpack / Quarkus) , Cloud-Native architectures, Event-driven architectures, APIs, Domain-Driven Design, Public Cloud (Google Cloud), Serverless, Kubernetes, Docker, DevOps, building scalable, reliable, available solutions, and/or performance testing. Strong technical background with the capability of being hands-on Conversant in multiple programming languages. Thorough knowledge of multi-threading, concurrency, and parallel processing concepts including scalability, performance, and consistency characteristics ...

What are we looking for? Seeking for a strong data analyst who can perform independent. Good to have Prior experience in banking domain is plus and understanding the finance various data transactions. Should be strong in the below: Python Pyspark SQL Airflow Trino Hive Offshore Cordination LLD Agile Scrum Linux Openshift Kubernentes Superset Optional skill set: Linux Openshift Kubernentes Superset Same Posting Description for Internal and External Candidates

Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implement version control an...

Key Responsibilities: Develop, configure, and optimize Apache DolphinScheduler workflows for data processing and automation. Design and implement ETL pipelines, job scheduling, and workflow orchestration solutions. Troubleshoot and resolve performance, scalability, and reliability issues in DolphinScheduler. Integrate DolphinScheduler with big data tools such as Hadoop, Spark, Flink, Hive, and Kafka. Work closely with data engineers, DevOps, and software teams to enhance workflow automation. Develop custom plugins and extensions for DolphinScheduler as needed. Monitor and optimize job execution, resource allocation, and workflow efficiency. Maintain best practices for CI/CD, version control,...

Description Strong knowledge in ETL testing using Big Data/DWH Core hands on testing skills in Bigdata ecosystem i.e. Hbase hive Solar Good knowledge of test data management process and test management tools like QC/ALM and Qtest Working knowledge of FRD BRD mapping documents based on requirements Understanding of Agile methodology Working knowledge of Azure devops boards and JIRA Strong knowledge on complex queries such as SQL HQL Knowledge of UNIX commands Knowledge of TOSCA is plus Knowledge of Putty and IBM data studio . Automation knowledge Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade B Level To Be Defined Named Job Posting? (if Yes - needs ...

Description Strong knowledge in ETL testing using Big Data/DWH Core hands on testing skills in Bigdata ecosystem i.e. Hbase hive Solar Good knowledge of test data management process and test management tools like QC/ALM and Qtest Working knowledge of FRD BRD mapping documents based on requirements Understanding of Agile methodology Working knowledge of Azure devops boards and JIRA Strong knowledge on complex queries such as SQL HQL Knowledge of UNIX commands Knowledge of TOSCA is plus Knowledge of Putty and IBM data studio . Automation knowledge Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade C Level To Be Defined Named Job Posting? (if Yes - needs ...

Key Responsibilities: Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implem...

Location Chennai and Hyderbad preferred but customer is willing to take resources from Hyderabad Experience 5 to 8 yrs ( U3 ). Exp - 5- 10 Yrs Location - Hyderabad / Chennai Location Proven experience as a development data engineer or similar role, with ETL background. Experience with data integration / ETL best practices and data quality principles. Play a crucial role in ensuring the quality and reliability of the data by designing, implementing, and executing comprehensive testing. By going over the User Stories build the comprehensive code base and business rules for testing and validation of the data. Knowledge of continuous integration and continuous deployment (CI/CD) pipelines. Famil...

SQL Budget -13$ /Hour (18 LPA) Location - Bangalore 3-5 years Primary skill is SQL we are looking for someone with expertise in SQL, advanced SQLbasic working knowledge of Python, Shell scriptinggood to have Airflow and MDM conceptsNeed to work from Bangalore office of customer few days from customer and few days remotely.Good knowledge on SQLbasic knowledge on Python, Shellgood to have Airflow and MDM concepts

Description Overall 10+ years of experience in Python and Shell Knowledge of distributed systems like Hadoop and Spark as well as cloud computing platforms such as Azure and AWS Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade B Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility No Global Role Family To be defined Local Role Name To be defined Local Skills Ruby;automation;Python Languages RequiredENGLISH Role Rarity To Be Defined

EXP 4 to 6 yrs Location Any PSL Location Rate below 14$ JD - DBT/AWS Glue/Python/Pyspark Hands-on experience in data engineering, with expertise in DBT/AWS Glue/Python/Pyspark. Strong knowledge of data engineering concepts, data pipelines, ETL/ELT processes, and cloud data environments (AWS) Technology DBT, AWS Glue, Athena, SQL, Spark, PySpark Good understanding of Spark internals and how it works. Goot skills in PySpark Good understanding of DBT basically should be to understand DBT limitations and when it will end-up in model explosion Good hands-on experience in AWS Glue AWS expertise should know different services and should know how to configure them and infra-as-code experience Basic ...

You will be a part of BPRISE Private Limited and play a crucial role in designing and developing high-volume, low-latency applications using Java and Spring framework. Your entrepreneurial spirit will be key to thriving in our dynamic start-up culture. - Design and develop high-volume, low-latency applications using Java and Spring framework. - Manage day-to-day programming tasks efficiently and meet target dates. - Lead and mentor a team of 3-5 developers if applying for the Tech Lead position. - Proactively identify new tasks and take ownership of them. - Collaborate with testing and other teams to resolve issues quickly and enhance efficiency. - Prioritize security and ensure safe operati...

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Strong proficiency in Java, Spring Framework, Spring boot, RESTful APIs, excellent understanding of OOP, Design Patterns. Strong knowledge of ORM tools like Hibernate or JPA, Java based Micro-services framew...

As a cloud Consultant you will serve as a client-facing practitioner who sells, leads and implements expert services utilizing the breadth of IBM's offerings and technologies. A successful Cloud Consultant is regarded by clients as a trusted business advisor who collaborates to provide innovative solutions used to solve the most challenging business problems. You will work developing solutions that excel at user experience, style, performance, reliability and scalability to reduce costs and improve profit and shareholder value. Your primary responsibilities includeArchitecting Modern SolutionsAnalyze the clients' legacy applications and surrounding systems, defining target application archit...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing streaming pipelines Exp...

As an Associate Software Developer at IBM, you'll work with clients to co-create solutions to major real-world challenges by using best practice technologies, tools, techniques, and products to translate system requirements into the design and development of customized systems Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Spring Boot, Java2/EE, Microsservices- Hadoop Ecosystem (HBase, Hive, MapReduce, HDFS, Pig, Sqoop etc) Spark Good to have Python Preferred technical and professional experience None

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...