1356 Hbase Jobs - Page 5

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL

We are looking for a skilled Team Lead - Data Engineer with 6-8 years of experience to join our team in the Employment Firms/Recruitment Services Firms industry. The ideal candidate will have a strong background in data engineering and excellent leadership skills. Roles and Responsibility Design, develop, and implement large-scale data pipelines and architectures. Lead a team of data engineers to deliver high-quality results. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain technical documentation for data systems and processes. Troubleshoot and resolve complex technical issues related to data engineering. Mentor and guide ...

We are looking for a skilled Tech Lead with 7-11 years of experience to join our team in the Employment Firms/Recruitment Services Firms industry. The ideal candidate will have a strong background in Pyspark and be able to lead teams effectively. Roles and Responsibility Design, develop, and implement scalable data processing solutions using Pyspark. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and resolve complex technical issues related to Pyspark. Mentor junior team members and provide guidance on best practices. Participate in code reviews and ensu...

We are looking for a skilled PySpark Architect with 8 to 13 years of experience to join our team in India. The ideal candidate will have a strong background in designing and implementing scalable data processing architectures using PySpark. Roles and Responsibility Design and develop scalable data processing architectures using PySpark. Collaborate with cross-functional teams to identify business requirements and design solutions. Develop and maintain large-scale data pipelines using PySpark. Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks. Optimize data processing workflows for performance, scalability, and reliability. Mentor junior...

We are looking for a skilled Senior Pyspark Developer with 5-9 years of experience to join our team in India. The ideal candidate will have expertise in developing scalable data processing pipelines using Pyspark. Roles and Responsibility Design, develop, and deploy large-scale data processing pipelines using Pyspark. Collaborate with cross-functional teams to identify business requirements and design solutions. Develop and maintain complex data transformations and data quality checks. Optimize pipeline performance and troubleshoot issues. Ensure compliance with industry standards and best practices. Participate in code reviews and contribute to improving overall code quality. Job Requiremen...

We are looking for a skilled Project Manager with 10-20 years of experience to lead our Big Data team in India. The ideal candidate will have a strong background in managing large-scale projects and leading teams. Roles and Responsibility Manage and deliver high-quality results on complex Big Data projects. Lead and motivate a team of professionals to achieve project goals. Develop and implement project plans, resource allocation, and risk management strategies. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure timely delivery of projects while maintaining quality standards. Identify and mitigate potential risks and issues impacting project succe...

We are looking for a skilled Senior Big Data Developer with 5-9 years of experience to join our team in India. The ideal candidate will have expertise in big data development and analysis. Roles and Responsibility Design, develop, and implement big data solutions using various technologies. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain large-scale data pipelines and architectures. Ensure data quality, integrity, and security. Optimize big data systems for performance and scalability. Stay updated with industry trends and emerging technologies. Job Requirements Strong understanding of big data concepts, including Hadoop, ...

We are looking for a skilled Team Lead with 6-8 years of experience to join our team in the Big Data domain. The ideal candidate will have a strong background in leading teams and driving business growth through data-driven insights. Roles and Responsibility Develop and implement big data strategies to drive business growth and improvement. Lead cross-functional teams to design, develop, and deploy big data solutions. Collaborate with stakeholders to identify business problems and develop data-driven solutions. Design and implement data governance frameworks to ensure data quality and integrity. Develop and maintain technical documentation for big data systems and processes. Provide training...

We are looking for a skilled Tech Lead - Big Data with 7-11 years of experience to join our team in India. Roles and Responsibility Design and implement big data solutions using various technologies. Lead the development team in building scalable and efficient big data systems. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data pipelines and architectures. Ensure high-quality code and adhere to industry standards. Mentor junior team members and provide technical guidance. Job Requirements Strong experience in big data technologies such as Hadoop, Spark, and NoSQL databases. Proven track record of le...

We are looking for a skilled Big Data Architect with 8 to 13 years of experience to join our team in India. The ideal candidate will have a strong background in designing and implementing large-scale data systems. Roles and Responsibility Design and develop scalable big data architectures to support business intelligence and analytics. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain technical documentation for big data systems and processes. Ensure compliance with industry standards and best practices for big data management. Provide technical leadership and guidance to junior team members on big data technologies. Participate in ...

Key activities Mandatory Skills: Location: Bangalore/Hyderabad Databricks: Expertise in design jobs and workloads. Proficiency in pyspark / scala for data manipulation, transformation and analysis o Optimization of Databricks clusters and notebooks. Python: Hands-on experience in automation and scripting. Cloudera: Strong knowledge of Spark, Hive, Impala, HDFS, Kafa, HBase and Cluster management. Palantir: Hands on experience with analytics, data fusion and developing analytical workflows DevOps Basics: Familiarity with Jenkins CI/CD pipelines. Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda Communication: Excellent verbal and written communi...

Role Overview: As a test engineer at Arista Networks, you will be responsible for testing and validating complex cloud infrastructure and services that power WiFi networks. You will play a crucial role in ensuring that the WiFi networks perform at scale and meet the highest standards of reliability, security, and efficiency. Working closely with cross-functional teams, you will contribute to the design, development, and execution of comprehensive test plans for cloud-based WiFi solutions, ultimately delivering industry-leading products. Key Responsibilities: - Lead the testing efforts on the cloud infrastructure supporting WiFi networks, ensuring scalability, performance, and resilience in v...

As an experienced professional with over 7+ years of experience in Noida, your role will involve the following key responsibilities: - Reviewing and understanding business requirements to ensure timely completion of development tasks with minimal defects - Collaborating with a software development team to implement best practices and enhance the performance of Data applications for meeting client needs - Engaging with various teams and customers to translate their business challenges into innovative solutions - Conducting research on new Big Data technologies to align them with the business and technology strategy - Operating within a rapid and agile development process to accelerate speed t...

JD : KAfka: Design and develop Kafka/Kafka connectors data pipelines and integration solutions. Implement and manage Kafka producers, consumers, topics, and partitions. Integrate Kafka with external systems (e.g., databases, APIs, cloud services). Optimize Kafka performance for throughput, latency, and reliability. Collaborate with DevOps, data engineering, and application teams. Monitor and troubleshoot Kafka clusters and streaming applications. Ensure data security, compliance, and governance in Kafka implementations. Maintain documentation for Kafka configurations, schemas, and processes. Mandatory Skills: Kafka Integration. Experience: 5-8 Years.

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Your role and responsibilities As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the worlds technology leader. Come to IBM and make a global impact Responsibilities: Responsible to manage end to end feature development and resolve challenges faced in impl...

JD:- Total Yrs. of Experience* 6+ Relevant Yrs. of experience* 6+ Detailed JD *(Roles and Responsibilities) 6+ years experience in Kafka, Spark, Scala ,Pyspark Strong knowledge of implementing and maintaining scalable streaming and batch data solutions with high throughput and strict SLA. Extensive experience of working in production with Kafka, Spark and Kafka Stream including best practices, observability, optimization, performance tuning. Knowledge of Python and Scala including best practices, architecture, dependency management Collaborate with cross-functional teams to understand data requirements and integrate data from multiple sources, ensuring data consistency and quality Mandatory ...

What will you do? Design and development of complex systems, large-scale enhancements from start to finish Design, develop, and implement robust, high volume applications using Java, SQL, NoSQL, Spring, Hadoop and other related technologies Work independently to determine methods and procedures on new or special assignment to find solutions to complex problems. Identify appropriate risks and develop mitigation plan. Create re-useable processes that help implement each solution. Work with stakeholders to understand the business needs and gather requirements to develop appropriate applications. Prepare business and technical documentation. Research market to identify upcoming technology to imp...

Hi, We have positions for Data Scientist role - Airoli - WFO (5 DAYS) JD: Key Responsibilities: Develop and maintain data pipelines using Hadoop ecosystem. Build and maintain Spark SQL applications for big data processing and analysis. Use Tableau to visualize data, create dashboards, and extract insights from Hadoop data. Optimize data processing performance, including query optimization and data storage strategies. Collaborate with other engineers and stakeholders to understand data requirements and deliver solutions. Troubleshoot and resolve issues related to data processing and visualization. Stay up to date with the latest technologies and best practices in the field. A Hadoop Administr...

Common Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow Experience on Spark/Hive/HDFS,Data modeling for Data conversion Resources (4) Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills Common Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow Experience on Spark/Hive/HDFS Data modeling for Data conversion Resources (4) Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills Data Engineer - Knows HR Knowledge , all other requirement from Functional Area given by UBER

Role & responsibilities Overall, 6 to 8 years of experience in IT Industry. Min 6 years of experience working on Data Engineering. Design and develop solution in combination of Cloudera, Palantir and Databricks. Develop Python-based automation scripts to optimize workflows and processes. Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda Define architecture for data-driven solutions. Provide solutioning for web applications and data pipelines. Solutioning data analytics requirements with Palantir. Stay updated with emerging technologies and quickly adapt to new tools and frameworks. Work with CI/CD pipelines. Ensure scalability, security, and pe...

Role Overview: DataWeave is a leading provider of advanced sales optimization solutions for Digital Commerce businesses, consumer brands, delivery intermediaries, and marketplaces. The Products team at DataWeave focuses on building data products that provide timely insights that are readily consumable and actionable at scale. As a member of the team, you will be responsible for the quality of code, delivering solutions into production, training and mentoring developers, working with technical project management, and providing technical leadership to multiple teams of software engineers. Key Responsibilities: - Take full responsibility for the quality of code and ensure solutions are delivere...

Project description Information and Document Systems is a global technology change and delivery organization comprising nearly 200 individuals located mostly in Switzerland, Poland, and Singapore. Providing global capturing and document processing, archiving, and retrieval solutions to all business divisions focusing on supporting Legal, Regulatory, and Operational functions. Responsibilities Design, implement, and manage data solutions on Azure Develop and maintain data pipelines using Databricks Ensure efficient data storage and retrieval using Azure Storage and Data Lake Automate infrastructure and application deployments with Ansible Write clean, maintainable code in Python Collaborate w...

Looking for a skilled professional with expertise in Spark and Delta Lake to join our team. The ideal candidate will have 7-12 years of experience. Roles and Responsibility Design and implement data pipelines using Spark and Delta Lake as the data storage layer. Develop and optimize Spark applications using Python, Scala, or Java. Work with large datasets to ensure data quality and integrity. Implement data partitioning and schema evolution techniques using Delta Lake. Collaborate with cross-functional teams to integrate Spark applications with ETL processes. Troubleshoot and resolve issues related to Spark application performance and data quality. Job Requirements Strong understanding of Sp...

Big data engineer/Developer Spark-Scala HQL, Hive Control-m Jinkins Git Technical analysis and up to some extent business analysis (knowledge about banking products, credit cards and its transactions) Notice Period: Immediate . Employment Type: Contract