1356 Hbase Jobs - Page 9

About The Role Data Engineer Databricks & PySpark Location: Bangalore Experience: 69 years Your Role As a Data Engineer, you will play a key role in designing and implementing scalable data solutions using Databricks, PySpark, and other modern data technologies. Youll collaborate with cross-functional teams to deliver high-performance data pipelines and contribute to the success of data-driven initiatives. In this role, you will: Develop and optimize data pipelines using Databricks , PySpark , and Python . Write efficient and scalable SQL queries for data extraction and transformation. Collaborate with data architects and analysts to understand business requirements. Integrate data workflows...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

As a Developer in this role, you will be responsible for developing analytic tools and working on Big Data and Distributed systems. Your main focus will be providing technical leadership in developing the core Analytic platform. Your expertise in innovation, problem solving, analytical skills, data structures, and design patterns will play a crucial role in the success of this position. Key Responsibilities: - Demonstrating excellence in innovation, problem solving, analytical skills, data structures, and design patterns - Leading development efforts on product features using Scala and Java - Building applications using Spark and Spark Streaming - Working with NoSQL technologies such as HBas...

As a Senior Product Engineer located in Bengaluru, your primary responsibility will be product engineering, design, research, and development. You will utilize analytical skills and excellent communication to ensure smooth workflows and successful project outcomes. Key Responsibilities: - Help build a quality product adhering to best practices and coding standards as a full-stack engineer - Work on both the back-end and front-end of systems, developing fully-fledged platforms - Play a key role in the development of the core product, working directly with the Senior Engineers and Product team - Understand, evaluate, and deliver quality work products based on requirements - Be responsible and ...

Role Overview: As one of the most senior engineers in the team, you will play a crucial role in leading and mentoring teams of ML Engineers and Software Engineers. Your responsibilities will include deploying, monitoring, and maintaining Machine Learning models, as well as collaborating with cross-functional teams to drive successful project outcomes while ensuring optimal performance and reliability. Key Responsibilities: - Lead and mentor teams of ML Engineers and Software Engineers in building scalable AI systems - Deploy, monitor, and maintain Machine Learning models in production environments - Perform performance evaluations of the models and implement MLOps processes - Facilitate coll...

1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks 2 Ensure data pipelines run smoothly and efficiently 3 Developing scalable and re-usable frameworks for ingesting of data sets 4 Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times 5 Working with event based / streaming technologies to ingest and process data 6 Working with other members of the project team to support delivery of additional project components (API interfaces, Search) 7 Evaluating the performance and applicability of multiple tools against customer requirem...

As the Data Practice Head at our company, you will play a pivotal role in shaping and implementing our data strategy, fostering innovation, and establishing a high-performing data practice. Your role will require you to possess visionary leadership qualities along with a profound understanding of data management, analytics, and AI/ML technologies, complemented by a robust business acumen to align data endeavors with organizational objectives. It is imperative that you demonstrate proficiency in designing, developing, and delivering data solutions across the board. Key Responsibilities: - Define and execute the overarching strategy for the Data Practice in alignment with business goals. - Dri...

You will play a crucial role as a Cloud Database Administrator (DBA) with expertise in MySQL, Aurora, PostgreSQL, MongoDB, HBase, and Elastic Search, focusing on cloud-native DB solutions such as AWS, Azure, and GCP. Your responsibilities will include: - Designing, deploying, and managing Distributed SQL Database cluster solutions in cloud and hybrid environments, ensuring high availability, fault tolerance, and performance. - Migrating complex workloads from various RDBMS platforms to Distributed SQL Database solutions. - Analyzing and optimizing Distributed SQL Database solutions for performance, scalability, and system reliability. - Supporting sales in pre-sales activities, including cus...

Developing scalable data pipelines and streaming applications. Working with real-time data streams (Kafka). Processing large datasets using Spark. Building microservices or backend services in Java with Spring Boot. Ensuring data processing is efficient and reliable.

About Happiest Minds:** Happiest Minds is a leading digital transformation and technology services company, empowered by the mission of enhancing the happiness of our customers, employees, and society at large. We provide cutting-edge solutions leveraging advanced technologies to drive meaningful outcomes for our clients. Location: Manyata Tech Park. JD: Need someone with GCP + Looker / LookML experience Strong knowledge of data processing in GCP , Spark Deep understanding of Big Query architecture, best practices, and performance optimization. Experience with DataProc for running Hadoop/ Spark jobs on GCP. Proficiency in LookML for building data models and metrics. Knowledge of building rep...

Role Overview: As a Big Data Engineer at Micron Technology, you will play a crucial role in transforming information into intelligence, inspiring advancements in learning, communication, and innovation. Your responsibilities will include developing ETL/ELT processes, building APIs for application integration, determining transformation requirements, collaborating with Data Scientists, and optimizing the performance of big data and machine learning systems. Key Responsibilities: - Understanding of Big Data Engineering/processing, Business Intelligence, and Advanced analytics - Developing ETL/ELT processes - Knowledge in databases and Data warehouse modeling - Knowledge in Cloud-based data eng...

As a Technical Specialist, you will contribute to the development and enhancement of Network Management applications for Optical Transport, SDH/SONET, and Photonic/WDM networks. Your role will involve designing, coding, and maintaining high-quality software solutions that enable seamless network configuration, fault supervision, and performance monitoring. With expertise in Core Java, Spring, Kafka, Zookeeper, Hibernate, Python, and React, you will develop scalable applications while integrating advanced algorithms to optimize network management. You will also work with RDBMS, PL-SQL, Linux, Docker, and database concepts, with domain knowledge in OTN and Photonic network management as a valu...

Title and Summary Associate Managing Consultant, Advisors & Consulting Services, Performance AnalyticsAssociate Managing Consultant Performance Analytics Advisors & Consulting Services Services within Mastercard is responsible for acquiring, engaging, and retaining customers by managing fraud and risk, enhancing cybersecurity, and improving the digital payments experience. We provide value-added services and leverage expertise, data-driven insights, and execution. Our Advisors & Consulting Services team combines traditional management consulting with Mastercards rich data assets, proprietary platforms, and technologies to provide clients with powerful strategic insights and recommendations. ...

Overview This position is for Manager Data Engineering in the Commercial Data as a Service group. In this position you will enjoy being responsible for helping define and maintain the data systems key to delivering successful outcomes for our customers. will lead a software development team focused on our core services someone who combines deep technical experience with great people management skills and can help elevate our teams and our approach to engineering. We are building a culture that fosters innovation, built on a foundation of inclusion and diversity. We are looking for a candidate that has proven experience in coding, architecture leadership, and leading engineers in a fast-paced...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support through RfP responses, Solution Architecture, Planning and Estimation Contribute to reusable components / asset / accelerator development to support capability development Participate in Customer presentations as Platform Architects / Subject Matter Experts on Big Data, Azure Cloud and related technologies Participate in customer PoCs to deliver the outcomes Participate in delivery reviews / product review...

We are looking for a Manager Software Engineering to join our IMS Team in Bangalore . This is an amazing opportunity to work on Big Data technologies involved in content ingestion. The team consists of 10-12 engineers and is reporting to the Sr Manager. We have a great skill set in Spark, Java, Scala, Hive, Sql, XSLT, AWS EMR, S3, etc and we would love to speak with you if you have skills in the same. About You experience, education, skills, and accomplishments: Work Experience: Minimum 7 years experience in Big Data projects involved in content ingestion, curation, transformation Technical Skill: Databricks, Spark, Python/Java , Scala, AWS EMR, S3, SQS, Hive, XSLT, Education (bachelors degr...

1 Designing and implementing data ingestion pipelines from multiple sources using Azure Databricks 2 Ensure data pipelines run smoothly and efficiently 3 Developing scalable and re-usable frameworks for ingesting of data sets 4 Integrating the end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times 5 Working with event based / streaming technologies to ingest and process data 6 Working with other members of the project team to support delivery of additional project components (API interfaces, Search) 7 Evaluating the performance and applicability of multiple tools against customer requirem...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

Note- Associate "Already applied in NCS, will not be eligible" Role & responsibilities Essential for this role: Education and Qualifications: • Bachelors degree in IT, Computer Science, Software Engineering, Business Analytics or equivalent. • Minimum seven plus years of experience in data analytics field • Experience with Azure/AWS Databricks • Experience in building and optimizing data pipelines, architectures and data sets • Excellent experience in Scala or Python, PySpark and SQL • Ability to troubleshoot and optimize complex queries on the Spark platform • Knowledgeable on structured and unstructured data design / modelling, data access and data storage techniques • Expertise in designi...

Role Overview: You will be responsible for developing models to achieve business objectives and tracking their progress with metrics. Your role will involve developing scalable infrastructure for automating training and deployment of ML models, managing resources efficiently to meet deadlines, and creating data visualizations for better data comprehension. Additionally, you will brainstorm and design various POCs using ML/DL/NLP solutions, work with and mentor fellow Data and Software Engineers, and communicate effectively to understand product challenges. Key Responsibilities: - Understand business objectives and develop models to achieve them - Develop scalable infrastructure for automatin...