17292 Hive Jobs - Page 31

Design scalable and secure data architecture on Databricks and AWS by working alongside the architect. Lead a team of data engineers and provide technical guidance. Oversee table migration from Hive/Impala tables to Delta Tables. Oversee conversion of HiveQL/Impala-based transformations to PySpark. Ensure adherence to best practices for performance, security, and cost optimization. Collaborate with stakeholders to define requirements and deliverables. Conduct code reviews, troubleshoot issues, and mentor team members.

Migrate Hive/Impala tables and associated metadata to Databricks Delta tables. Re-engineer ingestion pipelines from Cloudera to Databricks using PySpark. Convert transformation logic from HiveQL/Impala SQL to PySpark. Optimize data workflows for performance and scalability in Databricks. Implement best practices for data governance, security, and compliance on AWS.

Who You Are We are looking for an experienced Data engineer to join our data engineering team and help design, build, and optimize robust data pipelines and platforms that power our analytics, products, and decision-making. This role demands a strong foundation in big data technologies, excellent programming and SQL skills, and hands-on experience in tuning and optimization for large-scale data processing. You will work closely with data scientists, analysts, product managers, and other engineers to build scalable, efficient, and reliable data solutions. What Youll Do Design, develop, and maintain scalable big data pipelines using Spark (Scala or PySpark), Hive, and HDFS. Build and manage da...

Staff Data Engineer Hypersonix.ai is disrupting the e-commerce space with AI, ML and advanced decision capabilities to drive real-time business insights. Hypersonix.ai has been built ground up with new age technology to simplify the consumption of data for our customers in various industry verticals. Hypersonix.ai is seeking a well-rounded, hands-on product leader to help lead product management of key capabilities and features. We are looking for talented and driven Data Engineers at various levels to work with customers to build the data warehouse, analytical dashboards and ML capabilities as per customer needs. Roles and Responsibilities: Create and maintain optimal data pipeline architec...

Job Title: Female Digital Marketing Executive Company: Green Hive Properties Pvt Ltd Green Hive Properties Pvt Ltd, a leading asset management and hospitality-related company, is seeking a talented Female Digital Marketing Executive to join our dynamic team. In this role, you will play a pivotal role in enhancing our digital presence across various platforms, including social media, website management, and Google Ads. If you're ready to make an impact and thrive in a fast-paced environment, we want to hear from you! Responsibilities: Social Media Management: Develop and execute comprehensive social media strategies to elevate the Green Hive Properties brand across multiple platforms. Social ...

Big Data and Cloud Data Engineer - Officer Who we are looking for Role Overview A Data Engineer in the cloud is primarily responsible for designing, building, and managing scalable data infrastructure and pipelines. They work to ensure that data is accessible, reliable, and processed efficiently for various business needs. This role involves a mix of software engineering, data warehousing, and big data technologies. The key responsibilities include developing, constructing, testing, and maintaining data architectures (such as databases and large-scale processing systems). They are also responsible for aligning these architectures with business requirements, ensuring data quality and governan...

DESCRIPTION As a Data Engineer, You will be working on building and maintaining complex data pipelines, assemble large and complex datasets to generate business insights and to enable data driven decision making and support the rapidly growing and dynamic business demand for data. You will have an opportunity to collaborate and work with various teams of Business analysts, Managers, Software Dev Engineers, and Data Engineers to determine how best to design, implement and support solutions. You will be challenged and provided with tremendous growth opportunity in a customer facing, fast paced, agile environment. Key job responsibilities Design, implement and support an analytical data platfor...

Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are seeking for thr role of HIVE developer/Consultant Specialist In ...

Python Data Engineer: - Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from various sources and storage systems. Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements. Leading the implementation of algorithms and prototypes to transform raw data into useful information. Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI/ML transformations. Creating innovative data validation methods and data analysis tools. Ensuring compliance w...

Job Title : Data Engineer Location: Gurugram, Haryana Experience: 3-5 Years Role Overview : We are seeking a skilled Data Engineer with experience in designing, building, and optimizing big data solutions to meet business and technology needs. The ideal candidate will have a strong background in Hadoop, Hive, Spark, and Python/Java , with proven expertise in handling large-scale datasets, implementing data governance best practices, and ensuring data quality across all layers. Key Responsibilities: Design, develop, and maintain scalable big data pipelines and architectures to support business and analytical needs Build and optimize data processing systems using technologies such as Hadoop, H...

Python Data Engineer: - Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure for efficient ETL processes from various sources and storage systems. Collaborating closely with Product Managers and Business Managers to design technical solutions aligned with business requirements. Leading the implementation of algorithms and prototypes to transform raw data into useful information. Architecting, designing, and maintaining database pipeline architectures, ensuring readiness for AI/ML transformations. Creating innovative data validation methods and data analysis tools. Ensuring compliance w...

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Associate Managing Consultant, Advisors & Consulting Services, Performance Analytics Associate Managing Consultant – Performance Analytics Advisors & Consulting Services Serv...

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Associate Managing Consultant, Advisors & Consulting Services, Performance Analytics Associate Managing Consultant – Performance Analytics Advisors & Consulting Services Serv...

Core Responsibilities Design, develop, test, and maintain cross-platform mobile applications using Flutter and Dart Build high-performance, scalable, and reusable UI components Translate UI/UX designs and wireframes into responsive mobile interfaces Ensure smooth app performance across Android and iOS devices Application Development Implement state management solutions (Provider, Riverpod, Bloc, GetX, etc.) Integrate RESTful APIs , third-party libraries, and backend services Handle local storage , databases (SQLite, Hive), and cloud services (Firebase) Implement authentication , push notifications, and in-app features Code Quality & Testing Write clean, maintainable, and well-documented code...

Job Title: SAP BW4HANA Job Grade (refer to JE) Manager 1 / Manager 2 Function: IT Sub-function: IT Manager’s Job Label: G9A Location: Sun House, Mumbai No. of Direct Reports (if any) - Business Unit: IT Job Summary We are searching for skilled SAP BW / BW4HANA Developer and Data engineer to join our dynamic team. The role involves working closely with business stakeholders to understand business requirement and translating them into technical specifications and ensure successful deployment. Areas Of Responsibility BW4HANA information model development. Major experience in end to end implementation of SAP data warehouse platform Hands-on experience in BW application area like SD, MM , PP, VC ...

ALM Services with Data warehouse skills The Mastercard Account Level Management platform empowers real-time card level decisioning As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend Role o Develop high quality, secure and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO o Leverage technologies and solutions to innovate with increasingly large data sets o Drive automation and efficiency in Data ingestion, data movement and data access w...

All About You Experience in data management, data mining, data analytics, data reporting, data product development and quantitative analysis Financial Institution or a Payments experience a plus Experience presenting data findings in a readable and insight driven format, Experience building professional PowerPoint decks. Expertise in Advanced SQL coding Experience on Platforms/Environments: SQL Server, Microsoft BI Stack, Python Experience on SQL Server Integration Services (SSIS), SQL Server Analysis Services (SSAS) and SQL Server Reporting Services (SSRS) will be an added advantage Experience in building data models a plus Experience with data visualization tools such as Tableau, PowerBI, ...

About Amex You Lead the Way. We’ve Got Your Back. With the right backing, people and businesses have the power to progress in incredible ways. When you join Team Amex, you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers, communities and each other. Here, you’ll learn and grow as we help you create a career journey that’s unique and meaningful to you with benefits, programs, and flexibility that support you personally and professionally. At American Express, you’ll be recognized for your contributions, leadership, and impact—every colleague has the opportunity to share in the company’s success. Together, we’ll win as a team, stri...

Description As a Data Engineer, You will be working on building and maintaining complex data pipelines, assemble large and complex datasets to generate business insights and to enable data driven decision making and support the rapidly growing and dynamic business demand for data. You will have an opportunity to collaborate and work with various teams of Business analysts, Managers, Software Dev Engineers, and Data Engineers to determine how best to design, implement and support solutions. You will be challenged and provided with tremendous growth opportunity in a customer facing, fast paced, agile environment. Key job responsibilities Design, implement and support an analytical data platfor...

Description As a Data Engineer, You will be working on building and maintaining complex data pipelines, assemble large and complex datasets to generate business insights and to enable data driven decision making and support the rapidly growing and dynamic business demand for data. You will have an opportunity to collaborate and work with various teams of Business analysts, Managers, Software Dev Engineers, and Data Engineers to determine how best to design, implement and support solutions. You will be challenged and provided with tremendous growth opportunity in a customer facing, fast paced, agile environment. Key job responsibilities Design, implement and support an analytical data platfor...

About Us At Thoucentric, we offer end-to-end consulting solutions designed to address the most pressing business challenges across industries. Leveraging deep domain expertise, cutting-edge technology, and a results-driven approach, we help organizations streamline operations, enhance decision-making, and accelerate growth. We are headquartered in Bangalore with presence across multiple locations in India, US, UK, Singapore & Australia Globally. We help clients with Business Consulting, Program & Project Management, Digital Transformation, Product Management, Process & Technology Solutioning and Execution including Analytics & Emerging Tech areas cutting across functional areas such as Suppl...

DESCRIPTION Whole Foods Market is seeking an Data Engineering Manager to lead the ownership and technical evolution of a mission-critical enterprise analytics and operational platform that powers WFM's core business operations across Finance, Merchandising, Pricing, Supply Chain, and Marketing. As the Data Engineering Manager for Enterprise Data Platform, you will lead an 8-person engineering team responsible for platform operations, system reliability, and continuous improvement of this complex ERP system that serves 1,600+ active users across 43 business-critical applications. You'll own end-to-end platform health—from 24/7 incident response and production support to architectural evolutio...

About the Role We are looking for a highly skilled Data Engineer to design, build, and maintain robust data pipelines and scalable data infrastructure. You will work closely with analytics, product, and engineering teams to enable high-quality data availability for business insights, machine learning, and operational processes. This role is ideal for an engineer who enjoys solving complex data problems, optimizing systems, and ensuring clean, reliable data flows. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using modern data engineering tools. Build and optimize data lakes, data warehouses, and streaming architectures . Work with large and complex datasets to...

Description Job Description : Senior Data Engineer - SMC Global Securities About The Role We're seeking a Senior Data Engineer to join our team at SMC Global Securities. In this role, you will be crucial in building and maintaining the data infrastructure that powers our financial services and trading platforms. You will work with a diverse tech stack to handle massive volumes of real-time and historical financial data, ensuring that our analytics, research, and business teams have access to high-quality, reliable information to support our brokerage, wealth management, and advisory services. Responsibilities You will be responsible for designing, governing, and evolving the core data infras...

We are seeking a Data Architect with deep experience designing and implementing scalable, secure, and high-performance cloud data platforms. Ideal candidates will have solid Databricks expertise, strong knowledge of Azure data services, and hands-on architecture experience building modern data ecosystems including big data, metadata management, and enterprise-grade data governance. The Data Architect will collaborate closely with customers to define architectural blueprints, guide engineering teams, and ensure robust data solutions that support analytics, reporting, and advanced AI workloads. Key Responsibilities Design and lead end-to-end architecture for complex cloud-based data ecosystems...