17292 Hive Jobs - Page 23

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: * Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. * Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. * Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education ...

At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities,collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client"s challenges of today and tomorrow.Informed and validated by science and data. Superpowered by creativity and design. All underpinned by technology created with purpose. Your Role Design and develop generative AI-based multi-agent systems that can collaborate, communicate, and coordinate to achieve complex objectives Architect and implement RAG-based chatbot solutions that effectively leverage knowledge bases an...

About The Role Data engineers are responsible for building reliable and scalable data infrastructure that enables organizations to derive meaningful insights, make data-driven decisions, and unlock the value of their data assets. About The Role - Grade Specific The role involves leading and managing a team of data engineers, defining and executing the data engineering strategy, and ensuring the effective delivery of data solutions. They provide technical expertise, drive innovation, and collaborate with stakeholders to deliver high-quality, scalable, and reliable data infrastructure and solutions.

Your Role Pyspark Data Engineer As a Pyspark developer you Must have 2+ years in Pyspark. Strong programming experience, Python, Pyspark, Scala is preferred. Experience indesigning and implementing CI/CD, Build Management, and Development strategy. Experience with SQL and SQL Analytical functions, experience participating in key business, architectural and technical decisions Scope to get trained on AWS cloud technology Your Profile Pyspark SQL Data Engineer What you will love about working here Choosing Capgemini means having the opportunity to make a difference, whether for the worlds leading businesses or for society. It means getting the support you need to shape your career in the way t...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Job Description We are seeking a skilled Data Engineer with over 5+ years of experience to design, build, and maintain scalable data pipelines and perform advanced data analysis to support business intelligence and data-driven decision-making. The ideal candidate will have a strong foundation in computer science principles, extensive experience with SQL and big data tools, and proficiency in cloud platforms and data visualization tools. Responsibilities Key Responsibilities: Exp: 5+ years Design, develop, and maintain robust, scalable ETL pipelines using Apache Airflow, DBT, Composer (GCP), Control-M, Cron, Luigi, and similar tools. Build and optimize data architectures including data lakes ...

Looking for a java developer who has coding experience in building API's and got some experience from observability background. Well versed with tools like Grafana, Splunk. Exposure to big data bases impala/time series (Victoria metrics). Familiarity with streaming/data platforms (Kafka, Flink, Spark).

Job Description We are seeking a skilled Data Engineer with over 5+ years of experience to design, build, and maintain scalable data pipelines and perform advanced data analysis to support business intelligence and data-driven decision-making. The ideal candidate will have a strong foundation in computer science principles, extensive experience with SQL and big data tools, and proficiency in cloud platforms and data visualization tools. Responsibilities Key Responsibilities: Exp: 5+ years Design, develop, and maintain robust, scalable ETL pipelines using Apache Airflow, DBT, Composer (GCP), Control-M, Cron, Luigi, and similar tools. Build and optimize data architectures including data lakes ...

Azure Data Engineer Req number: R6811 Employment type: Full time Worksite flexibility: Hybrid Who we are CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise. Job Summary We are looking for a motivated Data Engineer ready to take us to the nex...

FinBox: Where Fintech Meets Fun! Welcome to FinBox, the buzzing hive of tech innovation and creativity! Since our inception in 2017, FinBox has built some of the most advanced technologies in the financial services space that help lenders like Banks, NBFCs and large enterprises build and launch credit products within a matter of days, not months or years. FinBox is a Series B funded company which is expanding globally with offices in India, Vietnam, Indonesia and Philippines. Our vision is to build the best-in-class infrastructure for lending products and help Banks & Financial Services companies across the world scale and launch credit programs that set a new standard in the era of digital ...

Job Details: Skill: Data Engineer Experience: 5+ Years Location: - PUNE Notice Period: Immediate Joiners Employee type : Full time Job Description: 5+ years of relevant experience in the field of Data Engineering Advance skills in big data technologies like Hadoop, Python, Spark, SQL. Must have experience building data APIs. Bachelors in Computer Science or related disciplines Knowledge of Data Structures and Algorithm. Strong Python programming skills with ability to implement OOPs and functional programming. Knowledge of Scala/Java would be plus. Strong knowledge on RDBMS and NoSQL databases with the ability to implement them from scratch. Knowledge of Graph databases will be a plus. Stron...

Data Engineer - PySpark ( Bulk hiring) Strong expertise in Apache Spark (batch + streaming) and Hive Proficiency in Python, Scala, or Java Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred) Experience working with Kafka, Solace, and object stores (S3, MinIO) Exposure to Docker/Kubernetes for deployment Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi)

Skill: Hadoop-hive, Pyspark, SQL and Unix 4.5 to 5.5 years experience as Data Engineering side using Big Data, Postgres, Spark skillsAbility to work as an independent developer Good in understand the tables structures and ability to write Complex SQL queries Good understanding on the DHW concepts and Basic knowledge on Unix/Shellscript Good in Written and communication skills Design end-to-end Data pipeline and optimize Data ingestion Pipelines and manage data flow to the upstream for consumption

Job Description – Data Architect (6–10 years) Role Summary We are looking for an experienced Data Architect with 6–10 years of expertise in data engineering, data management, and architecture. This role will define the strategy, design, and implementation of enterprise-scale data platforms, ensuring data availability, governance, security, and scalability across the organization. The Data Architect will collaborate with technology and business stakeholders to align data initiatives with strategic goals. Key Responsibilities ∙Define the enterprise data architecture roadmap, covering data modeling, integration, quality, and governance. ∙Architect and implement data platforms including data war...

Big data - Spark • Deep expertise in in k8s, OCP, and containerization • Understanding of IAM and security •Undestanding of Data and Governance best practices • Experince in defining and designing solutions at scale

Overview The Finance Data Engineering team focuses on empowering data-informed decisions through the development of scalable data products. Collaborating with data science and engineering teams, you will play a pivotal role in delivering valuable insights into financial data by developing robust pipelines, implementing data quality processes, creating conformed data models, and building effective visualizations. Joining our team means engaging with highly intelligent and straightforward colleagues. We thrive on posing challenging questions and encouraging one another to enhance our output continuously. While we value individual drive, we also emphasize collaboration. Our primary focus is on ...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, ...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, ...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, ...

Experience: Minimum 5 years as a Business Analyst or Data Analyst within financial services, focusing on data-intensive projects in Treasury, Market Risk, or Finance Technology. Core Expertise: Mandatory: Demonstrated ability to define data requirements, develop conceptual and logical data models, and create data flow diagrams. Mandatory: Strong proficiency in SQL for data profiling, analysis, reconciliation, and validation. Domain Knowledge: In-depth understanding of Treasury Securities, Bonds, Equities, and complex derivatives, particularly in relation to Initial Margin (IM) or Hedge Accounting. Data Requirements Expertise: Strong understanding of data needs for at least two of the followi...

Job Title: Manager-Decision Scientist Job Summary: Lead Enterprise Analytics team’s partnerships with Business teams across Tesco group to enable data driven decisions and deliver on organization's key strategic priorities and business impact. In this job, I’m accountable for: - Developing and leading a high performing team, creating an environment for success by setting direction and coaching them to succeed through inspiring conversations every day. (Refer to the expectations of a manager at Tesco- the minimum standards) - Initiates and designs continuous improvements initiatives to drive performance within their teams - Accountable for achieving teams objectives, stakeholder management an...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, ...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, ...

The team: Join the Recharges & Bill Payments Product team at Paytm, which touches millions of users daily across 26+ categories, including Mobile Recharges, Electricity Bills, DTH, Credit Card Bills, and FASTag. As a team, we operate at the intersection of scale, reliability, and innovation, constantly reimagining how India pays its bills. You''ll be part of a fast-paced, data-driven environment with end-to-end ownership, where every experiment and product improvement directly impacts user experience for millions. If you''re excited about solving complex problems at scale and building for Bharat, this is the place for you. the Role:- We are seeking an experienced Business Analyst to join our...