17292 Hive Jobs - Page 40

Design & Develop Transformations aspects using the ELT framework to modernize the Ingestion pipelines and build data transformations at scale Work closely with other data teams & Data Science teams and participate in the development of Ingestion pipelines Provide technical expertise in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and Spark Build and maintain a data environment for speed, accuracy, consistency, and up time Work closely with other data teams & Data Science teams and participate in the development of Ingestion pipelines Ensure data governance principles are ad...

We are seeking a big data engineer with advance Java experience to join our modernization initiative team. The candidate will be responsible for implementing and maintaining high volume online and offline batch and transactional client facing applications in cloud and On-prem. Candidate will also responsible for the creation and maintenance of our Code & database infrastructure, including collecting and maintaining data, ensuring the integrity of our data, and training data models Minimum 8 to 10 years of experience in Spring boot, Advanced Java and Spark. Bachelors degree or higher in computer science, data science, or a related field. Hands-on experience with data cleaning, visualisation, ...

Location - Hyderabad/Bangalore/Gurugram/Pune/Mumbai Work type: Remote but physical onboarding will be conducted & candidate needs to visit office in 3 to 6 month for conference Key Points Must Have Advanced Java proficient- Microservices Spring boot Writing SQL Queries (proficient) AWS 4-5 Yrs in Java, - Spark Good to have Unix Shell scripting JD Minimum of 8 years of experience in building complex Data Platforms and Data Engineering solutions. Minimum of 6 years of hands on experience in architecture and development of data solutions in AWS environment using AWS Services Experience with big data technologies such as: Spark, EMR, Hadoop, Hive, Experience programming with at least one modern ...

Primary Skills Design and develop on Hadoop applications Hands-on in developing Jobs in pySpark with Python/ SCALA (Preferred) or Java/ SCALA Experience on Core Java, Experience on Map Reduce programs, Hive programming, Hive queries performance concepts Experience on source code management with Git repositoriesSecondary Skills Exposure to AWS Ecosystem with hands-on knowledge of ec2, S3 and services Basic SQL programming Knowledge of agile methodology for delivering software solutions Build scripting with Maven / Cradle, Exposure to Jenkins

We are seeking a big data engineer with advance Java experience to join our modernization initiative team. The candidate will be responsible for implementing and maintaining high volume online and offline batch and transactional client facing applications in cloud and On-prem. Candidate will also responsible for the creation and maintenance of our Code & database infrastructure, including collecting and maintaining data, ensuring the integrity of our data, and training data models Minimum 8 to 10 years of experience in Spring boot, Advanced Java and Spark. Bachelors degree or higher in computer science, data science, or a related field. Hands-on experience with data cleaning, visualisation, ...

This is a remote position. We are seeking a big data engineer with advance Java experience to join our modernization initiative team. The candidate will be responsible for implementing and maintaining high volume online and offline batch and transactional client facing applications in cloud and On-prem. Candidate will also responsible for the creation and maintenance of our Code & database infrastructure, including collecting and maintaining data, ensuring the integrity of our data, and training data models Minimum 8 to 10 years of experience in Spring boot, Advanced Java and Spark. Bachelors degree or higher in computer science, data science, or a related field. Hands-on experience with dat...

This is a remote position. Engagement: Freelance Role Overview The Ab Initio Administrator will be responsible for ensuring the stability, performance, and security of the organizations Ab Initio ETL platform. This role involves managing Ab Initio environments, monitoring system health, performing deployments, handling issues, and supporting production workflows. Key Responsibilities Install, configure, and maintain Ab Initio environments Administer end-to-end ETL job execution, scheduling, and performance tuning Handle break-fix issues, root cause analysis, and production support Set up and manage Ab Initio Control Center (ECC) and monitoring alerts Manage Metadata Hub, Conduct>IT, Co>Op sy...

Experience : 4.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Hybrid () Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers' client - Aletha Health) What do you need for this opportunity? Must have skills required: Flutter, iOS, mobile development Aletha Health is Looking for: Job Description: Senior Flutter Developer – Aletha Health Company Overview: Aletha Health is dedicated to freeing individuals from pain caused by muscle tension through innovative, drug-free solutions. Our products offer effective alternatives to medication and invasive procedures, empowering users to achieve a p...

About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. WHY JOIN CAPCO? You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry. MAKE AN IMPACT Inno...

Job Description Bachelor’s degree with 2-6 years of proven experience in Python Strong programming skills in Python. Hands-on experience with PySpark, Spark SQL, and distributed data processing. Good understanding of ETL processes, data wrangling, and performance tuning in Spark. Experience with SQL, data lakes, and big data tools (e.g., Hadoop, Hive – optional). Familiarity with version control (Git), workflow orchestration tools (e.g., Airflow), and cloud platforms (AWS/GCP/Azure – optional). Strong analytical thinking, problem-solving skills, and ability to work in Agile teams.

Job Description Key Responsibilities: We are seeking a data-savvy professional with 6+ years of experience in Python and SQL, who also brings 2–3 years of direct client engagement experience. This role bridges technical data work with consultative client delivery, ideal for someone who can drive insights and manage stakeholder expectations. Write efficient, production-grade Python scripts for data extraction, transformation, and automation tasks. Design and optimize SQL queries to analyze large, complex datasets across multiple sources (Presto Server, Hive, Spark, etc.). Develop and maintain reusable ETL pipelines using Python libraries such as pandas, sqlalchemy, or Airflow or any tools ava...

Job Description We are looking for a senior data scientist in the PayU intelligence team who will be primarily responsible for modeling complex problems, discovering insights, and identifying opportunities through the use of statistical, algorithmic, mining, and visualization techniques. Your primary focus will be to propose innovative ways utilizing graph databases and analytics to look at the problems by applying data mining techniques, doing statistical analysis, validating your findings using an experimental and iterative approach, and building high-quality prediction systems integrated with our services. You will need strong business understanding, analytical and problem-solving skills,...

Discover your future at Citi Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact. Job Overview About CITI Citi's mission is to serve as a trusted partner to our clients by responsibly providing financial services that enable growth and economic progress. We have 200 years of experience helping our clients meet the world's toughest challenges and embrace its greatest opportunities. Analytics and Information Management (AIM) Citi AIM was established in 2003, and is located across multiple cities ...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. How will you make an impact in this role? Launched in 2012, Amex Offers is a digital advertising platform that connects Merchants and brands with the tens of milli...

We are looking for an Offshore Data engineer with database architecture design experience as well. 7+ years of software development and deployment experience with hands-on experience with SQL, Datastage (or other ETL tool), experience with BI tools (tableau, Cognos, thoughtspot) is a plus. Experience with Databricks, Azure is a must. Experience in analyzing huge datasets, identify trends, patterns, and outliers to extract meaningful insights Strong experience with data modeling, design patterns, building highly scalable Business Intelligence Solutions and distributed applications Knowledge of cloud platforms, for example: Experience with storing, joining, filtering, and analyzing data using ...

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Consultant –Performance Analytics Consultant – Performance Analytics Advisors & Consulting Services Services within Mastercard is responsible for acquiring, engaging, and ret...

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Associate Managing Consultant, Strategy & Transformation Overview: Associate Managing Consultant – Performance Analytics Advisors & Consulting Services Services within Master...

We are seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines and solutions in a cloud environment. This individual contributor role requires strong expertise in AWS services (IAM, EMR Serverless, Glue, Athena), advanced PySpark skills, and a solid understanding of data warehousing techniques. The ideal candidate will have experience in modern ETL frameworks and cloud-native data engineering practices. Familiarity with visualization tools like Power BI is a plus but not mandatory. You will work on building robust, secure, and high-performance data platforms that enable analytics and business intelligence across the organization. Key Responsibilities Interpretin...

Ready to build the future with AI? At Genpact, we don’t just keep up with technology—we set the pace. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies’ most complex challenges. If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what’s possible, this is your moment. Genpact (NYSE:...

Strong Python programming skills. Experience in workflow orchestration using Apache Airflow. Experience in productionizing machine learning models in Domino run-time environment. Experience in building data pipelines using Python and PySpark. Strong SQL skills and experience in extracting data from different databases (Hive, SnowFlake, etc.), performing data transformation, etc. Preferable experience working with Hadoop ecosystem - HDFS, Hive. Experience working with a job scheduler, preferably Control-M. Experience with Unix-based command line interface and Bash scripts. Experience in developing and querying APIs - Restful, OpenAPI, etc. Strong understanding of DevOps and CI/CD principles; ...

Job Description Experience in PySpark, Hive, and HBase. Proficiency in integrating, transforming, and consolidating data from various structured and unstructured data sources. Good experience in SQL or native SQL query languages. Good experience in PySpark, Hive, HBase, and Hadoop. Exposure to basic issues in working within Big Data clusters. Desired Skills Big Data Hadoop Python Spark Apache Spark Qualifications Bachelor of Technology.

Required Technical Skill Set: Bigdata, Hadoop, Apache, Spark, Hive, Scala, Kafka Must-Have: Prior experience of working with HDFS Hive/HQL Shell Scripting Spark Arcadia Kafka Daily status reporting Attending scrum calls Good to Have: Good communication skills Good in troubleshooting Agile knowledge is a must Good team player Minimum Qualification: 15 years of full-time education Minimum percentile of 50% in 10th, 12th, UG & PG (if applicable)

Overall minimum 6+ years of post-college working experience as a developer in Big Data, Hadoop, or Data Warehousing Tools, with Cloud Computing as an added skill. Minimum 3+ years of experience with Hadoop, Hive SQL, Spark, and Big Data ecosystem tools. Preferable to have good technical knowledge of Cloud Computing, AWS, or Azure Cloud Services. Strong conceptual and creative problem-solving skills, ability to work with considerable ambiguity, and ability to learn new and complex concepts quickly. Experience working with teams in a complex organization involving multiple reporting lines. The candidate should be able to tweak queries and work on performance enhancement. The candidate will be ...

Spark/Scala - Job Description Qualifications: Bachelor of Engineering Desired Skills: Scala, Spark, Unix Must-Have Skills Minimum 4+ years of experience in development of Spark Scala. Experience in designing and developing solutions for Big Data using Hadoop ecosystem technologies such as HDFS, Spark, Hive, Parquet File format, YARN, MapReduce, Sqoop. Good experience in writing and optimizing Spark jobs, Spark SQL, and handling both batch and streaming data processing. Experience in writing and optimizing complex Hive and SQL queries to process large datasets, including proficiency with UDFs, tables, joins, and views. Experience in debugging Spark code. Working knowledge of basic UNIX comman...

Key Technical Skills: AWS tools (Redshift, Glue, EMR, Athena, StepFunction, CloudFormation, CloudWatch) Programming languages: SQL, Python, Pyspark Data Pipelining skills Data blending Big data technologies: Hadoop, Hive Data Ingestion and Integration: Ingest data from various sources such as databases, files, APIs, and streaming platforms into Azure. For example, use Azure Data Factory to orchestrate the extraction, transformation, and loading (ETL) of data from an on-premises SQL Server database to Azure Blob Storage. Data Transformation and Processing: Perform data transformation and processing tasks to prepare the data for analysis and reporting. Azure Databricks or Azure Synapse Analyti...