14333 Hive Jobs - Page 45

Overview Prodapt is looking for senior data engineers having 3+ years of experience having hands on expertise on GCP, BQ, Data Pipeline creation & ETL. Responsibilities Understanding the requirements Performing in-depth analysis on data Setting up secure data pipelines from ingestion to delivery Individual contributor Requirements 3- 5 years of experience in Data Engineering with strong ability to work independently, communicate effectively, and deliver high-quality solutions. Should have strong SQL programming skills. Experience in cloud-based systems (GCP, BQ) is must. Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues. Expertise...

Overview Design and implement complex ETL/ELT pipelines using PySpark and Airflow for large-scale data processing on GCP.Lead data migration initiatives, including automating the movement of Teradata tables to BigQuery, ensuring data accuracy and consistency. Develop robust frameworks to streamline batch and streaming data ingestion workflows, leveraging Kafka, Dataflow, and NiFi. Collaborate with data scientists to build ML-ready data layers and support analytics solutions. Conduct proof of concepts (POCs) and document performance benchmarking for data throughput and velocity, ensuring optimized data workflows. Enhance CI/CD pipelines using Jenkins and GitLab for efficient deployment and mo...

Job Summary: We are looking for a Big Data Engineer with strong expertise in Apache Spark and Scala to design, develop, and optimize large-scale data processing solutions. The ideal candidate will have hands-on experience with distributed data systems, ETL development, and modern data engineering tools. Key Responsibilities: Design and develop data ingestion, transformation, and processing pipelines using Apache Spark (Core, SQL, Streaming) and Scala . Build scalable and reliable big data solutions on distributed platforms such as Hadoop, Databricks, or EMR . Optimize Spark jobs for performance and scalability . Work closely with data architects, analysts, and business teams to define data r...

Location: Bangalore - Karnataka, India - EOIZ Industrial Area Job Family: Engineering Worker Type Reference: Regular - Permanent Pay Rate Type: Salary Career Level: T3(A) Job ID: R-49123-2025 Description & Requirements Introduction: A Career at HARMAN Automotive We’re a global, multi-disciplinary team that’s putting the innovative power of technology to work and transforming tomorrow. At HARMAN Automotive, we give you the keys to fast-track your career. Engineer audio systems and integrated technology platforms that augment the driving experience Combine ingenuity, in-depth research, and a spirit of collaboration with design and engineering excellence Advance in-vehicle infotainment, safety,...

Job Summary: We are seeking an experienced ML Data Scientist to design, develop, and deploy machine learning models that solve complex business problems and deliver measurable outcomes. The ideal candidate will possess strong analytical skills, deep understanding of statistical and ML techniques, and hands-on experience in model development and deployment in production environments. Key Responsibilities: Understand business objectives and translate them into data-driven solutions . Design, develop, and implement machine learning models, algorithms, and predictive analytics . Perform data cleaning, preprocessing, feature engineering , and exploratory data analysis (EDA). Evaluate model perfor...

Job Summary: We are looking for an experienced GCP Data Engineer to design, build, and optimize data pipelines and solutions on the Google Cloud Platform (GCP) . The ideal candidate will have deep expertise in BigQuery, Dataflow, Dataproc , and other GCP data services, along with strong programming and analytical skills. Key Responsibilities: Design and develop scalable data pipelines and ETL workflows using GCP services such as BigQuery, Dataflow, Dataproc, Composer, and Pub/Sub . Build and maintain data lakes, data warehouses, and analytics solutions on GCP. Collaborate with data scientists, analysts, and stakeholders to deliver clean, reliable, and structured datasets . Implement data ing...

Role: Lead Engineer (Python +ML OPS) Location: Chennai & Bangalore Experience: 7+ Years Skills: Java, Python & GoLang + MLOPs & BigData Responsibilities : Overall experience of 10+ years with proven track record of over-achieving engineering, platform delivery and scaling targets in high volume, innovative and fast-paced high-pressure environment; proven results in delivery on platform products. Solid proficiency in programming languages such as Python, Go and Java Experience with cloud platforms (e.g., GCP, AWS, Azure) and containerization technologies (e.g., Docker, Kubernetes) Experience with Vertex AI, Jupyter Notebook, Airflow, Kubeflow, Argo, GPU and HPC. Knowledge of GPU optimization ...

Overview Join the Prodapt team in building a unified, cloud-native environment for scalable machine learning training and experimentation. You will help design, develop, and optimize robust workflows that empower data scientists and engineers to efficiently explore, train, and validate ML models at scale. Responsibilities Overall experience of 10+ years with proven track recordof over-achieving engineering, platform delivery and scaling targets in highvolume, innovativeand fast-paced high-pressureenvironment; proven results in delivery on platform products. Solid proficiency in programming languages such as Python, Go and Java Experience with cloud platforms (e.g., GCP, AWS, Azure) and conta...

Job Title: Data Engineer Location: Bangalore/ Chennai Experience: 6 to 9 yrs Job Summary: We are looking for a highly skilled PySpark and Scala Developer with hands-on experience in building and optimizing large-scale data processing systems using Apache Spark . The ideal candidate will have a deep understanding of distributed computing, data transformations, and performance tuning, along with strong programming and problem-solving skills. Key Responsibilities: Design, develop, and maintain data pipelines using Apache Spark (PySpark & Scala) for large-scale data processing. Implement data ingestion, cleansing, transformation, and aggregation workflows from various structured and unstructured...

We are seeking a skilled Data Engineer (Good exposure in Power BI) to design, build, and optimize scalable data pipelines and infrastructure. The ideal candidate will work closely with data analysts, data scientists, and business stakeholders to ensure data is reliable, accessible, and efficient for analytics and decision-making. Key Responsibilities Design, develop, and maintain robust ETL/ELT pipelines for structured and unstructured data. Build and manage data warehouses, data lakes, and real-time data platforms . Ensure data quality, consistency, and security across all data systems. Optimize database performance and implement best practices for scalability and reliability . Collaborate ...

Job Title: Hadoop Administrator Location: Chennai, India Experience: 4+yrs of experience in IT, with At least 3+ years of experience with cloud and system administration. At least 3 years of experience with and strong understanding of big data technologies in Hadoop ecosystem Hive, HDFS, Map/Reduce, Flume, Pig, Cloudera, HBase Sqoop, Spark etc. Company: Smartavya Analytica Private limited is a niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects acr...

About KPI Partners: KPI Partners is seeking a highly skilled and experienced Senior ODI Consultant to join our dynamic team. The ideal candidate will possess extensive knowledge and expertise in Oracle Data Integrator (ODI) and will be responsible for designing, implementing, and optimizing ETL processes to support our clients' data integration needs. Key Responsibilities: - Design and develop ETL processes using Oracle Data Integrator to facilitate seamless data integration between various sources and targets. - Conduct requirements gathering sessions to understand client needs and translate them into technical specifications. - Optimize existing ODI processes for performance and scalabilit...

Job Summary The role of a Manager on the FCSO TM PMM team is that of an individual contributor and involves primarily on change management related to watchlist and thresholds. It involves working with volumes of confidential data on watchlist/thresholds across all products handled at FCSO – Mantas, Trade AML, FSS, CCAML and FMTPP. It also involves usage of scripts on a routine basis to get desired output and working with oracle/hive environments for data. Apply analytical skills to identify anomalies and provide insight on the AML behaviour in relation to changes in watchlist/threshold management. The role is a global role that cuts across geographies and products of the Bank which are subje...

Job Summary Techno-Functional Product Owner ideal candidate will have a Strong mix of business acumen and technical expertise in the field of credit scoring and credit bureau integration across retail, private, business banking. This role requires collaboration with WRB Platform & Domain & Development Organization. Key Responsibilities Strategy Design and execute the product roadmap for credit scoring and credit evaluation Align the credit evaluation and scoring solutions with regulatory requirements, industry standards and business objectives. Stay updated on emerging trends in credit evaluation models and government credit scoring agencies across markets Aim to consolidate the functionalit...

Role & responsibilities Work as a project manager to Lead the design and evolution of our large-scale data lakehouse architecture, ensuring it is scalable, reliable, and cost-effective. Provide technical leadership and mentorship to data engineers and analysts. Collaborate closely with Software Engineers, and business stakeholders to understand requirements and deliver effective data solutions. Experience in data modelling, data mapping, data profiling and meta data management. Architect and tune high-performance data processing pipelines. Identify and resolve complex performance issues in distributed computing environments involving Spark execution, Hive query optimization, and Iceberg meta...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. How will you make an impact in this role? The Commercial Portfolio Products Development team (CPPD), within Global Commercial Services, is focused on designing and...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. Function Description: Global Commercial Services (GCS) accounts for nearly 50% of American Express’ card spend. GCS continues to be a fast-growing business within ...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Salary: 25 to 40 LPA Exp: 5 to 10 years Location: Bangalore/Hyderabad/Pune/Gurgaon Notice: Immediate only..!! Key Skills: SQL, Advance SQL, BI tools, ETL etc Roles and Responsibilities Extract, manipulate, and analyze large datasets from various sources such as Hive, SQL databases, and BI tools. Develop and maintain dashboards using Tableau to provide insights on banking performance, market trends, and customer behavior. Collaborate with cross-functional teams to identify key performance indicators (KPIs) and develop data visualizations to drive business decisions. Desired Candidate Profile 6-10 years of experience in Data Analytics or related field with expertise in Banking Analytics, Busin...

Salary: 20 to 35 LPA Exp: 3 to 8 years Location: Pune/Bangalore/Gurgaon(Hybrid) Notice: Immediate only..!! Key Skills: SQL, Advance SQL, BI tools etc Roles and Responsibilities Extract, manipulate, and analyze large datasets from various sources such as Hive, SQL databases, and BI tools. Develop and maintain dashboards using Tableau to provide insights on banking performance, market trends, and customer behavior. Collaborate with cross-functional teams to identify key performance indicators (KPIs) and develop data visualizations to drive business decisions. Desired Candidate Profile 3-8 years of experience in Data Analytics or related field with expertise in Banking Analytics, Business Intel...

Develop and migrate data pipelines using Spark, Python/Scala. Move Hive and Control-M jobs to Airflow/DBT. Integrate with Kafka, Solace, S3, MinIO, and deploy on Kubernetes ensuring scalable, automated, production-ready solutions. Required Candidate profile Experienced Data Engineer (6–9 yrs) with strong Spark, Python/Scala, and SQL skills. Hands-on in Airflow, DBT, Kafka, Kubernetes, and data lakehouse tools.Capable of independent delivery and migration

Salary: 20 to 35 LPA Exp: 3 to 8 years Location: Gurgaon(Hybrid) Notice: Immediate only..!! Key Skills: SQL, Advance SQL, BI tools etc Roles and Responsibilities Extract, manipulate, and analyze large datasets from various sources such as Hive, SQL databases, and BI tools. Develop and maintain dashboards using Tableau to provide insights on banking performance, market trends, and customer behavior. Collaborate with cross-functional teams to identify key performance indicators (KPIs) and develop data visualizations to drive business decisions. Desired Candidate Profile 3-8 years of experience in Data Analytics or related field with expertise in Banking Analytics, Business Intelligence, Campai...

Overview Job Summary: We are looking for a skilled GCP Data Engineer with 3 to 6 years of experience to join our dynamic team. The ideal candidate will have a strong background in data engineering, cloud technologies, and experience with Google Cloud Platform (GCP) services. You will be responsible for designing, building, and maintaining scalable data pipelines and frameworks that support our data analytics and machine learning initiatives. Key Responsibilities: Design and implement data pipelines using GCP services such as BigQuery, Dataflow, and Pub/Sub. Collaborate with data scientists and analysts to understand data needs and deliver appropriate solutions. Optimize data storage and proc...

Overview Join the Prodapt team in supporting a unified, scalable, and secure Jupyter-based environment for data science and machine learning. You will help build, maintain, and optimize the platform that empowers analysts, engineers, and scientists to explore data, develop models, and collaborate at scale. Responsibilities Overall experience of 5 years with proven track record of over-achieving engineering, platform delivery and scaling targets in highvolume, innovativeand fast-paced high-pressureenvironment; proven results in delivery on platform products. Solid proficiency in programming languages such as Python, Go and Java Experience with cloud platforms (e.g., GCP, AWS, Azure) and conta...

We are seeking a skilled Data Engineer with strong experience in SQL, PySpark, and cloud technologies to join our dynamic team. The ideal candidate will have a solid background in designing and implementing data engineering pipelines, with a focus on performance, scalability, and reliability. You will work closely with other data engineers, data scientists, and stakeholders to develop, maintain, and optimize data infrastructure. Key Responsibilities : SQL Development : - Write medium-complexity SQL queries to extract, transform, and load data efficiently. - Optimize SQL queries for performance and scalability. - Collaborate with team members to understand data requirements and translate them...