14271 Hive Jobs - Page 15

Should have strong experience in ETL testing with 6 to 9 years Should be strong in SQL query writing Experience with data warehousing and ETL processes Proficiency in Hadoop, Spark, and Hive Knowledge of SQL and NoSQL databases Experience with data warehousing and ETL processes This role involves working closely with data engineers, data analysts, and other stakeholders to ensure the accuracy, efficiency, and reliability of big data systems and applications

Engineering Manager - Data Engineering Experience: 6-14 Years Salary: Competitive Preferred Notice Period: Upto 45 Days Opportunity Type: Office (Noida) Placement Type: Full-time Note: This is a requirement for one of Uplers' Clients Nuaav: Must have skills: Azure OR synapse OR Data Factory OR Databricks OR Data lake OR Azure Data Lake AND Spark OR Python OR CI - CD AND Hive OR Scala About Nuaav: Nuaav is a boutique technology consulting firm focused on delivering innovative, scalable, and secure data engineering and AI solutions. We partner with corporate clients to drive impactful change through specialized expertise in product engineering, data systems, AI/ML, and user experience. Our ser...

Engineering Manager - Data Engineering Experience: 6-14 Years Salary: Competitive Preferred Notice Period: Upto 45 Days Opportunity Type: Office (Noida) Placement Type: Full-time Note: This is a requirement for one of Uplers' Clients Nuaav: Must have skills: Azure OR synapse OR Data Factory OR Databricks OR Data lake OR Azure Data Lake AND Spark OR Python OR CI - CD AND Hive OR Scala About Nuaav: Nuaav is a boutique technology consulting firm focused on delivering innovative, scalable, and secure data engineering and AI solutions. We partner with corporate clients to drive impactful change through specialized expertise in product engineering, data systems, AI/ML, and user experience. Our ser...

Job Title: Senior Data Engineer (Kafka & AWS) Responsibilities: Develop and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services . Configure and manage Kafka connectors , ensuring seamless data flow and integration across systems. Demonstrate strong expertise in the Kafka ecosystem , including producers, consumers, brokers, topics, and schema registry. Design and implement scalable ETL/ELT workflows to efficiently process large volumes of data. Optimize data lake and data warehouse solutions using AWS services such as Lambda, S3, and Glue . Implement robust monitoring, testing, and observability practices to ensure reliability and performance of data platf...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Job Description Job Summary: We are looking for a proactive and technically strong Lead Gen AI Engineer 10+ years exp to lead a high-performing offshore team working on Gen AI solutions in the real estate domain. This role requires close collaboration with the Gen AI Architect and direct accountability for delivery, technical execution, and mentoring the team across various Gen AI initiatives. Key Responsibilities: - Lead the offshore team in developing, testing, and deploying Gen AI and NLP-based applications. - Collaborate closely work with the Lead Architect to translate high-level designs into actionable workstreams. - Develop and guide the team on best practices in GPT-based development...

Why Join Us Expleo is a trusted partner for end-to-end, integrated engineering, quality services and management consulting for digital transformation. We are a talent incubator. The time you spend at Expleo will turbo-charge your career, allowing you to work on complex technical challenges, enjoy opportunities to expand your skills and take part in inspiring, multi-disciplinary collaborations with your colleagues. Whether working on autonomous vehicles, green planes, the factories of tomorrow or cutting edge banking technology, you will have the opportunity to become a bolder version of yourself. Let’s change the game together. We are looking for a Senior Business Analyst to join our dynamic...

Immediate Joiners Only Job Title: GCP Big Data Engineer Location: Bangalore / Gurugram Experience: 4–12 years About the Role We are seeking a GCP Big Data Engineer with strong expertise in building, optimizing, and managing large-scale data solutions on Google Cloud Platform (GCP) . The ideal candidate will have hands-on experience in GCP Big Data services , PySpark , SQL , and ETL design , along with the ability to lead and deliver complex data engineering initiatives. Key Responsibilities Design, develop, and maintain scalable and efficient data pipelines using GCP Big Data technologies. Implement ETL workflows using PySpark , SQL , and GCP-native services . Drive architecture discussions ...

We are looking for a passionate and detail-oriented Software Engineer to join our Big Data / Data Warehouse (DWH) / ETL team. The ideal candidate should have a strong understanding of data systems, data processing pipelines, and an interest in large-scale data analytics. Fresh graduates with relevant academic projects or training in data engineering are also welcome to apply. Responsibilities Design, develop, and maintain ETL pipelines for efficient data extraction, transformation, and loading. Work with Big Data technologies (Hadoop, Spark, Hive, etc. ) to process and analyse large datasets. Develop and maintain data warehouse models and ensure data integrity and consistency. Optimise and t...

Role: Senior Analyst Location: Bengaluru WHAT YOU’LL DO We’re MiQ, a global programmatic media partner for marketers and agencies. Our people are at the heart of everything we do, so you will be too. No matter the role or the location, we’re all united in the vision to lead the programmatic industry and make it better. As part of DnA team, you will work as an independent individual contributor who is an analytics expert with technical proficiency. You will be responsible for bringing new analytics ideas and innovation to the campaign optimization strategies, KPI reporting, automation, and QBR/Insights. You will also be the face of the project execution team to build cutting-edge technical to...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics - D and A – AWS DBX - Staff As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for Managers (GT...

Engineering Manager – Data Engineering Experience: 6-14 Years Salary: Competitive Preferred Notice Period: Upto 45 Days Opportunity Type: Office (Noida) Placement Type: Full-time Note: This is a requirement for one of Uplers' Clients Nuaav: Must have skills: Azure OR synapse OR Data Factory OR Databricks OR Data lake OR Azure Data Lake AND Spark OR Python OR CI - CD AND Hive OR Scala About Nuaav: Nuaav is a boutique technology consulting firm focused on delivering innovative, scalable, and secure data engineering and AI solutions. We partner with corporate clients to drive impactful change through specialized expertise in product engineering, data systems, AI/ML, and user experience. Our ser...

As AWS Data Engineer at organization, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives You will design and maintain scalable data pipelines using AWS data analytical resources, enabling efficient data processing and analytics. Key Responsibilities: - Highly experiences in developing ETL pipelines using AWS Glue and EMR with PySpark/Scala. - Utilize AWS services (S3, Glue, Lambda, EMR, Step Functions) for data solutions. - Design scalable data models for analytics and reporting. - Implement data validation, quality, and governance ...

Description: Proficiency/good understanding in at least couple of the following:Ab Initio SQL Data Modelling / relationships RDBMS Hadoop Machine Learning algorithms Ensure consistency in approach design and output to deliver quality and concise design solution documentation. Lead best practice methodology for design Define promote re-usable extendible scalable maintainable solution considering tradeoff for cost vs benefit Communicate at all levels in a clear and credible way about the importance of solution design. Lead developers in the team and foster a shared vision for design. Knowledgeable and skilled at the practice of data driven design solutions. Expert communications to all levels ...

Description: Proficiency/good understanding in at least couple of the following:Ab Initio SQL Data Modelling / relationships RDBMS Hadoop Machine Learning algorithms Ensure consistency in approach design and output to deliver quality and concise design solution documentation. Lead best practice methodology for design Define promote re-usable extendible scalable maintainable solution considering tradeoff for cost vs benefit Communicate at all levels in a clear and credible way about the importance of solution design. Lead developers in the team and foster a shared vision for design. Knowledgeable and skilled at the practice of data driven design solutions. Expert communications to all levels ...

Description: Skills: Proficiency in SQL is a must. PL/SQL to understand integration SP part. Experience in PostgreSQL is must. Basic knowledge of Google Cloud Composer ( or Apache Airflow). Composer is managed GCP service for Apache Airflow. All pipelines are orchestrated and scheduled through Composer GCP basics-high level understanding of using GCP UI and services like Cloud SQL PostgreSQL Cloud Composer Cloud Storage Dataproc Airlfow DAGs are written in Python basic knowledge of Python code for DAGs Dataproc is Managed Spark in GCP so a bit of PySpark knowledge is also nice to have. Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be ...

Description: Objective:Build and maintain data pipelines and infrastructure to support data storage and processing. Key Responsibilities: -Design develop and optimize data pipelines using Azure Databricks. -Ensure data reliability scalability and quality. -Integrate data sources into a unified platform. -Monitor and troubleshoot data workflows. Skills Required: -Expertise in Azure Databricks Spark and big data tools. -Strong programming skills (e.g. Python Scala SQL). -Knowledge of ETL processes and cloud technologies. -Familiarity with CI/CD practices for data pipelines Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be Defined Named J...

Description: 1. Job Summary:We are seeking a C2 Level skilled HVR Administrator to join our team for a critical data migration project at GE Vernova. The successful candidate will be responsible for overseeing the migration of data from GE's OneStream ERP system to a new data lake using HVR (High Volume Replication). This role involves the initial installation and configuration of HVR on a new instance, ensuring seamless data replication and integration. 2.Key Responsibilities:HVR Installation and Configuration:Install and configure HVR on the new instance. Set up HVR hub, channels, and locations for data replication. Data Migration:Plan and execute the migration of data from OneStream ERP t...

Description Primary Skill Kafka Cluster Management,Kafka admin,Kubernetes,Helm ,DevOps, Jenkins Secondary Skill:Grafana, Prometheus, Dynatrace Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade C Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility No Global Role Family To be defined Local Role Name To be defined Local Skills Kafka Cluster Management;Kubernetes Languages RequiredENGLISH Role Rarity To Be Defined

To ensure successful initiation, planning, execution, control and completion of the project by guiding team members on technical aspects, conducting reviews of technical documents and artefacts. Lead project development, production support and maintenance activities. Fill and ensure timesheets are completed, as is the invoicing process, on or before the deadline. Lead the customer interface for the project on an everyday basis, proactively addressing any issues before they are escalated. Create functional and technical specification documents. Track open tickets/ incidents in queue and allocate tickets to resources and ensure that the tickets are closed within the deadlines. Ensure analysts ...

Description Job Summary Role Value Proposition MetLife Data & Analytics organization is the team of expert technologists responsible for building big data platforms and data services with innovative technologies to enable MetLife businesses to generate insights and value to its customers. The team is the center of excellence in data engineering in MetLife and plays a key role in data enablement through multiple data stores supporting different kind of analytical use cases to be able to derive predictive prescriptive and descriptive insights. The Azure Data Engineer III serves as big data development expert within the data analytics engineering organization of MetLife Data & Analytics. This p...

Description Key Responsibilities Analyse raw data from various source files (e.g. EXCEL CSV JSON XML Parquet etc.) to identify formatting issues inconsistencies missing values and discrepancies. Use PySpark to transform clean and restructure source data to match the expected format for further processing and analysis. Apply data validation rules and data quality checks to correct issues related to data integrity including handling null values duplicate records and data type mismatches. Develop PySpark jobs to transform raw data into standardized formats (e.g. converting date formats normalizing text fields correcting encoding issues). Ensure that data transformations meet the required schema...

Location Hyd / Pune / Bengaluru JD 1ETL, Pyspark Experience4 8 years Proven experience as a development data engineer or similar role, with ETL background. Experience with data integration / ETL best practices and data quality principles. Play a crucial role in ensuring the quality and reliability of the data by designing, implementing, and executing comprehensive testing. By going over the User Stories build the comprehensive code base and business rules for testing and validation of the data. Knowledge of continuous integration and continuous deployment (CI/CD) pipelines. Familiarity with Agile/Scrum development methodologies. Excellent analytical and problem solving skills. Strong communi...

Title / Role No of Pos About The Role Must Skills Yrs of Exp Location Work Timings Scala+spark scala+spark/play+hive+cicd+cloud(aws perfered or any other cloud) and sql, candidate should be good with advanced programming language (scala) Scala,(either spark or play),sql & cloud(aws preferred) 5+yr Hyderabad WFO

Description Key job responsibilities include, but are not limited to Become involved with day-to-day operations in Production Control. Understand the workflows and be able to troubleshoot issues and define new workflows in PCS and Control-M Design Airflow infrastructure according to the industry best practices. Work with System Administrators, Platform Engineers, Network, Firewall and Monitoring teams on the implementation of the infrastructure. Document the system's specifics, define, and implement administrative controls and policies of Airflow. Work with the development teams to identify the groups of jobs to migrate to airflow. Assist the development teams with the migrationsdefine DAGs,...