17292 Hive Jobs - Page 13

Role: Cloudera Technical Lead Experience: 6+ years Location: Vijayawada Key Responsibilities 1)Platform Ownership: Design, deploy, and maintain Cloudera CDP/CDH clusters (on-premises or cloud). Manage Cloudera Manager, parcels/packages, services, roles, and service configurations. Capacity planning: nodes, memory/CPU, disks, network, HA/DR. 2)Reliability & Performance: Tune YARN, Spark, Hive, Impala, and HDFS for performance and cost. Troubleshoot job failures, skew/shuffle, Name Node/Data Node issues, GC pauses. 3)Security & Governance: Implement Kerberos, TLS/SSL, Ranger/Sentry policies, KMS, encryption zones. Drive data governance (lineage, catalogs, metadata), compliance and access contr...

will include designing, programming, debugging and supporting high quality, distributed, and large-scale software solutions on the latest Big Data tech stack We are looking for a highly motivated data engineering professional whos a team player and can engage with both technical and business team members while mentoring/augmenting Jr and Lead Data Engineers on our growing team As a Senior Data Engineer at Target Data Engineering, youll take the lead as you Assess client needs and convert business requirements into business intelligence (BI) solutions roadmap relating to complex issues involving long-term or multi-work streams Analyze technical issues and questions identifying data needs and ...

Blis is looking for Senior Data Engineer to join our team Roles and Responsibility Design, develop, and implement data pipelines and architectures to support business intelligence and analytics. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems, ensuring scalability, reliability, and performance. Work closely with stakeholders to understand business needs and provide technical solutions. Ensure data quality, integrity, and security by implementing appropriate measures. Stay up-to-date with industry trends and emerging technologies in data engineering. Job Requirements Strong understanding of data modeling, d...

Target is looking for Sr Data Engineer Target India to join our team Roles and Responsibility Design, develop, and implement large-scale data pipelines and architectures. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain complex data models and databases. Ensure data quality and integrity by implementing data validation and testing procedures. Optimize data processing workflows for improved performance and efficiency. Troubleshoot and resolve technical issues related to data engineering projects. Job Requirements Strong understanding of data engineering principles and practices. Proficiency in programming languages such as Python or...

Identify product strategy for Cloud SQL Observability as Google navigates the AI landscape Work closely with engineering to deliver differentiated and delightful product experiences Work with Go-to-Market (GTM) teams to make customers successful and bring back actionable feedback Google is proud to be an equal opportunity workplace and is an affirmative action employer We also consider qualified applicants regardless of criminal histories, consistent with legal requirements See also Google's EEO Policy and EEO is the Law If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form

Bachelor’s degree with 2-6 years of proven experience in Python Strong programming skills in Python. Hands-on experience with PySpark, Spark SQL, and distributed data processing. Good understanding of ETL processes, data wrangling, and performance tuning in Spark. Experience with SQL, data lakes, and big data tools (e.g., Hadoop, Hive – optional). Familiarity with version control (Git), workflow orchestration tools (e.g., Airflow), and cloud platforms (AWS/GCP/Azure – optional). Strong analytical thinking, problem-solving skills, and ability to work in Agile teams.

Key Responsibilities: We are seeking a data-savvy professional with 6+ years of experience in Python and SQL, who also brings 2–3 years of direct client engagement experience. This role bridges technical data work with consultative client delivery, ideal for someone who can drive insights and manage stakeholder expectations. Write efficient, production-grade Python scripts for data extraction, transformation, and automation tasks. Design and optimize SQL queries to analyze large, complex datasets across multiple sources (Presto Server, Hive, Spark, etc.). Develop and maintain reusable ETL pipelines using Python libraries such as pandas, sqlalchemy, or Airflow or any tools available at client...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

Description: At least 3-5 years of experience in Pyspark with GCP (Airflow, Dataproc, Big query) capable of configuring data pipelines. Strong Experience in writing complex SQL queries to perform data analysis on Databases SQL server, Oracle, HIVE etc. Possess the following technical skills SQL, Python, Pyspark, Hive, ETL, Unix, Control-M (or similar scheduling tools) Ability to work independently on specialized assignments within the context of project deliverables Take ownership of providing solutions and tools that iteratively increase engineering efficiencies. Design should help embed standard processes, systems and operational models into the BAU approach for end-to-end execution of Dat...

Introduction A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide. You’ll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you’ll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You’ll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences. Your Role And Respons...

Position: Lead Analyst Category : Software Development/ Engineering Shift : Hybrid Education Qualification: Bachelors degree in computer science or related field or higher with minimum 6 years of relevant experience. Position Description: Works independently under limited supervision and applies knowledge of subject matter in Applications Development. Possess sufficient knowledge and skills to effectively deal with issues, challenges within field of specialization to develop simple applications solutions. Second level professional with direct impact on results and outcome. Your future duties and responsibilities: Development experience in data technologies Experienced with data wrangling and...

Title and Summary Software Engineer II (Bigdata / Spark / Apache / NIFI/ AirFlow / Unix / Oracle / Hadoop)OverviewMastercard is the global technology company behind the worlds fastest payments processing network We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless We ensure every employee has the opportunity to be a part of something bigger and to change lives We believe as our company grows, so should you We believe in connecting everyone to endless, priceless possibilities As a Test Engineer in Data Platform and Engineering Services, you will have the opportunity to build frameworks to perform t...

Skill: Spark Scala Experience : 4 to 9 Years Location : AIA – Pune Minimum 2 years of experience in application development. Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing. Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop. Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi. Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data. Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL. Knowledge of data warehousing concepts, dimensional modeling, and data lakes. Abili...

Note: Freelancers, agency owners, or profiles with experience will NOT be preferred. 𝓕𝓻𝓮𝓼𝓱𝓮𝓻𝓼 𝓞𝓷𝓵𝔂—𝓒𝓪𝓷𝓭𝓲𝓭𝓪𝓽𝓮𝓼 𝓦𝓲𝓽𝓱 𝓑𝓪𝓼𝓲𝓬 𝓚𝓷𝓸𝔀𝓵𝓮𝓭𝓰𝓮 𝓘𝓷 𝓖𝓸𝓸𝓰𝓵𝓮 & 𝓜𝓮𝓽𝓪 𝓐𝓭𝓼 𝓦𝓲𝓵𝓵 𝓑𝓮 𝓒𝓸𝓷𝓼𝓲𝓭𝓮𝓻𝓮𝓭. 𝓢𝓽𝓲𝓹𝓮𝓷𝓭 𝓤𝓹 𝓣𝓸 ₹10,000. Please read the JD before applying. Stipend: Up to ₹10,000 (Based on Skills & Performance) Work Mode: Work From Home About Us Boost Hive Marketing is a fast-growing digital marketing agency helping brands scale through performance-driven strategies. We specialize in Google Ads, Meta Ads, SEO, and ROI-focused online campaigns across multiple industries. Internship Role We are looking for a motivated and eager-to-learn Google & Meta Ads Intern who has basic knowledge of paid ads and wants to build a st...

We are seeking an experienced Lead Engineer with strong expertise in Spark, Scala, GCP, Python/PySpark, Shell Scripting and SQL to build and optimize large-scale data solutions in a cloud environment. • 8+ years of experience in Big Data and Data Engineering. • Strong hands-on expertise in Apache Spark (batch & streaming). • Proficiency in Scala, Python/PySpark, and Shell scripting. • Solid experience with GCP services (BigQuery, Dataproc, Airflow, etc.). • Advanced knowledge of Spark-SQL and SQL. • Understanding of distributed systems and performance optimization. Roles and Responsibilities • Design and develop scalable data pipelines using Apache Spark and PySpark. • Implement data process...

We are seeking an experienced Lead Engineer with strong expertise in Spark, Scala, GCP, Python/PySpark, Shell Scripting and SQL to build and optimize large-scale data solutions in a cloud environment. • 8+ years of experience in Big Data and Data Engineering. • Strong hands-on expertise in Apache Spark (batch & streaming). • Proficiency in Scala, Python/PySpark, and Shell scripting. • Solid experience with GCP services (BigQuery, Dataproc, Airflow, etc.). • Advanced knowledge of Spark-SQL and SQL. • Understanding of distributed systems and performance optimization. Roles and Responsibilities • Design and develop scalable data pipelines using Apache Spark and PySpark. • Implement data process...

Minimum 3+ years hands on exp on PySpark, Python, Hive and Cloudera (CDP) Design and Build data pipeline in PySpark using requirement document.Experience inAgile delivery Jira, Airflow, scheduling tool(CA7 and ControlM, Gitbit bucket, GenAI

Role - AWS Data EngineerStrong Experience Range 4-10 Years Hands-on experience in Python programming and PySpark · Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) · Experience working with Apache Spark and Hadoop ecosystem. · Experience in writing and optimizing SQL for data manipulations · Good Exposure to scheduling tools. Airflow is preferable. · Must – Have Data Warehouse Experience with AWS Redshift or Hive · Experience in implementing security measures for data protection. · Expertise to build/test complex data pipelines for ETL processes (batch and near real time) Location Delhi Job Function TECHNOLOGY Role Developer Job Id 386780 Desired Skills AWS | Python Desired C...

Job Summary: We are looking for an experienced ETL/SQL/Python Testing Engineer to design, develop, and execute test cases for data pipelines, ETL processes, and database systems. The ideal candidate should have strong expertise in SQL querying, ETL validation, Python scripting, and test automation to ensure data accuracy, completeness, and performance.Your future duties and responsibilities - Develop and execute ETL test cases to validate data extraction, transformation, and loading processes. - Has experience in ETL pipeline testing in ADB environment. - Write complex SQL queries to verify data integrity, consistency, and correctness across source and target systems. - Automate ETL testing ...

Education Qualification: Bachelor''s degree in Computer Science or related field or higher with minimum 3 years of relevant experience. Your future duties and responsibilities: 6+ years of experience . Experience in developing applications in JAVA . Scala with Spark . Hadoop & HIVE DevOps Secondary: . Cloud platforms like AWS or Azure Front end (React, Angular) . Python, PySpark Java and Spring/Spring Boot Skills: Apache Spark Database Java Banking Scala

JD for Data Engineer : Hiring : Mid-Level Data Engineer Location : Delhi Experience Required : 2-4 Year Job Type : Full-Time Key Skills Required : - Design, build, and maintain - Implement and enforce data modeling standards - Build data pipelines using a Medallion Architecture - Develop and optimize composable data architectures - Develop and optimize data transformation processes - Write and optimize complex SQL queries and Python scripts - Implement and orchestrate data workflows -Utilize AWS cloud services such as Lambda ,Glue ,S3 ,Athena and Redshift ,to build robust data solutions. Requirements -Strong proficiency in SQL and Python is a must, with a focus on data manipulation and analy...

Join our data engineering team to build scalable data pipelines and infrastructure We're looking for experienced professionals with expertise in distributed systems, cloud platforms, and big data technologies You'll work with cutting-edge tools to process and analyze massive datasets, collaborate with cross-functional teams, and help drive our data strategy forward Experience with Angular 6+ (preferred) as the product is being built with Angular If you know any other framework such as ReactJS, VueJS open to learn/switch to others when needed Benefits include performance-based bonus and stock options

Title: AWS Data Engineer Location: India/ Remote Shift Hrs: 7:30 pm to 3:30 am IST Description: We are searching for a Data Engineer who is a self-starter, fueled by collaboration, able to transform conceptual designs into reliable, scalable processes that meet or exceed customer needs. A person should be very good at analytical, problem solving and troubleshooting data pipelines root cause analysis and resolutions. Working with various Development team, Technology partners and business stakeholders to deliver unified and timely support, while upholding quality and resolution standards to fulfil the operational needs of our business stakeholders. Person should have : • 8 + Years of IT experi...

About the role Analyse complex data sets using Business Intelligence tools, data modelling techniques and Commercial Retail analytics expertise. Work across all functions irrespective of geography to support to define and solve business problems using Big data analytics. Make it consumable using visual storytelling and visualization tools such as reports and dashboards built using approved tools (Tableau, PyDash) You will be responsible for - Understands business needs and in depth understanding of Tesco processes- Builds on Tesco processes and knowledge by applying CI tools and techniques. - Responsible for completing tasks and transactions within agreed KPI's- Solves problems by analyzing ...

The team has built a Big Data Platform to ingest data from a variety of data sources, standardize metrics and build data & analytics products . Data and ML Platform engineering employs new-age technologies such as Distributed Computing constructs, Real Time model predictions, Deep Learning, Accelerated Compute (GPU); scalable feature stores Cassandra, MySQL, Elastic Search, Solr, Aerospike; scalable programming constructs in, Python and ML Frameworks (TensorFlow, Pytorch, etc). Roles and Responsibilities Drive the data architecture, data modelling, design, and implementation of data applications using standard open source big data tech stack, Data Warehouse / MPP databases and distributed sy...