14271 Hive Jobs - Page 9

4 to 10 years of hands-on data engineering experience. •Strong expertise in Apache Spark (batch + streaming) and Hive. •Proficiency in Python, Scala, or Java. •Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred). •Experience working with Kafka, Solace, and object stores (S3, MinIO). •Exposure to Docker/Kubernetes for deployment. •Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi). Interested can share your resume to uthirakumar.k@tekskills.in

68 years of hands-on data engineering experience. •Strong expertise in Apache Spark (batch + streaming) and Hive. •Proficiency in Python, Scala, or Java. •Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred). •Experience working with Kafka, Solace, and object stores (S3, MinIO). •Exposure to Docker/Kubernetes for deployment. •Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi). 4 to 5.11 years of hands-on data engineering experience. •Strong expertise in Apache Spark (batch + streaming) and Hive. •Proficiency in Python, Scala, or Java. •Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frame...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, ...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, ...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, ...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, ...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, ...

Job Title: Junior Software Engineer (Java / Big Data) Location: Pune, India (Onsite) Experience: 1–3 Years (Immediate Joiners Preferred) About the Role We are seeking a passionate and driven Junior Software Engineer to join our dynamic team in Pune. The ideal candidate should have hands-on experience with Java and Big Data technologies , excellent problem-solving skills, and a strong desire to learn and grow in a fast-paced technology environment. Key Responsibilities Develop, test, and maintain scalable software applications using Java and Big Data frameworks . Work closely with senior engineers to design and implement data processing pipelines and backend systems. Participate in code revie...

About The Role We are seeking an experienced Big Data & Azure Engineer to join our data platform team. This role is critical to supporting and optimizing our enterprise-scale data infrastructure, managing migrations from on-premises Big Data systems to Azure cloud services, and ensuring seamless 24x7 production operations. The ideal candidate will combine strong technical expertise in both traditional Big Data technologies and modern cloud platforms with excellent problem-solving abilities. Required Skills And Qualifications Technical Expertise : Strong experience in Big Data technologies (Hive, Impala). Hands-on experience with Azure services: Network, VMs, Synapse, Databricks. Proficiency ...

Roles & Responsibilities Key Responsibilities Analyze existing Hadoop, Pig, and Spark scripts from Dataproc and refactor them into Databricks-native PySpark. Implement data ingestion and transformation pipelines using Delta Lake best practices. Apply conversion rules and templates for automated code migration and testing. Conduct data validation between legacy and migrated environments (schema, count, and data-level checks). Collaborate on developing AI-driven tools for code conversion, dependency extraction, and error remediation. Ensure best practices for code versioning, error handling, and performance optimization. Participate in UAT, troubleshooting, and post-migration validation activi...

Roles & Responsibilities Key Responsibilities Lead design and execution of Dataproc ? Databricks PySpark migration roadmap. Define modernization strategy, including data ingestion, transformation, orchestration, and governance. Architect scalable Delta Lake and Unity Catalog–based solutions. Manage and guide teams on code conversion, dependency mapping, and data validation. Collaborate with platform, infra, and DevOps teams to optimize compute costs and performance. Own the automation & GenAI acceleration layer, integrating code parsers, lineage tools, and validation utilities. Conduct performance benchmarking, cost optimization, and platform tuning (Photon, Auto-scaling, Delta Caching). Men...

Job Description: Xiaomi India is seeking a highly skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining our data infrastructure to support our rapidly growing business needs. The ideal candidate will have expertise in Apache Iceberg, Apache Hive, Apache Hadoop, SparkSQL, YARN, HDFS, MySQL, Data Modeling, Data Warehousing, Spark Architecture, and SQL Query Optimization. Experience with Apache Flink, PySpark, Automated Data Quality testing & Data Migration is considered a plus. Also, it's mandatory to know any one cloud stack (AWS or Azure) for Data Engineering to Create Data Jobs and Workflows and Scheduler it ...

As a Big Data Developer at Unison Consulting Pte Ltd, you will play a crucial role in designing, developing, and maintaining big data solutions to enhance data-driven decision making and analytics capabilities for our clients. You will leverage cutting-edge technologies and platforms to work with large volumes of structured and unstructured data. Responsibilities: - Design, develop, and maintain big data solutions utilizing technologies like Hadoop, HDFS, Spark, and Hive. - Ingest, process, and analyze substantial amounts of structured and unstructured data from various sources. - Develop and optimize ETL processes to facilitate efficient data extraction, transformation, and loading. - Imple...

Role Overview: You will be joining the Advertising Optimization & Automation Science team at Wayfair as a Senior Machine Learning Scientist based in Bangalore. In this role, you will play a crucial part in building intelligent, ML-powered systems that drive personalized recommendations and campaign automation within Wayfair's advertising platform. Your work will involve collaborating with other scientists, as well as members of internal Product and Engineering teams, to define and deliver capabilities that enhance advertiser outcomes and unlock substantial commercial value. Key Responsibilities: - Design and build intelligent budget, tROAS, and SKU recommendations, as well as simulation-driv...

What do we do? The TTS Analytics team provides analytical insights to the Product, Pricing, Client Experience and Sales functions within the global Treasury & Trade Services business. The team works on business problems focused on driving acquisitions, cross-sell, revenue growth & improvements in client experience. The team extracts relevant insights, identifies business opportunities, converts business problems into analytical frameworks, uses big data tools and machine learning algorithms to build predictive models & other solutions, and designs go-to-market strategies for a huge variety of business problems. Role Description The role will be Business Analytics Analyst 2 (C10) in the TTS A...

Role Overview: As an MLOps Engineer at our company, you will be responsible for developing scalable applications and platforms in an agile environment. You should be a self-motivated individual with a passion for problem-solving and continuous learning. Key Responsibilities: - Project Management (50%): - Front Door: Requirements, Metadata collection, classification & security clearance - Data pipeline template development - Data pipeline Monitoring development & support (operations) - Design, develop, deploy, and maintain production-grade scalable data transformation, machine learning and deep learning code, pipelines - Manage data and model versioning, training, tuning, serving, experiment ...

Greetings From Tata Consultancy Services!!! Role: Big Data Developer (Hive, Pyspark) Years of Experience: 4 to 10 yrs Location: Chennai, Hyderabad, Bengaluru Notice Period: 0- 90 days Date of Interview: 14th Nov, 2025 Mode of Interview: Virtual Drive(Cisco or Webex) Time Of Interview: 5.00PM To 7.00PM Job Description: Roles & Responsibilities: Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools. Should be able to develop, tweak queries and work on performance enhancement. Solid understanding of object-oriented programming and HDFS concepts The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in production ...

Overview This position is for Manager Data Engineering in the Commercial Data as a Service group. In this position you will enjoy being responsible for helping define and maintain the data systems key to delivering successful outcomes for our customers. will lead a software development team focused on our core services someone who combines deep technical experience with great people management skills and can help elevate our teams and our approach to engineering. We are building a culture that fosters innovation, built on a foundation of inclusion and diversity. We are looking for a candidate that has proven experience in coding, architecture leadership, and leading engineers in a fast-paced...

Title and Summary Lead Data EngineerOverview We are the global technology company behind the worlds fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities. Our team within Mastercard Services: The Services org is a key differentiator for Mastercard, providing the cutting-edge services that are used by some of the world's largest organizations to mak...

We are looking for a Manager Software Engineering to join our IMS Team in Bangalore . This is an amazing opportunity to work on Big Data technologies involved in content ingestion. The team consists of 10-12 engineers and is reporting to the Sr Manager. We have a great skill set in Spark, Java, Scala, Hive, Sql, XSLT, AWS EMR, S3, etc and we would love to speak with you if you have skills in the same. About You experience, education, skills, and accomplishments: Work Experience: Minimum 7 years experience in Big Data projects involved in content ingestion, curation, transformation Technical Skill: Databricks, Spark, Python/Java , Scala, AWS EMR, S3, SQS, Hive, XSLT, Education (bachelors degr...

Key Responsibilities: Operate: Responsible for the operation of the system and record any problems that occur. Resolve: Ensure rapid problem resolution in close cooperation with participating third parties. Follow: Proactively follow the solution progress of incidents. Monitor: Responsible for the monitoring and analysis of possible sources of error. Update: Keep stakeholders up-to-date on system-relevant incidents. Process: Follow established processes such as Incident Management and Change Request Management. Evangelize: Promote best practices and methodologies. Automate: Identify opportunities to automate processes and procedures. Cultivate: Build relationships with developers, engineers,...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensur...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quali...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Snowflake Data Warehouse Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating with Integration Archi...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensur...