14271 Hive Jobs - Page 8

EXP 4 to 6 yrs Location Any PSL Location Rate below 14$ JD - DBT/AWS Glue/Python/Pyspark Hands-on experience in data engineering, with expertise in DBT/AWS Glue/Python/Pyspark. Strong knowledge of data engineering concepts, data pipelines, ETL/ELT processes, and cloud data environments (AWS) Technology DBT, AWS Glue, Athena, SQL, Spark, PySpark Good understanding of Spark internals and how it works. Goot skills in PySpark Good understanding of DBT basically should be to understand DBT limitations and when it will end-up in model explosion Good hands-on experience in AWS Glue AWS expertise should know different services and should know how to configure them and infra-as-code experience Basic ...

JR REQ--- Data Engineer --6to8year---PUNE, THANE----Bhalchandra Suryawanshi ---TCS C2H ---900000

JD GCP Data Engineer Responsibilities: Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. Use Pub/Sub for real time data ingestion and streaming analytics. Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed. Optimize data storage and retrieval processes to enhance performance and reduce costs. Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services. Ensure data quality and integrity through robust testing and validation processes...

Azure Databricks: 1. Mounting Files 2. PAT Tokens 3. Cluster Auto scaling 4. Cluster Types 5. Nesting notebooks 6. Reading file using default and custom schema 7. Types Secrets and scopes in databricks 8. Delta Tables 9. Basic file loading scenario with its steps 10. Optimization 11. User defined functions 12. Transformations ADF: 1. Integration runtimes familiar with and where they are used 2. Components in creating pipelines 3. Scenario based question for creating a basic pipeline for loading data to Azure SQL table 4. Basic steps to improve the loading activity of a huge amount of file , ex: 1TB file size

ROLES & RESPONSIBILITIES Key Responsibilities Analyze existing Hadoop, Pig, and Spark scripts from Dataproc and refactor them into Databricks-native PySpark. Implement data ingestion and transformation pipelines using Delta Lake best practices. Apply conversion rules and templates for automated code migration and testing. Conduct data validation between legacy and migrated environments (schema, count, and data-level checks). Collaborate on developing AI-driven tools for code conversion, dependency extraction, and error remediation. Ensure best practices for code versioning, error handling, and performance optimization. Participate in UAT, troubleshooting, and post-migration validation activi...

ROLES & RESPONSIBILITIES Key Responsibilities Lead design and execution of Dataproc ? Databricks PySpark migration roadmap. Define modernization strategy , including data ingestion, transformation, orchestration, and governance. Architect scalable Delta Lake and Unity Catalog –based solutions. Manage and guide teams on code conversion, dependency mapping, and data validation. Collaborate with platform, infra, and DevOps teams to optimize compute costs and performance. Own the automation & GenAI acceleration layer , integrating code parsers, lineage tools, and validation utilities. Conduct performance benchmarking, cost optimization, and platform tuning (Photon, Auto-scaling, Delta Caching). ...

Job Title: Software Developer (Experience: 4- 5 Years ) Company Website: https://elitewebtechnologies.com/ Location: MDC, Panchkula Job Type: Full-Time (ON-SITE) Experience Required: 4- 5 Years Job Description: We are seeking a highly skilled and experienced Senior React Native Developer with more than 4 years of hands-on experience in React JS , React Native , TypeScript , and Flutter . The ideal candidate should have a strong background in front-end and mobile technologies, leadership experience, and a passion for modern, scalable, and performance-driven development. Experience with blockchain and offline-first mobile development is a strong plus. Core Skills & Requirements 5+ years of exp...

Expedia Group brands power global travel for everyone, everywhere. We design cutting-edge tech to make travel smoother and more memorable, and we create groundbreaking solutions for our partners. Our diverse, vibrant, and welcoming community is essential in driving our success. Why Join Us? To shape the future of travel, people must come first. Guided by our Values and Leadership Agreements, we foster an open culture where everyone belongs, differences are celebrated and know that when one of us wins, we all win. We provide a full benefits package, including exciting travel perks, generous time-off, parental leave, a flexible work model (with some pretty cool offices), and career development...

Discover your future at Citi Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact. Job Overview What do we do? The TTS Analytics team provides analytical insights to the Product, Pricing, Client Experience and Sales functions within the global Treasury & Trade Services business. The team works on business problems focused on driving acquisitions, cross-sell, revenue growth & improvements in client experience. The team extracts relevant insights, identifies business opportunities, converts busine...

Department: Development Location: Mohali Type: Full-Time We are seeking an experienced Flutter Developer to join our mobile app development team. The ideal candidate will have 3–4 years of hands-on experience designing, developing, and maintaining cross-platform mobile applications using Flutter and Dart, with strong expertise in Flutter frameworks, state management solutions, and mobile app development best practices. Key Responsibilities Design, develop, and maintain high-quality cross-platform mobile applications using Flutter. Collaborate with designers, product managers, and backend engineers to define, design, and deliver new features. Translate UI/UX designs into performant, responsiv...

Job ID: 43806 Location: Chennai, IN Area of interest: Audit, Accounting & Finance Job type: Regular Employee Work style: Office Working Opening date: 11 Nov 2025 Job Summary Drive Standard Chartered ’s Technology strategy through leadership of the engineering teams that develop and maintain our Intra Day Liquidity platforms. Key Responsibilities Strategy Lead the data sourcing, modelling, and analysis efforts to support reporting, risk, and P&L calculations for products including Treasury Securities, Bonds, Equity, Assets & Liabilities, and P&L. Translate complex business requirements for Market Risk Limits and Utilization, RWA, IM (Initial Margin) Posting, and Cashflow Hedge MI into clear D...

Job Title: Head of Data Engineering Department: Data Engineering Reporting To: Chief Technology Officer (CTO) Role Overview Spiro is seeking an exceptional Head of Data Engineering to lead, design, and scale our next-generation data infrastructure. You will oversee the development of robust, scalable data pipelines, architect our big data platforms, and ensure the integrity and quality of the data fueling our AI, analytics, and digital products. As a hands-on leader, you will guide a team of talented engineers while collaborating closely with analytics, software development, and product teams to drive business outcomes through data. This is a critical leadership role shaping the future of da...

Summary Position Summary Artificial Intelligence & Engineering AI & Engineering leverages cutting-edge engineering capabilities to help build, deploy, and operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions insights are powered by engineering for business advantage, helping transforming mission-critical operations. Join our AI & Engineering team to help in transforming technology platforms, driving innovation, and helping help make a significant impact on our clients' success achievements. You’ll work alongside talented professionals reimagining and re-engineering operations and processes that are could be critical...

The Data Analyst is responsible for analyzing, managing, and visualizing data across the organization’s Identity and Access Management (IAM) ecosystem. The role focuses on generating actionable insights from identity data to enhance user security, streamline access management, and ensure compliance with organizational and regulatory standards. Roles and Responsibilities Lead the design and implementation of solutions within the team, ensuring compliance with design standards and alignment with business objectives. Analyze existing business models, data flows, and system architectures to develop functional specifications and test plans. Create high-level and detailed process models, sequence ...

Immediate Joiners-Preferred Contact Amreen-6304949975 Rajeshwari-8105657937 Tejaswini-6301629162 Role Summary We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires strong hands-on development skills in data engineering, with the ability to deliver high-quality pipelines under guidance from internal leads. Key Responsibilities Develop and optimize data pipelines using Spark 3.5 and Python/Scala. Migrate existing Hive, Spark, and Control-M jobs to Airflow and DBT-based workflows. Integrate data pipelines with messaging systems (Kafka, Solace) and object stores (S3,...

About the Role We are seeking an experienced Big Data & Azure Engineer to join our data platform team. This role is critical to supporting and optimizing our enterprise-scale data infrastructure, managing migrations from on-premises Big Data systems to Azure cloud services, and ensuring seamless 24x7 production operations. The ideal candidate will combine strong technical expertise in both traditional Big Data technologies and modern cloud platforms with excellent problem-solving abilities. Required Skills and Qualifications Technical Expertise : Strong experience in Big Data technologies (Hive, Impala). Hands-on experience with Azure services : Network, VMs, Synapse, Databricks. Proficiency...

About Company Kenexai delivers smart, data-driven solutions that empower businesses across industries. Our mission is to combine deep, domain-specific expertise with cutting-edge technology to drive meaningful impact. With a trusted team, consistent quality, and a growing global presence, we remain committed to delivering excellence while staying true to our core values: innovation, integrity, and client success. Be part of a team that's not just building solutions, but shaping the future with intelligence. Key Responsibilities Oracle BDS Cluster Setup & Configuration We are seeking an experienced Oracle Big Data Service (BDS) Specialist to design, implement, and maintain our Oracle BDS infr...

We are seeking highly skilled GIS Data Engineers with strong expertise in Python, PySpark, and geospatial data processing to support the integration and analysis of spatial datasets. The selected candidates will work on large-scale data engineering projects in a distributed environment, focusing on building pipelines and workflows that support geospatial analytics and visualization. Responsibilities : - Develop and maintain scalable ETL pipelines using PySpark and Python for processing GIS and spatial datasets. - Work with large geospatial datasets from various sources (e. g., shapefiles, GeoJSON, raster formats, satellite data). - Integrate geospatial data with enterprise systems (e. g., Po...

Job Summary We are seeking a highly skilled Technical Architect with deep expertise in Big Data technologies and AWS Cloud services. The ideal candidate will lead the design and implementation of scalable, secure, and high-performance data solutions using Python, PySpark, Spark, Hive, AWS EMR, and AWS Glue. This role requires strong leadership, architectural vision, and hands-on technical proficiency. We are looking for immediate joiner or (Max 15 Day NP) Multiple Location - Indore/Pune/Hyderabad/Noida/Gurgaon/Bangalore Key Responsibilities Architect and design end-to-end Big Data solutions on AWS Cloud Lead development of scalable data pipelines using PySpark, Spark, and Hive Optimize perfo...

Description Are you excited about the digital media revolution and passionate about designing and delivering advanced analytics that directly influence the product decisions of Amazon's digital businesses. Do you see yourself as a champion of innovating on behalf of the customer by turning data insights into action? The Amazon Digital Acceleration (DA) org is looking for an analytical and technically skilled data engineer to join our team. In this role, you will play a critical part in developing foundational analytical datasets spanning orders, subscriptions, discovery, promotions, pricing and royalties. Our mission is to enable digital clients to easily innovate with data on behalf of cust...

Our Purpose Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential. Title And Summary Managing Consultant - Analytics Advisors & Consulting Services Services within Mastercard is responsible for acquiring, engaging, and retaining customers by managing fraud an...

JD - Data Scientist About Credit Saison India Established in 2019, Credit Saison India (CS India) is one of the country’s fastest growing Non-Bank Financial Company (NBFC) lenders, with verticals in wholesale, direct lending and tech-enabled partnerships with Non-Bank Financial Companies (NBFCs) and fintechs. Its tech-enabled model coupled with underwriting capability facilitates lending at scale, meeting India’s huge gap for credit, especially with underserved and under penetrated segments of the population. Credit Saison India is committed to growing as a lender and evolving its offerings in India for the long-term for MSMEs, households, individuals and more. Credit Saison India is registe...

🚀 Co-Founder Opportunity | Hive Realty Network (Eaststreet Group Unit) 📍 Lucknow | Real Estate | Banking | Automobile Are you ready to build something bigger than a career — a legacy? At Hive Realty Network, we believe real estate should be built on trust, not just transactions. Backed by a decade of experience under Eaststreet Group, we’re creating a customer-first real estate ecosystem rooted in transparency, innovation, and relationships. We’re looking for a Co-Founder — a visionary entrepreneur ready to lead growth, build partnerships, and shape a trusted brand in Uttar Pradesh. What You’ll Do * Lead marketing & brand-building to reach 1,000+ clients * Build developer, channel & partner ...

Role & responsibilities Job Title: Developer Skills Required: Digital: BigData and Hadoop Ecosystems, Digital: PySpark Experience Range in Required Skills: 4 to 6 Years Job Description: Big Data (PySpark, HIVE) 1. Need to work as a developer in Bigdata, Hadoop or Data Warehousing Tools and Cloud Computing. 2. Work on Hadoop, Hive SQLs, Spark, and Bigdata Eco System Tools. 3. Experience in working with teams in a complex organization involving multiple reporting lines.? 4. The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies. 5. The candidate should have strong DevOps and Agile Developme...

We are seeking a Senior Data Engineer to build scalable, cloud-native data platforms and enable end-to-end MLOps workflows. You will design ETL/ELT pipelines, manage data lakes/warehouses/feature stores, and ensure high-performance, secure, and cost-efficient pipelines for AI/ML and analytics. This role blends Data Engineering + MLOps to deliver production-ready, automated, and reliable ML workflows. Responsibilities Data Pipelines: Design & optimize batch/streaming ETL/ELT pipelines at scale. Platforms: Build/manage data lakes, warehouses, feature stores for ML/BI workloads. MLOps: Enable model training, deployment, CI/CD, monitoring, retraining, versioning using SageMaker (AWS), Vertex AI ...