14333 Hive Jobs - Page 35

Big Data DeveLoper Responsibilities Design and implement data pipelines for migration from HDFS/Hive to cloud object storage (e.g., S3, Ceph). Optimize Spark (and optionally Flink) jobs for performance and scalability in a Kubernetes environment. Ensure data consistency, schema evolution, and governance with Apache Iceberg or equivalent table formats. Support migration strategy definition by providing technical input and identifying risks. Mentor junior developers and review their code / design decisions. Collaborate with platform engineers, cloud architects, and product stakeholders to align technical implementation with project goals. Troubleshoot complex distributed system issues in data ...

Interview Mode : Face-to-face Locations : Innova offices in Hyderabad, Chennai, or Bangalore Interview Rounds : Only one round Offer Timeline : Same-day offer release Work Mode : Hybrid (3 days in office, 2 days remote) Role & responsibilities Apache Spark, Hadoop, Hive, HDFS - Mandatory & Iceberg(Optional) SQL & NoSQL databases (Postgres, Cassandra, MongoDB, HBase) - Mandatory(at least one) Strong programming skills in Python, pySpark(Spark Core ) & Java. - Pyspark Mandatory Experience with workflow orchestration tools (Airflow, Oozie).Mandatory(at least one) Proficiency in containerization & CI/CD (Docker, GitLab CI/CD). Mandatory(at least one) Good understanding of data modelling, governa...

We have taken SQL & HIVE from secondary skillset to Primary requirement as per informed by client recently. Job description / - 5-7 years of experience in Big Data stacks Spark/Scala/Hive/Impala/Hadoop Strong Expertise in Scala The resource should have good hands-on experience in Scala programming language . Should be able to model the given problem statement using Object Oriented programming concepts. Should have the basic understanding of the Spark in-memory processing framework and the concept of map tasks and reduce tasks. Should have hands-on experience on data processing projects. Should be able to frame sqls and analyze data based on the given requirements Advanced SQL knowledge Git h...

You Lead the Way. We’ve Got Your Back. You Lead the Way. We’ve Got Your Back. You Lead the Way. We’ve Got Your Back. At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you’ll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us de f ine the future of American Express. Function Description: With a focus on digiti...

About the Role As a Data & AI Consultant in the Public Services domain , you will play a key role in designing, developing, and delivering data-driven and AI-enabled solutions for government and public sector organizations. You will collaborate with cross-functional teams to help clients leverage data, analytics, and automation to improve service delivery, enhance operational efficiency, and enable data-informed policy decisions. This is a client-facing role within Accentures Global Network Delivery team, working on large-scale transformation projects across global markets. Key Responsibilities Solution Design & Delivery: Design and implement data and AI solutions that address client busines...

Hands on knowledge of SPARK, scala, etc. Hands on knowledge of RDBMS like MS-SQL/Oracle Knowledge of CI/CD tools like uDeploy Understanding of Vanguard and its landscape will be additional advantage

7+ years of experience in Big Data with strong expertise in Spark and Scala Mandatory Skills Big Data Primarily Spark and Scala Strong Knowledge in HDFS, Hive, Impala with knowledge on Unix , Oracle, Autosys, Good to Have Agile Methodology and Banking Expertise Strong Communication Skills Not limited to Spark batch, need Spark streaming experience No SQL DB Experience HBase/Mongo/Couchbase

About Lowe’s Lowe’s is a FORTUNE® 100 home improvement company serving approximately 16 million customer transactions a week in the United States. With total fiscal year 2024 sales of more than $83 billion, Lowe’s operates over 1,700 home improvement stores and employs approximately 300,000 associates. Based in Mooresville, N.C., Lowe’s supports the communities it serves through programs focused on creating safe, affordable housing, improving community spaces, helping to develop the next generation of skilled trade experts and providing disaster relief to communities in need. For more information, visit Lowes.com. Lowe’s India, the Global Capability Center of Lowe’s Companies Inc., is a hub ...

Overview The role will work in developing Machine Learning (ML) and Artificial Intelligence (AI) projects. Specific scope of this role is to develop ML and GenAI solution in support of ML/AI projects using big analytics toolsets in a CI/CD environment. Analytics toolsets may include DS tools/Spark/Databricks along with LLM frameworks like LangChain / LlamaIndex, and other technologies offered by Microsoft Azure or open-source toolsets. This role will also help automate the end-to-end cycle with Azure Machine Learning Services and Pipelines. Responsibilities Understand the existing Proof of concepts that were built to showcase capability of LLMs to deliver the accurate response to any natural...

Role Proficiency: Act creatively to develop applications by selecting appropriate technical options optimizing application development maintenance and performance by employing design patterns and reusing proven solutions. Account for others' developmental activities; assisting Project Manager in day to day project execution. Outcomes: Interpret the application feature and component designs to develop the same in accordance with specifications. Code debug test document and communicate product component and feature development stages. Validate results with user representatives integrating and commissions the overall solution. Select and create appropriate technical options for development such...

What youll do: Collaborate with business users to understand and refine ETL requirements and business rules for effective solution implementation. Design, develop, implement, and optimize ETL processes to meet business and technical needs. Troubleshoot and resolve ETL-related issues, ensuring system performance and reliability. Create and execute comprehensive unit test plans based on system and validation requirements to ensure the quality of the solutions. Provide ongoing support and consultation for the development and enhancement of technical solutions across various business functions. What to Have for this position: Primary skills: Strong understanding of advanced ETL concepts, as well...

As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team to ensure that th...

Title : BigData Developer Location : Bangalore Position type : Full time Requirement: No Remote: All 5 days work from office. Working experience of Hadoop, Hive SQLs, Spark, Bigdata Eco System Tools. • Should be able to tweak queries and work on performance enhancement. • The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in production after testing. • The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies. Occasionally, the candidate may have to be responsible as a primary contact and/or driver for small to medium size projects...

Role Description As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team ...

Role Description As a Senior Cloud Data Platform (GCP) Engineer at Incedo, you will be responsible for managing and optimizing the Google Cloud Platform environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with big data technologies such as Hadoop or Spark. You will be responsible for configuring and optimizing the GCP environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the security team ...

The Professional, Data Engineering job designs, builds and maintains moderately complex data systems that enable data analysis and reporting. With limited supervision, this job collaborates to ensure that large sets of data are efficiently processed Required Candidate profile Minimum requirement of 5 years of relevant work experience. Typically reflects 7 years or more of relevant experience. Design, develop, and maintain scalable ETL pipelines for multi-scale datasets.

Provide expertise on database management/design to drive integration of business data, functions, and systems. Establish standards, guidelines, procedures, and other infrastructure necessary to support the objective ofintegration of data. Provide expertise on database management/design to drive integration of business data, functions, and systems. Partnering with IT and Data Ingestion team to transform business requirements to data requirements needed for automation.Validating feasibility of ideas, understanding customer expectations from the product, conducting design due diligence, and evaluating business value and risks.Leading E2E business product test, business process testing, validati...

Job Description Role and Responsibilities: Emphasis is on end-to-end delivery of analysis Extremely comfortable working with data, including managing large number of data sources, analyzing data quality, and pro-actively working with client’s data/ IT teams to resolve issues Hands on experience on Machine Learning algorithms such as Logistic Regression, Random Forest, XG Boost Use variety of analytical tools (Python, SQL, PySpark etc.) to carry out analysis and drive conclusions Reformulate highly technical information into concise, understandable terms for presentations Candidate Profile: Required skills: Python, SQL, Hive,PySpark, Hadoop, Tableau 4- 6 years of consulting, analytics deliver...

About the Role We are seeking a highly skilled and motivated Data Engineer with 5+ years of experience in designing, building, and maintaining scalable data pipelines. The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driven decision-making across the organization. Locations: All EXL (Pune, Gurugram, Bengaluru, Hyderabad, Noida) Responsibilities Design, develop, and optimize robust data pipelines using PySpark and SQL. Implement and manage data warehousing solutions using Snowflake. Work with large-scale data processing frameworks within the Hadoop ecosystem. Collaborate with data scientists, analysts, a...

Job Title: Developer Locations: CHENNAI,BANGALORE,HYDERABAD,KOLKATA,KOLKATA We are looking for a skilled Developer with strong hands-on experience in Scala, Java, and Python, who is passionate about building scalable data-driven solutions. The ideal candidate will have a solid background in big data technologies and cloud platforms, particularly AWS and GCP. Key Responsibilities Design, develop, and maintain scalable applications using Scala, Java, and Python. Build and optimize data pipelines and ETL workflows using big data platforms such as Cloudera. Work with Apache Spark for data processing and transformation. Develop and maintain Hive tables and manage Oozie workflows. Collaborate with...

Hiring: Big Data/Hadoop Engineer (PySpark, Hive) | 4 to 6 Years We are looking for talented Big Data/Hadoop Engineer for one of our premium clients! Work Locations: Bangalore (KA) | Chennai (TN) | Hyderabad (TG) Experience: 4 to 6 Years Required Skills: Strong hands-on experience in PySpark and Hive Expertise in Big Data & Hadoop Ecosystem tools Ability to design and optimize scalable data pipelines If interested, please share your profile at Mishra.Neha@net2source.co.in

SUMMARY Wissen Technology is Hirin g for Data Engineer About Wissen Technology: At Wissen Technology, we deliver niche, custom-built products that solve complex business challenges across industries worldwide. Founded in 2015, our core philosophy is built around a strong product engineering mindset ensuring every solution is architected and delivered right the first time. Today, Wissen Technology has a global footprint with 2000+ employees across offices in the US, UK, UAE, India, and Australia . Our commitment to excellence translates into delivering 2X impact compared to traditional service providers. How do we achieve this? Through a combination of deep domain knowledge, cutting-edge tech...

Job Summary: We are seeking an experienced and dynamic Senior Analyst Data Strategy to join the Strategy & Consulting (S&C) Global Network AI team . In this role, you will help organizations unlock the value of their data by defining and implementing data and AI-driven strategies . You will collaborate with business, technology, and analytics teams to shape data foundations, improve governance, and enable enterprise-scale artificial intelligence and analytics adoption. Key Responsibilities: Design and execute data and AI strategies aligned with client business goals and transformation roadmaps. Conduct data maturity assessments , identify improvement areas, and develop actionable recommendat...

Job Summary: We are seeking an experienced and dynamic Senior Analyst Data Strategy to join the Strategy & Consulting (S&C) Global Network AI team . In this role, you will help organizations unlock the value of their data by defining and implementing data and AI-driven strategies . You will collaborate with business, technology, and analytics teams to shape data foundations, improve governance, and enable enterprise-scale artificial intelligence and analytics adoption. Key Responsibilities: Design and execute data and AI strategies aligned with client business goals and transformation roadmaps. Conduct data maturity assessments , identify improvement areas, and develop actionable recommendat...

We are seeking a highly skilled Senior Flutter Developer with 3 to 5 years of extensive hands-on experience in developing robust, scalable, and high-quality mobile applications using Flutter. The ideal candidate will take ownership of full lifecycle app development while ensuring code quality and performance excellence. Key Responsibilities Lead Flutter app development with proven experience delivering production-level, complex mobile applications. Write clean, maintainable, and efficient Dart code following best practices. Architect and implement state management solutions primarily using Provider, ensuring scalability and performance. Design and develop responsive UI optimized across multi...