18 Apache Hive Jobs

We are seeking a highly skilled Lead Data Engineer to join our R&D Data Engineering Team. In this role, you will be a key player in shaping the architecture and technical direction of our data platform, ensuring that it meets the evolving needs of the business while adhering to best practices and industry standards. If you''re looking for an opportunity to combine your technical skills with strategic thinking and make a real difference, we want to hear from you. About You experience, education, skills, and accomplishments: Bachelors Degree or equivalent At least 7 years of Relevant Experience At least 5+ Years in Software Development: Demonstrated experience in software development, with a f...

Role Description : As a Senior Big Data Platform Engineer at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise. Roles & Responsibilities: Designing, developing and maintaining large-scale big ...

Primary Responsibilities: Regular interaction with stakeholders to understand the new requirements Managing and Implementation of Adobe Analytics / Glass box/ Google Analytics tags on website / Apps (Tools: DTM / Adobe Launch or any other Tag manager) Building reports/dashboards and case studies on data captured in Adobe Analytics / Session Cam tools Product/business/support monitoring and analyzing the performances Generate insights based on trends observed in the data, tie back to the business initiatives and update business owners Use statistical tools to identify and evaluate the relationships between data fields and outcomes Produce tactical analysis and implications/recommendations in ...

You will be responsible for designing, developing, and supporting scalable ETL processes using open source tools and data frameworks such as AWS Glue, AWS Athena, Redshift, Apache Kafka, Apache Spark, Apache Airflow, and Pentaho Data Integration (PDI). Additionally, you will design, create, and maintain data lakes and data warehouse on the AWS cloud. Your role will involve maintaining and optimizing the data pipeline architecture, formulating complex SQL queries for big data processing, collaborating with product and engineering teams for designing a platform for data modeling and machine learning operations, implementing various data structures and algorithms, ensuring data privacy and comp...

As a Senior Data Engineer at Infogain, you will be responsible for leading the design and execution of the Dataproc to Databricks PySpark migration roadmap. Your role will involve defining a modernization strategy encompassing data ingestion, transformation, orchestration, and governance. Additionally, you will architect scalable solutions using Delta Lake and Unity Catalog, ensuring optimal performance and cost efficiency. Key Responsibilities: - Lead the design and execution of Dataproc to Databricks PySpark migration roadmap. - Define a modernization strategy for data ingestion, transformation, orchestration, and governance. - Architect scalable Delta Lake and Unity Catalog-based solution...

Role Overview: In this role, you will be working on solving problems and designing solutions that facilitate data migrations on a large scale, from petabytes to exabytes per day. Your main focus will be to accelerate customers" journey towards Business Intelligence (BI) and Artificial Intelligence (AI) by delivering multiple products to external Google Cloud Platform (GCP) customers. Your work will involve simplifying data processing needs and delivering enterprise-grade solutions using cutting-edge technology and tools. Key Responsibilities: - Design and develop software for Data Warehouse migration, with a focus on cloud-native and distributed systems. - Collaborate with Product and Engine...

You are seeking a Spark, Big Data - ETL Tech Lead for Commercial Cards Global Data Repository development team at Citigroup. You will be interacting with various teams within Citigroup and need to have exceptional communication skills across technology and business areas. As a technical lead, you will design and implement large-scale data processing pipelines using Apache Spark on the BigData Hadoop Platform. Your responsibilities will include developing and optimizing Spark applications, providing technical leadership for global software solutions, integrating data from various sources, and managing development scope, budgets, and timelines. You will also mentor and guide junior developers ...

• Experience on deploying shallow learning and deep learning models • Experience with Big Data Platform and cloud technologies • Building production grade Gen AI applications is a plus. • ML Design pattern, algorithm and the data structure skills

Data processing ML Eng apache hive Data Modelling ML Eng Tensorflow ML Eng Pytorch ML Eng keras Data Bases ML Eng SQL ML Eng Postgre SQL ML Eng Mongo ML Eng Dynamo DB Programming/ Scripting Language ML Eng Unix ML Eng Docker, Kubernet

You will be working at Paras Twin Tower, Gurgaon as a full-time employee for Falcon, a Series-A funded cloud-native, AI-first banking technology & processing platform. Falcon specializes in assisting banks, NBFCs, and PPIs to efficiently launch cutting-edge financial products like credit cards, credit lines on UPI, prepaid cards, fixed deposits, and loans. Since its inception in 2022, Falcon has processed over USD 1 billion in transactions, collaborated with 12 of India's top financial institutions, and generated revenue exceeding USD 15 million. The company is supported by prominent investors from Japan, the USA, and leading Indian ventures and banks. To gain more insights about Falcon, vis...

You are being offered a unique opportunity to join the Mastercard Economics Institute (MEI) as an Associate Economics Analyst in the Global Growth and Operations team. In this role, you will report to the Director, Growth and Operations and be responsible for blending advanced economic research with strong programming and data visualization skills. As an Associate Economics Analyst at MEI, you will play a crucial role in supporting client and stakeholder engagements across the institute. You will collaborate with a diverse team of economists, econometricians, developers, visualization experts, and industry partners. Your responsibilities will include developing and testing hypotheses at the ...

Job Title: Senior Data Engineer Location: Pan India Experience: 7+ Years Joining: Immediate/Short Notice Preferred Job Summary: We are looking for an experienced Senior Data Engineer to design, develop, and optimize scalable data solutions across Enterprise Data Lake (EDL) and hybrid cloud platforms. The role involves data architecture, pipeline orchestration, metadata governance, and building reusable data products aligned with business goals. Key Responsibilities: Design & implement scalable data pipelines (Spark, Hive, Kafka, Bronze-Silver-Gold architecture). Work on data architecture, modelling, and orchestration for large-scale systems. Implement metadata governance, lineage, and busine...

You are a Spark, Big Data - ETL Tech Lead for Commercial Cards Global Data Repository development team at Citigroup. In this role, you will collaborate with the Development Project Manager, development, testing, and production support teams, and various departments within Citigroup to ensure the success of TTS platforms. Your exceptional communication skills across technology and business realms will be crucial as you play a visible role as a technical lead in building scalable, enterprise-level global applications. Your responsibilities will include leading the design and implementation of large-scale data processing pipelines using Apache Spark on the BigData Hadoop Platform. You will deve...

As a Software Development Engineer at our company, you will have the opportunity to work in either Hyderabad, Telangana, India or Bengaluru, Karnataka, India. You should hold a Bachelor's degree in Computer Science, a related technical field, or have equivalent practical experience. With at least 8 years of experience in software development using general-purpose programming languages, you will be responsible for designing and building solutions for data migrations and developing software for Data Warehouse migration. Your expertise in programming languages such as Java, C/C++, Python, or Go will be crucial for this role. Additionally, experience in systems engineering with designing and bui...

The Applications Development Intermediate Programmer Analyst position is a role at an intermediate level where you will be responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. Your responsibilities will include utilizing your knowledge of applications development procedures and concepts, as well as basic knowledge of other technical areas to identify and define necessary system enhancements. This will involve using script tools, analyzing/interpreting code, consulting with users, cl...

The Applications Development Intermediate Programmer Analyst position is an intermediate level role where you will be responsible for contributing to the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to assist in applications systems analysis and programming activities. You will utilize your knowledge of applications development procedures and concepts, along with basic knowledge of technical areas, to identify and define necessary system enhancements. This includes using script tools, analyzing code, and consulting with users, clients, and other technology groups to recommend programm...

As a skilled professional in the field of Big Data and Analytics, you will be responsible for utilizing your expertise to drive impactful solutions for Standard Chartered Bank. Your role will involve leveraging your proficiency in various technologies and frameworks such as Hadoop, HDFS, HIVE, SPARK, Bash Scripting, SQL, and others. Your ability to handle raw and unstructured data while adhering to coding standards and software development life cycles will be crucial in ensuring the success of the projects you are involved in. In addition to your technical skills, you will also play a key role in Regulatory & Business Conduct by embodying the highest standards of ethics and compliance. Your ...

Role & responsibilities Primary Skills: Bigdata, Hadoop/ Apache Hive Must have Skills: Synapse, Data Lake Experience:8 to 12 years Location/ Shift/ Work Mode: Bangalore or Hyderabad 1 to 10pm Preferred candidate profile: Strong knowledge of distributed computing and big data frameworks: Hadoop, Spark, Hive, Presto, Kafka Hands-on experience with cloud platforms: AWS (S3, Glue, EMR, Athena, Redshift) or Azure (Synapse, ADLS, Data Factory) or GCP (Big Query, Dataflow, Pub/Sub) Deep understanding of data lake, Lakehouse, and warehouse design principles Proficiency in data modeling, schema design, partitioning strategies, and metadata management Experience with CI/CD, Terraform, Git, and orchest...