9 Hive Queries Jobs

Mid: 4- 6 Yrs 11 L Senior: 8+ Yrs17L Key Responsibilities: * Design, develop, and maintain robust data pipelines using big data technologies. * Optimize data processing and storage frameworks to ensure high performance and scalability. * Work with large-scale datasets using tools such as Hive, Spark, and HDFS. * Develop ETL processes to ingest and transform data from diverse sources. * Ensure data quality and integrity across all stages of the data pipeline. * Collaborate with cross-functional teams to understand data needs and deliver solutions. * Implement best practices for data engineering, security, and compliance. Required Skills: * Strong experience in Big Data ecosystems (Hadoop, HDFS, Hive, etc.) * Proficient in SQL for data querying and transformation. * Hands-on experience with Apache Hive for managing structured data in Hadoop. * Strong working knowledge of PySpark for distributed data processing. * Familiarity with data modeling, data warehousing concepts, and ETL processes. * Proficient in scripting languages (e.g., Python)

Responsibility Diagnosing, troubleshooting and fixing production software issues Developing and owning monitoring solutions for production and non-production environments and applications Develop smaller complexity features / enhancements in existing stable system components Adapt installer, shell scripts and perl scripts and aggressively automate manual tasks through scripting. Provide feedback from customer users to the team. Maintain on-going record of problem analysis and resolution activity in an on-call tracking system. Desired Skills Good exposure to MySQL and writing SQL queries. Should be able to write and understand complex joins. Automation scriptingknowledge of scripting language ExPython, perl, shell script is required. Proven success in fast paced production support environment. Programming experience in any language (C++ / Java / RubyOnRails will be a plus). Good in problem solving and analytical skills. Demonstrated ability to communicate effectively in writing, ideally with a successful track record of responding to/resolving customer issues through written communication Excellent written and oral communications skills. Prior experience in e-commerce or web services domain will be a plus. Ability to effectively work with cross functional team. Possess ability to understand business problems and provide solutions/informations related to the business requirements. Exposure to Hadoop, Hive queries will be added advantage. Experience2+ Year PhonePe Full Time Employee Benefits (Not applicable for Intern or Contract Roles) Insurance Benefits - Medical Insurance, Critical Illness Insurance, Accidental Insurance, Life Insurance Wellness Program - Employee Assistance Program, Onsite Medical Center, Emergency Support System Parental Support - Maternity Benefit, Paternity Benefit Program, Adoption Assistance Program, Day-care Support Program Mobility Benefits - Relocation benefits, Transfer Support Policy, Travel Policy Retirement Benefits - Employee PF Contribution, Flexible PF Contribution, Gratuity, NPS, Leave Encashment Other Benefits - Higher Education Assistance, Car Lease, Salary Advance Policy Working at PhonePe is a rewarding experience! Great people, a work environment that thrives on creativity, the opportunity to take on roles beyond a defined job description are just some of the reasons you should work with us. Read more about PhonePe on our blog. Life at PhonePe PhonePe in the news

Wipro Limited (NYSEWIT, BSE507685, NSEWIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For additional information, visit us at www.wipro.com Primary Skill: Apache Spark Secondary Skill: Java Data Engineer Job Summary: Join our team as a Data Engineer with the opportunity to be at the forefront of our data operations, leveraging your expertise in Spark and the Big Data ecosystem to drive meaningful insights and solutions. We are looking for engineers who possess 5-7years of hands-on experience in data engineering within a robust Big Data environment, primarily utilizing Spark as a foundational skill. You will be proficient in data integration expertises, such as ETL/ELT development, constructing scalable, and maintainable data pipelines while supporting diverse integration patterns including batch processing, replication, and event streaming. In-depth knowledge of NoSQL technologies, particularly HBase, will be essential in your role. An understanding of Big Data cluster management and operations will be beneficial. You will demonstrate proficiency in manipulating and transforming data across varied datasets and technologies to meet project goals. Ideal candidates will have experience with medium to large scale enterprise projects, ideally within the financial services sector. A proactive attitude towards learning new technologies and experimenting with different approaches is valued. Excellent communication skills, both written and verbal, are crucial as collaboration is key in our data-driven environment. Key Responsibilities: Establish and create data pipelines for retention, cleanup, persistence, and maintenance of data on NoSQL datastores. Implement data consistency checks and rules to ensure data meets business standards and needs. Optimize data engineering pipelines and queries to ensure efficiency, reliability and scalability of data processing and analysis. Perform root cause analysis on issues and processes to answer specific business questions and identify opportunities for improvement. Skills Required: To excel in this role, candidates should bring a blend of technical expertise and problem-solving capabilities. Strong knowledge and hands-on experience with Apache Spark frameworks, including Core Spark, Spark DataFrames, and Spark Streaming functionalities are required. Candidates should be proficient in at least one programming language, specifically Java or Scala, to develop and maintain processing workflows. A solid understanding of distributed programming concepts will be essential to navigate through our extensive data systems. Experience in optimizing Spark Directed Acyclic Graphs (DAG) and Hive queries utilizing Tez will be significant advantages. Proficiency in tools such as Git, Autosys, Bitbucket, and Jira will support streamlined workflows and team collaboration. Ability to effectively apply Data Warehouse principles in the context of Hadoop environments and NoSQL databases. Good to Have: While not mandatory, additional skills and experiences can elevate your candidacy. Basic experience with Data Preparation Tools will enhance your ability to preprocess and structure data effectively. Experience in exploratory data analysis through SQL is highly regarded, facilitating insightful data discovery and evaluation. Familiarity with Big Data cluster operations can greatly support your understanding of data processing environments. Knowledge or experience with PySpark can provide an added layer of versatility in project approaches. Utilization of GitHub Copilot along with prompt engineering knowledge to enhance development processes will be an asset. A background in Operating Systems, accompanied by shell scripting proficiency, will further complement your technical toolkit.

Responsibility Diagnosing, troubleshooting and fixing production software issues Developing and owning monitoring solutions for production and non-production environments and applications Develop smaller complexity features / enhancements in existing stable system components Adapt installer, shell scripts and perl scripts and aggressively automate manual tasks through scripting. Provide feedback from customer users to the team. Maintain on-going record of problem analysis and resolution activity in an on-call tracking system. Desired Skills Good exposure to MySQL and writing SQL queries. Should be able to write and understand complex joins. Automation scriptingknowledge of scripting language ExPython, perl, shell script is required. Proven success in fast paced production support environment. Programming experience in any language (C++ / Java / RubyOnRails will be a plus). Good in problem solving and analytical skills. Demonstrated ability to communicate effectively in writing, ideally with a successful track record of responding to/resolving customer issues through written communication Excellent written and oral communications skills. Prior experience in e-commerce or web services domain will be a plus. Ability to effectively work with cross functional team. Possess ability to understand business problems and provide solutions/informations related to the business requirements. Exposure to Hadoop, Hive queries will be added advantage. Experience2+ Year PhonePe Full Time Employee Benefits (Not applicable for Intern or Contract Roles) Insurance Benefits - Medical Insurance, Critical Illness Insurance, Accidental Insurance, Life Insurance Wellness Program - Employee Assistance Program, Onsite Medical Center, Emergency Support System Parental Support - Maternity Benefit, Paternity Benefit Program, Adoption Assistance Program, Day-care Support Program Mobility Benefits - Relocation benefits, Transfer Support Policy, Travel Policy Retirement Benefits - Employee PF Contribution, Flexible PF Contribution, Gratuity, NPS, Leave Encashment Other Benefits - Higher Education Assistance, Car Lease, Salary Advance Policy Working at PhonePe is a rewarding experience! Great people, a work environment that thrives on creativity, the opportunity to take on roles beyond a defined job description are just some of the reasons you should work with us. Read more about PhonePe on our blog. Life at PhonePe PhonePe in the news

Job Summary: AWS Developer (Offshore Role) Role Overview: Responsible for migrating and transforming data pipelines from legacy Cloudera/Hadoop systems to AWS-native solutions, using tools like PySpark, MWAA, and EMR. Key Responsibilities: Develop ingestion pipelines (batch & stream) to move data to S3. Convert HiveQL to SparkSQL/PySpark. Orchestrate workflows using MWAA (Airflow). Build and manage Iceberg tables with proper partitioning and metadata. Perform job validation and implement unit testing. Required Skills: 35 years of data engineering experience, with strong AWS expertise. Proficient in EMR (Spark), S3, PySpark, and SQL. Familiar with Cloudera/HDFS and legacy Hadoop pipelines. Knowledge of data lake/lakehouse architectures is a plus. Mandatory: AWS Developer experience.

Desired Candidate Profile 5-9 years of experience in software development or quality assurance with expertise in UI automation testing. Strong understanding of BDD (Behavior-Driven Development) principles and CICD (Continuous Integration & Continuous Deployment). Proficiency in tools like Hive Queries, JMeter, Sauce Labs, CI/CD pipelines. Proficiency in Java,selenium,Rest Assured

Responsibility Diagnosing, troubleshooting and fixing production software issues Developing and owning monitoring solutions for production and non-production environments and applications Develop smaller complexity features / enhancements in existing stable system components Adapt installer, shell scripts and perl scripts and aggressively automate manual tasks through scripting. Provide feedback from customer users to the team. Maintain on-going record of problem analysis and resolution activity in an on-call tracking system. Desired Skills Good exposure to MySQL and writing SQL queries. Should be able to write and understand complex joins. Automation scriptingknowledge of scripting language ExPython, perl, shell script is required. Proven success in fast paced production support environment. Programming experience in any language (C++ / Java / RubyOnRails will be a plus). Good in problem solving and analytical skills. Demonstrated ability to communicate effectively in writing, ideally with a successful track record of responding to/resolving customer issues through written communication Excellent written and oral communications skills. Prior experience in e-commerce or web services domain will be a plus. Ability to effectively work with cross functional team. Possess ability to understand business problems and provide solutions/informations related to the business requirements. Exposure to Hadoop, Hive queries will be added advantage. Experience2+ Year PhonePe Full Time Employee Benefits (Not applicable for Intern or Contract Roles) Insurance Benefits - Medical Insurance, Critical Illness Insurance, Accidental Insurance, Life Insurance Wellness Program - Employee Assistance Program, Onsite Medical Center, Emergency Support System Parental Support - Maternity Benefit, Paternity Benefit Program, Adoption Assistance Program, Day-care Support Program Mobility Benefits - Relocation benefits, Transfer Support Policy, Travel Policy Retirement Benefits - Employee PF Contribution, Flexible PF Contribution, Gratuity, NPS, Leave Encashment Other Benefits - Higher Education Assistance, Car Lease, Salary Advance Policy

Responsibility Diagnosing, troubleshooting and fixing production software issues Developing and owning monitoring solutions for production and non-production environments and applications Develop smaller complexity features / enhancements in existing stable system components Adapt installer, shell scripts and perl scripts and aggressively automate manual tasks through scripting. Provide feedback from customer users to the team. Maintain on-going record of problem analysis and resolution activity in an on-call tracking system. Desired Skills Good exposure to MySQL and writing SQL queries. Should be able to write and understand complex joins. Automation scriptingknowledge of scripting language ExPython, perl, shell script is required. Proven success in fast paced production support environment. Programming experience in any language (C++ / Java / RubyOnRails will be a plus). Good in problem solving and analytical skills. Demonstrated ability to communicate effectively in writing, ideally with a successful track record of responding to/resolving customer issues through written communication Excellent written and oral communications skills. Prior experience in e-commerce or web services domain will be a plus. Ability to effectively work with cross functional team. Possess ability to understand business problems and provide solutions/informations related to the business requirements. Exposure to Hadoop, Hive queries will be added advantage. Experience2+ Year PhonePe Full Time Employee Benefits (Not applicable for Intern or Contract Roles) Insurance Benefits - Medical Insurance, Critical Illness Insurance, Accidental Insurance, Life Insurance Wellness Program - Employee Assistance Program, Onsite Medical Center, Emergency Support System Parental Support - Maternity Benefit, Paternity Benefit Program, Adoption Assistance Program, Day-care Support Program Mobility Benefits - Relocation benefits, Transfer Support Policy, Travel Policy Retirement Benefits - Employee PF Contribution, Flexible PF Contribution, Gratuity, NPS, Leave Encashment Other Benefits - Higher Education Assistance, Car Lease, Salary Advance Policy

About PhonePe Group: PhonePe is Indias leading digital payments company with 50 crore (500 Million) registered users and 3.7 crore (37 Million) merchants covering over 99% of the postal codes across India. On the back of its leadership in digital payments, PhonePe has expanded into financial services (Insurance, Mutual Funds, Stock Broking, and Lending) as well as adjacent tech-enabled businesses such as Pincode for hyperlocal shopping and Indus App Store which is India's first localized App Store. The PhonePe Group is a portfolio of businesses aligned with the company's vision to offer every Indian an equal opportunity to accelerate their progress by unlocking the flow of money and access to services. Culture At PhonePe, we take extra care to make sure you give your best at work, Everyday! And creating the right environment for you is just one of the things we do. We empower people and trust them to do the right thing. Here, you own your work from start to finish, right from day one. Being enthusiastic about tech is a big part of being at PhonePe. If you like building technology that impacts millions, ideating with some of the best minds in the country and executing on your dreams with purpose and speed, join us! Responsibility Diagnosing, troubleshooting and fixing production software issues Developing and owning monitoring solutions for production and non-production environments and applications Develop smaller complexity features / enhancements in existing stable system components Adapt installer, shell scripts and perl scripts and aggressively automate manual tasks through scripting. Provide feedback from customer users to the team. Maintain on-going record of problem analysis and resolution activity in an on-call tracking system. Desired Skills Good exposure to MySQL and writing SQL queries. Should be able to write and understand complex joins. Automation scriptingknowledge of scripting language ExPython, perl, shell script is required. Proven success in fast paced production support environment. Programming experience in any language (C++ / Java / RubyOnRails will be a plus). Good in problem solving and analytical skills. Demonstrated ability to communicate effectively in writing, ideally with a successful track record of responding to/resolving customer issues through written communication Excellent written and oral communications skills. Prior experience in e-commerce or web services domain will be a plus. Ability to effectively work with cross functional team. Possess ability to understand business problems and provide solutions/informations related to the business requirements. Exposure to Hadoop, Hive queries will be added advantage. Experience2+ Year PhonePe Full Time Employee Benefits (Not applicable for Intern or Contract Roles) Insurance Benefits - Medical Insurance, Critical Illness Insurance, Accidental Insurance, Life Insurance Wellness Program - Employee Assistance Program, Onsite Medical Center, Emergency Support System Parental Support - Maternity Benefit, Paternity Benefit Program, Adoption Assistance Program, Day-care Support Program Mobility Benefits - Relocation benefits, Transfer Support Policy, Travel Policy Retirement Benefits - Employee PF Contribution, Flexible PF Contribution, Gratuity, NPS, Leave Encashment Other Benefits - Higher Education Assistance, Car Lease, Salary Advance Policy Working at PhonePe is a rewarding experience! Great people, a work environment that thrives on creativity, the opportunity to take on roles beyond a defined job description are just some of the reasons you should work with us. Read more about PhonePe .