21920 Hadoop Jobs - Page 8

Job Requirements Job Requirements Role/ Job Title: Data Engineer Business: New Age Function/ Department: Data & Analytics Place of Work: Mumbai Roles & Responsibilities 'Minimum 2-3 years of Data Engineering experience Proven experience in in SQL, Spark, Hadoop ecosystem Have worked on multiple TBsof data volume from ingestion to consumption Work with business stakeholders to identify and document high impact business problems and potential solutions Good understanding of Data Lake/Lakehouse architecture and experience/exposure to Hadoop (cloudera, hortonworks) and/or AWS Work on end-to-end data lifecycle from Data Ingestion, Data Transformation and Data Consumption layer. Versed with API an...

Job Title: Data Engineer (Scala, Spark, Pyspark, Databricks) Remark - final round will be the F2F Experience: 10+ Years (Lead Role) Responsibilities Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform. Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency. Optimize Spark applications for performance and cost-efficiency within the Databricks environment. Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning. Collaborate with data scientists, analysts, and other engineering teams to under...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Job Title: Data Engineer (Scala, Spark, Pyspark, Databricks) Remark - final round will be the F2F Experience: 10+ Years (Lead Role) Responsibilities Design, develop, and maintain robust and scalable data pipelines using Apache Spark and Scala on the Databricks platform. Implement ETL (Extract, Transform, Load) processes for various data sources, ensuring data quality, integrity, and efficiency. Optimize Spark applications for performance and cost-efficiency within the Databricks environment. Work with Delta Lake for building reliable data lakes and data warehouses, ensuring ACID transactions and data versioning. Collaborate with data scientists, analysts, and other engineering teams to under...

About the Role: We are seeking a detail-oriented Big Data Analyst to analyze and interpret large-scale datasets to support business decisions and strategy. The ideal candidate will work with structured and unstructured data, leverage analytics tools, and deliver actionable insights that drive performance and growth. Key Responsibilities: 1. Data Analysis & Interpretation Collect, clean, and analyze large and complex datasets from multiple sources. Identify trends, patterns, correlations, and anomalies in big data to support business insights. Use statistical methods and data mining techniques to generate actionable recommendations. 2. Reporting & Visualization Create dashboards, reports, and...

About the Company: Founded in 2019, zingbus is building the most trusted brand for intercity travel. Keeping reliability and safety at the core, we are building a two-sided platform that delivers standardized journey experience for travelers and increased earnings for our supply partners. We connect 300+ cities across the country through our daily services and have served 2.5 Mn+ unique customers so far and are aggressively working towards the fleet electrification and establishment of charging technology and infrastructure. Raised Series A from Y Combinator, InfoEdge, AdvantEdge, and other prominent investors from India and Silicon Valley. Additionally, secured a significant investment of $...

About PhonePe Limited: Headquartered in India, its flagship product, the PhonePe digital payments app, was launched in Aug 2016. As of April 2025, PhonePe has over 60 Crore (600 Million) registered users and a digital payments acceptance network spread across over 4 Crore (40+ million) merchants. PhonePe also processes over 33 Crore (330+ Million) transactions daily with an Annualized Total Payment Value (TPV) of over INR 150 lakh crore. PhonePe’s portfolio of businesses includes the distribution of financial products (Insurance, Lending, and Wealth) as well as new consumer tech businesses (Pincode - hyperlocal e-commerce and Indus AppStore Localized App Store for the Android ecosystem) in I...

Job Summary: We are seeking a highly skilled Data Engineer with a strong background in Python. The ideal candidate will have 7 10 years of experience in data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, enabling data driven decision making across the organization. Responsibilities: Design, develop, and maintain robust data pipelines and ETL processes to support data ingestion and transformation. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions. Imp...

Today Top Secret/SCI $150,000 - $198,000 Unspecified Engineering - Systems Augusta, GA (ON-SITE/OFFICE) Requirements Job Description We are seeking a highly motivated and experienced DevOps Engineer to join our fast-paced development team. The ideal candidate will have strong working knowledge in Kubernetes and Container Orchestration, Configuration Management, CI/CD, Automation, AWS, Linux systems administration, Scripting in Bash and Programming in Python, and a background in Big Data solutions. The DevOps Engineer will be responsible for implementing infrastructure, automating deployment processes, and ensuring the monitoring, reliability and scalability of our services. Work is performed...

DESCRIPTION AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and emerging technologies include AWS Partners, AWS Sovereign Cloud, AWS International Product, and the Ge...

DESCRIPTION AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and emerging technologies include AWS Partners, AWS Sovereign Cloud, AWS International Product, and the Generative AI Innovation Center. You’ll join a diverse team of technical experts in dozens of countries who help customers achieve more with the AWS cloud. Are you a Data Analytics specialist? Do you have Data Warehousing, Hadoop/D...

Description - Internal At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. Description: The role is under Data Analytics and Testing Team which is a critical role in Regulatory Automations and Change Management (RAC...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

DESCRIPTION Are you fascinated by the power of Natural Language Processing (NLP) and Large Language Models (LLM) to transform the way we interact with technology? Are you passionate about applying advanced machine learning techniques to solve complex challenges in the e-commerce space? If so, Amazon's International Seller Services team has an exciting opportunity for you as an Applied Scientist. At Amazon, we strive to be Earth's most customer-centric company, where customers can find and discover anything they want to buy online. Our International Seller Services team plays a pivotal role in expanding the reach of our marketplace to sellers worldwide, ensuring customers have access to a vas...

DESCRIPTION AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and emerging technologies include AWS Partners, AWS Sovereign Cloud, AWS International Product, and the Ge...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

Job Description Data Science & AI AI Expert Bangalore This is Worldline We are the innovators at the heart of the payments technology industry, shaping how the world pays and gets paid. The solutions our people build today power the growth of millions of businesses tomorrow. From your local coffee shop to unicorns and international banks. From San Francisco to Auckland. We are in every corner of the world, in every part of commerce. And just as we help our customers accelerate their business, we are committed to helping our people accelerate their careers. Together, we shape the evolution. The Opportunity At Worldline, our technology addresses the persistent challenges of the payment world. ...

DESCRIPTION AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and emerging technologies include AWS Partners, AWS Sovereign Cloud, AWS International Product, and the Generative AI Innovation Center. You’ll join a diverse team of technical experts in dozens of countries who help customers achieve more with the AWS cloud. Are you a Data Analytics specialist? Do you have Data Warehousing, Hadoop/D...

DESCRIPTION Come and be part of Data Engineering team at Amazon and work on solving modern and relevant business problems! We are a team of DEs who support Applied Scientists, Data Scientist, and Economists who experiment, research, and turn machine/deep learning and AI research into great products for our customers. We are seeking a smart, highly-motivated, and experienced Data Engineer to join Amazon. As a Data Engineer, you will provide technical leadership, lead data engineering initiatives and build end-to-end analytical solutions that are highly available, scalable, stable, secure, and cost-effective. You are passionate about working with large datasets and have experience with the org...

Senior Associate Application Developer Bangalore, Karnataka, India We are seeking a skilled Senior Associate Application Developer with excellent expertise in C#, Salesforce, and DevOps practices. The ideal candidate will play a key role in developing, implementing, and maintaining software applications that align with our business goals. You will work collaboratively with cross-functional teams to deliver high-quality solutions that enhance our operational efficiency. What youll be DOING What will your essential responsibilities include? Design, develop, and maintain applications using C# and Salesforce technologies. Collaborate with business analysts and stakeholders to gather requirements...

Snowflake is about empowering enterprises to achieve their full potential — and people too. With a culture that’s all in on impact, innovation, and collaboration, Snowflake is the sweet spot for building big, moving fast, and taking technology — and careers — to the next level. We are looking for a Solutions Architect to be part of our Professional Services team to deploy cloud products and services for our customers' Global Competency Centers located in India. This person must be a hands-on, self-starter who loves solving innovative problems in a fast-paced, agile environment. The ideal candidate will have the insight to connect a specific business problem and Snowflake’s solution and commu...

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Alteryx Administrator to join our team in Hyderabad, Telangana (IN-TG), India (IN). Altery Administrator Working with Alteryx servers, Setup Alteryx Desinger, Gallery, Controller, Worker, Persistant Layer (connect to databases, user management & permissions setup) Minimum 3 + years relavent experince overall 5 years experince. Maintenance of Designer & Gallery (update, backup & migration of Desinger instances) Management of Alteryx workflows and access/ data sharing amo...

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Software Engineering Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transfor...

Technical Architect (Python) Location: Ahmedabad Employment Type: Full-Time Experience: 8–10 years About the Role We are seeking an experienced Technical Architect (Python) to lead the design and architecture of scalable, high-performance software systems. The ideal candidate will provide technical leadership, guide development teams, and ensure that all solutions meet business and technical requirements. Key ResponsibilitiesSolution Architecture Design and oversee architecture of complex Python-based systems. Ensure solutions are scalable, secure, and optimized for performance and maintainability. Technical Leadership Lead and mentor development teams. Define coding standards, best practice...

Job Title: AI/ML Engineer Experience Required: 4 to 8 Years CONTRACTUAL JOB: 3 MONTHS Location: Pune (Work from Office) About the Role We are seeking a skilled and passionate AI/ML Engineer with at least 4 years of experience to join our growing team. The ideal candidate will have strong expertise in designing, developing, and deploying machine learning and deep learning models, including Retrieval-Augmented Generation (RAG) systems, along with the ability to translate business problems into data-driven solutions. Key Responsibilities Design, build, and deploy scalable machine learning and AI models for real-world applications. Work closely with data scientists, engineers, and business stake...