26798 Hadoop Jobs

Role: Senior Data Engineer Location: Mumbai & Pune Experience: 3yrs to 8yrs Technologies / Skills: Advanced SQL, Python and associated libraries like Pandas, NumPy etc., Pyspark , Shell scripting, Data-Modelling, Big data, Hadoop, Hive, ETL pipelines. Responsibilities: • Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and develop data engineering strategy. • Ability to work with business owners to define key business requirements and convert to user stories with required technical specifications. • Communicate results and business impacts of insight initiatives to key stakeholders to collaborat...

Profile Description We’re seeking someone to join our team as (Director) who will be working as the QA automation analyst and drive the core automation activities. WM_Technology Wealth Management Technology is responsible for the design, development, delivery, and support of the technical solutions behind the products and services used by the Morgan Stanley Wealth Management Business. Practice areas include: Analytics, Intelligence, & Data Technology (AIDT), Client Platforms, Core Technology Services (CTS), Financial Advisor Platforms, Global Banking Technology (GBT), Investment Solutions Technology (IST), Institutional Wealth and Corporate Solutions Technology (IWCST), Technology Delivery M...

Job description Hiring for Hadoop Developer Mandatory Skills: Hadoop, bigdata, spark Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed funct...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

5+yrs of hands on experience in Hadoop Scala Pyspark Hive Spark hive Impala SQL with Hadoop eco system Experience in design and development of data engineering platforms .Guide developers and others on project limitations and capabilities, performance requirements and interfaces .Good understanding of Data integration, Data Quality and data architecture Location Bengaluru Job Function TECHNOLOGY Role Engineer Job Id 387777 Desired Skills Big Data | Spark Desired Candidate Profile Qualifications : BACHELOR OF ENGINEERING

Key Responsibilities: A day in the life of an Infoscion As part of the Infosys delivery team your primary role would be to interface with the client for quality assurance issue resolution and ensuring high customer satisfaction You will understand requirements create and review designs validate the architecture and ensure high levels of service offerings to clients in the technology domain You will participate in project estimation provide inputs for solution delivery conduct technical risk planning perform code reviews and unit test plan reviews You will lead and guide your teams towards developing optimized high quality code deliverables continual knowledge management and adherence to the ...

Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to join our team i...

Discover your future at Citi Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact. Job Overview At Citi we’re not just building technology, we’re building the future of banking. Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with laser focused on evolving the ways of doing things. As one of the world’s most global banks we’re changing how the world does bu...

Technical Architect (Python) Location: Ahmedabad Employment Type: Full-Time Experience: 8–10 years About the Role We are seeking an experienced Technical Architect (Python) to lead the design and architecture of scalable, high-performance software systems. The ideal candidate will provide technical leadership, guide development teams, and ensure that all solutions meet business and technical requirements. Key ResponsibilitiesSolution Architecture Design and oversee architecture of complex Python-based systems. Ensure solutions are scalable, secure, and optimized for performance and maintainability. Technical Leadership Lead and mentor development teams. Define coding standards, best practice...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

About the Role: Our client, a global technology and AI-focused organization, is seeking an experienced Data Engineer – AI Trainer for a short-term, remote engagement with flexible working hours. This role combines large-scale data engineering with AI training and prompt-related workflows to support intelligent, data-driven systems. Key Responsibilities Build, maintain, and scale ETL pipelines for batch and streaming data Work with big data technologies including Hadoop and Spark Design and manage real-time data pipelines using Kafka Prepare high-quality datasets for AI training, evaluation, and prompt engineering Collaborate with ML and product teams to support AI model development Clearly d...

At eBay, we're more than a global ecommerce leader — we’re changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We’re committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts. Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work — every day. We're in this together, sustaining the future of our customers, our company, and our planet. Join a team of passionate thinkers, innovators, and dreamers — and help us connect people and build communities to create economic opportunity for all. ...

The future. It’s on you. You & Western Digital. We’ve been storing the world’s data for more than 50 years. Once, it was the most important thing we could do for data. Now we’re helping the world capture, preserve, access and transform data in a way only we can. The most game-changing companies, consumers, professionals, and governments come to us for the technologies and solutions they need to capture, preserve, access, and transform their data. But we can’t do it alone. Today’s exceptional data challenges require your exceptional skills. It’s You & Us. Together, we’re the next big thing in data. Western Digital® data-centric solutions are found under the G-Technology™, HGST, SanDisk®, Tegi...

Role Description Roles and responsibilities : Duties of Lead Data/platform engineer We are looking for a Lead Engineer to join our Ascend Cloud Foundation Platform team. We unlock the power of data to create opportunities for consumers, businesses and society. At life's big moments – from buying a home or car, to sending a child to university, to growing a business exponentially by connecting it with new customers – we empower consumers and our clients to manage their data with confidence so they can maximize every opportunity. Reporting into our Engineering Director, you will join an established agile team, with a passion and lead a technical team that supports innovation, learning and coll...

Job Description JOB DATA JOB TITLE: Lead - Data Engineer Argano is the world’s largest global digital consultancy, exclusively connecting design and delivery for the transformation of high-performance business operations, extending our clients’ commercial agility, profitability, customer experience, and growth. Our strategic consulting, bolstered by proprietary IP, provides a comprehensive view of business operations, pinpointing areas of strength and unveiling opportunities for improvement. Argano is at the intersection of operations and technology for digital transformation. The Lead Data Engineer plays a critical role in designing and delivering scalable data solutions while leading and m...

Location: Remote About The Job At Alignerr, we partner with the world’s leading AI research teams and labs to build and train cutting-edge AI models. You’ll challenge advanced language models on topics like machine learning theory, statistical inference, neural network architectures, and data engineering pipelines—documenting every failure mode so we can harden model reasoning. Organization : Alignerr Position : Data Scientist (Masters) - AI Data Trainer Type : Hourly Contract Compensation : $40–$80 /hour Location : Remote Commitment : 10–40 hours/week What You’ll Do Develop Complex Problems: Design advanced data science challenges across domains like hyperparameter optimization, Bayesian in...

About the Role: Grade Level (for internal use): 10 Segment: S&P Global Energy The Role: Senior Software Developer Grade 10 The Team: We are looking for a highly motivated, enthusiastic, and skilled engineering leader for S&P Global Energy. We strive to deliver solutions that are sector-specific, data-rich, and hyper-targeted for evolving business needs. The Impact: S&P Global Energy is seeking a Senior Software Developer to provide technical leadership for all stages of software design, development, and maintenance for data processing applications. This person would be part of a development team that manages and supports the internal applications that support Horizon business datasets. This ...

About Client: Our Client is a global IT services company headquartered in Southborough, Massachusetts, USA. Founded in 1996, with a revenue of $1.8B, with 35,000+ associates worldwide, specializes in digital engineering, and IT services company helping clients modernize their technology infrastructure, adopt cloud and AI solutions, and accelerate innovation. It partners with major firms in banking, healthcare, telecom, and media. Our Client is known for combining deep industry expertise with agile development practices, enabling scalable and cost-effective digital transformation. The company operates in over 50 locations across more than 25 countries, has delivery centers in Asia, Europe, an...

Location: Remote About The Job At Alignerr, we partner with the world’s leading AI research teams and labs to build and train cutting-edge AI models. You’ll challenge advanced language models on topics like machine learning theory, statistical inference, neural network architectures, and data engineering pipelines—documenting every failure mode so we can harden model reasoning. Organization : Alignerr Position : Data Scientist (Masters) - AI Data Trainer Type : Hourly Contract Compensation : $40–$80 /hour Location : Remote Commitment : 10–40 hours/week What You’ll Do Develop Complex Problems: Design advanced data science challenges across domains like hyperparameter optimization, Bayesian in...

TCS has been a great pioneer in feeding the fire of Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together. TCS Hiring for AWS Data Engineer Experience Range: - 5 years & Above Location: Chennai Must-Have Strong hands-on experience in Python programming and PySpark Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) Experience working with Apache Spark and Hadoop ecosystem. Experience in writing and optimizing SQL for data manipulations. Good Exposure to scheduling tools. Airflow is preferable. Must – Have Data Warehouse Experience with AWS Redshift or Hive Experience in implementing security measures for data ...

About Client :- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is committed to unleashing human energy through technology for an inclusive and sustainable future, helping organisations accelerate their transition to a digital and sustainable world. They provide a variety of services, including consulting, technology, professional, and outsourcing services. Job Details:- location: Gurugram Mode Of Work : ...

At Citi we’re not just building technology, we’re building the future of banking. Encompassing a broad range of specialties, roles, and cultures, our teams are creating innovations used across the globe. Citi is constantly growing and progressing through our technology, with laser focused on evolving the ways of doing things. As one of the world’s most global banks we’re changing how the world does business. Shape your Career with Citi We’re currently looking for a high caliber professional to join our team as Officer, Big Data Engineer -Hybrid based in Chennai, India. Being part of our team means that we’ll provide you with the resources to meet your unique needs, empower you to make health...

Join our data team and play a crucial role in powering the next generation of property technology. You'll design and build robust data pipelines that transform how estate agents and property professionals make decisions, using both Microsoft's leading-edge data stack and our innovative in-house C# solutions. Working closely with our Data Analysts, you'll ensure clean, structured data flows seamlessly into Power BI dashboards that drive business growth for thousands of property professionals worldwide. Essential Requirements Create highly scalable Data Dashboard solution that can collect, store,process & analyse sets of data from a wide variety of sources Be responsible for setting up Data In...

Role Overview: As an Engineer/ Sr Engineer/ Lead Engineer / Principal Engineer in SMART Solutions & AI Delivery at Futuristic Underwriters Pvt. Ltd., you will be instrumental in building the future of insurance with AI. Join the India Digital Innovation Unit to design and deploy AI-powered solutions that revolutionize underwriting, claims, and operational efficiency for a leading global insurer. Whether you are an AI Engineer, Senior Engineer, or Principal Engineer with 3 to 15 years of experience, your role will involve hands-on model building and AI platform architecture to drive impactful outcomes. Key Responsibilities: - Design, train, and deploy ML models for risk scoring, underwriting ...