26832 Hadoop Jobs - Page 16

Define, Design, and Build an optimal data pipeline architecture to collect data from a variety of sources, cleanse, and organize data in SQL & NoSQL destinations (ELT & ETL Processes). Define and Build business use case-specific data models that can be consumed by Data Scientists and Data Analysts to conduct discovery and drive business insights and patterns. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ tec...

DESCRIPTION Do you want to join an innovative team of scientists who use machine learning and statistical techniques to create state-of-the-art solutions for providing better value to Amazon’s customers? Do you want to build and deploy advanced algorithmic systems that help optimize millions of transactions every day? Are you excited by the prospect of analyzing and modeling terabytes of data to solve real world problems? Do you like to own end-to-end business problems/metrics and directly impact the profitability of the company? Do you like to innovate and simplify? If yes, then you may be a great fit to join the Machine Learning and Data Sciences team for India Consumer Businesses. If you ...

About the role Lead solution scoping and development to drive Enterprise Analytics team’s partnership with Business teams across Tesco to enable data driven decisions and deliver on organization's key strategic priorities You will be responsible for Following our Business Code of Conduct and always acting with integrity and due diligence and have these specific risk responsibilities: Represent Talent Acquisition in all forums/ seminars pertaining to process, compliance and audit Perform other miscellaneous duties as required by management Driving CI culture, implementing CI projects and innovation for withing the team Engaging with business & functional partners to understand business priori...

Condé Nast is a global media company producing the highest quality content with a footprint of more than 1 billion consumers in 32 territories through print, digital, video and social platforms. The company’s portfolio includes many of the world’s most respected and influential media properties including Vogue, Vanity Fair, Glamour, Self, GQ, The New Yorker, Condé Nast Traveler/Traveller, Allure, AD, Bon Appétit and Wired, among others. Job Description Location: Bengaluru, KA About The Role: Condé Nast is seeking a motivated and skilled Machine Learning Engineer I to support the productionization of machine learning projects in Databricks or AWS environments for the Data Science team. This r...

Profile Description We’re seeking someone to join our WM Technology team as a ETL QA, in Analytics Intelligence & Data Technology to who will be working as the QA automation analyst and drive the core automation activities. In the Technology division, we leverage innovation to build the connections and capabilities that power our Firm, enabling our clients and colleagues to redefine markets and shape the future of our communities. This is Associate position that devises test strategies, conducts and/or coordinates tests, and identifies defects to maintain high standards of performance and reliability. Since 1935, Morgan Stanley is known as a global leader in financial services, always evolvi...

CGI Information Systems and Management Consultants is looking for Hadoop Developer to join our team Roles and Responsibility Design, develop, and implement Hadoop-based solutions for complex data processing needs. Collaborate with cross-functional teams to identify business requirements and design scalable data architectures. Develop high-quality code that meets performance, security, and reliability standards. Troubleshoot and optimize Hadoop clusters for optimal performance. Participate in code reviews to ensure adherence to coding standards and best practices. Stay updated with the latest trends and technologies in Hadoop development. Job Requirements Strong understanding of Hadoop ecosys...

CGI Information Systems and Management Consultants is looking for Senior JAVA Developer to join our team Roles and Responsibility Design, develop, and test high-quality software applications using Java. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale Java-based systems with complex architecture. Troubleshoot and resolve technical issues efficiently. Participate in code reviews and contribute to improving overall code quality. Stay updated with the latest trends and technologies in Java development. Job Requirements Strong proficiency in Java programming language. Excellent understanding of object-oriented programming c...

Job Description: As a Data Engineer, you will be responsible for designing, developing, and maintaining the data infrastructure that powers our technology platform. You will work closely with cross-functional teams to build scalable data pipelines, optimize data workflows, and ensure the reliability and performance of our data systems. Responsibilities: Design, develop, and maintain ETL pipelines to collect, process, and store data from various sources. Work with APIs, databases, and other data sources to integrate data into the data warehouse. Implement and maintain data validation and monitoring processes to ensure data accuracy and reliability. Collaborate with data scientists, analysts, ...

About Sopra Steria Sopra Steria, a major Tech player in Europe with 50,000 employees in nearly 30 countries, is recognised for its consulting, digital services and solutions. It helps its clients drive their digital transformation and obtain tangible and sustainable benefits. The Group provides end-to-end solutions to make large companies and organisations more competitive by combining in-depth knowledge of a wide range of business sectors and innovative technologies with a collaborative approach. Sopra Steria places people at the heart of everything it does and is committed to putting digital to work for its clients in order to build a positive future for all. In 2024, the Group generated r...

Greetings, We are hiring for the below: Position: Solution Architect (Data & AI) Experience: 8+ Yrs Work Model: Work from Home in India and if needed should be willing to travel onsite in Abu Dhabi Notice Period: Immediate to 30 days Mode: Permanent Job Description We are looking for an experienced, hands-on Solution Architect (Data and AI) to lead the architecture, design, and delivery of advanced Data and AI solutions for enterprise clients across industries. The role combines technical leadership, strategic consulting, and solution design, ensuring our clients derive measurable business value from their data investments. You will act as a trusted advisor to clients, guide technical teams,...

ABOUT QUINCE Founded in 2018, Quince was built to challenge the idea that nice things have to cost a lot. Our mission is simple: to make really high quality essentials for really low prices, produced fairly and sustainably. We believe everyone deserves exceptional craftsmanship and timeless design without the traditional markups. Quince is a direct-to-consumer (DTC) model that cuts out middlemen and leverages just-in-time manufacturing to minimize waste and maximize value. Quince is a tech company disrupting the retail industry by putting AI, analytics and automation at the center of everything we do. Our unwavering commitment to excellence and company values guide our teams and actions: Cus...

Role: GCP DevOps Engineer Required Technical Skill Set : Google Cloud Platform Desired Experience Range : 5-8 Years Location of Requirement : Hyderabad, Mumbai, Bangalore Desired Competencies (Technical/Behavioral Competency): Must-Have · Knowledge on Google cloud Platform · Hands-on development experience on Google Cloud Platform, on · Following Cloud services: Pub sub, Data proc, Data flow, CDAP, GCP Storage Concept, Cloud Functions · Knowledge on Microservices, Docker, Kubernetes, etc. · Experience with working on workflow schedulers Airflow, Compose · Experience with Java, Python or Scala programming language · Experience with shell scripting · Hands-on development experience in Big Quer...

Job Description Citco Bank is seeking an experienced Data Scientist to lead our growing analytics team. The ideal candidate will combine strong technical expertise, business acumen, and proven management experience to develop and implement sophisticated machine learning models and data-driven solutions. This role will be crucial in driving data-based decision-making across our banking and financial services operations working closely with cross-functional teams to deliver actionable insights and innovative solutions Responsibilities Lead the development and implementation of advanced machine learning models and statistical analyses to solve complex business problems Collaborate with business...

About the Role We are seeking a highly skilled and proactive Lead QA Engineer with 47 years of strong hands-on experience in API testing, SQL, and Linux, along with exposure to or interest in Big Data testing. In this role, you will take ownership of quality across services, guide junior team members, and ensure robust end-to-end validation of complex data-driven applications. You will work closely with cross-functional teams to deliver high-quality, scalable, and reliable solutions. Key Responsibilities Design, develop, and execute comprehensive API test cases using tools like Postman, Rest Assured, etc. Perform backend data validations using advanced SQL queries (joins, aggregations, data ...

Business Overview The Analytics & Data (A&D) organization is a key growth area within Morgan Stanley's Wealth Management Division, playing a critical role in the execution of the wider Wealth Management strategy. The team owns all the executive reporting, insights, and predictive modeling in support of Wealth Management business. The use of analytics and data will be a key driver in accelerating growth across client segments, enabling data-driven decision making and delivering the best client experience. We are looking for an experienced professional to join the Analytics & Data organization who will be responsible for analytics for US Banks. The candidate will work with data in a hands-on c...

Greeting from LTIMindtree!! We are thrilled to announce an exciting opportunity for the role of Talend Architect . We are on the lookout for exceptional candidates who can join us within an immediate to 30 days' time. If you are passionate about this field and eager to take on new challenges, we would love to hear from you! This is a fantastic chance to become a part of our dynamic team and contribute to our projects with your expertise and skills. About the Role The Talend Architect will design and implement real-time data integration solutions using Talend for population scale system development. This role requires expertise in big data processing, Talend architecture, and cloud-based inte...

Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes Build and operate data platforms using modern cloud and big data technologies Act as an individual contributor (~60%), delivering high-quality, production-ready code Coach and mentor data engineers on best practices and engineering standards Perform code reviews, design reviews, and ensure testing and deployment quality Monitor and optimize data infrastructure performance and reliability Resolve complex technical challenges and manage technical debt Ensure DevSecOps practices are embedded into daily engineering work Collaborate with Engineering Managers, Product Owners, Business Analysts, and Scrum M...

Job Summary The role of a Senior Specialist on the FCSO TM & Fraud -Tuning team is that of an individual contributor and involves working with three facets – Working with large volumes of confidential and regulated data associated with customer’s financial transactions , Development of scripts and routines using new age programming languages and working of the Oracle / Hive environments to work with large volumes of structured and unstructured data , Apply analytical / statistical / quantitative models on data to identify anomalies and patterns which help in providing insight on the AML behaviour associated with customers and the transactions conducted by them. The role is a global role that...

As a data engineer - YOU GET TO WORK ON- Data modeling for OLAP, warehousing and building ETL pipelines on cloud AWS technologies like EMR, Lambda, S3, SQS, EC2, Glue, etc. Using Airflow for orchestration BASIC QUALIFICATIONS 1-3 years of data engineering experience Experience with SQL and NoSQL databases Practical Knowledge of Linux or Unix shell scripting. Experience in at least one programming language, such as Python or Javascript Experience partnering with business owners directly to understand their requirements and provide data which can help them observe patterns and spot anomalies PREFERRED QUALIFICATIONS Experience with emerging technologies in space like Kafka, ClickHouse Experien...

We are seeking an experienced ETL/SQL/Python Testing Engineer to design, develop, and execute test cases for data pipelines, ETL processes, and database systems. The ideal candidate will possess strong expertise in SQL querying, ETL validation, Python scripting, and test automation to ensure data accuracy, completeness, and optimal performance. Your future duties and responsibilities: Develop and execute ETL test cases to validate data extraction, transformation, and loading processes Perform ETL pipeline testing in an ADB (Azure Databricks) environment Write complex SQL queries to verify data integrity, consistency, and correctness across source and target systems Automate ETL testing workf...

Job Description: As a Data Engineer, you will be responsible for designing, developing, and maintaining the data infrastructure that powers our technology platform. You will work closely with cross-functional teams to build scalable data pipelines, optimize data workflows, and ensure the reliability and performance of our data systems. Responsibilities: Design, develop, and maintain ETL pipelines to collect, process, and store data from various sources. Work with APIs, databases, and other data sources to integrate data into the data warehouse. Implement and maintain data validation and monitoring processes to ensure data accuracy and reliability. Collaborate with data scientists, analysts, ...

PolicyBazaar.com is India's largest insurance marketplace and a leading fintech player globally. It has backing from a host of investors including the likes of SoftBank, InfoEdge (Naukri.com), Temasek, Tiger Global Management, True North, Premji Invest. The portal started in 2008 with a purpose to educate people on insurance products and has had a significant influence on how insurance is bought in India. About the AI Lab at Policybazaar The AI Lab at Policybazaar is at the forefront of innovation, tackling advanced challenges in processing and analyzing audio, image/video, and text data on a large scale. Our work spans various domains including Speech Recognition, Natural Language Processin...

Role - Data Architect Years of Experience - 15 to 22 years Location - Pan India 15+ years of overall experience in architecting and building data and analytics solutions Proven hands-on experience in architecting and implementing solutions using leading cloud data platforms like Databricks, Snowflake, Microsoft Fabric etc. Strong background in designing and implementing ETL/ELT processes, data lakes, and data warehouses Strong knowledge and experience in building data quality and metadata management solutions. Experience with one or more major cloud platforms (Azure, AWS, GCP), with a preference for Azure and its data services ecosystem Familiarity with Spark, Hadoop, and streaming data tech...

Job Description Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success, we have evolved to become one of the top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail and supply chain. We are currently looking for Lead Software Engineer_Back End who has proven track record in IT Industry. This is an exciting opportunity to expand your skill set, achieve job satisfaction and work-life balance. More detail...

About The Opportunity Operating in the IT services & analytics sector, this role sits inside a data engineering practice that builds large-scale batch and streaming data platforms for enterprise clients. We deliver high-throughput, low-latency data processing solutions using Hadoop ecosystems and modern ETL practices to support analytics, reporting and ML use cases. Position: Big Data Engineer (Hadoop Developer) | Location: India | Workplace: On-site Role & Responsibilities Design, develop and maintain end-to-end Hadoop-based data pipelines for batch and streaming ingestion, transformation, and delivery to downstream consumers. Implement and optimise Spark and MapReduce jobs for high-volume ...