22039 Hadoop Jobs - Page 34

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : Data Engineering Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Key Responsibilities Design and build efficient data ingestion pipelines from multiple sources using Databricks and Spark.Develop and implement strategies that integrate data ingestion, processing, governance, and analytics.Store and process raw, unstructured, semi-structured, and structured data in Databrick...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code across multiple clients. Your typical day will involve collaborating with team members to ensure the successful implementatio...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Analytics Services Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Roles & Responsibilities:-Develop and Optimize Data Pipelines using PySpark and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads.-Design and Implement ETL Processes by leveraging Databricks notebooks, Delta Lake, and Python-based custom scripts for data ingestion and curation.-Collaborate with Data Ana...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Warehouse ETL Testing Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. Your typical day will involve collaborating with teams to develop innovative solutions and ensure seamless application functionality. Roles & Responsibilities:- Expected to be an SME- Collaborate and manage the team to perfor...

Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc. Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation Ability to analyse data for functional business requirements & front face customer Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 5 to 7 years of relevant experience working as technical analyst with Big Query on GCP platform. Skilled in multiple GCP services - GCS, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer You love colla...

Job Description Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert re...

Role Description: The UI Developer is responsible for designing, developing, and maintaining user interfaces for software applications and solutions that meet business needs. This role involves working closely with product managers, designers, and other engineers to create high-quality, scalable software solutions. Roles & Responsibilities: Take ownership of complex software projects from conception to deployment. Manage software delivery scope, risk, and timeline. Possess strong rapid prototyping skills and can quickly translate concepts into working code. Contribute to front-end development using cloud technology. Develop innovative solutions using generative AI technologies. Conduct code ...

Role Purpose The purpose of this role is to design, develop and troubleshoot solutions/ designs/ models/ simulations on various softwares as per clients/ project requirements Do 1. Design and Develop solutions as per clients specifications Work on different softwares like CAD, CAE to develop appropriate models as per the project plan/ customer requirements Test the protype and designs produced on the softwares and check all the boundary conditions (impact analysis, stress analysis etc) Produce specifications and determine operational feasibility by integrating software components into a fully functional software system Create a prototype as per the engineering drawings & outline CAD model is...

Mandatory Skills: Palantir . Experience3-5 Years .

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Looking for a skilled AI Data Engineer to join our team in Hyderabad. The ideal candidate will have 2-7 years of experience and a strong background in artificial intelligence, data engineering, and machine learning. Roles and Responsibility Design and develop scalable data pipelines using AI and ML techniques. Collaborate with cross-functional teams to integrate data from various sources. Develop and maintain large-scale data systems and architectures. Ensure data quality and integrity through data validation and testing procedures. Implement data governance policies and standards. Optimize data processing workflows for improved performance and efficiency. Job Requirements Strong knowledge o...

We are looking for a highly skilled and experienced Cloud Data Engineer to join our team at Apple India Pvt Ltd. The ideal candidate will have a strong background in designing, developing, and implementing data engineering solutions on cloud platforms. Roles and Responsibility Design and develop scalable and efficient data pipelines using cloud-based technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data architectures on cloud platforms such as AWS or Azure. Ensure data quality and integrity by implementing data validation and testing procedures. Optimize data processing workflows to improve performance and...

We are looking for a highly skilled Machine Learning Engineer with 2 to 7 years of experience to join our team at Apple India Pvt Ltd. The ideal candidate will have expertise in machine learning and natural language processing. Roles and Responsibility Design, develop, and deploy machine learning models using various algorithms and techniques. Collaborate with cross-functional teams to integrate machine learning solutions into existing systems. Develop and maintain large-scale data pipelines and architectures. Conduct research and experimentation to improve model performance and efficiency. Work closely with data engineers to ensure seamless data flow and processing. Implement automated test...

We are looking for a skilled Cloud Data Engineering Manager to lead our team in designing and implementing scalable data engineering solutions. The ideal candidate will have a strong background in cloud computing, data engineering, and leadership. Roles and Responsibility Design and implement large-scale data engineering projects on cloud platforms. Lead a team of engineers in developing and deploying data pipelines and architectures. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain technical roadmaps and strategies for data engineering initiatives. Ensure high-quality code reviews and adherence to industry standards. Troub...

Should have strong experience in ETL testing with 6 to 9 years Should be strong in SQL query writing Experience with data warehousing and ETL processes Proficiency in Hadoop, Spark, and Hive Knowledge of SQL and NoSQL databases Experience with data warehousing and ETL processes This role involves working closely with data engineers, data analysts, and other stakeholders to ensure the accuracy, efficiency, and reliability of big data systems and applications

Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours! Adobe is seeking Produ...

Bachelors degree or equivalent experience or equivalent in computer science 6+ years experience in Java/Angular/BigData/Spark/Kafka/SQL/Python/AWS/Microservices Preferred knowledge/experience in the following technologies Angular Spark, Java Streaming and Batch Analytics processes Data Frameworks: Hadoop, Spark, Kafka Experience in following Tools: Eclipse, Maven, Gradle, DB tools, Bitbucket/JIRA/Confluence Can develop SOA services and good knowledge of REST API and Micro service architectures Solid knowledge of web architectural and design patterns Understands software security practices including user authentication and authorization, data validation and an understanding of common DOS and ...

Associate Managing Consultant, Advisors & Consulting Services, Performance Analytics Advisors with Advanced Analytics is charged with servicing Consulting Services, Information Services and Managed Services by centralizing and optimizing the world class Solution Design, analytical, modeling, product development, product management, econometrics, and associated delivery capabilities of the MasterCard Advisors organization. Use broad retail, capital markets, media, and/or payments industry experience and deep knowledge of the application of big data quantitative analytics to provide hands-on support for information product development and custom analytical project delivery that satisfies and r...

Job Title: Senior Data Engineer (Kafka & AWS) Responsibilities: Develop and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services . Configure and manage Kafka connectors , ensuring seamless data flow and integration across systems. Demonstrate strong expertise in the Kafka ecosystem , including producers, consumers, brokers, topics, and schema registry. Design and implement scalable ETL/ELT workflows to efficiently process large volumes of data. Optimize data lake and data warehouse solutions using AWS services such as Lambda, S3, and Glue . Implement robust monitoring, testing, and observability practices to ensure reliability and performance of data platf...

Job Description : About Diageo: Diageo is the worlds leading premium drinks company with Outstanding collection of brands, such as Johnnie Walker, Smirnoff, Baileys, Captain Morgan, Tanqueray and Guinness. With over 200 brands in 180 countries and a global network of daring individuals, our teams blend a diverse range of experience, knowledge and skills. We connect customers and consumers to our iconic products and build innovative experiences that bring people together to celebrate life. Who we are: The Digital & Technology vision is to own the way in the transformation of Diageo business capabilities, demonstrating data & digital technology, to build a driven edge in the marketplace. About...

Who we are About Stripe About the team The Batch Compute team at Stripe manages the infrastructure, tooling and systems behind running batch processing systems at Stripe, which are currently powered by Hadoop and Spark. Batch processing systems power several core asynchronous workflows at Stripe and operate at significant scale. Were looking for a Software Engineer with experience designing, building and maintaining high-scale, distributed systems. You will work with a team that is in charge of the core infrastructure used by the product teams to build and operate batch processing jobs. You will have an opportunity to play a hands-on role in significantly rearchitecting our current infrastru...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

We are seeking an AI Builder for our TAI initiative to develop a conversational bot using RAG framework and LLM, Develop new models and integrate GenAI to analyze the data. Positions in this function produce innovative solutions driven by exploratory data analysis from unstructured, diverse datasets typically measured in gigabytes or larger. Applies knowledge of statistics, machine learning, programming, data modeling, simulation, and advanced mathematics to recognize patterns, identify opportunities, pose business questions, and make valuable discoveries leading to prototype development and product improvement. Uses a flexible, analytical approach to design, develop, and evaluate predictive...

Job Description Job Summary: We are looking for a proactive and technically strong Lead Gen AI Engineer 10+ years exp to lead a high-performing offshore team working on Gen AI solutions in the real estate domain. This role requires close collaboration with the Gen AI Architect and direct accountability for delivery, technical execution, and mentoring the team across various Gen AI initiatives. Key Responsibilities: - Lead the offshore team in developing, testing, and deploying Gen AI and NLP-based applications. - Collaborate closely work with the Lead Architect to translate high-level designs into actionable workstreams. - Develop and guide the team on best practices in GPT-based development...

Immediate Joiners Only Job Title: GCP Big Data Engineer Location: Bangalore / Gurugram Experience: 4–12 years About the Role We are seeking a GCP Big Data Engineer with strong expertise in building, optimizing, and managing large-scale data solutions on Google Cloud Platform (GCP) . The ideal candidate will have hands-on experience in GCP Big Data services , PySpark , SQL , and ETL design , along with the ability to lead and deliver complex data engineering initiatives. Key Responsibilities Design, develop, and maintain scalable and efficient data pipelines using GCP Big Data technologies. Implement ETL workflows using PySpark , SQL , and GCP-native services . Drive architecture discussions ...