21920 Hadoop Jobs - Page 6

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : AWS Glue Good to have skills : Python (Programming Language), Amazon Web Services (AWS), Machine LearningMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutio...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating wit...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Building Tool Good to have skills : Snowflake Data Warehouse Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuri...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Data Services Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. Your typical day will involve collaborating with teams, making team decisions, and providing solutions to problems for your immediate team and across multiple teams. You will engage with multiple teams and contribute to ke...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Oracle Procedural Language Extensions to SQL (PLSQL) Good to have skills : Python (Programming Language), Data Engineering, Google BigQuery Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating wit...

About Solidatus At Solidatus, we’re changing how organisations understand their data. We’re an award-winning, venture-backed software company—often called the ‘Git for Metadata.’ Our platform helps businesses harvest, model, and visualise complex data lineage flows. Our unique lineage-first approach, combined with active AI development, provides organisations with unparalleled clarity and robust control over their data’s journey and meaning. As a growing B2B SaaS business (<100 employees), your work here directly shapes our product. People know us for innovation and a great, collaborative culture. Join us as we expand globally and define the future of data understanding! Role Overview We are...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role & responsibilities Preferred candidate profile Experience Required: 4 years Domain: Clinical & Healthcare( Main ) Location: Bangalore L Job Responsibilities Design, develop, and optimize scalable big data pipelines using Hadoop, Spark, and related technologies. Build and maintain ETL workflows for ingesting, transforming, and processing large datasets from diverse sources. Implement data models and validation rules to ensure data quality and support advanced analytics. Collaborate with data analysts, business teams, and other stakeholders to deliver business intelligence solutions. Automate data validation, performance monitoring, and reporting using tools like Airflow, BigQuery, and Sn...

Division: Information Technology Employment Status: Exempt Salary Grade: 108 Shift Requisition ID: 76462 Please be aware that if you are selected to formally interview for an internal position you will be required to notify your current manager. Please refer to the Employee Transfers Guidelines posted on Skylink. Description Seeking a passionate, handson technical AI /ML engineer to join our growing team and solve exciting engineering problems in semiconductor space. The nature of problems are wide ranging giving an opportunity to grow continuously. This position will work closely with multidisciplinary team, product managers, Data engineers, data scientists, and business stakeholders to bri...

Your mission - deliver well-reasoned, accurate, and clearly written outputs backed by credible sources. Solve complex tasks in different domains with the help of automations Develop and submit precise answers based on complex prompts, including coding, automation, and data processing tasks. Write and optimize Python scripts for data analysis, automation, and verification. Work with large datasets efficiently, ensuring data is clean and well-structured. Utilize various LLMs to generate advanced prompts and improve AI output quality. Format outputs in required structures such as Markdown, JSON, tables, etc. Identify and troubleshoot non-trivial technical problems related to AI workflows and in...

A person with strong technical skills who can understand complex financial analyses in Excel and partner effectively with the business to write code in Python that will be used for data and report automation processes. Ideally 3+ years experience doing data-heavy work in a financial or economic-adjacent field (or equivalent) Can understand a complex Excel financial model, breaking it down into manageable components Can partner closely with the business to specify and understand business requirements, ask clarifying questions, and write down the goals and technical specifications in documentation Prior experience writing complex logic in Python code to transform time series data Can write aud...

Design, code, and develop new features/fix bugs/add enhancements Analyze and improve efficiency, scalability and stability of various system resources Lead and Mentor junior engineers and drive a culture of technical perfection. Drive creative and innovative solutions to complex problems, exemplifying good technical discernment. Drive improvements and new approaches to address potential systemic pain points and technical debt, anticipate and avoid problems. Take a hands-on approach in the development of prototypes, independently and with others, to establish design decisions and/or technical feasibility. Evaluate, Install, Setup, Maintain and Upgrade, Data Engineering, Machine Learning and C...

Collaborate with customers and project teams to gather requirements and translate them into technical specifications Manage day-to-day ticketing queue, ensuring timely resolution and escalation as needed Prepare and support internal meetings, client updates, and weekly status reports Participate in QA, UAT, and production launch support for customer engagements Provide Tier 2/3 technical support for custom integrations and platform functionality Drive resolution of routine and complex issues, ensuring permanent fixes and improved customer experience Maintain up-to-date ticket documentation and ensure SLA adherence Support platform enhancements in collaboration with product development teams ...

This position will require interacting with customers/prospects/partners on a regular basis, driving technical discussions to support sales in region. Engage with existing customers and business partners, providing EDB technical expertise to help clients solve business problems and grow the subscription and services business. Provide subject matter expertise to ensure planned sales targets are achieved. Work with EDB professional services to build statement of work required in the deployment of EDB solutions. Assist clients and partners to build training and enablement plans. Provide single point of technical contact for partner engagements, liaising with local EDB SEs to provide necessary t...

Design, develop, and deploy scalable software systems. Collaborate with cross-functional teams across product, design, and data. Solve complex engineering challenges in AI/ML, cloud infrastructure, data platforms, and consumer applications. Participate in agile development cycles, code reviews, and innovation sprints. Create and maintain software that improves customer and associate experiences. Work on domains like supply chain, retail systems, finance, logistics, and mobile development. Use technologies such as Java, Hadoop, Cassandra, ERP, machine learning, and open-source frameworks. What Youll Bring: Final-year students (Class of 2026) in Computer Science, Software Engineering, or relat...

Design, develop, and deploy scalable software systems. Collaborate with cross-functional teams across product, design, and data. Solve complex engineering challenges in AI/ML, cloud infrastructure, data platforms, and consumer applications. Participate in agile development cycles, code reviews, and innovation sprints. Create and maintain software that improves customer and associate experiences. Work on domains like supply chain, retail systems, finance, logistics, and mobile development. Use technologies such as Java, Hadoop, Cassandra, ERP, machine learning, and open-source frameworks. What Youll Bring: Final-year students (Class of 2026) in Computer Science, Software Engineering, or relat...

Design, develop, and deploy scalable software systems. Collaborate with cross-functional teams across product, design, and data. Solve complex engineering challenges in AI/ML, cloud infrastructure, data platforms, and consumer applications. Participate in agile development cycles, code reviews, and innovation sprints. Create and maintain software that improves customer and associate experiences. Work on domains like supply chain, retail systems, finance, logistics, and mobile development. Use technologies such as Java, Hadoop, Cassandra, ERP, machine learning, and open-source frameworks. What Youll Bring: Final-year students (Class of 2026) in Computer Science, Software Engineering, or relat...

Experience and understanding in ETL, APIs, various data formats (JSON, Avro, Parquet) and experience in documenting/maintaining interface inventories. Deep understanding of AWS services (e. g. , Glue, S3, Databricks, Snowflake) and Hadoop ecosystem for data processing and storage. Familiarity with Databricks, Delta Lake, and Medallion architecture for advanced analytics and fraud detection use cases. Build logical and physical data models, enforce data quality, and integrate data across multiple systems. Data Design and Requirements Analysis: Able to apply data design patterns and frameworks, working knowledge of schemas and normalization. Experience in preparing architecture vision document...

With a focus on digitization, innovation, and analytics, the Enterprise Digital team creates central, scalable platforms and customer experiences to help markets across all of these priorities. Charter is to drive scale for the business and accelerate innovation for both immediate impact as well as long-term transformation of our business. A unique aspect of the team is the integration of diverse skills across all its remit. The American Express Enterprise Digital Experimentation & Analytics (EDEA) leads the Enterprise Product Analytics and Experimentation charter for Brand & Performance Marketing, Digital Acquisition & Membership experiences, Digital Servicing as well as Enterprise Platform...

Good understanding of SQL and data analysis Have utilized GenAI or basic understanding GenAI/LLM tools Basic knowledge of Python for data processing Awareness of ETL concepts and workflow tools like Airflow or dbt Good understanding of programming concepts and algorithms. Exposure to cloud platforms (AWS, GCP, or Azure) Interest in data pipelines, orchestration, and data quality Strong analytical and problem-solving mindset Pursuing or recently completed a degree in Computer Science, Data Engineering, or related field (Optional) Experience through academic projects or open-source contributions Responsibilities Support the design and development of data pipelines for ingestion, transformation...

ETL Developer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) using Apache Spark and Python. This role required deep understanding of data engineering principles, proficiency in Python and hands-on experience with Spark and Hadoop ecosystems. Developer will collaborate with data engineers, analysts, and business stakeholders to process, transform and drive insights and data driven decisions. Responsibilities: Data Processing and Transformation: Design and Implement of Spark applications to process and transform large datasets in HDFS. Develop ETL Pipelines in Spark using Python...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Apache Hadoop Good to have skills : Python (Programming Language) Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day wil...

Are you passionate about building robust Python applications and leveraging big data technologies to solve complex business challenges? Do you thrive in environments where your technical expertise drives meaningful impact? We are seeking an experienced Python Lead Developer to join our dynamic LSH Data Platform Team. You will play a pivotal role in designing, developing, and maintaining Python-based data processing applications and services that support scalable big data solutions. If you're excited about combining deep Python skills with cutting-edge technologies like Apache Spark, PySpark , GraphDB , SQL, and relational databases, we want to hear from you. About You experience, education, ...