30 Apache Hadoop Jobs

As a Senior Big Data Developer with expertise in PySpark and the Apache Big Data ecosystem, your role will involve designing, developing, and optimizing scalable data pipelines. You will collaborate with cross-functional teams to deliver reliable, high-performance data solutions. Your responsibilities will include: - Building and optimizing large-scale data processing pipelines using PySpark - Working with Apache Hadoop, Hive, HDFS, Spark, and other tools for managing big data workloads - Handling ETL development, data ingestion, transformation, and integration from various sources - Collaborating with Data Scientists, Analysts, and business stakeholders to deliver data-driven solutions - En...

Role Overview: As a Technology Practice Leader at our company, you will play a crucial role in enabling delivery scalability and leading the successful delivery of complex projects in the Application Performance Engineering, Application Performance Management, and Quality Assurance domain. You will be at the forefront of providing thought leadership and innovation to build a High-end Technology company that aims to be a Global leader in the P-A-S-S (performance, availability, scalability, and security) Assurance space. Your role will involve leading from the front, supporting the team, managing stakeholders, and ensuring successful account entry and downstream business with new customers. Ke...

Role Overview: At Improzo, we are looking for a highly skilled Data and Reporting Developer (Improzo Level - Associate) to join our dynamic team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies. This exciting opportunity is suitable for an individual with a strong technical background and a passion for working with large datasets to deliver high-quality solutions. Key Responsibilities: - Design, develop, and maintain scalable data pipelines and big data applications. - Work with distributed processing frameworks (e.g., Apache Hadoop, Apache Spark) to process and analyze large datasets....

As a highly motivated and experienced data scientist, you will lead a team of Gen-Ai Engineers. Your responsibilities will include managing all processes from data extraction, cleaning, and pre-processing to training models and deploying them to production. The ideal candidate will be passionate about artificial intelligence and stay up-to-date with the latest developments in the field. Key Responsibilities: - Utilize frameworks like Langchain for developing scalable and efficient AI solutions. - Integrate vector databases such as Azure Cognitive Search, Weavite, or Pinecone to support AI model functionalities. - Work closely with cross-functional teams to define problem statements and proto...

As a software developer at our company, you will be responsible for the following: - Designing, coding, testing, documenting, and implementing application release projects as part of the development team. - Utilizing your experience in programming/debugging for business applications. - Demonstrating working knowledge of industry practices and standards. - Proactively notifying the Development Project Manager of risks, bottlenecks, problems, issues, and concerns. - Ensuring compliance with Citi's System Development Lifecycle and Information Security requirements. - Collaborating closely with Quality Control teams to deliver quality software within agreed project schedules. - Working with Busi...

Role Hadoop Sr. developer Preferred candidate profile exp-3-10years Mandate Skills:- Hadoop, Bigdata Pyspark, SQL, Python, Hadoop, Spark, AWS Database : MySQL, IBM DB2 OS: Windows.Linux,IBM Mainframes. Big data tools: Cloudera,Hive, Sqoop

As a Data Reporting Specialist at Infor, you will be responsible for delving deep into the data and consolidating multiple sources to develop robust reporting solutions. Your focus will be on assisting internals, partners, and customers in managing their operations, making informed business decisions, and shaping strategic plans and investments. Leading the architecture and development of interactive and user-friendly operational, strategic, KPI, and run-the-business reports and dashboards will be a key aspect of your role. Key Responsibilities: - Participate in business analysis activities to gather necessary reporting and dashboard requirements, translating them into specifications for imp...

Role & responsibilities Lead and mentor a team of full stack engineers, fostering a culture of technical excellence and collaboration. Architect, design, and develop scalable and robust full stack applications using Python and GoLang for backend services and React.js for front-end development. Manage the entire software development lifecycle, including planning, coding, testing, deployment, and maintenance. Design and manage databases using PostgreSQL , ensuring data integrity and performance. Utilize and manage services on AWS (Amazon Web Services) , including EC2, S3, RDS, and others, to deploy and scale applications. Implement and manage data processing pipelines using technologies like A...

As a Senior Engineer at Impetus Technologies, you will be responsible for designing, developing, and deploying scalable data processing applications using Java and Big Data technologies. Your role will involve collaborating with cross-functional teams to gather requirements, develop high-quality code, and optimize data processing workflows. Additionally, you will mentor junior engineers and contribute to architectural decisions to enhance system performance and scalability. Key Responsibilities: - Design, develop, and maintain high-performance applications using Java and Big Data technologies. - Implement data ingestion and processing workflows utilizing frameworks like Hadoop and Spark. - C...

As a [Job Title], your role is crucial in ensuring the success of the organization by [insert brief role overview here]. Key Responsibilities: - Develop user requirements for systems in production to ensure maximum usability - Utilize skills in SQL, Apache Spark, and Python for data pipeline development - Implement data modeling and ETL processes for efficient data processing - Work with Apache Hadoop and data warehousing technologies - Collaborate on projects related to cloud platforms and big data technologies - Communicate effectively with team members and stakeholders Qualifications: - Proficiency in SQL, Apache Spark, and Python - Experience with data modeling and ETL processes - Famili...

As a skilled Senior Engineer at Impetus Technologies, you will utilize your expertise in Java and Big Data technologies to design, develop, and deploy scalable data processing applications. Your responsibilities will include collaborating with cross-functional teams, developing high-quality code, and optimizing data processing workflows. Additionally, you will mentor junior engineers and contribute to architectural decisions to enhance system performance and scalability. Key Responsibilities: - Design, develop, and maintain high-performance applications using Java and Big Data technologies. - Implement data ingestion and processing workflows with frameworks like Hadoop and Spark. - Collabora...

In this role of QA with Data, ETL in Dubai, you will be responsible for the following: **Role Overview:** As a QA professional, you will be responsible for formulating test strategies for applications within the big data platform. You will create and maintain automated test scripts using tools like Apache Hadoop, Hive, or equivalents. Collaboration with cross-functional teams to understand product requirements and designing appropriate test cases will be a key aspect of your role. Furthermore, you will execute test cases, analyze results to identify defects and areas for improvement, and engage in agile development methodologies. **Key Responsibilities:** - Formulate test strategies for appl...

As a Presales Specialist at Neysa, a leading AI Acceleration Cloud System provider, your role will involve working closely with the sales teams to understand client requirements, design tailored solutions, and drive technical engagements. Your responsibilities will include: - **Solution Design & Customization**: Collaborate with customers to understand their business challenges and technical requirements. Design and propose customized solutions leveraging Cloud, Network, AI, and Machine Learning technologies. - **Sales Support & Enablement**: Provide technical support during the sales process, including delivering presentations, conducting technical demonstrations, and assisting in proposal ...

Role Overview: As a Pre-Sales Specialist at Neysa, you will play a crucial role in engaging with customers to understand their business challenges and technical requirements. You will design and propose customized solutions leveraging Cloud, Network, AI, and Machine Learning technologies to best fit their needs. Your responsibilities will include collaborating with the sales team to provide technical support, conducting product demos, leading Proof of Concept (PoC) engagements, and facilitating customer workshops and training sessions. Additionally, you will stay up-to-date on industry trends, provide feedback to product and engineering teams, and contribute to market and competitive analysi...

We are looking for a highly motivated and experienced data scientist to lead the team of Gen-Ai Engineers. As a data scientist, you will be responsible for managing all processes from data extraction, cleaning, and pre-processing to training models and deploying them to production. The ideal candidate will have a passion for artificial intelligence and stay updated on the latest developments in the field. You will be expected to utilize frameworks like Langchain for developing scalable and efficient AI solutions. Additionally, you will integrate vector databases such as Azure Cognitive Search, Weavite, or Pinecone to support AI model functionalities. Working closely with cross-functional tea...

You will be working at Paras Twin Tower, Gurgaon as a full-time employee for Falcon, a Series-A funded cloud-native, AI-first banking technology & processing platform. Falcon specializes in assisting banks, NBFCs, and PPIs to efficiently launch cutting-edge financial products like credit cards, credit lines on UPI, prepaid cards, fixed deposits, and loans. Since its inception in 2022, Falcon has processed over USD 1 billion in transactions, collaborated with 12 of India's top financial institutions, and generated revenue exceeding USD 15 million. The company is supported by prominent investors from Japan, the USA, and leading Indian ventures and banks. To gain more insights about Falcon, vis...

As an experienced Data Engineer with 6-12 years of experience, you will be responsible for working with Big Data technologies, programming languages, ETL & Data Engineering, Cloud Platforms, and various tools & frameworks. Your expertise in Scala, Spark, PySpark, Python, SQL, Hadoop, Hive, Pig, MapReduce, and other related skills will be crucial in this role. You must have a strong background in Data Warehouse Design, ETL, Data Analytics, Data Mining, Data Cleansing, and experience in creating data pipelines, optimization, troubleshooting, and data validation. Proficiency in cloud platforms such as GCP and Azure, along with tools like Apache Hadoop, Airflow, Kubernetes, and Containers, will ...

As a Technology Practice Leader, you will play a crucial role in enabling delivery scalability for our high-end technology company based in India, aiming to be a global leader in the P-A-S-S (performance, availability, scalability, and security) Assurance space. With an impressive track record of over 60+ Enterprise customers, you will lead and ensure the successful delivery of some of the world's most complex projects. Your role will require you to be a hands-on performance architect, adept at solving deep technical issues, while also providing innovative thought leadership. In this role, your responsibilities will include leading and successfully delivering new and complex projects in area...

As a Senior Big Data Developer specializing in PySpark, with a robust 57 years of experience, you will be responsible for designing, developing, and optimizing scalable data pipelines. Collaboration with cross-functional teams is essential to deliver reliable, high-performance data solutions in the Apache Big Data ecosystem. Your primary responsibilities will encompass building and enhancing large-scale data processing pipelines using PySpark, working with tools like Apache Hadoop, Hive, HDFS, Spark, and more to manage big data workloads efficiently. Additionally, you will be engaged in ETL development, data ingestion, transformation, integration from diverse sources, and collaborating with ...

As a Software Developer at our company, you will collaborate with client developers & off-shore developers to deliver project tasks efficiently. Your responsibilities will include analyzing system domain and client requirements, creating and maintaining a robust system to support business operations with a focus on usability, and ensuring the completion of necessary milestones within the constraints of planned projects. You should possess very strong knowledge in Object-Oriented Programming (OOP) and Core Java, along with hands-on experience in JavaEE and Springboot. Experience in technologies such as Spring, Spring Security, Hibernate, JPA, and Restful services is required. Additionally, fa...

Join the SASA! We are committed to creating a welcoming and supportive environment for all employees. Our goal is to foster a culture of respect, open communication, and collaboration. In our dynamic and challenging work environment, you will have the opportunity to engage in cutting-edge projects for a diverse clientele. As a part of our team of experts, you will work with individuals who are dedicated to excellence, innovation, and collaboration. We value employees who take ownership of their work, pursue continuous learning and development, and strive for both professional and personal growth. If you are seeking a challenging and rewarding career in software development and consulting, we...

As a Senior Engineer at Impetus Technologies, you will play a crucial role in designing, developing, and deploying scalable data processing applications using Java and Big Data technologies. Your responsibilities will include collaborating with cross-functional teams, mentoring junior engineers, and contributing to architectural decisions to enhance system performance and scalability. Your key responsibilities will revolve around designing and maintaining high-performance applications, implementing data ingestion and processing workflows using frameworks like Hadoop and Spark, and optimizing existing applications for improved performance and reliability. You will also be actively involved in...

As a Pyspark Developer_VIS, your primary responsibility will be to develop high-performance Pyspark applications for large-scale data processing. You will collaborate with data engineers and analysts to integrate data pipelines and design ETL processes using Pyspark. Optimizing existing data models and workflows to enhance overall performance is also a key aspect of your role. Additionally, you will need to analyze large datasets to derive actionable insights and ensure data quality and integrity throughout the data processing lifecycle. Utilizing SQL for querying databases and validating data is essential, along with working with cloud technologies to deploy and maintain data solutions. You...

As a Java Developer, you will be responsible for analyzing, designing, programming, debugging, and modifying software enhancements and/or new products used in various computer programs. Your expertise in Java, Spring MVC, Spring Boot, Database design, and query handling will be utilized to write code, complete programming, and perform testing and debugging of applications. You will work on local, networked, cloud-based, or Internet-related computer programs, ensuring the code meets the necessary standards for commercial or end-user applications such as materials management, financial management, HRIS, mobile apps, or desktop applications products. Your role will involve working with RESTful ...

You will be responsible for understanding complex and critical business problems and formulating an integrated analytical approach to mine data sources. Your role will involve employing statistical methods and machine learning algorithms to contribute to solving unmet medical needs, discovering actionable insights, and automating processes to reduce effort and time for repeated use. You will manage the implementation and adherence to the overall data lifecycle of enterprise data, from data acquisition or creation through enrichment, consumption, retention, and retirement. This will enable the availability of useful, clean, and accurate data throughout its lifecycle. Your high agility will al...