50 Apache Hadoop Jobs

TCS is hiring... Role: GCP Data Engineer EXP: 6 - 9 YEARS LOCATION: Bengaluru Job Description Excellent communication ( both oral and written ) and documentation Hands-on experience in the complete eco-system of any one/more of the various Hadoop distributions such as MapR ( preferred ) and/or Hortonworks and/or Cloudera and/or Apache Hadoop , with specialization in tools such as Spark (Core and SQL) , Hive and NoSql Databases such as HBase and/or Cassandra and/or MongoDB Hands-on experience in the various services of Google Cloud Platform ( GCP ) cloud such as CloudStorage, DataFlow, DataProc, CI/CD, BigQuery , Spanner, BigTable, Composer, Pub/Sub, Hyper-drive, etc Broader responsibilities ...

Role Overview: As a Presales Specialist at Neysa, you will play a crucial role in engaging with customers, understanding their technical requirements, and designing customized solutions leveraging Cloud, Network, AI, and Machine Learning technologies. Your responsibilities will include collaborating with the sales team to provide technical support, conducting product demos and presentations, leading Proof of Concept (PoC) engagements, and facilitating technical workshops and trainings. Additionally, you will contribute to market and competitive analysis, provide feedback to product and engineering teams, and assist in crafting technical proposals and RFP responses. Key Responsibilities: - De...

As a Pre-Sales Specialist at Neysa, you will play a crucial role in understanding client requirements, designing customized solutions, and driving technical engagements. Your responsibilities will include: - **Solution Design & Customization:** Collaborate with customers to identify their business challenges and technical needs. Propose tailored solutions leveraging Cloud, Network, AI, and Machine Learning technologies. - **Sales Support & Enablement:** Assist the sales team by providing technical support throughout the sales process. Deliver presentations, conduct technical demonstrations, and contribute to proposal and RFP responses. - **Customer Engagement:** Engage with prospects and cus...

As a **Data Engineer** at our company, you will play a crucial role in developing and maintaining our data infrastructure. Your success in this position will be defined by your ability to design and implement efficient data pipelines, data modeling, and ETL processes. This role is essential in ensuring that our data systems are robust, scalable, and optimized for performance. **Key Responsibilities:** - Design and develop data pipelines using technologies such as Apache Spark and Apache Hadoop - Create and maintain data models to support business requirements - Implement ETL processes to move data between systems - Work on data warehousing solutions for storing and processing large datasets ...

Greetings!!! TCS is hiring... Role: GCP Data Enginee EXP: 6 - 8 YEARS LOCATION: Bengaluru Notice Period- 30 DAYS Mandatory Skills Excellent communication ( both oral and written ) and documentation Hands-on experience in the complete eco-system of any one/more of the various Hadoop distributions such as MapR ( preferred ) and/or Hortonworks and/or Cloudera and/or Apache Hadoop , with specialization in tools such as Spark (Core and SQL) , Hive and NoSql Databases such as HBase and/or Cassandra and/or MongoDB Hands-on experience in the various services of Google Cloud Platform ( GCP ) cloud such as CloudStorage, DataFlow, DataProc, CI/CD, BigQuery , Spanner, BigTable, Composer, Pub/Sub, Hyper-...

Full Stack Developer (Mid-Level) We are seeking a Mid-Level Full Stack Developer with 10-15 years of experience to join our dynamic team. The ideal candidate will be proficient in developing and maintaining both front-end and back-end applications, contributing to all phases of the software development lifecycle, and working with a modern tech stack. You will be responsible for building scalable and reliable systems, collaborating with cross-functional teams, and ensuring the performance and security of our applications. Key Responsibilities Design and Development: Design, develop, and maintain robust and scalable web applications using Python for the back end and React.js for the front end....

Lead/Manager, Full Stack Development We're looking for a highly skilled and experienced Lead/Manager, Full Stack Development to lead our engineering team. You'll be responsible for the end-to-end development of our applications, from front-end user interfaces to back-end services and data pipelines. The ideal candidate will have a strong technical background, excellent leadership skills, and a passion for building scalable, high-performance systems. Responsibilities Lead and mentor a team of full stack engineers, fostering a culture of technical excellence and collaboration. Architect, design, and develop scalable and robust full stack applications using Python and GoLang for backend service...

As a skilled Senior Engineer at Impetus Technologies, you will utilize your expertise in Java and Big Data technologies to design, develop, and deploy scalable data processing applications. Your responsibilities will include collaborating with cross-functional teams, developing high-quality code, and optimizing data processing workflows. Additionally, you will mentor junior engineers and contribute to architectural decisions to enhance system performance and scalability. Key Responsibilities: - Design, develop, and maintain high-performance applications using Java and Big Data technologies. - Implement data ingestion and processing workflows with frameworks like Hadoop and Spark. - Collabora...

Role Overview: You will be a Senior Engineer at Impetus Technologies, utilizing your expertise in Java and Big Data technologies to design, develop, and deploy scalable data processing applications. Your responsibilities will include collaborating with cross-functional teams, mentoring junior engineers, and contributing to architectural decisions to enhance system performance and scalability. Key Responsibilities: - Design, develop, and maintain high-performance applications using Java and Big Data technologies. - Implement data ingestion and processing workflows with frameworks like Hadoop and Spark. - Collaborate with the data architecture team to define efficient data models. - Optimize e...

As a Senior PHP Developer at SASA, you will be part of a team of experts dedicated to excellence, innovation, and collaboration. Your role will involve hands-on experience with technologies like Python, R Lang, Tableau, SQL, Apache Hadoop, AWS, Microsoft Azure, Google Cloud Platform (GCP), Apache Kafka, & Airflow. You will work on SaaS apps architecture, utilize Git, JIRA, CI/CD, and ensure effective communication and participation in client meetings. **Key Responsibilities:** - Utilize hands-on experience in technologies such as Python, R Lang, Tableau, SQL, Apache Hadoop, AWS, Microsoft Azure, Google Cloud Platform (GCP), Apache Kafka, & Airflow - Work on SaaS apps architecture - Use Git, ...

As a highly motivated and experienced data scientist, you will lead a team of Gen-Ai Engineers, overseeing all processes from data extraction and pre-processing to training models and deploying them into production. Your passion for artificial intelligence and staying updated with the latest developments in the field will be crucial for this role. Key Responsibilities: - Utilize frameworks like Langchain for developing scalable and efficient AI solutions. - Integrate vector databases such as Azure Cognitive Search, Weavite, or Pinecone to enhance AI model functionalities. - Collaborate with cross-functional teams to define problem statements and prototype solutions using generative AI. - Ens...

**Job Description:** As a highly motivated and experienced data scientist, you will lead the team of Gen-Ai Engineers. Your responsibilities will include managing all processes from data extraction, cleaning, and pre-processing to training models and deploying them to production. You should be passionate about artificial intelligence and stay updated with the latest developments in the field. **Key Responsibilities:** - Utilize frameworks like Langchain for developing scalable and efficient AI solutions. - Integrate vector databases such as Azure Cognitive Search, Weavite, or Pinecone to support AI model functionalities. - Work closely with cross-functional teams to define problem statements...

As a highly motivated and experienced data scientist, you will lead a team of Gen-Ai Engineers involved in various processes from data extraction to deploying AI models to production. Your passion for artificial intelligence and staying up-to-date with the latest developments will be crucial in this role. Key Responsibilities: - Utilize frameworks like Langchain for developing scalable and efficient AI solutions. - Integrate vector databases such as Azure Cognitive Search, Weavite, or Pinecone to support AI model functionalities. - Work closely with cross-functional teams to define problem statements and prototype solutions leveraging generative AI. - Ensure robustness, scalability, and reli...

Role Overview: As a Presales Specialist at Neysa, you will play a crucial role in engaging with customers to understand their technical requirements, design customized solutions, and drive successful technical engagements. Your responsibilities will include presenting complex technology solutions, creating compelling demonstrations, and assisting in converting sales opportunities. You will collaborate closely with the sales team to provide technical support, deliver presentations, conduct technical demonstrations, and facilitate workshops to uncover customer requirements. Key Responsibilities: - Work closely with customers to understand their business challenges and technical requirements, d...

You will be responsible for designing, developing, and supporting scalable ETL processes using open source tools and data frameworks such as AWS Glue, AWS Athena, Redshift, Apache Kafka, Apache Spark, Apache Airflow, and Pentaho Data Integration (PDI). Additionally, you will design, create, and maintain data lakes and data warehouse on the AWS cloud. Your role will involve maintaining and optimizing the data pipeline architecture, formulating complex SQL queries for big data processing, collaborating with product and engineering teams for designing a platform for data modeling and machine learning operations, implementing various data structures and algorithms, ensuring data privacy and comp...

As a Java developer at the company, your responsibilities will include: - Working with client developers & off-shore developers to deliver project tasks - Analyzing system domain and client requirements - Collaborating with the team to create and maintain a robust system supporting business with a focus on usability - Ensuring productivity and teamwork within the constraints of a planned project to complete necessary milestones - Solving challenging real-world problems using OOP & functional programming concepts - Writing production-grade backend code, SP, and upholding high code quality standards You must have the following qualifications: - Very strong knowledge in OOP and Core Java - Inhe...

As a Senior Data Engineer at Infogain, you will be responsible for leading the design and execution of the Dataproc to Databricks PySpark migration roadmap. Your role will involve defining a modernization strategy encompassing data ingestion, transformation, orchestration, and governance. Additionally, you will architect scalable solutions using Delta Lake and Unity Catalog, ensuring optimal performance and cost efficiency. Key Responsibilities: - Lead the design and execution of Dataproc to Databricks PySpark migration roadmap. - Define a modernization strategy for data ingestion, transformation, orchestration, and governance. - Architect scalable Delta Lake and Unity Catalog-based solution...

Scientific Innovation Senior Expert: Work with a team of AI researchers and SMEs with core domain expertise in applying AI to drug discovery. Work with AI modelers to ensure models are robust and performant Work with Engineering and Product Development resources to ensure delivery of AI solutions. Raise the awareness of AI applications to aid in answering key research questions across BR. Help position AI-aided drug discovery contributions to deliver and support progress of BRs portfolio, enable new kinds of therapeutic discoveries, shorten cycle times, and increase efficiency. Collaboration & partnership: Act as liaison of AICS for identification of research questions, solution design, and ...

Role & responsibilities •Strong expertise in Apache Spark (batch + streaming) and Hive. •Proficiency in Python, Scala, or Java. •Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred). •Experience working with Kafka, Solace, and object stores (S3, MinIO). •Exposure to Docker/Kubernetes for deployment. •Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi). Thanks & Regards, Aziz Hussain Account Manager E: aziz.h@tekskills.in

• Experience on deploying shallow learning and deep learning models • Experience with Big Data Platform and cloud technologies • Building production grade Gen AI applications is a plus. • ML Design pattern, algorithm and the data structure skills

As a Senior Big Data Developer with expertise in PySpark and the Apache Big Data ecosystem, your role will involve designing, developing, and optimizing scalable data pipelines. You will collaborate with cross-functional teams to deliver reliable, high-performance data solutions. Your responsibilities will include: - Building and optimizing large-scale data processing pipelines using PySpark - Working with Apache Hadoop, Hive, HDFS, Spark, and other tools for managing big data workloads - Handling ETL development, data ingestion, transformation, and integration from various sources - Collaborating with Data Scientists, Analysts, and business stakeholders to deliver data-driven solutions - En...

Role Overview: As a Technology Practice Leader at our company, you will play a crucial role in enabling delivery scalability and leading the successful delivery of complex projects in the Application Performance Engineering, Application Performance Management, and Quality Assurance domain. You will be at the forefront of providing thought leadership and innovation to build a High-end Technology company that aims to be a Global leader in the P-A-S-S (performance, availability, scalability, and security) Assurance space. Your role will involve leading from the front, supporting the team, managing stakeholders, and ensuring successful account entry and downstream business with new customers. Ke...

Role Overview: At Improzo, we are looking for a highly skilled Data and Reporting Developer (Improzo Level - Associate) to join our dynamic team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies. This exciting opportunity is suitable for an individual with a strong technical background and a passion for working with large datasets to deliver high-quality solutions. Key Responsibilities: - Design, develop, and maintain scalable data pipelines and big data applications. - Work with distributed processing frameworks (e.g., Apache Hadoop, Apache Spark) to process and analyze large datasets....

As a highly motivated and experienced data scientist, you will lead a team of Gen-Ai Engineers. Your responsibilities will include managing all processes from data extraction, cleaning, and pre-processing to training models and deploying them to production. The ideal candidate will be passionate about artificial intelligence and stay up-to-date with the latest developments in the field. Key Responsibilities: - Utilize frameworks like Langchain for developing scalable and efficient AI solutions. - Integrate vector databases such as Azure Cognitive Search, Weavite, or Pinecone to support AI model functionalities. - Work closely with cross-functional teams to define problem statements and proto...

As a software developer at our company, you will be responsible for the following: - Designing, coding, testing, documenting, and implementing application release projects as part of the development team. - Utilizing your experience in programming/debugging for business applications. - Demonstrating working knowledge of industry practices and standards. - Proactively notifying the Development Project Manager of risks, bottlenecks, problems, issues, and concerns. - Ensuring compliance with Citi's System Development Lifecycle and Information Security requirements. - Collaborating closely with Quality Control teams to deliver quality software within agreed project schedules. - Working with Busi...