21920 Hadoop Jobs - Page 21

As a Senior Machine Learning Engineer at SettleMint India in Delhi, you will play a crucial role in leading AI & machine learning initiatives within the company. Here's what you can expect in terms of roles, responsibilities, and qualifications: **Role Overview:** You will leverage your extensive experience and expertise to lead AI & machine learning initiatives, collaborating closely with cross-functional teams to identify business problems, design data-driven solutions, and drive actionable insights. **Key Responsibilities:** - Lead and manage the machine learning team, including hiring, performance management, and career development. - Develop and execute the company's machine learning st...

Role Overview: You will be joining the Advertising Optimization & Automation Science team at Wayfair as a Senior Machine Learning Scientist based in Bangalore. In this role, you will play a crucial part in building intelligent, ML-powered systems that drive personalized recommendations and campaign automation within Wayfair's advertising platform. Your work will involve collaborating with other scientists, as well as members of internal Product and Engineering teams, to define and deliver capabilities that enhance advertiser outcomes and unlock substantial commercial value. Key Responsibilities: - Design and build intelligent budget, tROAS, and SKU recommendations, as well as simulation-driv...

Role Overview: You will be responsible for leading the data analytics team as a Data Analyst Architect, with a focus on designing and optimizing data solutions, providing technical guidance, and managing a team to deliver high-impact data-driven projects. Your role will involve deep understanding of data systems, extensive experience in analytics architecture, and proven leadership skills. Key Responsibilities: - Design scalable and efficient data architectures to support analytics and business intelligence needs. - Establish and maintain data governance standards, ensuring data quality, security, and compliance. - Lead the development and delivery of actionable insights from complex dataset...

You will be responsible for delivering training in Data Science with expertise in Machine Learning, Deep Learning, R Programming, Python, Statistics, Hadoop, etc. Your role will involve imparting knowledge to the students and ensuring comprehensive understanding of the subject matter. Key Responsibilities: - Conduct training sessions on Data Science topics including Machine Learning, Deep Learning, R Programming, Python, Statistics, Hadoop, etc. - Develop and deliver engaging and interactive training materials. - Provide guidance and support to students to enhance their learning experience. Qualifications Required: - Strong knowledge and hands-on experience in Machine Learning, Deep Learning...

As a Senior Data Engineer at our company, you will be responsible for designing, developing, and maintaining data pipelines for processing large-scale datasets. Your role will involve building efficient ETL workflows to transform and integrate data from multiple sources, as well as developing and optimizing Hadoop and PySpark applications for data processing. You will also play a key role in ensuring data quality, governance, and security standards are met across systems. Additionally, you will implement and manage Cloud-based data solutions using platforms such as AWS, Azure, or GCP. Collaboration with data scientists and analysts to support business intelligence initiatives will be an esse...

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

About The Role PubMatic is seeking Data Analytics focused Senior Software Engineers with expertise in building and optimizing AI agents, including strong skills in Hadoop, Spark, Scala, Kafka, Spark Streaming, and cloud-based solutions, with proficiency in programming languages such as Scala and Python. You will be responsible for developing advanced AI agents that enhance our data analytics capabilities, enabling our platform to handle complex information retrieval, contextual understanding, and adaptive interactions, ultimately improving our data-driven insights and analytical workflows What You’ll Do Build, design, and implement our highly scalable, fault-tolerant big data platform to pro...

Greetings From Tata Consultancy Services!!! Role: Big Data Developer (Hive, Pyspark) Years of Experience: 4 to 10 yrs Location: Chennai, Hyderabad, Bengaluru Notice Period: 0- 90 days Date of Interview: 14th Nov, 2025 Mode of Interview: Virtual Drive(Cisco or Webex) Time Of Interview: 5.00PM To 7.00PM Job Description: Roles & Responsibilities: Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools. Should be able to develop, tweak queries and work on performance enhancement. Solid understanding of object-oriented programming and HDFS concepts The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in production ...

Director of Engineering Location:- Chennai, India About Arrcus Arrcus was founded to enhance business efficiency through superior network connectivity. The Arrcus Connected Edge (ACE) platform offers best-in-class networking with the most flexible consumption model at the lowest total cost of ownership. The Arrcus team consists of world-class technologists who have an unparalleled record in shipping industry-leading networking products, complemented by industry thought leaders, operating executives, strategic partners, and top-tier VCs. The company is headquartered in San Jose, California. For more information, go to www.arrcus.com or follow @arrcusinc.. We offer a variety of roles in softwa...

As an experienced candidate in testing, particularly in data engineering, you will be responsible for the following key areas: - Strong coding skills in Python/Java - Proficiency in SQL and NoSQL databases - Hands-on experience in data engineering, ETL processes, and data warehousing QA activities - Design and develop automated test frameworks for data pipelines and ETL processes - Use tools like Selenium, Jenkins, and Python to automate test execution - Experience with cloud platforms such as AWS, Azure, or Google Cloud - Familiarity with data technologies like Data Bricks, Hadoop, PySpark, and Kafka - Understanding of CI/CD pipelines and DevOps practices - Knowledge of containerization tec...

As a Cloud Leader (Jr. Data Architect) with 7+ years of IT experience, you will be responsible for working on two Structural databases (SQL/Oracle/Postgres) and one NoSQL Database. You will collaborate with the Presales team to propose the best solution and architecture. Additionally, you should have design experience on BQ/Redshift/Synapse. Your role will involve managing the end-to-end product life cycle, from proposal to delivery. It is crucial to regularly check with the delivery team on architecture improvement. Key Responsibilities: - Work on two Structural databases (SQL/Oracle/Postgres) and one NoSQL Database - Collaborate with the Presales team to propose the best solution and archi...

Job Description Job Title: Senior Data Science Associate Consultant Job Type: Full-time Location: Remote/ Hybrid - India Job Summary ZS's Insights & Analytics group partners with clients to design and deliver solutions to help them tackle a broad range of business challenges. Our teams work on multiple projects simultaneously, leveraging advanced data analytics and problem-solving techniques. Our recommendations and solutions are based on rigorous research and analysis underpinned by deep expertise and thought leadership. Key Responsibilities Lead the design, development, and deployment of advanced AI and ML models addressing large-scale, high-dimensional problems. Architect data-driven syst...

Job Description Job Title: Mid-level Data Science Associate Consultant Job Type: Full-time Location: Remote / Hybrid India Job Summary: ZS's Insights & Analytics group partners with clients to design and deliver solutions to help them tackle a broad range of business challenges. Our teams work on multiple projects simultaneously, leveraging advanced data analytics and problem-solving techniques. Our recommendations and solutions are based on rigorous research and analysis underpinned by deep expertise and thought leadership. Key Responsibilities: Design and implement advanced analytical and ML models to solve complex business challenges. Apply data mining, predictive modeling, and NLP techni...

We are looking for a dynamic professional who brings a unique blend of software development expertise and business analysis acumen. The ideal candidate will have hands-on experience in coding and system design, coupled with a strong understanding of business processes and stakeholder management. Key Responsibilities: Collaborate with stakeholders to gather and analyze business requirements. Translate business needs into technical specifications and solutions. Participate in system design, development, and testing phases. Work closely with development teams to ensure business requirements are met. Create and maintain documentation including BRDs, FRDs, and user stories. Conduct gap analysis a...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

Role Overview: As a Data Quality Specialist at our company, you will play a crucial role in owning the data quality of martech platforms and products. Your primary responsibility will be the productization and delivery of test solutions to enhance productivity, test efficiency, and scalability to support our business growth. You will collaborate with cross-functional teams to understand business requirements and deliver scalable solutions. Additionally, you will proactively identify potential issues, communicate effectively with the team and management, and create a robust data quality framework to assess, monitor, and report the quality of data across various systems and platforms. Your cre...

Role Overview: As a Machine Learning Engineer, you will be responsible for designing, developing, and deploying machine learning models that drive specific applications such as predictive analytics, natural language processing, computer vision, recommendation systems, etc. You will collaborate closely with data scientists, software engineers, and product teams to build scalable, high-performance AI solutions. You should have a strong foundation in machine learning algorithms, data processing, and software development, along with the ability to take ownership of the full machine learning lifecycle from data collection and model training to deployment and monitoring. Key Responsibilities: - Mo...

This position will be part of a growing team working towards building world class large scale Big Data architectures. This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to spend a majority of their time coding. Location - Bengaluru Work Experience : 3 - 5 Years Responsibilities: Good development practices Hands on coder with good experience in programming languages like Java, Python, C++ or Scala. Good understanding of programming principles and development practices like checkin policy, unit testing, code deployment Self starter to be able to grasp new concepts and technology and translat...

Job Summary We are seeking an experienced Cloud Architect with a strong background in Python programming and extensive knowledge of Azure AWS or GCP cloud platforms. The ideal candidate will have a deep understanding of object oriented programming (OOP) concepts SOLID principles and architecture design. Additionally the candidate should be proficient in DevOps practices version control using Git and have experience with AI/ML services including NLP Generative AI Vector Search and Large Language Responsibilities Design and architect scalable secure and resilient cloud solutions on Azure AWS or GCP. Develop and maintain Python applications with a focus on OOP principles and SOLID design. Imple...

Overview This position is for Manager Data Engineering in the Commercial Data as a Service group. In this position you will enjoy being responsible for helping define and maintain the data systems key to delivering successful outcomes for our customers. will lead a software development team focused on our core services someone who combines deep technical experience with great people management skills and can help elevate our teams and our approach to engineering. We are building a culture that fosters innovation, built on a foundation of inclusion and diversity. We are looking for a candidate that has proven experience in coding, architecture leadership, and leading engineers in a fast-paced...

Title and Summary Lead Data EngineerOverview We are the global technology company behind the worlds fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities. Our team within Mastercard Services: The Services org is a key differentiator for Mastercard, providing the cutting-edge services that are used by some of the world's largest organizations to mak...

We are looking for a Manager Software Engineering to join our IMS Team in Bangalore . This is an amazing opportunity to work on Big Data technologies involved in content ingestion. The team consists of 10-12 engineers and is reporting to the Sr Manager. We have a great skill set in Spark, Java, Scala, Hive, Sql, XSLT, AWS EMR, S3, etc and we would love to speak with you if you have skills in the same. About You experience, education, skills, and accomplishments: Work Experience: Minimum 7 years experience in Big Data projects involved in content ingestion, curation, transformation Technical Skill: Databricks, Spark, Python/Java , Scala, AWS EMR, S3, SQS, Hive, XSLT, Education (bachelors degr...

Key Responsibilities: Operate: Responsible for the operation of the system and record any problems that occur. Resolve: Ensure rapid problem resolution in close cooperation with participating third parties. Follow: Proactively follow the solution progress of incidents. Monitor: Responsible for the monitoring and analysis of possible sources of error. Update: Keep stakeholders up-to-date on system-relevant incidents. Process: Follow established processes such as Incident Management and Change Request Management. Evangelize: Promote best practices and methodologies. Automate: Identify opportunities to automate processes and procedures. Cultivate: Build relationships with developers, engineers,...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensur...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NAMinimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quali...