15749 Hadoop Jobs - Page 9

Job Details: Skill: Scala,hadoop,java, Job type: contract to hire Job Description: - 10+ years of software development experience building large scale distributed data processing systems/application, Data Engineering or large scale internet systems. Experience of at least 4 years in Developing/ Leading Big Data solution at enterprise scale with at least one end to end implementation Strong experience in programming languages Java/J2EE/Scala. Good experience in Spark/Hadoop/HDFS Architecture, YARN, Confluent Kafka , Hbase, Hive, Impala and NoSQL database. Experience with Batch Processing and AutoSys Job Scheduling and Monitoring Performance analysis, troubleshooting and resolution (this inclu...

Skill:Data Engineer Notice Period:Immediate. Employment Type: Contract Job Description : Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, Scala Performance Turing Optimize SQL, PySpark for performance Airflow workflow scheduling tool for creating data pipelines GitHub source control tool & experience with creating/ configuring Jenkins pipeline Experience in EMR/ EC2, Databricks etc. DWH tools incl. SQL database, Presto, and Snowflake Streaming, Serverless Architecture .

Skills : Teardata Developer Notice Period: Immediate Type: Contract 5+ years experience inTeradata. Good inTeradata, should know BTEQ scripts, FastLoad, MLoad Experience Informatica Power Center experience Good in Writing SQL queries using Joins, Essential to have DataIKU tool proficient knowledge Proficient in Python Scripting Read logs. Can Script, Can automate script, can build Server Can do triaging Well-rounded self-started who can keep the service running.

Experience: 5+ Years Skill: ITSS- Senior Azure Developer / Data Engineer Notice Period:Immediate. Employment Type: Contract Working Mode: Hybrid Job Description Loc - Bangalore , Hyd, Chennai and Noida Experience: Mid-Level Primary Skillsets: Azure (ADF/ADLS/Key vaults) Secondary Skillsets: Databricks Good to have Skillsets: Ability to communicate well Experience in cloud applications, especially in Azure (basically things covered in Primary skillsets listed below) Work in agile framework Experience in ETL, SQL, PySpark Run with a task without waiting for direction all the time Experience with git repository and release pipelines. Any certifications on Azure Any certification on Databricks w...

Lead production support for a Finance Datastage ETL Platform for a 24*7 SLA based engagement. Reviewing job designs and code created by other DataStage developers. Provide support for ongoing inbound/outbound data loads and issue resolution. Monitor DataStage job execution and troubleshoot issues as needed. Troubleshoot DataStage job failures and provide root cause analysis. Optimize existing DataStage jobs for performance (as necessary).

#Notice Period: Immediate #Employment Type:Contract JOB Description: Salesforce CDP/Data Cloud JD 1. Overall IT experience of Minimum 7 years. 2. Experience in CDP/Data Cloud for a minimum of 6 months. 3. Should have knowledge of the SFDC Platform 4. Good Experience in SQL Queries, Data Model Concepts 5. Should have worked on a CDP/Data Cloud Implementation. 6. Show have working knowledge on at least the first 3 areas of CDP listed below. Data Ingestion Unification Segmentation Activation 1. Should have knowledge about both Batch and Real Time Integration Options. 2. Good to have knowledge on basic Data Model understanding of Financial Services Cloud. 3. Good to have experience in Salesforce...

At least 8 + years of experience in any of the ETL tools Prophecy, Datastage 11.5/11.7, Pentaho.. etc . At least 3 years of experience in Pyspark with GCP (Airflow, Dataproc, Big query) capable of configuring data pipelines . Strong Experience in writing complex SQL queries to perform data analysis on Databases SQL server, Oracle, HIVE etc . Possess the following technical skills SQL, Python, Pyspark, Hive, ETL, Unix, Control-M (or similar scheduling tools ) Ability to work independently on specialized assignments within the context of project deliverables Take ownership of providing solutions and tools that iteratively increase engineering efficiencies . Design should help embed standard pr...

Job Title: AI/ML Manager Location: Hyderabad, India Experience: Minimum 8 Years Joining: Immediate About the Role: We are seeking an experienced AI/ML Manager to lead the design, development, and deployment of cutting-edge AI/ML solutions. The ideal candidate will have a strong background in machine learning frameworks, generative AI, NLP technologies, and big data ecosystems , along with proven experience in managing teams and delivering scalable AI-driven products. Key Responsibilities: Lead and manage AI/ML projects from concept to production, ensuring timely and quality delivery. Architect and implement machine learning models using TensorFlow, PyTorch, and other ML frameworks . Drive in...

Notice Period: Immediate Joiners Job Description: Must have skills Azure DataBricks, Python And Pyspark, Spark. Please find the JD In the mail chain Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on experience in Azure Databricks , Data Factory, Data Lake store/Blob storage, SQL DB Experience in creating Big data Pipelines with Azure components Hands on programing with Python Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming Experience with messaging systems, such as Kafka or RabbitMQ Good understanding of...

Should have 6+ years of exp in Apache Superset for data exploration and visualisation exp in Apache Beam and Flink for data pipelineETL exp in Apache Airfow DAGS (collection of executions task) Good to have knowledge in any SQL/Mongo DB/Postgress

Notice Period: Immediate . Employment Type: Contract Job Description 7+ years of experience conducting statistical, research-minded analysis of variety of data types/forms with aim to utilize this analysis into building or optimizing predictive methods 5+ years experience in programming with languages such as Python, R, SAS 4+ years of deep, hands-on experience with machine Learning applied to the healthcare or other high-stakes domains (direct experience in a cloud environment is highly valued) Previous exposure to healthcare provider data, payer data, patient generated data, Iot data would be advantage. Experience applying computational algorithms, statistical and programming methods using...

Big data engineer/Developer Spark-Scala HQL, Hive Control-m Jinkins Git Technical analysis and up to some extent business analysis (knowledge about banking products, credit cards and its transactions) Notice Period: Immediate . Employment Type: Contract

Job Role: Data Engineer Experience: 4 to 5years Job Location: Kochi, Kerala Job Type: Full-time, Permanent Notice: Immediate/15 days or currently serving (LWD within 30 days) Candidates from Kerala are the first priority. We are seeking an experienced and driven Data Engineer with 4-5 years of hands-on experience in building scalable data infrastructure and systems. You will play a key role in designing and developing robust, high-performance ETL pipelines and managing large-scale datasets to support critical business functions. This role requires deep technical expertise, strong problem-solving skills, and the ability to thrive in a fast-paced, evolving environment. Key Responsibilities 1)D...

Responsibilities Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques Optimize data processing workflows for maximum performance and efficiency Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems Implement best practices for dat...

DESCRIPTION AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and emerging technologies include AWS Partners, AWS Sovereign Cloud, AWS International Product, and the Ge...

Expedia Group brands power global travel for everyone, everywhere. We design cutting-edge tech to make travel smoother and more memorable, and we create groundbreaking solutions for our partners. Our diverse, vibrant, and welcoming community is essential in driving our success. Why Join Us? To shape the future of travel, people must come first. Guided by our Values and Leadership Agreements, we foster an open culture where everyone belongs, differences are celebrated and know that when one of us wins, we all win. We provide a full benefits package, including exciting travel perks, generous time-off, parental leave, a flexible work model (with some pretty cool offices), and career development...

Job Description: Job Description Role and Responsibilities: • Emphasis is on end-to-end delivery of analysis • Extremely comfortable working with data, including managing large number of data sources, analyzing data quality, and pro-actively working with client’s data/ IT teams to resolve issues Hands on experience on Machine Learning algorithms such as Logistic Regression, Random Forest, XG Boost • Use variety of analytical tools (Python, SQL, PySpark etc.) to carry out analysis and drive conclusions • Reformulate highly technical information into concise, understandable terms for presentations Candidate Profile: • Required skills: Python, SQL, Hive, PySpark, Hadoop, Machine Learning, Credi...

Job Overview: We are looking for a talented Business Analyst with expertise in Hadoop technologies and a strong background in the banking domain. The ideal candidate will play a crucial role in bridging the gap between business needs and technology solutions, ensuring optimal use of data resources to drive banking operations and decision-making. As a Business Analyst, you will work alongside cross-functional teams to gather requirements, analyze data, and contribute to data-driven decision-making processes. Key Responsibilities: Gather and document business requirements related to banking operations, including data processing, reporting, and analytics needs Analyze and interpret large volume...

Responsibilities : Onboarding and updating data deliveries on our Hadoop Datalake • Developing frameworks to process and deploy new data delivery methods or file formats (JSON, XML, CSV, ProtoBuf, Avro, Parquet, etc) • Creating views and tables for our users with optimal performance for their use case • Experience of connecting and interfacing with systems via APIs • Support both Development and Operations teams in quickly solving complex issues that are hindering the team and/or stakeholders • Coordinating with source teams producing data and also consumers using this data for their use cases • Supporting in the design, building, and testing of new services and extending existing services o...

DESCRIPTION AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. AWS Global Services includes experts from across AWS who help our customers design, build, operate, and secure their cloud environments. Customers innovate with AWS Professional Services, upskill with AWS Training and Certification, optimize with AWS Support and Managed Services, and meet objectives with AWS Security Assurance Services. Our expertise and emerging technologies include AWS Partners, AWS Sovereign Cloud, AWS International Product, and the Ge...

About Chubb Chubb is a world leader in insurance. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients. The company is defined by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength and local operations globally. Parent company Chubb Limited is listed on the New York Stock Exchange (NYSE: CB) and is a component of the S&P 500 index. Chubb employs approximately 40,000 people worldwide. Additional information can be found at: www.chubb.com. About Chubb India ...

RiskInsight Consulting Pvt Ltd is looking for a Data Analyst with expertise in SQL and HDFS (Hadoop Distributed File System) to join our dynamic team. The selected candidate will play a crucial role in analyzing large datasets and providing actionable insights to drive business decisions. If you are a detail-oriented individual with a passion for data, we want to hear from you! Design, implement, and maintain data pipelines and workflows using HDFS for data management Conduct data extraction, transformation, and loading (ETL) processes using SQL and Hive Perform rigorous data analysis to identify trends, inconsistencies, and insights for stakeholders Collaborate with business units to unders...

Solution Engineering Hyderabad, Telangana, India Date posted Sep 26, 2025 Job number 1883142 Work site 3 days / week in-office Travel 25-50 % Role type Individual Contributor Profession Technology Sales Discipline Solution Engineering Employment type Full-Time Overview Are you insatiably curious, deeply passionate about the realm of databases and analytics, and ready to tackle complex challenges in a dynamic environment in the era of AI? If so, we invite you to join our team as a Cloud & AI Solution Engineer in Innovative Data Platform for commercial customers at Microsoft. Here, you'll be at the forefront of innovation, working on cutting-edge projects that leverage the latest technologies ...

ETL Developer (IBM Datastage + SQL) Location: Hyderabad (work from office hybrid mode) Contract: 6 month Experience : 4+ years Walk-in Interview – on Saturday Hyderabad Location Role Overview: We are looking for an experienced ETL Developer with strong IBM Datastage and SQL expertise to join our dynamic team . The ideal candidate will be responsible for designing, developing, testing, and supporting ETL processes and data integration solutions to ensure seamless data flow across multiple systems. Key Responsibilities: Design, develop, and maintain ETL jobs using IBM DataStage. Work closely with business analysts, architects, and data modelers to understand business requirements and convert t...

Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive increased value across their business ecosystem. As an Azure Data Engineer, you will play a crucial role in designing, building, and maintaining scalable and reliable data solutions on the Microsoft Azure platform. You will work closely with cross-functional teams to understand data requirements, design and implement data ingestion pipel...