22039 Hadoop Jobs - Page 41

As a Data Engineer at our company, you will collaborate with various teams to meet our Data Platform needs. Your responsibilities will include designing, implementing, and maintaining a secure and scalable infrastructure platform across AWS/Azure and our Data Center. You will also be responsible for ensuring that internal and external SLAs are met, monitoring system-centric KPIs, and working on data lake, data warehouse, and stream processing systems. Your role will involve creating a unified query engine, multi-model databases, analytics extracts, reports, dashboards, and visualizations. Additionally, you will design systems for high availability, high throughput, data consistency, security...

As a Data Engineer at our company, you will play a crucial role in designing, building, and managing robust and scalable data pipelines using Python, SQL, and AWS. Your key responsibilities will include: - Designing, building, and managing robust and scalable data pipelines (batch and real-time). - Developing ETL processes to acquire, transform, and integrate data from multiple sources. - Building and maintaining data warehouses, data lakes, and other storage solutions. - Optimizing data systems for performance, reliability, and scalability. - Collaborating with cross-functional teams to understand data requirements and deliver efficient solutions. - Ensuring data quality, consistency, and i...

Job Summary: We are looking for a versatile and results-driven Data Scientist / Machine Learning Developer with 7+ years of experience to join our dynamic team. The ideal candidate will have a strong background in both data science and machine learning, capable of handling end-to-end processes from data analysis and feature engineering to model deployment and monitoring. This role demands a proactive and collaborative mindset, working closely with product owners and engineering teams to deliver scalable, production-ready ML solutions. You will take ownership of the entire model lifecycle driving experimentation, validation, deployment, and continuous optimization to create high-impact, AI-po...

Role Overview: The Data Science and Capability team within CCB Card Modeling is a Center of Excellence dedicated to ensuring superior quality of data used in CCB Card models and strategies. The team utilizes a combination of traditional and advanced techniques, including Artificial Intelligence, to achieve this goal. Your role in the team is crucial in safeguarding the business by maintaining data quality and deriving actionable insights for revenue growth and risk mitigation in the card business. Key Responsibilities: - Design and develop an attribute library to enhance the consistency and quality of data utilized in machine learning models across the customer lifecycle - Collaborate with s...

As an AI/ML Developer at our company, you will be an integral part of our team of researchers, data scientists, and developers. Your primary responsibility will be to work on cutting-edge AI solutions in various industries such as commerce, agriculture, insurance, financial markets, and procurement. By developing and optimizing machine learning and generative AI models, you will contribute towards solving real-world challenges. Key Responsibilities: - Develop and optimize ML, NLP, Deep Learning, and Generative AI models. - Research and implement state-of-the-art algorithms for supervised and unsupervised learning. - Work with large-scale datasets in distributed environments. - Understand bus...

You will be part of a Mega Walk-In Drive for Data Science, GenAI, and MLOps roles in Kolkata. The event is scheduled for Saturday, 15th November starting at 9:30 AM. You can contact Purbita Mondal at purbita.mondal@ltilmindtree.com for further details. **Role Overview:** - Data Scientists with Gen AI: - Mandatory Skills: - Data Science, GenAI, Python, RAG - Cloud: Azure / AWS / GCP - AI/ML, NLP - Preferred Skills: - LangChain, ChatGPT, Prompt Engineering - Vector Stores, LLaMA, PaLM, BERT, GPT, BLOOM - Deep Learning, OCR, Transformers - Regression, Forecasting, Classification - MLOps, Model Training, Deployment, Inference - Tools: MLflow, Kubeflow, Airflow, Docker, Kubernetes - Ideal Candida...

As a hands-on technical lead and senior individual contributor in BI Engineering within Visa's Global Data organization, reporting to the Lead of Data Insights Studio, you will partner with internal analytics teams to deliver high-impact BI solutions across products and markets. Operating from the Global Shared Services hub in Bengaluru, you will leverage Visa's rich datasets to drive actionable insights that create business value. **Key Responsibilities:** - Partner with internal analytics and business teams to translate complex, ambiguous problems into clear, measurable outcomes and actionable data products. - Lead end-to-end BI solution delivery, including requirements refinement, data mo...

hackajob is collaborating with J.P. Morgan to connect them with exceptional tech professionals for this role. Are you looking for an exciting opportunity to join a dynamic and growing team in a fast paced and challenging area? This is a unique opportunity for you to work in our team to partner with the Business to provide a comprehensive view. As the Data Product Manager within the Securities Services Data Product Management team, you will promote the strategy, development, and delivery of our data lake solutions. You will partner closely with engineering, operations, and business teams to define and execute the product vision, strategy, and roadmap for the Securities Services Data Lake, ali...

Role Overview: You will be an Applications Development Senior Programmer Analyst at an intermediate level, responsible for contributing to the establishment and implementation of a new Strategic Data Repository. Your role will involve working closely with the Global Technology team and participating in applications systems analysis and programming activities. Key Responsibilities: - Develop real-time and batch data transformation processes using a wide range of technologies including Hadoop, Spark Stream, Spark SQL, Python, and Hive. - Translate architecture and low-level requirements into design and code using Big-data tools and processes. - Utilize specialty knowledge of applications devel...

Job Responsibilities Conduct virtual training Co-ordinate Internship programs (operational) Evaluate projects and analyse feedback Enhance course material & course delivery based on feedback to improve training and internship effectiveness Location: Mysore, Bangalore Description of the Profile We are looking for training and Internship co-ordinators with 2 to 4 years of teaching experience and technology know-how in two or more of the following areas: Artificial Intelligence concepts awareness, Hands-on experince is preferred Java – Java programming, Spring, Angular / React, Bootstrap Big Data – Python programming, Hadoop, Spark, Scala, Mongo DB, NoSQL Data Science – Python for data science,...

This job is with LexisNexis Legal & Professional®, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Would you like to be part of a team that delivers high-quality software to our customers? Are you a highly visible champion with a 'can do' attitude and enthusiasm that inspires others? About Our Team LexisNexis Legal & Professional, serving customers in more than 150 countries with 11,800 employees worldwide, is part of RELX, a global provider of information-based analytics and decision tools for professional and business customers. Our company is a leader in deploying AI and advanced t...

Role Overview: As an ETL Developer at the company, you will be responsible for developing and maintaining ETL processes using Python and PySpark. Your role will involve designing and implementing data pipelines and workflows, optimizing data processing applications, and collaborating with data scientists and analysts to understand data requirements. You will play a key role in ensuring data integrity and consistency across systems, writing clean, scalable, and maintainable code, as well as monitoring and troubleshooting data processing jobs. Key Responsibilities: - Get to the heart of customer issues, diagnose problem areas, design innovative solutions, and facilitate deployment resulting in...

Description : 3-6yrs Location : Pune. Proven Skills With Writing Complex SQL Queries. Unix Shell Scripting. Data Warehousing Fundamentals. Experience with ETL/ELT pipelines. Relational Database. SQL, NoSQL. Data Mapping, Data Modeling, Data Mining, and Data Warehousing/Mart Relational databases and SQL Query performance tuning. Hands-on experience with at least one programming language Python / Java. Good understanding of Big Data Fundamentals (Hadoop/Spark) and Data Processing Pipelines. Hands-on experience with at least one cloud platform (GCP, AWS, Azure). Responsibilities Design, Develop and Deploy scalable data pipelines and data services,. Design, develop, and test data processes per b...

Role Overview: As an Azure Data Factory (ADF) Developer Engineer, your role will involve ensuring effective design, development, validation, and support activities to meet client needs and architectural requirements. Your primary responsibility will be to interface with clients for quality assurance, issue resolution, and ensuring high customer satisfaction in the technology domain. You will play a key role in understanding requirements, creating and reviewing designs, validating architecture, and delivering high levels of service offerings to clients. Additionally, you will lead and guide teams towards developing optimized high-quality code deliverables, continual knowledge management, and ...

As a skilled Data Engineer, your role will involve designing, building, and maintaining efficient data pipelines and architectures to support analytics and business intelligence initiatives. Your hands-on experience in data integration, ETL development, and cloud-based data platforms will be crucial for this position. Key Responsibilities: - Design and implement data pipelines for the ingestion, transformation, and storage of large datasets. - Develop and maintain ETL processes to ensure data quality, consistency, and availability. - Collaborate with data analysts, scientists, and business teams to support data-driven initiatives. - Optimize data workflows for scalability and performance. - ...

As a Senior Software Test Engineer - ETL at Calix, you will play a crucial role in designing and developing advanced test suites using object-oriented methodologies. Your high energy and ability to manage relationships effectively will be key in rolling up your sleeves to get the job done. You will work on implementing and executing test strategies across all supported platforms and languages to enhance overall quality and test code coverage. Key Responsibilities: - Design and develop functional and Automation test suites, including backend integration tests and tests for RESTful APIs. - Collaborate with stakeholders to gather insights and translate technical concepts effectively. - Document...

Job Description The Finance Data & Insights Team is an agile product team responsible for the development, production, and transformation of Financial data and reporting across CCB. Job Summary As a Data Domain Architect in CBB- field performance area , you will play a key role in bringing transformation in how we report and analyze Financial, Operational and Behavioral Data across Consumer Banking and Business Banking with in CCB. Your day to day responsibilities would include but not limited to discover, source, design and deliver the data domains into the Databricks powered Data Mart that brings together essential data categories to enable the Finance function to support their analytical ...

Hands-on experience with graph technologies like TigerGraph. Skills in designing efficient graph data models. Proficiency in GSQL. Expertise in integrating graph databases with other systems. Programming skills, including developing REST APIs using Python. Familiarity with large-scale data ecosystems like Hadoop, MySQL, and Kafka Hands-on experience with graph technologies like TigerGraph. Skills in designing efficient graph data models. Proficiency in GSQL. Expertise in integrating graph databases with other systems. Programming skills, including developing REST APIs using Python. Familiarity with large-scale data ecosystems like Hadoop, MySQL, and Kafka Advanced conceptual understanding of...

Job Responsibilities Conduct virtual training Co-ordinate Internship programs (operational) Evaluate projects and analyse feedback Enhance course material & course delivery based on feedback to improve training and internship effectiveness Location: Mysore, Bangalore Description of the Profile We are looking for training and Internship co-ordinators with 2 to 4 years of teaching experience and technology know-how in two or more of the following areas: Artificial Intelligence concepts awareness, Hands-on experince is preferred Java – Java programming, Spring, Angular / React, Bootstrap Big Data – Python programming, Hadoop, Spark, Scala, Mongo DB, NoSQL Data Science – Python for data science,...

Are you interested in bringing your technical expertise to projects? Are you a detail-oriented paralegal with a 'can do' attitude? About Our Team LexisNexis Legal & Professional, which serves customers in more than 150 countries with 11,300 employees worldwide, is part of RELX, a global provider of information-based analytics and decision tools for professional and business customers. About The Role This position performs moderate research, design, and software development assignments within a specific software functional area or product line. Responsibilities Model Development & Deployment: Design, train, and optimize machine learning models for various applications such as predictive analy...

Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements Triage issues to find gaps in existing pipelines and fix the issues Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs Help joiner team members to resolve issues and technical challenges Drive technical discussion with client architect and team members Orchestrate the data pipelines in scheduler via Airflow Skills and Qualifications: Bachelor's a...

Job description Hiring for Hadoop Developer Mandatory Skills: Hadoop, bigdata, spark Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed funct...

Overview Intuit is seeking a Sr Data Scientist to join our Data sciences in Intuit India. The AI team develops game changing technologies and experiments that redefine and disrupt our current product offerings. You’ll be building and prototyping algorithms and applications on top of the collective financial data of 100 million consumers and small businesses. Applications will span multiple business lines, including personal finance, small business accounting, and tax. You thrive on ambiguity and will enjoy the frequent pivoting that’s part of the exploration. Your team will be very small and team members frequently wear multiple hats. In this position you will have close collaboration with t...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology Your Role And Responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, p...

About The Opportunity Industry: Cloud Data & Analytics / Enterprise Cloud Services. Sector: Technology — Data Engineering & Analytics. We are hiring a hands-on senior data engineer to design, build and operate large-scale data pipelines and analytics platforms on Google Cloud Platform (GCP). This is an on-site role based in India. Primary job title (best-performing): Google Cloud Data Engineer Role & Responsibilities Design and implement scalable ETL/ELT pipelines on GCP using Dataflow, Pub/Sub, Cloud Storage and BigQuery for batch and streaming workloads. Optimize BigQuery schemas, queries, partitioning and clustering to reduce cost and improve query performance at scale. Develop and mainta...