2482 Sqoop Jobs - Page 11

Company Description Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid. Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa. Job Description Serve as an analytics expert in designing, ...

You will be part of the Health Plan and Providers team of ZS, which enables plans and providers in driving growth through member acquisition and retention and improving value through member and provider insights and engagement. This group offers a range of support from strategic advisory to execution of custom analysis to development of standalone analytics accelerators and products. What Youll Do Lead the delivery process across 3-4 client engagements helping to deliver world-class business and technology solutions; Own end to end responsibility to lead project across all phases right from discovery/ POC to managing operations; Understand the technology landscape in the broader healthcare i...

Common Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow Experience on Spark/Hive/HDFS,Data modeling for Data conversion Resources (4) Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills Common Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow Experience on Spark/Hive/HDFS Data modeling for Data conversion Resources (4) Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills Data Engineer - Knows HR Knowledge , all other requirement from Functional Area given by UBER

Greetings from TCS! TCS is hiring for Big Data Support Engineer / Hadoop Support Engineer Desired Experience: 4 to 10 Years Job Location: Hyderabad Require skillset: Bigdata Hadoop Platform -Cloudera, Sqoop, hive, spark, oozie and Flume- Cloudera (CDH) Job Description: Must Have Technical Qualifications: · 3 years exp on Sqoop, hive, spark, oozie and Flume- Cloudera (CDH) · Plan, execute and implement applications and configuration change procedures/requests · Supervise all alerts related to application and system procedures and provide services proactively. · Install and prepare tools required for proper functioning of applications on regular basis. · 2+ years of experience working with SQL...

Skillset required: 1 Excellent knowledge of UNIX/LINUX OS 2 Knowing of core java is a plus but not mandatory 3 Good understanding of OS concepts, process management and resource scheduling 4 Basics of networking, CPU, memory and storage 5 Good hold of shell scripting, Deploying a hadoop cluster, maintaining a hadoop cluster, adding and removing nodes using cluster monitoring tools like Cloudera Manager, configuring the NameNode high availability and keeping a track of all the running hadoop jobs 2 Implementing, managing and administering the overall hadoop infrastructure 3 Knowledge all the components in the Hadoop ecosystem like Apache Spark, Apache Hive, HBase, Kafka, Sqoop, Yarn, Zookeepe...

Spark, Scala, Bigdata Team Management: Lead and manage a team of technical professionals Data Engineer and Application Developers, ensuring effective collaboration and productivity, Client Interaction: Serve as the primary point of contact for clients, understanding their needs and ensuring successful project delivery, Status Reporting: Prepare and present detailed status reports on ongoing projects to stakeholders, highlighting progress, risks, and mitigation plans, Issue Resolution: Proactively identify and resolve any technical challenges or roadblocks faced by the team, ensuring smooth project execution, Project Management: Oversee the entire project lifecycle, from planning to execution...

GCP Cloud Data EngineerLocation: Kochi Design and Develop Data Pipelines: Build, optimize, and maintain scalable ETL/ELT pipelines using GCP tools such as Cloud Dataflow, Data Fusion, Pub/Sub, Dataproc, and Composer (Airflow) Data Modeling & Warehousing: Design and implement efficient data models and schemas for BigQuery or other GCP data stores that support analytical and operational needs Data Integration: Ingest structured and unstructured data from multiple internal and external sources into GCP-based data lakes and warehouses Performance Optimization: Monitor and optimize data pipeline performance, query efficiency, and cost-effectiveness within GCP Automation & CI/CD: Implement infrast...

Project description Information and Document Systems is a global technology change and delivery organization comprising nearly 200 individuals located mostly in Switzerland, Poland, and Singapore. Providing global capturing and document processing, archiving, and retrieval solutions to all business divisions focusing on supporting Legal, Regulatory, and Operational functions. Responsibilities Design, implement, and manage data solutions on Azure Develop and maintain data pipelines using Databricks Ensure efficient data storage and retrieval using Azure Storage and Data Lake Automate infrastructure and application deployments with Ansible Write clean, maintainable code in Python Collaborate w...

Project description We need a Senior Python and Pyspark Developer to work for a leading investment bank client. Responsibilities Develop software applications based on business requirements Maintain software applications and make enhancements according to project specifications Participate in requirement analysis, design, development, testing, and implementation activities Propose new techniques and technologies for software development. Perform unit testing and user acceptance testing to evaluate application functionality Ensure to complete the assigned development tasks within the deadlines Work in compliance with coding standards and best practices Provide assistance to Junior Developers ...

We are looking for a skilled professional with 6-15 years of experience to join our team in the Employment Firms/Recruitment Services Firms industry. The ideal candidate will have a strong background in contact center operations and Genesys BA. Roles and Responsibility Manage data migration, storage, and management, including real-time and historical data. Analyze contact center reporting and BI to optimize processes and improve performance. Implement WFM process, forecasting, scheduling, routing, and queue optimization. Develop and maintain knowledge management systems (KMS) for agent assist and sentiment analysis. Collaborate with teams to implement AI/Gen AI enabled agent assist and routi...

We are looking for a skilled SFDC Developer with 5-8 years of experience to join our team in Bengaluru. The ideal candidate will have a strong background in data engineering using Python and experience working with big data technologies. Roles and Responsibility Design, develop, and implement data pipelines using SFDC. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain technical documentation for data pipelines and architectures. Troubleshoot and resolve issues related to data pipeline development. Participate in code reviews and ensure adherence to coding standards. Mentor junior developers and provide technical guidance. Job Requir...

We are looking for a skilled professional with 6-9 years of experience to lead and manage key projects, drive institutional fraud-related projects, and provide expertise on fraud and financial crime risk management. The ideal candidate will have a strong background in managing Falcon upgrades, AML updates, and merchant fraud migrations. Roles and Responsibility Lead and manage key projects like the Falcon upgrade across retail, institutional, and merchant sectors. Manage Falcon upgrades and drive institutional fraud-related projects. Provide expertise on fraud and financial crime risk management. Collaborate with financial institutions to develop effective fraud detection and prevention stra...

Looking for a skilled professional with expertise in Spark and Delta Lake to join our team. The ideal candidate will have 7-12 years of experience. Roles and Responsibility Design and implement data pipelines using Spark and Delta Lake as the data storage layer. Develop and optimize Spark applications using Python, Scala, or Java. Work with large datasets to ensure data quality and integrity. Implement data partitioning and schema evolution techniques using Delta Lake. Collaborate with cross-functional teams to integrate Spark applications with ETL processes. Troubleshoot and resolve issues related to Spark application performance and data quality. Job Requirements Strong understanding of Sp...

We are looking for a skilled professional with 5-9 years of experience to join our team as an Hadoop-Spark specialist. The ideal candidate will have a strong background in big data processing and analytics. Roles and Responsibility Design, develop, and implement scalable big data solutions using Hadoop and Spark. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and optimize performance issues in big data systems. Ensure data quality and integrity through data validation and testing procedures. Stay updated with industry trends and emerging technologies in ...

We are looking for a skilled Sr Edi Engineer with 6-9 years of experience to join our team in IDESLABS PRIVATE LIMITED. The ideal candidate will have a strong background in Employment Firms/Recruitment Services Firms and excellent communication skills. Roles and Responsibility Design, develop, and implement EDI solutions for clients. Collaborate with cross-functional teams to identify business requirements and provide technical support. Develop and maintain complex EDI interfaces between various systems. Troubleshoot and resolve EDI-related issues efficiently. Provide training and support to clients on EDI usage and best practices. Stay updated with industry trends and emerging technologies ...

Looking for a candidate with over 6 years of hands-on involvement in Snowflake. The primary expertise required is in Snowflake, must be capable of creating complex SQL queries for manipulating data. The candidate should excel in implementing complex scenarios within Snowflake. The candidate should possess a strong foundation in Informatica PowerCenter, showcasing their proficiency in executing ETL processes. Strong hands-on experience in SQL and RDBMS Strong hands-on experience in Unix Shell Scripting Knowledge in Data warehousing and cloud data warehousing Should have good communication skills

6+ years of experience in Data engineering projects using COSMOS DB- Azure Databricks (Min 3-5 projects) Strong expertise in building data engineering solutions using Azure Databricks, Cosmos DB Strong T-SQL programming skills or with any other flavor of SQL Experience working with high volume data, large objects, complex data transformations Experience working in DevOps environments integrated with GIT for version control and CI/CD pipeline. Good understanding of data modelling for data warehouse and data marts Strong verbal and written communication skills Ability to learn, contribute and grow in a fast phased environment Nice to have: Expertise in Microsoft Azure is mandatory including co...

Big data engineer/Developer Spark-Scala HQL, Hive Control-m Jinkins Git Technical analysis and up to some extent business analysis (knowledge about banking products, credit cards and its transactions) Notice Period: Immediate . Employment Type: Contract

Notice Period: Immediate Joiners Job Description: Must have skills Azure DataBricks, Python And Pyspark, Spark. Please find the JD In the mail chain Expert level understanding of distributed computing principles Expert level knowledge and experience in Apache Spark Hands on experience in Azure Databricks , Data Factory, Data Lake store/Blob storage, SQL DB Experience in creating Big data Pipelines with Azure components Hands on programing with Python Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming Experience with messaging systems, such as Kafka or RabbitMQ Good understanding of...

At least 8 + years of experience in any of the ETL tools Prophecy, Datastage 11.5/11.7, Pentaho.. etc . At least 3 years of experience in Pyspark with GCP (Airflow, Dataproc, Big query) capable of configuring data pipelines . Strong Experience in writing complex SQL queries to perform data analysis on Databases SQL server, Oracle, HIVE etc . Possess the following technical skills SQL, Python, Pyspark, Hive, ETL, Unix, Control-M (or similar scheduling tools ) Ability to work independently on specialized assignments within the context of project deliverables Take ownership of providing solutions and tools that iteratively increase engineering efficiencies . Design should help embed standard pr...

#Notice Period: Immediate #Employment Type:Contract JOB Description: Salesforce CDP/Data Cloud JD 1. Overall IT experience of Minimum 7 years. 2. Experience in CDP/Data Cloud for a minimum of 6 months. 3. Should have knowledge of the SFDC Platform 4. Good Experience in SQL Queries, Data Model Concepts 5. Should have worked on a CDP/Data Cloud Implementation. 6. Show have working knowledge on at least the first 3 areas of CDP listed below. Data Ingestion Unification Segmentation Activation 1. Should have knowledge about both Batch and Real Time Integration Options. 2. Good to have knowledge on basic Data Model understanding of Financial Services Cloud. 3. Good to have experience in Salesforce...

Strong programming skills in Python programming and advance SQL. strong experience in NumPy, Pandas, Data frames Strong analytical and problem-solving skills. Excellent communication and collaboration abilities.

Highly proficient in Databricks and Pyspark Strong python programming skills. Strong in SQL scripting. Good to have experiece in snowflake cloud datawarehouse Experience in AWS services like s3, cloudwatch, kms Required good debugging skills Nice to have exposure to airflow orchestration and CI/CD Good communication and problem solving skills

About The Role A Data Platform Engineer specialises in the design, build, and maintenance of cloud-based data infrastructure and platforms for data-intensive applications and services. They develop Infrastructure as Code and manage the foundational systems and tools for efficient data storage, processing, and management. This role involves architecting robust and scalable cloud data infrastructure, including selecting and implementing suitable storage solutions, data processing frameworks, and data orchestration tools. Additionally, a Data Platform Engineer ensures the continuous evolution of the data platform to meet changing data needs and leverage technological advancements, while maintai...

Job DescriptionProduct Owner – C1Employment Type- ;PermanentLocation Chennai ;Responsible FunctionsProduct Vision & Strategy: Perform market analysis to understand market landscape including competitor solutions, trends and customer needs to help define and communicate product vision & strategy aligning with company objectivesStakeholder Engagement: Interact with diversified stakeholders to conduct JAD sessions and use variety of techniques to elicit, document, analyze and validate client requirements. Interface with Business team to conduct product demonstrations, evaluate, prioritize and build new features and functions.Requirements Management: Analyze and develop business requirement docu...