1671 Sqoop Jobs

About The Role : Job Title: Risk Portfolio Analyst LocationMumbai, India Role Description Market and Valuation Risk Management (MVRM) provides an independent view of market risks and valuation to Deutsche Banks senior management. The market risk team manages Deutsche Banks Market Risk position in an independent and neutral way. You will be a part of the Market Risk Analysis and Control (MRAC) function within MVRM and will be responsible for the provision of all official market risk metrics and core analysis in support of risk management decision making for Global Rates asset class. The team operates a business/asset class and risk metric aligned organizational matrix supported by central fun...

Interested candidates can email at seema@talentvelocity.co.in WhatsApp 9870343675. Job Title: Big Data Architect Experience: 8+ Years Location: Nagpur / Pune (Onsite – 5 Days Working) Notice Period: 0 to 30 days max About the Role We are looking for a highly skilled Big Data Architect to design and deliver scalable, production-grade big data solutions integrating Hadoop ecosystems with cloud platforms. The ideal candidate will have hands-on experience in architecting, optimizing, and deploying complex data pipelines while ensuring performance, cost efficiency, and best practices in data engineering. Key Responsibilities Deliver reference architecture for Hadoop + Cloud integration tailored t...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Databricks Developer Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation . Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for metadata files with requirements for ingestion) Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud Strong Programming skills with at least one of Python, Scala or Java Location- Pune, Bangalore, Coimbatore, Chennai Mandatory Skills: DataBricks - Data Enginee...

Title and Summary Specialist, Product ManagementOur Purpose MasterCard Data & Services enables customers across industries and geographies to make smarter decisions and reach better outcomes with a tailored portfolio of solutions beyond the transaction We harness the power of real-time, anonymized, aggregated transaction data; powerful software platforms; and a wealth of expertise We empower customers to make better data-driven decisions by unlocking a holistic view of consumer behaviour beyond their four walls and distilling actionable insights from data We work with financial institutions, retailers, telecommunications organizations, travel companies, and more Our decency quotient, or DQ, ...

We are seeking a skilled Big Data Developer with 3+ years of experience to develop, maintain, and optimize large-scale data pipelines using frameworks like Spark, PySpark, and Airflow. The role involves working with SQL, Impala, Hive, and PL/SQL for advanced data transformations and analytics, designing scalable data storage systems, and integrating structured and unstructured data using tools like Sqoop. The ideal candidate will collaborate with cross-functional teams to implement data warehousing strategies and leverage BI tools for insights. Proficiency in Python programming, workflow orchestration with Airflow, and Unix/Linux environments is essential. Location: Remote- Delhi / NCR,Banga...

Job TitleData Engineer Experience5"“8 Years LocationDelhi, Pune, Bangalore (Hyderabad & Chennai also acceptable) Time ZoneAligned with UK Time Zone Notice PeriodImmediate Joiners Only Role Overview We are seeking experienced Data Engineers to design, develop, and optimize large-scale data processing systems You will play a key role in building scalable, efficient, and reliable data pipelines in a cloud-native environment, leveraging your expertise in GCP, BigQuery, Dataflow, Dataproc, and more Key Responsibilities Design, build, and manage scalable and reliable data pipelines for real-time and batch processing. Implement robust data processing solutions using GCP services and open-source tec...

We are looking for a skilled Python Developer with expertise in Machine Learning to join our team at Panacorp Software Solutions. The ideal candidate will have 6 years of experience and a strong background in developing scalable and efficient machine learning models. Roles and Responsibility Design, develop, and deploy machine learning models using Python. Collaborate with cross-functional teams to identify business problems and develop solutions. Develop and maintain large-scale data pipelines and architectures. Implement automated testing and deployment scripts. Troubleshoot and resolve technical issues related to machine learning models. Stay updated with industry trends and advancements ...

Primary Responsibilities: Analyzes and investigates Provides explanations and interpretations within area of expertise Participate in scrum process and deliver stories/features according to the schedule Collaborate with team, architects and product stakeholders to understand the scope and design of a deliverable Participate in product support activities as needed by the team. Understand product architecture, features being built and come up with product improvement ideas and POCs Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, c...

Job Overview: We are looking for a Module Lead Azure Databricks to lead the design, development, and deployment of data engineering and analytics solutions on the Azure platform. The role involves guiding a team, ensuring high-quality deliverables, and collaborating with business and technology stakeholders to drive data-driven transformation. Key Responsibilities: Lead end-to-end design and development of scalable data pipelines and analytics solutions using Azure Databricks, Azure Data Lake, Synapse, and related services . Translate business requirements into technical specifications and data solutions. Oversee ETL/ELT design, data ingestion, transformation, and integration with multiple s...

Common Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow,Experience on Spark/Hive/HDFS,Data modeling for Data conversion Resources Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skillsCommon Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow Experience on Spark/Hive/HDFS,Data modeling for Data conversion Resources Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills Data Engineer - Knows HR Knowledge , all other requirement from Functional Area given by UBER

Associate Managing Consultant, Advisors & Consulting Services, Performance Analytics Overview MasterCard Advisors is helping to shape the future of data insights by leveraging billions of anonymized, aggregated transactions in a 10 petabyte data warehouse to help financial institutions, merchants, media, and governments manage their businesses more effectively Advanced Analytics is charged with servicing clients by centralizing and optimizing the world-class analytical, modeling, software coding, data sourcing, product development, product management, econometrics, and associated delivery capabilities of the MasterCard Advisors organization Use broad Banking, Retail, Travel, Technology, Digi...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

Design, develop, and optimize ETL workflows to extract, transform, and load data from various sources into the data warehouse. Write efficient and complex SQL queries to support data extraction, transformation, and reporting needs. Manage and maintain database systems ensuring performance, reliability, and security. Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver scalable solutions. Monitor and troubleshoot ETL processes and database performance issues. Implement data quality checks and validation mechanisms to ensure data accuracy and consistency. Document data pipelines, workflows, and best practices. Stay updated with the...

To ensure efficient and effective functioning of Coating plant in shifts and proper maintenance of machines in the plant Should have Knowledge of PLC, AC / DC Drvies (GE Fanuc / siemens / schneider), Induction Unit (Electrotherm / Inductotherm), HT & LT Braker Maintenance (Schneider / L&T), AC & DC Motor Maintenance, Temperature Controller, Switchgear, Starters, SAP Knowledge Industrial Safety - Proper Housekeeping of departnental Electrical systems & spares as per OHSAS & EMS standard. Maximizing the machine uptime - Attend breakdowns in time. Analyze the breakdown & take corrective action for repetitive/non repetitive breakdowns. Documentations as per SOP (maintenance). In-house repairing ...

Project description We need a Senior Python and Pyspark Developer to work for a leading investment bank client. Responsibilities Develop software applications based on business requirements Maintain software applications and make enhancements according to project specifications Participate in requirement analysis, design, development, testing, and implementation activities Propose new techniques and technologies for software development. Perform unit testing and user acceptance testing to evaluate application functionality Ensure to complete the assigned development tasks within the deadlines Work in compliance with coding standards and best practices Provide assistance to Junior Developers ...

Project description As a Data & Application Engineer, you are responsible for the engineering team and the technology that the team owns. You will not only work as a coach for your team but also as a technical leader, ensuring that the right technical decisions are made when building our data and reporting product(s). As a data and analytics team, we are responsible for building a cloud-based Data Platform for our client and its stakeholders across brands. We aim to provide our end users from different Finance departments, e.g.., Risk, FPA, Tax, Order to Cash, the best possible platform for all of their Analytics, Reporting & Data needs. Collaborating closely with a talented team of engineer...

Job summary: Analytics Team at Grant Thornton INDUS Marketing are seeking a skilled and motivated Microsoft Fabric Engineer. In the given role, you will be responsible for designing, implementing, and maintaining solutions within the Microsoft Fabric ecosystem. Your expertise will contribute to the optimization of enterprise data processes, analytics workflows, and system integrations, ensuring the delivery of high-performance, scalable, and secure solutions. Key responsibilities: Design, implement, and maintain solutions leveraging Microsoft Fabric services (e.g., Power BI, Synapse Analytics, Azure Data Factory, Data Lake) Develop and manage robust data pipelines for ETL/ELT processes withi...

Role: Azure Data Engineer · Experience: 5+ Years · Location: Hyderabad · Duration: 6 Months ( Extension depends on the project) · Shift Timings: 10:00 AM to 7:00 PM · Work Mode: Work from Office (5 Days Working) · Notice Period: Immediate · Key Skills: · Azure Devops, Azure AD, Key Vault, and Managed Identities, Python, SQL/T-SQL, and Azure CLI/PowerShell, Azure Data Services (ADLS, Synapse, Databricks, SQL) Overview: We are looking for an Azure Data Engineer to design and build scalable data solutions within the Azure ecosystem. Responsibilities : ● Develop and manage data storage solutions (ADLS , Blob Storage, Azure SQL, Synapse). ● Build and orchestrate ETL/ELT pipelines using Azure Data...

Must have: 7+ years of development experience in Java Good background with Spring framework Project experience(s) on Java Spark Job using HDFS Strong SQL backgroundNice to have: Snowflake Airflow, Angular, NodeJS, Tableau Mandatory Competencies Programming Language - Java - Core Java (java 8+) Programming Language - Java - Spring Framework Beh - Communication Database - Database Programming - SQL Big Data - Big Data - SPARK

Key Responsibilities Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources. Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems. Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs. Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery. Data Strategy & Business Value: Art...

Description:Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS.Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL.Experience with batch job scheduling and managing data dependencies.Knowledge of data processing tools like Spark and Airflow.Automate repetitive tasks and build reusable frameworks to improve efficiency.Provide Run/DevOps support and manage the ongoing operation of data services. Location - Bangalore, Mumbai, Pune, Chennai, Kolkata, Hyderabad

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark, SQL Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various stakeholders to gather requirements, overseeing the development process, and ensuring that the applications meet the specified needs. You will also engage in problem-...

Project Role : Data Governance Practitioner Project Role Description : Establish and enforce data governance policies to ensure the accuracy, integrity, and security of organizational data. Collaborate with key stakeholders to define data standards, facilitate effective data collection, storage, access, and usage; and drive data stewardship initiatives for comprehensive and effective data governance. Must have skills : Snowflake Data Warehouse Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Governance Practitioner, you will establish and enforce data governance policies to ensure the accuracy, int...