2959 Sqoop Jobs

As a Big Data Engineer specializing in the Hadoop Ecosystem, your primary role will involve designing, deploying, and maintaining Hadoop ecosystem clusters (HDFS, YARN) to ensure stability, scalability, and security for production workloads. You will be responsible for developing and optimizing batch ETL pipelines using Spark, Hive, Sqoop, and related tools to ingest, transform, and store large datasets. Additionally, you will build and operate streaming data pipelines using Kafka to guarantee low-latency delivery and fault tolerance. Your duties will also include performance tuning, capacity planning, and cluster troubleshooting, such as resource contention, job optimization, and storage fo...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics - D and A – AWS DBX - Manager As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for Managers (...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics - D and A – AWS DBX - Manager As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for Managers (...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics - D and A – AWS DBX - Manager As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for Managers (...

Job Summary We are seeking a Product Solution Architect with strong expertise in designing and delivering AWS-based big data solutions . The role focuses on building scalable, secure, and high-performance data platforms while providing technical leadership to data engineering teams. Key Responsibilities Design and architect end-to-end big data solutions on AWS aligned with best practices. Collaborate with product, engineering, and business teams to translate requirements into technical solutions. Lead implementation from design to production, ensuring performance, scalability, and cost optimization. Ensure data security, compliance, quality, and governance across data pipelines. Mentor data ...

Posted On: 18 Dec 2025 Location: Noida, UP, India Company: Iris Software Why Join Iris? Are you ready to do the best work of your career at one of India’s Top 25 Best Workplaces in IT industry ? Do you want to grow in an award-winning culture that truly values your talent and ambitions ? Join Iris Software — one of the fastest-growing IT services companies — where you own and shape your success story . About Us At Iris Software, our vision is to be our client’s most trusted technology partner, and the first choice for the industry’s top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technol...

Role Overview: You will be responsible for developing and maintaining Hadoop applications using technologies such as HDFS, Hive, Spark, Sqoop, Flume, Oozie, Unix Script, and Autosys. Your role will involve working with big data frameworks and ensuring the smooth functioning of data processing systems. Key Responsibilities: - Gather requirements and design data processing frameworks - Develop and implement data processing solutions using Spark with Java - Utilize your excellent communication skills to collaborate effectively with team members and stakeholders - Be prepared to work in shifts based on project requirements Qualifications Required: - Solid understanding of Hadoop concepts, includ...

Big Data/Hadoop Experience particularly in ingesting data and implementing Data ingestion pipelines, SQOOP, HADOOP, HDFS, HIVE, IMPALA, Java, Scala, Spark Scala is Mandatory Data Engineer with below responsibilities: Lead Data Engineer to build data pipelines to support implementation of data science and analytics use cases. Candidate needs to be able to develop code in the corresponding language (see technical skills), test it, and follow up with the implementation into Production environment. Candidate will also take part in the solution design phase, so experience in analysis requirements is desirable. Technical expert to lead a squad of engineers for a Data Product and implement data tra...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Design ETL test plans and automated scripts Vali transformations, perform profiling, automate data quality checks, test stored procedures, generate reports, manage defects, ensure compliance with business rules Strong SQL, ETL tools (Informatica, Talend, DataStage, Glue, ADF) Experience with AWS/Azure/GCP, Jira/Azure DevOps, Agile Strong communication and documentation skills Additional Information At Tietoevry, we believe in the power of diversity, equity, and inclusion We encourage applicants of all backgrounds, genders (m/f/d), and walks of life to join our team, as we believe that this fosters an inspiring workplace and fuels innovation Our commitment to openness, trust, and diversity is...

Online fraud detection such as collusion, multiple ids, bonus abuse etc using data analytics Use analytics techniques to detect, prevent and mitigate fraud Fraud hypothesis and identifying new patterns of abuse Work on Insights and help in translating data into actionable business decisions Solutioning with Business & Product team by bringing in the right process/ system/ policy fixes in a manner that balances b/w cost & experience Defining key Financial and Operational metric to enable real time detection of fraud/ abuse Own daily, weekly and monthly reporting of KPIs Build strategies and suggest changes in processes which will eventually become industry benchmarks in the risk management sp...

Databricks Architect to lead the migration of our enterprise data platform from Cloudera to the Databricks Lakehouse. The role involves defining target architecture, designing migration pathways, modernizing workloads, and ensuring secure and optimized operations on Databricks. Define Databricks Lakehouse architecture (Delta Lake, medallion layers, security, governance). Assess existing Cloudera/Hadoop environment and design migration strategy. Lead conversion of Hive tables, Spark jobs, Oozie workflows, Sqoop/NiFi pipelines to Databricks (Jobs, Workflows, DLT, Unity Catalog). Implement best practices for performance, cost optimization, cluster management, and monitoring. Establish data gove...

Migrate Hive/Impala tables and associated metadata to Databricks Delta tables. Re-engineer ingestion pipelines from Cloudera to Databricks using PySpark. Convert transformation logic from HiveQL/Impala SQL to PySpark. Optimize data workflows for performance and scalability in Databricks. Implement best practices for data governance, security, and compliance on AWS.

Title and Summary Associate Managing Consultant, Advisors & Consulting Services, Performance AnalyticsAssociate Managing Consultant Performance Analytics Advisors & Consulting Services Services within Mastercard is responsible for acquiring, engaging, and retaining customers by managing fraud and risk, enhancing cybersecurity, and improving the digital payments experience. We provide value-added services and leverage expertise, data-driven insights, and execution. Our Advisors & Consulting Services team combines traditional management consulting with Mastercards rich data assets, proprietary platforms, and technologies to provide clients with powerful strategic insights and recommendations. ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qualit...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. You will also engage...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. You will also engage in strategic pl...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

Positions on this level have advanced knowledge and experience and participates in/leads the development of new solutions/projects Shares best practice and advice to the co-workers in the professional area Not only generates own workload but outlines directions to others Can supervise and coordinate lower-level specialists being single point of contact in complex matters Coordinates the daily operations, enables and oversees the implementation of short to medium term activities within the team Delivers input to policies, processes and standards, where decisions are of tactical and operational nature within a defined scope Manages a mixed team of Specialist and Support jobs, with full employe...

Databricks Architect to lead the migration of our enterprise data platform from Cloudera to the Databricks Lakehouse. The role involves defining target architecture, designing migration pathways, modernizing workloads, and ensuring secure and optimized operations on Databricks. Define Databricks Lakehouse architecture (Delta Lake, medallion layers, security, governance). Assess existing Cloudera/Hadoop environment and design migration strategy. Lead conversion of Hive tables, Spark jobs, Oozie workflows, Sqoop/NiFi pipelines to Databricks (Jobs, Workflows, DLT, Unity Catalog). Implement best practices for performance, cost optimization, cluster management, and monitoring. Establish data gove...

Lead Engineers should have min 6 yrs hands on coding Manage GKE workloads and applications. On daily basis working on Linux OS ,GCP platform(mainly GKE, Networking:VPC Firewall etc.Logging Stackdriver, Big Query)Kafka(CFK)development of Workloads

Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc. Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation Ability to analyse data for functional business requirements & front face customer Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 5 to 7 years of relevant experience working as technical analyst with Big Query on GCP platform. Skilled in multiple GCP services - GCS, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer You love colla...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

NDR Operations & Analysis Monitor NDR alerts, anomalies, and threat detections. Investigate suspicious network traffic patterns and escalate incidents as required. Perform root cause analysis and support incident response activities. Create reports and dashboards for threat visibility and management review. Collaborate with SOC and other security teams for triage and resolution. Administration & Tool Management configure, and integrate the NDR solution with SIEM, SOAR, EDR, and firewalls. Perform user access management, policy updates, and rule tuning. Maintain system health (patching, upgrades, backup/restore, performance optimization). Define and implement detection use cases and custom si...

Job Summary 5+ years of experience writing and deploying high-quality production code Spark/Pyspark with strong Python SQL. 5+ years of hands on experience in managing and optimizing Big Data ecosystems such as Spark Pyspark to build sustainable technical solutions that verifiably meet specific well-defined business requirements Experience selecting and using industry-standard open source and/or commercial tools and libraries to solve specific prob Responsibilities 8.Roles & Responsibilities Work collaboratively in a small team of engineers maintaining and improving our product Help shape the future of our technology platform. Infuse industry best practices into our team processes and develo...