2488 Sqoop Jobs - Page 18

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS – Data and Analytics (D And A) – AWS DBX – Senior As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufac...

Job DescriptionProduct Owner – C1Employment Type- ;PermanentLocation Chennai ;Responsible FunctionsProduct Vision & Strategy: Perform market analysis to understand market landscape including competitor solutions, trends and customer needs to help define and communicate product vision & strategy aligning with company objectivesStakeholder Engagement: Interact with diversified stakeholders to conduct JAD sessions and use variety of techniques to elicit, document, analyze and validate client requirements. Interface with Business team to conduct product demonstrations, evaluate, prioritize and build new features and functions.Requirements Management: Analyze and develop business requirement docu...

Technical / Behavioral Extensive experience in automation, framework outlining, coding and application development Superior skills in Java, Python, and SQL Sound knowledge of quality assurance procedures , testing Build and SaaS based applications. Strong expertise in use of stress testing tools and software testing methodologies. Extensive Experience in Testing Tools like Selenium, Playwright, Karate, Rest Assured and Low Code Testing Platforms Sound Knowledge of UI/Web, API , Data and Mobile Testing domains. Excellent grasp of SQL queries and Internet technologies Experience in migrating infrastructure workload to AWS cloud and ability to automate and maintain AWS EKS and other Cloud Servi...

2-4 years of experience Good experience in hadoop hive Sqoop Good in Writing SQL queries using Joines Sub Good in DWH concepts Good in Communication and written skills Ability to work independently working Agile is plus Nice to have - Experience in ETL and unix scripting is good to have Teradata is nice to have Account/Client Name : Morgan Stanley Local Grade of the requisition

JD for Unity Catalog and Databricks Engineer ClientPersistent Role C2H LocationPan India Job description Experience-6 to 9yrs overall, Also experience in Pyspark, Databricks Location-PAN INDIA(except Hyderabad and Chennai as preferred location) NP-Immediate/15 days Hybrid-2 or 3 days WFO "Unity Catalog Adoption Data Engineer 3-6 Years,PySpark,Databricks,Unity Catalog JD Design, develop, and maintain efficient and scalable data pipelines using PySpark, Databricks. Utilize Databricks to orchestrate and automate data workflows. Implement and manage data storage solutions using Unity Catalog for effective data governance. Collaborate with data scientists, analysts, and business stakeholders to e...

Backend Hadoop, Spark, Hive Proficiency in one or more general purpose big data languages Hadoop, Python, Hive, HDFS and Spark 4 years+ experience designing and development using Python or Spark. 2+ years experience working in UNIX, SQL, Java and/or Scala 3 to 5 years experience with Unix shell scripting Demonstrated experience in Agile development, application design, software development, and testing Expertise in objected oriented analysis and design across a variety of platforms Experience with adaptive and responsive development techniques Aptitude for learning and applying programming concepts Ability to effectively communicate with internal and external business partners

Key Responsibilities: Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. Implem...

Location Chennai and Hyderbad preferred but customer is willing to take resources from Hyderabad Experience 5 to 8 yrs ( U3 ). Exp - 5- 10 Yrs Location - Hyderabad / Chennai Location Proven experience as a development data engineer or similar role, with ETL background. Experience with data integration / ETL best practices and data quality principles. Play a crucial role in ensuring the quality and reliability of the data by designing, implementing, and executing comprehensive testing. By going over the User Stories build the comprehensive code base and business rules for testing and validation of the data. Knowledge of continuous integration and continuous deployment (CI/CD) pipelines. Famil...

SQL Budget -13$ /Hour (18 LPA) Location - Bangalore 3-5 years Primary skill is SQL we are looking for someone with expertise in SQL, advanced SQLbasic working knowledge of Python, Shell scriptinggood to have Airflow and MDM conceptsNeed to work from Bangalore office of customer few days from customer and few days remotely.Good knowledge on SQLbasic knowledge on Python, Shellgood to have Airflow and MDM concepts

Description Detailed JD RTIM Pega CDH 8.8 Multi App Infinity 24.1 Java Restful API oAuth 1. Understanding the NBA requirements and the complete CDH architecture 2. Review of the Conceptual Design Detailed Design and estimations. 3. Reviewing and contributing to the deployment activities and practices 4. Contributing to overall technical solution and putting it to practise. 5. Contributing to the requirement discussion with the Subject matter expertise in relation to Pega CDH 6. Experience in Pega CDH v8.8 multi app or 24.1 and retail banking domain is preferred. 7. Conducting peer code reviews 8. Excellent communications skills Named Job Posting? (if Yes - needs to be approved by SCSC) Addit...

Description Overall 10+ years of experience in Python and Shell Knowledge of distributed systems like Hadoop and Spark as well as cloud computing platforms such as Azure and AWS Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade B Level To Be Defined Named Job Posting? (if Yes - needs to be approved by SCSC) No Remote work possibility No Global Role Family To be defined Local Role Name To be defined Local Skills Ruby;automation;Python Languages RequiredENGLISH Role Rarity To Be Defined

EXP 4 to 6 yrs Location Any PSL Location Rate below 14$ JD - DBT/AWS Glue/Python/Pyspark Hands-on experience in data engineering, with expertise in DBT/AWS Glue/Python/Pyspark. Strong knowledge of data engineering concepts, data pipelines, ETL/ELT processes, and cloud data environments (AWS) Technology DBT, AWS Glue, Athena, SQL, Spark, PySpark Good understanding of Spark internals and how it works. Goot skills in PySpark Good understanding of DBT basically should be to understand DBT limitations and when it will end-up in model explosion Good hands-on experience in AWS Glue AWS expertise should know different services and should know how to configure them and infra-as-code experience Basic ...

JR REQ--- Data Engineer --6to8year---PUNE, THANE----Bhalchandra Suryawanshi ---TCS C2H ---900000

JD GCP Data Engineer Responsibilities: Design, develop, and maintain data pipelines using GCP services such as Dataflow, BigQuery, and Pub/Sub. Implement and manage data warehouse solutions using BigQuery, ensuring data is stored securely and efficiently. Use Pub/Sub for real time data ingestion and streaming analytics. Provision and manage GCP infrastructure using Terraform, ensuring best practices in IaC are followed. Optimize data storage and retrieval processes to enhance performance and reduce costs. Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability of data services. Ensure data quality and integrity through robust testing and validation processes...

Azure Databricks: 1. Mounting Files 2. PAT Tokens 3. Cluster Auto scaling 4. Cluster Types 5. Nesting notebooks 6. Reading file using default and custom schema 7. Types Secrets and scopes in databricks 8. Delta Tables 9. Basic file loading scenario with its steps 10. Optimization 11. User defined functions 12. Transformations ADF: 1. Integration runtimes familiar with and where they are used 2. Components in creating pipelines 3. Scenario based question for creating a basic pipeline for loading data to Azure SQL table 4. Basic steps to improve the loading activity of a huge amount of file , ex: 1TB file size

Job Summary: We are seeking a skilled Data Engineer with expertise in Data Modeling, SQL, Snowflake, Python, AWS, and NoSQL . The ideal candidate will be responsible for designing and implementing scalable data solutions, ensuring efficient data storage, retrieval, and processing. Experience in NoSQL Data Modeling is a plus. Key Responsibilities: Design and implement data models to support analytical and operational workloads. Develop, optimize, and manage SQL queries for data extraction, transformation, and loading (ETL). Work extensively with Snowflake to build scalable data pipelines and warehouses. Develop and maintain Python scripts for data processing and automation. Implement AWS serv...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – Azure/Databricks Architect We’re looking for candidates with strong technology and data understanding in big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. Your Key Responsibilities Architecting big data solutions in a cloud environment using Azure Cloud services ETL design, development, and deployment...

Who we are Alef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe. Today, Alef is proudly headquartered in the UAE, working hand-in-hand with ministries of education, schools, and teachers to bring smart, data-powered platforms into classrooms in over 14,000 schools. Supporting over 1.1 million students and 50,000 teachers across the UAE, Indonesia & Morocco our AI-driven platforms generate 16+ million data points every day, helping...

As a DevOps Engineer at our company based in Pune, you will be responsible for a variety of tasks to ensure efficient and smooth operations. You will be working with AWS/GCP/Azure, Kubernetes, Terraform, and CI/CD tools to maintain and improve our infrastructure. Additionally, you will be utilizing Kafka & Sqoop for data processing and integration, managing cloud databases including NoSQL databases, and having experience with Airflow or any workflow manager on big data for scheduling and monitoring data pipelines. Your role will also involve managing web and microservices to ensure high availability and scalability, as well as working with Kubernetes and Docker for container orchestration. T...

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Strong proficiency in Java, Spring Framework, Spring boot, RESTful APIs, excellent understanding of OOP, Design Patterns. Strong knowledge of ORM tools like Hibernate or JPA, Java based Micro-services framew...

As a cloud Consultant you will serve as a client-facing practitioner who sells, leads and implements expert services utilizing the breadth of IBM's offerings and technologies. A successful Cloud Consultant is regarded by clients as a trusted business advisor who collaborates to provide innovative solutions used to solve the most challenging business problems. You will work developing solutions that excel at user experience, style, performance, reliability and scalability to reduce costs and improve profit and shareholder value. Your primary responsibilities includeArchitecting Modern SolutionsAnalyze the clients' legacy applications and surrounding systems, defining target application archit...

As an Associate Software Developer at IBM, you'll work with clients to co-create solutions to major real-world challenges by using best practice technologies, tools, techniques, and products to translate system requirements into the design and development of customized systems Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Spring Boot, Java2/EE, Microsservices- Hadoop Ecosystem (HBase, Hive, MapReduce, HDFS, Pig, Sqoop etc) Spark Good to have Python Preferred technical and professional experience None

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Job Role Key skills Azure Data Factory (primary) , Azure Data bricks Spark (PySpark, SQL) Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for me...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Python (Programming Language), Apache Spark, AWS Architecture, PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, ...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will be responsible for overseeing the application development process and ensuring successful project delivery. Roles & Responsibilities:- Expected to be an SME- Collaborate and manage the team to perform- Responsible for t...