2488 Sqoop Jobs - Page 10

Experience: 5+ Years Skill: ITSS- Senior Azure Developer / Data Engineer Notice Period:Immediate. Employment Type: Contract Working Mode: Hybrid Job Description Loc - Bangalore , Hyd, Chennai and Noida Experience: Mid-Level Primary Skillsets: Azure (ADF/ADLS/Key vaults) Secondary Skillsets: Databricks Good to have Skillsets: Ability to communicate well Experience in cloud applications, especially in Azure (basically things covered in Primary skillsets listed below) Work in agile framework Experience in ETL, SQL, PySpark Run with a task without waiting for direction all the time Experience with git repository and release pipelines. Any certifications on Azure Any certification on Databricks w...

Skill:Data Engineer Notice Period:Immediate. Employment Type: Contract Job Description : Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, Scala Performance Turing Optimize SQL, PySpark for performance Airflow workflow scheduling tool for creating data pipelines GitHub source control tool & experience with creating/ configuring Jenkins pipeline Experience in EMR/ EC2, Databricks etc. DWH tools incl. SQL database, Presto, and Snowflake Streaming, Serverless Architecture .

Job Details: Skill: Scala,hadoop,java, Job type: contract to hire Job Description: - 10+ years of software development experience building large scale distributed data processing systems/application, Data Engineering or large scale internet systems. Experience of at least 4 years in Developing/ Leading Big Data solution at enterprise scale with at least one end to end implementation Strong experience in programming languages Java/J2EE/Scala. Good experience in Spark/Hadoop/HDFS Architecture, YARN, Confluent Kafka , Hbase, Hive, Impala and NoSQL database. Experience with Batch Processing and AutoSys Job Scheduling and Monitoring Performance analysis, troubleshooting and resolution (this inclu...

Type: Contract Description: GCPdata engineer Big Query SQL Python Talend ETL ProgrammerGCPor Any Cloud technology. Experienced in GCP data engineer Big Query SQL Python Talend ETL Programmer GCPor Any Cloud technology. Good experience in building the pipeline of GCP Components to load the data into Big Query and to cloud storage buckets. Excellent Data Analysis skills. Good written and oral communication skills Self-motivated able to work independently

Key skills: Spark, Scala Experience: 6 to 12 years Location: AIA Hyderabad Job description Develop, test, and deploy data processing applications using Apache Spark and Scala. Optimize and tune Spark applications for better performance on large-scale data sets. Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. Design and implement high-performance data processing and analytics solutions. Ensure data integrity, accuracy, and security across all processing tasks. Troubleshoot and resolve pe...

Job type Contract to HIRE Primary Skills 6-8yrs of Experience in working as bigdata developer/supporting environemnts Strong knowledge in Unix/BigData Scripting Strong understanding of BigData (CDP/Hive) Environment Hands-on with GitHub and CI-CD implementations. Attitude to learn / understand ever task doing with reason Ability to work independently on specialized assignments within the context of project deliverable Take ownership of providing solutions and tools that iteratively increase engineering efficiencies. Excellent communication skills & team player Good to have hadoop, Control-M Tooling knowledge. Good to have Automation experience, knowledge of any Monitoring Tools. Role You wil...

We are looking for a skilled Tech Lead - Data Engineer with 7-11 years of experience to join our team in the Employment Firms/Recruitment Services Firms industry. Roles and Responsibility Design, develop, and implement data engineering solutions using various technologies. Lead a team of data engineers to ensure timely project delivery. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain large-scale data systems and architectures. Ensure data quality, integrity, and security. Stay updated with industry trends and emerging technologies. Job Requirements Strong knowledge of data engineering principles and practices. Experience w...

Looking to onboard a skilled Hadoop Admin with 5-12 years of experience to join our team in Bangalore. The ideal candidate will have a strong background in Big Data technologies and programming languages such as Python, Scala. Roles and Responsibility Design, develop, and implement scalable data processing systems using Hadoop and Spark. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Troubleshoot and resolve complex technical issues related to data processing and storage. Ensure high availability and performance of data systems and applications. Participate in code reviews and contrib...

AWS data developers with 6-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Big Data - Big Data - Pyspark Beh - Communication Database - Database Programming - SQL

AWS data developers with 8-10 years experience certified candidates (AWS data engineer associate or AWS solution architect) are preferred Skills required - SQL, AWS Glue, PySpark, Air Flow, CDK, Red shift Good communication skills and can deliver independently Mandatory Competencies Cloud - AWS - Tensorflow on AWS, AWS Glue, AWS EMR, Amazon Data Pipeline, AWS Redshift Beh - Communication Big Data - Big Data - Pyspark Database - Database Programming - SQL Programming Language - Python - Apache Airflow

We are looking for a skilled Team Lead - Data Engineer with 6-8 years of experience to join our team in the Employment Firms/Recruitment Services Firms industry. The ideal candidate will have a strong background in data engineering and excellent leadership skills. Roles and Responsibility Design, develop, and implement large-scale data pipelines and architectures. Lead a team of data engineers to deliver high-quality results. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain technical documentation for data systems and processes. Troubleshoot and resolve complex technical issues related to data engineering. Mentor and guide ...

We are looking for a skilled PySpark Architect with 8 to 13 years of experience to join our team in India. The ideal candidate will have a strong background in designing and implementing scalable data processing architectures using PySpark. Roles and Responsibility Design and develop scalable data processing architectures using PySpark. Collaborate with cross-functional teams to identify business requirements and design solutions. Develop and maintain large-scale data pipelines using PySpark. Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks. Optimize data processing workflows for performance, scalability, and reliability. Mentor junior...

We are looking for a skilled Senior Pyspark Developer with 5-9 years of experience to join our team in India. The ideal candidate will have expertise in developing scalable data processing pipelines using Pyspark. Roles and Responsibility Design, develop, and deploy large-scale data processing pipelines using Pyspark. Collaborate with cross-functional teams to identify business requirements and design solutions. Develop and maintain complex data transformations and data quality checks. Optimize pipeline performance and troubleshoot issues. Ensure compliance with industry standards and best practices. Participate in code reviews and contribute to improving overall code quality. Job Requiremen...

We are looking for a skilled Project Manager with 10-20 years of experience to lead our Big Data team in India. The ideal candidate will have a strong background in managing large-scale projects and leading teams. Roles and Responsibility Manage and deliver high-quality results on complex Big Data projects. Lead and motivate a team of professionals to achieve project goals. Develop and implement project plans, resource allocation, and risk management strategies. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure timely delivery of projects while maintaining quality standards. Identify and mitigate potential risks and issues impacting project succe...

We are looking for a skilled Senior Big Data Developer with 5-9 years of experience to join our team in India. The ideal candidate will have expertise in big data development and analysis. Roles and Responsibility Design, develop, and implement big data solutions using various technologies. Collaborate with cross-functional teams to identify business requirements and develop solutions. Develop and maintain large-scale data pipelines and architectures. Ensure data quality, integrity, and security. Optimize big data systems for performance and scalability. Stay updated with industry trends and emerging technologies. Job Requirements Strong understanding of big data concepts, including Hadoop, ...

We are looking for a skilled Team Lead with 6-8 years of experience to join our team in the Big Data domain. The ideal candidate will have a strong background in leading teams and driving business growth through data-driven insights. Roles and Responsibility Develop and implement big data strategies to drive business growth and improvement. Lead cross-functional teams to design, develop, and deploy big data solutions. Collaborate with stakeholders to identify business problems and develop data-driven solutions. Design and implement data governance frameworks to ensure data quality and integrity. Develop and maintain technical documentation for big data systems and processes. Provide training...

We are looking for a skilled Tech Lead - Big Data with 7-11 years of experience to join our team in India. Roles and Responsibility Design and implement big data solutions using various technologies. Lead the development team in building scalable and efficient big data systems. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data pipelines and architectures. Ensure high-quality code and adhere to industry standards. Mentor junior team members and provide technical guidance. Job Requirements Strong experience in big data technologies such as Hadoop, Spark, and NoSQL databases. Proven track record of le...

We are looking for a skilled Big Data Architect with 8 to 13 years of experience to join our team in India. The ideal candidate will have a strong background in designing and implementing large-scale data systems. Roles and Responsibility Design and develop scalable big data architectures to support business intelligence and analytics. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain technical documentation for big data systems and processes. Ensure compliance with industry standards and best practices for big data management. Provide technical leadership and guidance to junior team members on big data technologies. Participate in ...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – Cloud Architect - Manager As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for Senior...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – Cloud Architect - Manager As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for Senior...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY GDS – Data and Analytics (D&A) – Cloud Architect - Manager As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, Manufacturing, Healthcare, Retail, Manufacturing and Auto, Supply Chain, and Finance. The opportunity We’re looking for Senior...

As an experienced professional with over 7+ years of experience in Noida, your role will involve the following key responsibilities: - Reviewing and understanding business requirements to ensure timely completion of development tasks with minimal defects - Collaborating with a software development team to implement best practices and enhance the performance of Data applications for meeting client needs - Engaging with various teams and customers to translate their business challenges into innovative solutions - Conducting research on new Big Data technologies to align them with the business and technology strategy - Operating within a rapid and agile development process to accelerate speed t...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, collaborating with Integration Architects and Data Architects to ensure cohesive integration betwee...

JD : KAfka: Design and develop Kafka/Kafka connectors data pipelines and integration solutions. Implement and manage Kafka producers, consumers, topics, and partitions. Integrate Kafka with external systems (e.g., databases, APIs, cloud services). Optimize Kafka performance for throughput, latency, and reliability. Collaborate with DevOps, data engineering, and application teams. Monitor and troubleshoot Kafka clusters and streaming applications. Ensure data security, compliance, and governance in Kafka implementations. Maintain documentation for Kafka configurations, schemas, and processes. Mandatory Skills: Kafka Integration. Experience: 5-8 Years.

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...