1671 Sqoop Jobs - Page 6

Google Cloud Platform o GCS, DataProc, Big Query, Data Flow Programming Languages o Java, Scripting Languages like Python, Shell Script, SQL Google Cloud Platform o GCS, DataProc, Big Query, Data Flow 5+ years of experience in IT application delivery with proven experience in agile development methodologies 1 to 2 years of experience in Google Cloud Platform (GCS, DataProc, Big Query, Composer, Data Processing like Data Flow) Mandatory Key Skills sql,data flow,java,shell scripting,agile,google,gen,data processing,spark,hadoop,hive,sqoop,big data,scala,aws,javascript,kafka,airflow,html,mysql,linux,microsoft azure,unix,jenkins,gcp*,agile development methodology*,bigquery*,python*,dataproc*

Google Cloud Platform o GCS, DataProc, Big Query, Data Flow Programming Languages o Java, Scripting Languages like Python, Shell Script, SQL Google Cloud Platform o GCS, DataProc, Big Query, Data Flow 5+ years of experience in IT application delivery with proven experience in agile development methodologies 1 to 2 years of experience in Google Cloud Platform (GCS, DataProc, Big Query, Composer, Data Processing like Data Flow) Mandatory Key Skillssql,data flow,java,shell scripting,agile,google,gen,data processing,spark,hadoop,hive,sqoop,big data,scala,aws,javascript,kafka,airflow,html,mysql,linux,microsoft azure,unix,jenkins,gcp*,agile development methodology*,bigquery*,python*,dataproc*

Job Description Position Duties & Responsibilities Deliver complete data solutions across the SDLC, from design to deployment, based on senior guidance and best practices. Contribute quantifiably to business goals by ensuring technical work addresses key challenges or improves outcomes. Collaborate effectively with other team members to gain a clear understanding of business needs and translate them into technical tasks. Help the team meet deadlines and maintain high data quality standards across projects. Share knowledge and reuse existing code to accelerate development and maintain consistency. Evaluate and propose new tools or solutions that optimize time, effort, and support the best bus...

As an Application Developer, you will lead IBM into the future by translating system requirements into the design and development of customized systems in an agile environment. The success of IBM is in your hands as you transform vital business needs into code and drive innovation. Your work will power IBM and its clients globally, collaborating and integrating code into enterprise systems. You will have access to the latest education, tools and technology, and a limitless career path with the world’s technology leader. Come to IBM and make a global impact Responsibilities: Responsible to manage end to end feature development and resolve challenges faced in implementing the same Learn new te...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc. Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation Ability to analyse data for functional business requirements & front face customer Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 5 to 7 years of relevant experience working as technical analyst with Big Query on GCP platform. Skilled in multiple GCP services - GCS, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer You love colla...

Developer leads the cloud application development/deployment. A developer responsibility is to lead the execution of a project by working with a senior level resource on assigned development/deployment activities and design, build, and maintain cloud environments focusing on uptime, access, control, and network security using automation and configuration management tools Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Strong proficiency in Java, Spring Framework, Spring boot, RESTful APIs, excellent understanding of OOP, Design Patterns. Strong knowledge of ORM tools like Hibernate or JPA, Java based Micro-services framew...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, and facilitating communication among stakehold...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating wit...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : AWS BigData Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, addressing any challenges that arise, and providing guidance to team members to foster a productive work environment. You...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating wit...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. You will be responsible for overseeing the application development process and ensuring successful project delivery. Roles & Responsibilities:- Expected to be an SME- Collaborate and manage the team to perform- Responsible for t...

remote typeOn-site locationsBengaluru, KA time typeFull time posted onPosted 5 Days Ago job requisition idREQ408131 Data Engineer 2 JLL Technologies COE- Bangalore What this job involves About the role #JLLTechAmbitions Azure Data Engineer for implementation of HR Datawarehouse project. Sounds like you? To apply you need to be Experience & Education 4+ years of overall experience in building data systems, of which 2+ years minimum in Azure Databricks. Excellent understanding of SQL and ability to write complex SQL queries in a performant way. Good understanding of Datawarehouse concepts; experience working with a dimensional model is a plus. Excellent hands-on knowledge in writing structured...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Job Role Key skills Azure Data Factory (primary) , Azure Data bricks Spark (PySpark, SQL) Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for me...

This is a remote position. 1. Python & PySpark 2. Azure Cloud Services such Synapse & Data Bricks & Data Factory (Data Bricks is mandatory) 3. OOPS Concept 4. Data Modelling with scalability Assure that data is cleansed, mapped, transformed, and otherwise optimised for storage and use according to business and technical requirements Solution design using Microsoft Azure services and other tools The ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.) Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics application...

Job Summary: We are seeking a highly skilled and motivated Senior Data Scientist with over 5 years of experience in applying advanced Machine Learning (ML), Deep Learning, Natural Language Processing (NLP), and Computer Vision (CV) techniques to real-world problems. The ideal candidate will possess deep technical expertise, business acumen, and the ability to work independently and collaboratively in a fast-paced environment. Prior exposure to Generative AI models (LLMs, VLMs, MLLMs) and Big Data ecosystems is essential. Key Responsibilities: Act as a Data Scientist for data handling, extraction, manipulation; creating structured form of data and pulling tangible insights from data Uses pred...

6+ years of professional experience in software development and/or data engineering; and in working with relational databases including Oracle, Teradata, MySQL. 6+ years of experience in working with Hadoop ecosystem, i.e. Hadoop, Hive, PySpark, Sqoop, Kafka Must have programming experience in Python, shell scripting Must have experience of handling inbound and out bound file transmission process using EFX/SFG, NDM etc. Experience with modern workflow/orchestration tools (e.g. Apache Airflow, Oozie, etc.) Experience working with reporting tools like Tableau Good to have knowledge of AWS cloud services and GenAI capabilities. Strong analytical abilities. Agile experience is required with Vers...

We are seeking experienced Data Engineers to join our growing team, with positions open for both senior (9+ years) and mid-level (5\u20139 years) professionals. This role focuses on developing scalable data solutions in cloud or relational database environments and requires strong hands-on experience with large datasets and implementation projects. The ideal candidate will have a strong foundation in Data Engineering or Data Warehousing (DWH), deep SQL skills, and a proven track record of working on real-world, implementation-focused data projects (not support roles). You\u2019ll be responsible for designing, developing, and optimising end-to-end data flows, ensuring clean, secure, and high-...

The position is for a Full Time job with rotational shifts based in Nagpur, Pune, or Bangalore. We are looking to fill 4 positions with candidates who have 5 to 8 years of experience. As an AWS Data Engineer, you will be responsible for leading development activities for the Data engineering team. You will collaborate with other teams such as application management and product delivery, working closely with technical leads, product managers, and support teams. Your role will involve providing guidance to the development, support, and product delivery teams. Additionally, you will lead the implementation of tools and technologies to drive cost-efficient architecture and infrastructure. On the...

Position Description 6+ years of professional experience in software development and/or data engineering; and in working with relational databases including Oracle, Teradata, MySQL. 6+ years of experience in working with Hadoop ecosystem, i.e. Hadoop, Hive, PySpark, Sqoop, Kafka Must have programming experience in Python, shell scripting Must have experience of handling inbound and out bound file transmission process using EFX/SFG, NDM etc. Experience with modern workflow/orchestration tools (e.g. Apache Airflow, Oozie, etc.) Experience working with reporting tools like Tableau Good to have knowledge of AWS cloud services and GenAI capabilities. Strong analytical abilities. Agile experience ...

C1X AdTech Pvt Ltd is a fast-growing product and engineering-driven AdTech company building next-generation advertising and marketing technology platforms. Our mission is to empower enterprise clients with the smartest marketing solutions, enabling seamless integration with personalization engines and delivering cross-channel marketing capabilities. We are dedicated to enhancing customer engagement and experiences while focusing on increasing Lifetime Value (LTV) through consistent messaging across all channels.Our engineering team spans front end (UI), back end (Java/Node.js APIs), Big Data, and DevOps , working together to deliver scalable, high-performance products for the digital adverti...

This is a remote position. 1. Python PySpark 2. Azure Cloud Services such Synapse Data Bricks Data Factory (Data Bricks is mandatory) 3. OOPS Concept 4. Data Modelling with scalability Key Responsibilities: Design, develop, and maintain scalable and robust data pipelines to support data processing and analysis. Collaborate with cross-functional teams to understand data requirements and implement effective solutions. Perform data modeling and design to ensure the integrity, availability, and performance of data systems. Implement and optimize ETL processes for extracting, transforming, and loading data from various sources into our data warehouse. Identify and troubleshoot data-related issues...

Responsibilities for Data Engineer (AM Role) Develop data pipelines in Python, SQL - build reusable python components. Good understanding of Individual Insurance Markets Work with stakeholders throughout the organization to identify opportunities for leveraging company data to drive business solutions. Mine and analyze data from company databases to drive optimization and improvement of product development, marketing techniques and business strategies. Assess the effectiveness and accuracy of new data sources and data gathering techniques. Develop processes and tools to monitor and analyze model performance and data accuracy. Team management. Exhibits strong understanding of core business pr...

" Educational Requirements Bachelor of Engineering , BCA , BSc , MCA , MTech , MSc Service Line Data & Analytics Unit Responsibilities 5-8 yrs exp in Azure (Hands on experience in Azure Data bricks and Azure Data Factory) Good knowledge in SQL, PySpark. Should have knowledge in Medallion architecture pattern Knowledge on Integration Runtime Knowledge on different ways of scheduling jobs via ADF (Event/Schedule etc) Should have knowledge of AAS, Cubes. To create, manage and optimize the Cube processing. Good Communication Skills. Experience in leading a team Additional Responsibilities: Good knowledge on software configuration management systems Strong business acumen, strategy and cross-indu...