2488 Sqoop Jobs - Page 24

Role Description: As a Technical Lead - Cloud Data Platform (AWS) at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining securit...

Join us as a Data Engineer, Pyspark, SQL and DWH Youll be the voice of our customers, using data to tell their stories and put them at the heart of all decision-making Well look to you to drive the build of effortless, digital first customer experiences If youre ready for a new challenge and want to make a far-reaching impact through your work, this could be the opportunity youre looking for We're offering this role at vice president level What you'll do As a Data Engineer, youll be looking to simplify our organisation by developing innovative data driven solutions through data pipelines, modelling and ETL design, inspiring to be commercially successful while keeping our customers, and the b...

Join us as a Data Engineer Were looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secure Day-to-day, youll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through insights If youre ready for a new challenge, and want to bring a competitive edge to your career profile by delivering streaming data ingestions, this could be the role for you We're offering this role at associate vice president level What youll do Your daily responsibilities will include you developing a comprehensive knowledge of our data structures and me...

Role Description: As a Senior Cloud Data Platform (Azure) Engineer at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise You will also work with the secur...

Role Description: As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secu...

Role Description As a Senior Cloud Data Platform (AWS) Specialist at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secur...

Role Description: As a Technical Lead - Cloud Data Platform (AWS) at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining secur...

Role Description We are looking for a Senior Python Developer with Databricks expertise to join our BSR (Billing System Replacement) team. The role is critical for our client AssetMark, who are modernizing their billing platform and moving towards a data-first architecture. This is a full-time ODC-based role, with strict five-day office presence required due to client compliance. Working hours are aligned to 1 PM 10 PM IST, supporting overlap with U.S. stakeholders. The right candidate will be highly skilled in Python and Databricks while also capable of understanding legacy codebases built on .NET and Azure. Technical Skills Key Responsibilities Build and optimize data pipelines on Databric...

Role Description :As a Senior Technical Lead - Cloud Data Platform (Snowflake) at Incedo, you will be responsible for managing and optimizing the Snowflake environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or Azure and have experience with data warehousing technologies such as Snowflake. You will be responsible for configuring and optimizing the Snowflake environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the sec...

ETL developer with Pyspark A Senior Engineer - Software / ETL Developer with PySpark is responsible for designing, developing, and optimizing data pipelines and ETL processes using PySpark and other related big data technologies. This role typically involves working with large-scale datasets and ensuring data quality, integrity, and performance. Key Responsibilities: ETL Pipeline Development: Design, develop, and maintain robust and scalable ETL pipelines using Python and PySpark to extract, transform, and load data from various sources into data warehouses or data lakes. Data Transformation & Optimization: Implement complex data transformations, aggregations, and optimizations within Spark ...

Role Description As a Technical Lead - Cloud Data Platform (AWS) at Incedo, you will be responsible for designing, deploying and maintaining cloud-based data platforms on the AWS platform. You will work with data engineers, data scientists and business analysts to understand business requirements and design scalable, reliable and cost-effective solutions that meet those requirements. Roles & Responsibilities: Designing, developing and deploying cloud-based data platforms using Amazon Web Services (AWS) Integrating and processing large amounts of structured and unstructured data from various sources Implementing and optimizing ETL processes and data pipelines Developing and maintaining securi...

Relevant experience and skills: Must haves: At least 6-9 years of work experience in US and overseas payroll. Understanding of customer invoicing and timesheet management Quick learner & presentation skill Strong sense of urgency and results-orientation MS Office Advanced Excel and good Power point Acquaint with different client portals like wand, Fieldglass, Beeline, Coupa, Ariba Good to have: Experience of Background in IT staffing business ERP working knowledge Quick Book

Skills: 3-5 years of Data Warehouse, Business Intelligence work experience required working with Talend Open Studio Extensive experience with Talend Real-Time Big Data Platform in the areas of design, development and Testing with focus on Talend Data Integration and Talend Big-data Real Time including Big data Streaming (Spark) jobs with different databases Experience working with data bases like Greenplum, HAWQ, Oracle, Teradata, MsSql Server, Sybase, Casandra, Mongo-DB, Flat files, API’s and different Hadoop concepts in Bigdata (ecosystems like Hive, Pig, Sqoop, and Map Reduce) Working knowledge of Java is preferred Advanced knowledge of ETL, including the ability to read and write efficie...

Big Data Architect Skills Required 4 Years experience in Big data Architect Proficient in Spark, Scala, Hadoop MapReduce/HDFS, PIG, HIVE, AWS cloud computing Hands-on experience in tools like: EMR, EC2, Pentaho BI, Impala, ElasticSearch, Apache Kafka, Node.js, Redis, Logstash, statsD, Ganglia, Zeppelin, Hue, KETTLE Sound experience in Machine learning, Zookeeper, Bootstrap.js, Apache Flume, FluentD, Collectd, Sqoop, Presto, Tableau, R, GROK, MongoDB, Apache Storm, HBASE Hands-on experience in development - Core Java & Advanced Java Job Requirement: Bachelors degree in Computer Science, Information Technology, or MCA 4 Years of experience in Relevant Role Good analytical and problem solving a...

Lead who can manage deliverables from offshore, ensures adequate design/technical support is provided PySpark, Python, Data bricks PySpark, Python/Scala, Data bricks, Understanding on Streaming Pipeline, Docker & Kubernetes Problem solving and technical troubleshooting skills Scala (Good to have) Mandatory Competencies Big Data - Big Data - Pyspark Beh - Communication Data Science and Machine Learning - Data Science and Machine Learning - Databricks Data Science and Machine Learning - Data Science and Machine Learning - Python DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - Containerization (Docker, Kubernetes)

UiPath Robotic Automation Process India Pvt Ltd is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey Liaising with coworkers and clients to elucidate the requirements for each task. Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed. Reformulating existing frameworks to optimize their functioning. Testing such structures to ensure that they are fit for use. Preparing raw data for manipulation by data scientists. Detecting and correcting errors in your work. Ensuring that your work remains backed up and readily accessible to relevant coworkers. Remaining up-to-date with industry standards and technological a...

Develop and maintain scalable data pipelines using Databricks and Apache Spark. Collaborate with data scientists, analysts, and engineers to implement data models and analytics solutions. Optimize performance of Spark jobs and Databricks clusters for efficient processing. Manage Databricks workspace, clusters, and security configurations. Integrate Databricks workflows with various data sources and cloud services (AWS, Azure, GCP). Monitor, troubleshoot, and resolve pipeline issues to ensure data reliability and accuracy. Automate deployment and scheduling of Databricks jobs and workflows. Implement data governance and security best practices on the platform. Stay updated on the latest Datab...

Design, develop, and maintain scalable big data pipelines and architectures. Work with large datasets from various sources and transform them for analysis. Implement and optimize ETL processes using big data tools. Collaborate with data scientists, analysts, and stakeholders to understand data requirements and deliver solutions. Monitor and troubleshoot data pipelines for performance and reliability issues. Manage and maintain big data platforms (e.g., Hadoop, Spark, Kafka). Ensure data quality, security, and compliance with company policies. Continuously evaluate and adopt new big data technologies and best practices.

About The Job Role Works in the area of Software Engineering, which encompasses the development, maintenance and optimization of software solutions/applications. 1. Applies scientific methods to analyse and solve software engineering problems. 2. He/she is responsible for the development and application of software engineering practice and knowledge, in research, design, development and maintenance. 3. His/her work requires the exercise of original thought and judgement and the ability to supervise the technical and administrative work of other software engineers. 4. The software engineer builds skills and expertise of his/her software engineering discipline to reach standard software engine...

Join us as a Software Engineer, PySpark and AWS This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority Its a chance to hone your existing technical skills and advance your career We're offering this role at associate vice president level What you'll do In your new role, youll engineer and maintain innovative, customer centric, high performance, secure and robust solutions. Youll be working within a feature team and using your extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects an...

Join us as a Data Engineer Youll be the voice of our customers, using data to tell their stories and put them at the heart of all decision-making Well look to you to drive the build of effortless, digital first customer experiences If youre ready for a new challenge and want to make a far-reaching impact through your work, this could be the opportunity youre looking for We're offering this role at vice president level What you'll do As a Data Engineer, youll be looking to simplify our organisation by developing innovative data driven solutions through data pipelines, modelling and ETL design, inspiring to be commercially successful while keeping our customers, and the banks data, safe and se...

We are looking for highly motivated people with proven track record to conduct research in natural language processing, artificial intelligence, and machine learning. As a Research Intern, you will be working with scientists in GE Aerospace Research to develop search and recommendation systems to improve the productivity of our Engineering teams. Your responsibilities will include developing and implementing algorithms to process Aerospace domain data for recommendation systems, design experiments, conduct thorough evaluations, and document your work (e.g., publications, invention disclosures). It will also include effectively communicating your findings with the appropriate stakeholders. Yo...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Google Cloud Platform Architecture Good to have skills : Python (Programming Language)Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating da...

ETL QA - Technical Lead Experience: 7 to 11 Years Job Locations: Gurgaon (1 position) Job Summary: We are looking for a highly skilled and detail-oriented ETL QA - Technical Lead with strong experience in Big Data Testing , Hadoop ecosystem , and SQL validation . The ideal candidate should have hands-on experience in test planning, execution, and automation in a data warehouse/ETL environment. You'll work closely with cross-functional teams in an Agile environment to ensure the quality and integrity of large-scale data solutions. Key Responsibilities: Lead end-to-end testing efforts for data/ETL pipelines across big data platforms Design and implement test strategies for validating large dat...

As a Techie, Do you face these challenges while pursuing opportunities? Navigating numerous job platforms. Enduring lengthy interview processes. Tedious negotiation phases. Ambiguity about project quality. Getting entangled in unsatisfactory work cultures. Wavering job security. What are we looking for ? Actively seeking experienced senior developers in #Spark and #Kafka who are open to working in the PST timezone. Ideal candidates should possess a minimum of 6 years of hands-on experience with Spark, Kafka, #java, Postgres, and a track record of successfully delivering 3-4 Spark projects.