14 Ingestion Jobs

My linkedin linkedin.com/in/yashsharma1608. contract period - 6-12month payroll will be - ASV consulting , my company client - will disclose after 1 round Job location - Gurgaon - onsite(WFO) budget - upto 1lpa/month , depending on last (relevant hike) Exprnce - 3+ JD is About the Role We are looking for a skilled AWS Data Engineer with strong hands-on experience in AWS Glue and AWS analytics services. The candidate will be responsible for designing, building, and optimizing scalable data pipelines and ETL processes that support advanced analytics and business intelligence requirements. Key Responsibilities Design and develop ETL pipelines using AWS Glue, PySpark, and AWS services (Lambda, S...

Job Description: Complete data ingestion, data pipeline, data lineage , data quality , data wearhouse, data governance and data reconciliation. Essential Skills: Must have Data architect experience and knowledge. Data Architect with over 10 +years of hands-on experience in designing, developing, and managing large-scale data solutions. Proven expertise in building and optimizing ETL pipelines. Strong in data preprocessing, and enhancing data quality.Extracting events, processing large datasets (5 billion+ records) within (a Spark-Hadoop) cluster. Automated data processing tasks for DAAS (Data as a Service) project, streamlining workflow efficiency. Configured file and client setups, ensuring...

5+ years of relevant experience on Scala/Python (PySpark), Distributed Databases, Kafka with solid hands-on multi-threading, functional programing etc. A good understanding of CS Fundamentals, Data Structures, Algorithms and Problem Solving. Professional hand-on experience in Sql and Query Optimization. Experience in building frameworks for data ingestions and consumptions patterns. Expertise with GCP cloud and GCP data processing tools, platforms and technologies like GCS, DataProc, DPaaS, BigQuery, Hive etc. aws, glue, devops, pyspark ETL, pipeline, AWS, glue AWS, AI, python, etl

5+ years of relevant experience on Scala/Python (PySpark), Distributed Databases, Kafka with solid hands-on multi-threading, functional programing etc. A good understanding of CS Fundamentals, Data Structures, Algorithms and Problem Solving. Professional hand-on experience in Sql and Query Optimization. Experience in building frameworks for data ingestions and consumptions patterns. Expertise with GCP cloud and GCP data processing tools, platforms and technologies like GCS, DataProc, DPaaS, BigQuery, Hive etc. aws, glue, devops, pyspark ETL, pipeline, AWS, glue AWS, AI, python, etl

5+ years of relevant experience on Scala/Python (PySpark), Distributed Databases, Kafka with solid hands-on multi-threading, functional programing etc. A good understanding of CS Fundamentals, Data Structures, Algorithms and Problem Solving. Professional hand-on experience in Sql and Query Optimization. Experience in building frameworks for data ingestions and consumptions patterns. Expertise with GCP cloud and GCP data processing tools, platforms and technologies like GCS, DataProc, DPaaS, BigQuery, Hive etc. aws, glue, devops, pyspark ETL, pipeline, AWS, glue AWS, AI, python, etl

Adobe AEP Developer Adobe AEP Implementation Key Responsibilities Work with development, deployment, and production areas of the business to craft new solutions using Adobe Experience Platform, Adobe Analytics, Audience Manager, Data Workbench, and Adobe Analytics. Interface directly with internal teams, to address and manage client requests and communicate status in person, via phone and/or email. Be able to understand, customize and optimize the entire customer journey and data management process, to include data management solutions for ingestion of customer data from 1 st , 2 nd and 3 rd party data sources. Capable of developing reports, dashboards and metrics analysis to deliver actiona...

We are seeking a highly skilled and experienced Over-the-Top (OTT) Subject Matter Expert (SME) to join our dynamic team. As the OTT SME, you will provide strategic and technical leadership across all aspects of our OTT video platform to ensure reliable and high-quality content delivery to our audience. The ideal candidate for this role will possess in-depth expertise in OTT technologies, a strong understanding of industry trends, and a track record of applying best practices to enhance platform performance and drive innovation. You should hold a Bachelor's degree in Computer Science, Engineering, or a related field, along with at least 7 years of hands-on experience in OTT video streaming. Y...

Hello, Greetings from ZettaMine!! Hiring For Data engineer Exp: 6 to 10 Years Location: Bangalore Looking for immediate joiners only Job description. Skills Required: Python, SQL, ETL Azure Data Services (ADF, Synapse), Databricks Data Pipelines, Ingestion (Batch & Streaming), Data Migration Strong in data modelling, transformation, and performance tuning Interested candidates can share updated cv on [HIDDEN TEXT] Thanks & Regards Afreen Show more Show less

As a Developer specializing in data modeling and ingestion, you will be responsible for designing, developing, and managing scalable database solutions using MongoDB. Your role will involve writing robust, effective, and scalable queries and operations for MongoDB-based applications. Additionally, you will integrate third-party services, tools, and APIs with MongoDB for data management and processing. Collaboration will be a key aspect of your job as you work closely with developers, data engineers, and stakeholders to ensure the seamless integration of MongoDB with applications and systems. You will also be involved in running unit, integration, and performance tests to guarantee the stabil...

Experience: 3-5 years of prior Product Management experience working with data warehouses, clouds, or AdTech platforms. Bachelor’s or Master of Science in Computer Science, Information Systems, Business or related degree Ability to lead demonstrations for technical and non-technical audiences Deep understanding of APIs and how they work/operate Proven ability to create product artifacts, including: Product requirement documents (PRDs),epics, story mapping, OKRs, etc. High-level understanding of the Product Lifecycle (PDLC) Basic understanding of coding and software development understanding Excellent attention to detail Excellent written and verbal communication skills Type S(tartup) persona...

Role: Data Engineer Experience: 5+ Years Location: Pune, Gurgaon & Bangalore Hybrid Shift Time: 12:00 PM - 10:00 PM Must have: Experience working in AWS, Redshift, Python Prior exposure to Data Ingestion and Curation work (such as working with Data Lakehouse) Knowledge in SQL for purpose of data analysis/investigation Help and support the Data Product Owner) to manage and deliver on the product technical roadmap Ability to digest and understand what the data is, how it is derived, meaning/context around the data itself and how the data fits into NFLs data model Working knowledge of Confluence and JIRA Good to have: Masters degree in computer science, statistics, or related discipline 5+ year...

Job Description: Design, implement, and maintain data pipelines and data integration solutions using Azure Synapse Develop and optimize data models and data storage solutions on Azure Collaborate with data scientists and analysts to implement data processing and data transformation tasks. Ensure data quality and integrity through data validation and cleansing methodologies. Monitor and troubleshoot data pipelines to identify and resolve performance issues Collaborate with cross-functional teams to understand and prioritize data requirements. Stay up-to-date with the latest trends and technologies in data engineering and Azure services. Skills & Qualifications: Bachelors degree in IT, compute...

Data Engineers/ Analysts that can create the data models for Apromore Ingestion

Role & responsibilities Technical Capability Foundry Certified (Data Engineering) Foundry Certified (Foundational) Microsoft Certified (Azure AI Fundamentals) Microsoft Certified: Azure Fundamentals Microsoft Certified: Azure Data Engineer Associate Ontology Manager Pipeline Builder Data Linerage Object Explorer SQL Python & Scala Good knowledge of Azure cloud & ADF & Databricks Spark (Pyspark & Scala Spark) Troubleshooting jobs & finding the root cause of the issue Advanced ETL pipeline design for data ingestion & egress for batch dataFoundry Certified (Data Engineering) Experience 4+ Soft Skills Good communication skills Good documentation skills for drafting problem definition and solutio...