858 Data Ingestion Jobs - Page 16

At Tredence AWS Data Engineer designs, builds, and maintains scalable data pipelines and infrastructure using AWS services like Glue, S3, and Redshift, focusing on data ingestion, transformation (ETL), modeling, and quality. They write SQL and Python code, orchestrate workflows with tools like Airflow, and collaborate with data scientists and analysts, aiming to ensure data is accurate, accessible, and optimized for analysis and business decision-making. Role - AWS Data Engineer Years of Experience: 2~5 years Roles and responsibilities The day-to-day work of a junior-to-mid AWS data engineer involves a mix of development, monitoring, and collaboration. Pipeline development: Designing, buildi...

Analyze and understand customers use case and data sources and extract, transform and load data from multitude of customers nterprise sources and ingest into Adobe Experience Platform Design and build data ingestion pipelines into the platform using PySpark Ensure ingestion is designed and implemented in a performant manner to support the throughout and latency needed. Develop and test complex SQLs to extract\analyze and report the data ingested into the Adobe Experience platform. Ensure the SQLs are implemented in compliance with the best practice to they are performant. Migrate platform configurations, including the data ingestion pipelines and SQL, across various sandboxes. Debug any issu...

You are a highly skilled Snowflake Developer with extensive experience in designing, implementing, and managing Snowflake-based data solutions. Your role involves developing data architectures and ensuring the effective use of Snowflake to drive business insights and innovation. Key Responsibilities: - Design and implement scalable, efficient, and secure Snowflake solutions to meet business requirements. - Develop data architecture frameworks, standards, and principles, including modeling, metadata, security, and reference data. - Implement Snowflake-based data warehouses, data lakes, and data integration solutions. - Manage data ingestion, transformation, and loading processes to ensure dat...

You will be joining Northern Trust, a globally recognized and award-winning financial institution with a history dating back to 1889. As a Fortune 500 company, Northern Trust is dedicated to providing innovative financial services and guidance to successful individuals, families, and institutions while upholding the values of service, expertise, and integrity. With over 130 years of financial experience and a team of more than 22,000 partners, we cater to sophisticated clients worldwide through cutting-edge technology and exceptional service. Your role will involve creating professional-level Power BI visuals for complex reports, including DAX coding for measure and calculated column design....

Job Title: Database Reliability Engineer Role Overview: We are seeking for a DBRE who will improve and maintain software development, test and live infrastructure and services. He/she will articulate and have experience with Linux and various Database services. The primary mission as a DBRE is working with the development, technical operations, quality assurance, and product management teams, to ensure the uptime and performance of Trellix Email Security Cloud solution for corporate clients. Total 3yrs to 6yrs experience of Analyze solutions and implement best practices for our main cloud database and its components. Responsible for maintaining and keeping the uptime, scalability, and availa...

BDO RISE -Senior Data Engineer I - Bangalore/ Hyderabad The Senior Data Engineer I, Tax Product Development, works with the Data Engineering and Integration team to develop and support BDOs Tax Data Warehouse and Tax Data Lake, manage and maintain data ingestion and Extract/Transform/Load (ETL) processes, as well as provide support for the Power BI business intelligence platform and enterprise applications supporting the tax practice. You will be responsible for implementing and participate in delivery of Data related engagements, including Data modeling, Data cleansing, Data enrichments and Analytical solutions to our clients. Your experience will be instrumental in optimizing data processe...

Job Description: Complete data ingestion, data pipeline, data lineage , data quality , data wearhouse, data governance and data reconciliation. Essential Skills: Must have Data architect experience and knowledge. Data Architect with over 10 +years of hands-on experience in designing, developing, and managing large-scale data solutions. Proven expertise in building and optimizing ETL pipelines. Strong in data preprocessing, and enhancing data quality.Extracting events, processing large datasets (5 billion+ records) within (a Spark-Hadoop) cluster. Automated data processing tasks for DAAS (Data as a Service) project, streamlining workflow efficiency. Configured file and client setups, ensuring...

JD for Tech Lead: Job Title: Splunk Technical Lead Location: Bangalore, India Mode of Work: Work from Office Shift: Rotational Job Summary: We are seeking an experienced and highly skilled Splunk Technical Lead to join our dynamic team in Bangalore. As a Splunk Technical Lead, you will be responsible for leading and managing a team of engineers to implement and maintain Splunk solutions for our clients. You will play a crucial role in designing, developing, and optimizing Splunk environments while ensuring effective monitoring and troubleshooting. This is a hands-on leadership role, requiring both technical expertise and the ability to guide and mentor team members. Key Responsibilities: Lea...

Flexing It is a freelance consulting marketplace that connects freelancers and independent consultants with organizations seeking independent talent. Our client, a leading global specialist in energy management and automation, is looking to engage with a Consultant Tableau Developer. In this role, you will play an active part in accelerating the company's Big Data and Analytics environment, contributing to Digital initiatives aimed at enhancing, automating, and accelerating the implementation of master data management, adoption of big data platforms, data excellence and data dictionary evolution, data security, and business intelligence and analytics. You will collaborate with different busi...

We are searching for a talented Kafka Administrator to become a part of our team. In this position, you will play a crucial role in setting up, configuring, and managing Kafka clusters to ensure the high availability and optimal performance of our data streaming platform. Your responsibilities will involve collaborating closely with development and operations teams to devise and execute Kafka solutions that align with our business requirements. Your key responsibilities will include installing, configuring, and maintaining Kafka clusters in both production and development environments. You will be tasked with monitoring Kafka performance and resolving issues associated with brokers, producer...

Wipro Limited is a leading technology services and consulting company dedicated to creating innovative solutions that cater to the most complex digital transformation needs of clients. With a comprehensive portfolio of capabilities in consulting, design, engineering, and operations, Wipro assists clients in achieving their boldest ambitions and developing sustainable, future-ready businesses. Employing over 230,000 individuals and business partners spread across 65 countries, Wipro is committed to ensuring the success of its customers, colleagues, and communities in an ever-evolving world. The role's primary purpose is to facilitate process delivery by overseeing the daily performance of the...

As an Expert Engineer in the GPS Technology department located in Gurugram, India, reporting to the Project Manager, you will be an integral part of the Technology function providing IT services to Fidelity International business globally. Your role involves developing and supporting business applications that are crucial for revenue, operational efficiency, compliance, finance, legal, customer service, and marketing functions. Your primary responsibility will be to understand system requirements, analyze, design, develop, and test application systems following defined standards. Your expertise in software designing, programming, engineering, and problem-solving skills will be crucial in del...

Design, develop, optimize data ingestion pipelines for integrating multiple sources into Databricks. Implement & maintain CI/CD pipelines for data workflows Exp in Kubernetes, Ensure data integrity, security, compliance throughout ingestion process Required Candidate profile Proven experience in data ingestion Exp with CI/CD tools , Azure DevOps, Kubernetes, Databricks, Spark, and data lake architectures, Python, Scala, or SQL, AWS, Azure, or GCP.

About Us At SentinelOne, were redefining cybersecurity by pushing the limits of whats possible?leveraging AI-powered, data-driven innovation to stay ahead of tomorrows threats, From building industry-leading products to cultivating an exceptional company culture, our core values guide everything we do Were looking for passionate individuals who thrive in collaborative environments and are eager to drive impact If youre excited about solving complex challenges in bold, innovative ways, wed love to connect with you, What are we looking for As a member of the SaaS Performance team you will play a pivotal role in ensuring our cutting-edge cybersecurity solutions deliver unmatched speed and relia...

You will be part of a dynamic team at NTT DATA as an ITSS-Azure Databricks Developer in Bengaluru, Karnataka, India. Your main responsibilities will include designing and implementing highly performant data ingestion pipelines using Apache Spark and/or Azure Databricks. You will be delivering proofs of concept to project stakeholders and developing scalable frameworks for ingesting geospatial data sets. NTT DATA is a trusted global innovator of business and technology services with a commitment to helping clients innovate, optimize, and transform for long-term success. As a Global Top Employer, NTT DATA operates in more than 50 countries with a diverse team of experts. The company offers ser...

RBH Solutions Pvt. Ltd. is in search of a proficient Cloud / System Architect to take charge of designing, executing, and overseeing scalable cloud and on-premise infrastructure solutions. Your role entails leveraging your expertise in real-time systems, coupled with a thorough grasp of enterprise deployment frameworks, microservices architecture, and cybersecurity practices. With a minimum of 3 years of hands-on experience in a similar capacity, you will be tasked with delving into AI/ML concepts and their seamless integration into cloud systems. Your familiarity with AI-based tools will play a pivotal role in augmenting coding, testing, automation, and deployment workflows. Moreover, a sol...

As a member of the Oracle Cloud Infrastructure (OCI) team, you play a vital role in shaping the future of cloud services for Enterprises. Working alongside a diverse group of creators and innovators, you embody the agility and innovation of a startup while benefiting from the resources and customer-centric approach of a global enterprise software leader. At OCI, our core values guide our every action and drive us towards excellence. We prioritize equity, inclusion, and mutual respect in all aspects of our work. Committed to creating products that contribute to the greater good, we continuously seek growth opportunities for both our careers and personal development. Within our team, we foster...

As a Senior Associate- Splunk Enterprise Administrator with ITSI experience at Genpact, your primary responsibility will be to develop, create, integrate, and administer an on-premise Splunk Enterprise Instance running on VMware. You will be tasked with developing Splunk Apps and add-ons to support data ingestion for applications and cybersecurity, as well as supporting Splunk ITSI Application functionality. Additionally, you will play a key role in Splunk development, data integrations, and application administration. To excel in this role, you must hold either a Splunk Enterprise Certified Administrator or Splunk Certified Developer certification. Your responsibilities will include adminis...

ZS is a place where passion changes lives. As a management consulting and technology firm focused on improving life and how we live it, we transform ideas into impact by bringing together data, science, technology and human ingenuity to deliver better outcomes for all. Here you'll work side-by-side with a powerful collective of thinkers and experts shaping life-changing solutions for patients, caregivers and consumers, worldwide. ZSers drive impact by bringing a client-first mentality to each and every engagement. We partner collaboratively with our clients to develop custom solutions and technology products that create value and deliver company results across critical areas of their busines...

ZS is a place where passion changes lives. As a management consulting and technology firm focused on improving life and how we live it, we transform ideas into impact by bringing together data, science, technology and human ingenuity to deliver better outcomes for all. Here you'll work side-by-side with a powerful collective of thinkers and experts shaping life-changing solutions for patients, caregivers and consumers, worldwide. ZSers drive impact by bringing a client-first mentality to each and every engagement. We partner collaboratively with our clients to develop custom solutions and technology products that create value and deliver company results across critical areas of their busines...

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It's a unique legacy of innovation that's fueled by great technology-and amazing people. Today, we're tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent. As an NVIDIAN, you'll be immersed in a diverse, supportive environment where everyone is inspired to do their best work. Come join the team and see how you can make a lasting impact on the world. We'r...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

We are seeking for a 47-year experience AI engineer with a strong background in machine learning, programming skills, and a deep understanding of generative models. The position is responsible for turning research into practical solutions that address real-world problems while ensuring the reliability and ethical use of generative AI in their applications. Technical Requirements: Strong proficiency in Python for data processing and automation. Handson experience with generative AI models and their integration into data workflows. Handson experience with prompt engineering and LLM models (Opensource and Closesource) Handson experience with Application development framework like LangChain, Lan...