863 Data Ingestion Jobs - Page 20

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

We are seeking Data Analysts / Data Engineers with experience in U.S. pharmaceutical commercial data . Key Responsibilities: Ingest and onboard third-party data sources with appropriate quality and compliance measures and reporting Design and implement QC protocols for data integrity and completeness. Track data lineage and maintain proper documentation of data flow and transformations. Apply statistical or algorithmic techniques to identify anomalies in data related to sales, claims, or patient-level records. Provide detailed reports and insights for stakeholders to support commercial decision- making. Required Skills & Qualifications: 2+ years of experience in data analytics / engineering ...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

We are seeking a highly skilled Senior Data Engineer with 5+ years of experience for our Bengaluru location (max 30 days notice period) The ideal candidate will have strong expertise in designing, developing, and maintaining robust data ingestion frameworks, scalable pipelines, and DBT-based transformations Responsibilities include building and optimizing DBT models, architecting ELT pipelines with orchestration tools like Airflow/Prefect, integrating workflows with AWS services (S3, Lambda, Glue, RDS), and ensuring performance optimization on platforms like Snowflake, Redshift, and Databricks The candidate will implement CI/CD best practices for DBT, manage automated deployments, troublesho...

We are seeking a highly skilled Data Engineer with 5+ years of experience for our Bengaluru location (max 30 days notice period). The ideal candidate will have strong expertise in designing, developing, and maintaining robust data ingestion frameworks, scalable pipelines, and DBT-based transformations. Responsibilities include building and optimizing DBT models, architecting ELT pipelines with orchestration tools like Airflow/Prefect, integrating workflows with AWS services (S3, Lambda, Glue, RDS), and ensuring performance optimization on platforms like Snowflake, Redshift, and Databricks. The candidate will implement CI/CD best practices for DBT, manage automated deployments, troubleshoot p...

Job Summary: We are seeking an experienced Senior Data Engineer to join our data engineering team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support enterprise data solutions. The role focuses on data ingestion into Azure Data Lake (ADLS Gen2), data transformations in Databricks, and end-to-end pipeline automation to enable scalable and high-quality data workflows across the organization. Key Responsibilities: Data Ingestion & Pipeline Development Design and develop scalable, secure, and efficient data pipelines using Azure Data Factory, PySpark, or Databricks notebooks. Ingest structured and unstructured data from multiple sour...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure Data Services Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. You will be responsible for ensuring the smooth functioning of applications and providing solutions to work-related problems. A typical day in this role involves collaborating with team members, analyzing business requirem...

We are seeking a highly skilled and motivated Big Data NiFi Developer to join our growing data engineering team in Pune. The ideal candidate will have hands-on experience with Apache NiFi, strong understanding of big data technologies, and a background in data warehousing or ETL processes. If you are passionate about working with high-volume data pipelines and building scalable data integration solutions, wed love to hear from you. Key Responsibilities: Design, develop, and maintain data flow pipelines using Apache NiFi. Integrate and process large volumes of data from diverse sources using Spark and NiFi workflows . Collaborate with data engineers and analysts to transform business requirem...

About The Role Management Consulting - Travel Find endless opportunities to solve the most pressing client needs and challenges, especially during the backdrop of a global pandemic as we adapt to the new normal. Practice: Industry Consulting, Capability Network I Areas of Work: Travel | Level: Analyst /Consultant/Manager | Location: Pune, Gurgaon, Mumbai, Bangalore, Chennai, Hyderabad, Kolkata | Years of Exp: 8-15 years Explore an Exciting Career at Accenture Are you an outcome-oriented problem solver? Do you enjoy working on transformation strategies for global clients? Does working in an inclusive and collaborative environment spark your interest? Then, Accenture Strategy and Consulting is...

As a Senior Associate Full Stack Software Engineer at Amgen in Hyderabad, India, you will be an integral part of a team focused on designing, developing, and maintaining software applications and solutions to meet business needs. Your role will involve collaborating with product managers, designers, data engineers, and other team members to create high-quality, scalable software solutions and ensure the availability and performance of critical systems. One of the key initiatives you will be involved in is a regulatory submission content automation project aimed at modernizing and digitizing the regulatory submission process. This project will showcase innovative technologies such as Generati...

We are looking for a skilled and experienced Adobe Experience Platform (AEP) Developer to join our team. The ideal candidate should have prior experience with Adobe Experience Platform and other Adobe Marketing Cloud solutions like Adobe Target, Adobe Analytics, and Adobe Campaign. We are seeking someone who has expertise in digital targeting and marketing automation technologies. As an AEP Developer, your responsibilities will include analyzing business requirements and translating them into comprehensive AEP solutions. You will need to develop detailed business use cases to demonstrate how AEP functionalities can address specific business needs and enhance customer experiences. Utilizing y...

At Branch, were transforming how brands and users interact across digital platforms. Our mobile marketing and deep linking solutions are trusted to deliver seamless experiences that increase ROI, decrease wasted spend, and eliminate siloed attribution. Our Branch team consists of smart, humble, and collaborative people who value ownership over all. Everything we do is centered around creating a great product, team, and company that lives and breathes our motto: Build Together, Grow Together, Win Together. About The Role Branch is looking for a Senior Software Engineer to lead our efforts on third-party data integrations within the Mobile Measurement Platform (MMP) team. In this role, you wil...

You should have a degree and 6-8 years of experience. Your responsibilities will include working with SQL, creating Snowflake, and managing Data Warehouse. You should be familiar with connecting to various data sources, preparing data layers for business usage, and ETL processes. In addition, you will need expertise in Snowflake, data warehouse architecture, management, and Snow pipe. You should be capable of distinguishing between User Defined Functions and Stored Procedures, Multi Clusters DWH, Views, Secure Views, and Materialized views in Snowflake. Your role will involve tuning and enhancing performance in Snowflake, database development, writing complex queries, and optimizing database...

Join us as a Data Engineer responsible for supporting the successful delivery of Location Strategy projects to plan, budget, agreed quality and governance standards. You'll spearhead the evolution of our digital landscape, driving innovation and excellence. You will harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. To be successful as a Data Engineer, you should have experience with hands-on experience in pyspark and strong knowledge of Dataframes, RDD, and SparkSQL. Additionally, experience in developing, testing, and maintaining applications on AWS Cloud is crucial. A strong hold on the AWS Data Analytics Technology Stack (G...

As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient big data processing pipelines in distributed computing systems. You will collaborate with cross-functional teams to understand data requirements and design appropriate data solutions. Your role will involve implementing data ingestion, processing, and transformation processes to support various analytical and machine learning use cases. In this position, you will optimize and tune data pipelines to enhance performance, scalability, and reliability. You will also be responsible for monitoring and troubleshooting pipeline performance issues, identifying and resolving bottlenecks. Ensur...

You are a Data Engineer with 5-8 years of experience in AWS Data Engineering. Your role involves implementing data lake and warehousing strategies to support analytics, AI, and machine learning initiatives. You will be responsible for developing and maintaining scalable data pipelines, managing data storage solutions using S3 buckets, and optimizing data retrieval and query performance. Your expertise in Python, proficiency in Snowflake and AWS services, and strong understanding of data warehousing, ETL processes, and cloud data storage will be crucial in this role. You will collaborate with cross-functional teams to deliver solutions that align with business goals, ensure compliance with da...

You are a candidate with strong experience in Spark Core/Streaming, Spark RDD API, and Spark Dataframes API using programming languages such as Scala, Java, or Python. You have a background in Machine Learning or AI and possess a deep understanding of Data Structures, Algorithms, Data Transformation, Data Ingestion, and Optimization mechanisms. Additionally, you are well-versed in Big Data technologies including Hadoop, MapReduce, Kafka, and Cassandra. Your primary responsibility will be to design and develop scalable and high-performance data processing applications using Apache Spark (Core, Streaming) with Scala. You will work with Spark RDD and DataFrame APIs to create robust data pipelin...

You are a highly skilled and detail-oriented ETL QA - Technical Lead with a solid background in Big Data Testing, the Hadoop ecosystem, and SQL validation. Your primary responsibility will be leading end-to-end testing efforts for data/ETL pipelines across various big data platforms. You will be working closely with cross-functional teams in an Agile environment to ensure the quality and integrity of large-scale data solutions. Your key responsibilities include designing and implementing test strategies for validating large datasets, transformations, and integrations. You will be hands-on testing Hadoop-based data platforms such as HDFS, Hive, and Spark. Additionally, you will develop comple...

As a Data Engineer (Python) at Programmers.IO, you will be responsible for supporting the RAN Cutover and Data Ingestion workstream. Your primary focus will be on developing and maintaining Python-based data pipelines to migrate data from legacy OSS systems to a new platform. This role will require you to work with vendor-specific data formats, particularly Ericsson & Nokia XML, and assist in market-by-market cutover processes. Your key responsibilities will include: - Developing and maintaining Python-based data pipelines for extracting data from 360 OSS servers. - Processing and transforming vendor-specific data formats (Ericsson & Nokia XML). - Supporting market-by-market data migration a...

About GlobalFoundries: GlobalFoundries is a leading full-service semiconductor foundry providing a unique combination of design, development, and fabrication services to some of the world's most inspired technology companies. With a global manufacturing footprint spanning three continents, GlobalFoundries makes possible the technologies and systems that transform industries and give customers the power to shape their markets. For more information, visit www.gf.com. The Data Solutions Group at GlobalFoundries is responsible for integrating manufacturing and engineering data from a wide variety of source systems used in the semiconductor engineering and production process. The data warehouse s...

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, were a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future. We are looking forward to hire PROJECT MANAGEMENT Professionals in the following areas : Role Overview We are seeking an experienced Project Manager to lead end-to-end delivery of AI projects for our c...

Minimum 2 years of hands-on experience with Snowflake Experience in migrating data from other databases to Snowflake OR pulling data into Snowflake from various sources Strong experience in SQL Experience with ETL tools such as: SSIS, Talend, Informatica, Databricks, or ADF (preferred) Team handling experience is a must Excellent communication skills Familiarity with BI tools like Power BI Working knowledge of a programming language like Python

At NiCE, we believe in pushing the boundaries and constantly challenging ourselves. We are a team of ambitious individuals who strive to be game changers and always aim to win. If you share our mindset, we have an exciting career opportunity that will ignite a passion within you. NICE Actimize is currently looking for a skilled Financial Crime Portfolio Solutions Engineer to assist our partner ecosystem in selling advanced financial crime and compliance solutions. In this role, you will play a crucial part in supporting Value-Added Resellers (VARs), System Integrators (SIs), Advisory Partners, Delivery Partners, and Cloud Marketplaces (AWS) by providing technical expertise in positioning, de...

As an Assistant Vice President Generative AI Systems Architect, you will leverage your 12+ years of experience to architect and design end-to-end systems for production-grade Generative AI applications. This includes creating systems for LLM-based chatbots, copilots, and content generation tools. Your responsibilities will involve defining system architecture for data ingestion, model training/fine-tuning, inferencing, and deployment pipelines. It is essential to establish architectural tenets such as modularity, scalability, reliability, observability, and maintainability. Collaboration plays a crucial role in this role, as you will work closely with data scientists, ML engineers, platform ...

As a dedicated professional at Leighton Asia, you will be responsible for spearheading the development of end-to-end Azure integration solutions in alignment with CIMIC's OneIT Target Reference Architecture. Your key responsibilities will include ensuring compliance with CIMIC's Security Standards, constructing data and integration solutions that adhere to CIMIC's Target Reference Architecture, as well as hands-on development and unit testing of the solutions. You will play a crucial role in following CIMIC's path to production environments, providing technical support during test phases, and conducting handover sessions to transition solutions to BAU Support. Additionally, you will be invol...