858 Data Ingestion Jobs - Page 11

We are looking for a seasoned Senior Data Engineer with a passion for building scalable, reliable, and cutting-edge data solutions on cloud platforms. The ideal candidate will bring deep expertise in Google Cloud Platform (GCP), BigQuery, and modern data engineering practices, including experience with ingestion and transformation tools, as well as proficiency in medallion architecture to drive data quality and governance.Experience with Databricks on AWS is highly valued and considered a distinct advantage.As a key member of our data engineering team, you will architect and implement end-to-end data pipelines that power actionable business intelligence, advanced analytics, and machine learn...

Job Description Job Title: Software/Data Engineer AWS Role Overview We are seeking a skilled Data Engineer to develop and maintain a high-performance streaming data platform for a leading healthcare CRM product You will work across technologies like Python, SQL, NodeJS, Kafka, and cloud-native services, contributing to scalable, efficient, and robust data solutions, Key Responsibilities Design, develop, and maintain scalable data pipelines and streaming systems, Work with Python, SQL, Scala, NodeJS, and various data stores (relational, NoSQL, Kafka), Analyze healthcare and marketing datasets using SQL, Refactor and optimize existing codebases for performance improvements, Collaborate closely...

Key Responsibilities Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources. Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems. Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs. Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery. Data Strategy & Business Value: Art...

Lead the strategy, roadmap, and execution of the organization's critical data ingestion platform, handling diverse structured, unstructured, real-time, and batch data from various sources. Define and champion the product vision , conducting market research, competitive analysis, and customer discovery for innovation and improvement. Elicit and prioritize requirements from stakeholders across the organization, balancing business needs with technical feasibility and resource constraints. Collaborate with engineering teams to design, develop, and launch new features and improvements to the data ingestion platform, creating detailed product specifications, user stories, and acceptance criteria. ...

As a seasoned Senior Database Administrator (DBA) with strong expertise in SQL Server, you will join our IoT Software team to manage, optimize, and scale databases supporting massive volumes of machine-generated and telemetry data from connected devices. Your passion for data performance and experience in high-ingestion environments will be crucial in this fast-paced, innovation-driven role. **Key Responsibilities:** - Architecting, deploying, and maintaining SQL Server databases optimized for high-throughput, real-time IoT data ingestion and analytics. - Performing advanced query tuning, index optimization, and partitioning to support time-series data and sensor data warehousing. - Collabor...

As a Product Owner at PitchBook, you will collaborate with key stakeholders and teams to deliver the department's product roadmap. Your role involves aligning engineering activities with product objectives for new product capabilities, data, and scaling improvements, focusing on AI/ML data extraction, collection, and enrichment capabilities. - Be a domain expert for your product area(s) - Define backlog priorities - Manage feature delivery according to the Product Roadmap - Validate requirements - Create user stories and acceptance criteria - Communicate with stakeholders - Define metrics for team performance - Manage risks or blockers - Support AI/ML collections work To be successful in thi...

Primary Responsibilities: Design, develop, and operate secure cloud platform services and software that meet business requirements Lead a team of cloud platform engineers to ensure that technical solutions align with architectural principles, design patterns, and enterprise security requirements Create GitHub Actions and workflows for standardize CI/CD pipelines within UHG And ensure that pipelines are following best practices, documented and delivered in a scalable reusable manner Demonstrate innovation, streamline processes, and reduce technical debt by standardizing patterns Automate repetitive tasks (TOIL), monitor applications, simplify work practices, define metrics, and ensure the ope...

Primary Responsibilities: Design, develop, and operate secure cloud platform services and software that meet business requirements Create GitHub Actions and workflows for standardize CI/CD pipelines within UHG.And ensure that pipelines are following best practices, documented and delivered in a scalable reusable manner Demonstrate innovation, streamline processes, and reduce technical debt by standardizing patterns Automate repetitive tasks (TOIL), monitor applications, simplify work practices, define metrics, and ensure the operational quality of applications Manage security controls at the platform level to enable secure, efficient, and policy-compliant operations Collaborate with multiple...

About The Role : Job Title - IT Architect Specialist, AVP Location - Pune, India Role Description This role is for a Senior business functional analyst for Group Architecture. This role will be instrumental in establishing and maintaining bank wide data policies, principles, standards and tool governance. The Senior Business Functional Analyst acts as a link between the business divisions and the data solution providers to align the target data architecture against the enterprise data architecture principles, apply agreed best practices and patterns. Group Architecture partners with each division of the bank to ensure that Architecture is defined, delivered, and managed in alignment with the...

Primary Responsibilities: Design, develop, and operate secure cloud platform services and software that meet business requirements Create GitHub Actions and workflows for standardize CI/CD pipelines within UHG And ensure that pipelines are following best practices, documented and delivered in a scalable reusable manner Demonstrate innovation, streamline processes, and reduce technical debt by standardizing patterns Automate repetitive tasks (TOIL), monitor applications, simplify work practices, define metrics, and ensure the operational quality of applications Manage security controls at the platform level to enable secure, efficient, and policy-compliant operations Collaborate with multiple...

Databricks Developer Must-have skills Cloud certified in one of these categories Azure Data Engineer Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL, DATA Ingestion, Curation . Semantic Modelling/ Optimization of data model to work within Rahona Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop Microsoft Excel (for metadata files with requirements for ingestion) Any other certificate in Azure/AWS/GCP and data engineering hands-on experience in cloud Strong Programming skills with at least one of Python, Scala or Java Location- Pune, Bangalore, Coimbatore, Chennai Mandatory Skills: DataBricks - Data Enginee...

Description: We are seeking a Data Engineer to build and maintain scalable data pipelines that support our data platform. This role will focus on developing ETL processes, integrating data sources, and ensuring data consistency and quality for financial analytics. Requirements: 4+ years of experience in data engineering or similar roles. Strong experience with Snowflake, Kafka, and Debezium. Proficiency in SQL, Python, and ETL frameworks. Experience with data warehousing, data modeling, and pipeline optimization. Strong problem-solving skills and attention to detail. Experience in the financial services or fintech industry is highly desirable. Job Responsibilities: Design, implement, and mai...

About the role: We are seeking an experienced and strategic Adobe CDP (Customer Data Platform) Lead/Architect to join our team. The ideal candidate will have deep expertise in Adobe Experience Platform (AEP), with a strong understanding of data architecture, integrations, and customer journey orchestration. You will play a key role in defining and executing the customer data strategy for our clients, ensuring a seamless integration of Adobe CDP with various digital marketing platforms. Roles & Responsibilities: Lead the design, development, and implementation of Adobe CDP solutions for enterprise clients. Architect robust data ingestion, identity resolution, segmentation, and activation work...

Location: Remote / Pan India iSource Services is hiring for one of their client for the position of Adobe CDP Consultant (Execution Specialist). About the role: We are hiring an Adobe CDP Consultant (Execution Specialist) to support hands-on implementation of Adobe Real-Time CDP. Working under a Senior Consultant, you will manage technical setup, data flows, segmentation, and activation processes. The ideal candidate has strong execution experience in CDP environments and a solid grasp of data integration and marketing tech ecosystems. Roles & Responsibilities: Assist in the technical setup, configuration, and deployment of Adobe Real-Time CDP. Support data ingestion, transformation, identit...

Job TitleData Engineer Experience5"“8 Years LocationDelhi, Pune, Bangalore (Hyderabad & Chennai also acceptable) Time ZoneAligned with UK Time Zone Notice PeriodImmediate Joiners Only Role Overview We are seeking experienced Data Engineers to design, develop, and optimize large-scale data processing systems You will play a key role in building scalable, efficient, and reliable data pipelines in a cloud-native environment, leveraging your expertise in GCP, BigQuery, Dataflow, Dataproc, and more Key Responsibilities Design, build, and manage scalable and reliable data pipelines for real-time and batch processing. Implement robust data processing solutions using GCP services and open-source tec...

As a highly skilled Technical Data Analyst, you will be joining our team to help establish a single source of truth for our high-volume, direct-to-consumer accounting and financial data warehouse. Your solid background in data analysis, SQL, and data transformation, along with prior experience in financial data warehousing and reporting, will be crucial for this role. Your responsibilities will include collaborating closely with finance and accounting teams to gather requirements, develop dashboards, and transform data to facilitate month-end accounting, tax reporting, and financial forecasting. You will also be in charge of migrating reporting and transformation processes to Databricks whil...

As an Engineering Manager at ZS, you will have the opportunity to shape and lead the development of scalable and distributed software systems. Your role will involve translating business requirements into technical specifications, overseeing technical execution, and ensuring the performance and reliability of systems. Here's what you'll be doing: - Take ownership of architecture design and development of scalable and distributed software systems - Translate business requirements into technical specifications - Oversee technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation - Utilize data-driven decision-making skills to achieve product goals - De...

As a Data Engineer/Architect at EY, you will play a crucial role in transforming clients" operations through the power of data. Your responsibilities will include driving data strategy and governance, designing advanced architectures and models, and ensuring organizations can effectively harness their data to become truly data-driven. Here is a breakdown of your key responsibilities: - Define, guide, and advise clients on developing data strategies that drive transformative outcomes and embrace innovation. - Gather, challenge, and prioritize clients" data requirements to tailor solutions to their unique needs. Engage with clients to understand their business realities and identify data-drive...

Role Overview: You should have 6-10 years of hands-on experience in Java development, with a focus on building robust data processing components. Your proficiency should include working with Google Cloud Pub/Sub or similar streaming platforms like Kafka. It is essential that you are skilled in JSON schema design, data serialization, and handling structured data formats. Key Responsibilities: - Design BigQuery views optimized for performance, scalability, and ease of consumption - Enhance and maintain Java-based adapters to publish transactional data from the Optimus system to Google Pub/Sub - Implement and manage JSON schemas for smooth and accurate data ingestion into BigQuery - Collaborate...

Primary Responsibilities: Design, develop, and operate secure cloud platform services and software that meet business requirements Create GitHub Actions and workflows for standardize CI/CD pipelines within UHG And ensure that pipelines are following best practices, documented and delivered in a scalable reusable manner Demonstrate innovation, streamline processes, and reduce technical debt by standardizing patterns Automate repetitive tasks (TOIL), monitor applications, simplify work practices, define metrics, and ensure the operational quality of applications Manage security controls at the platform level to enable secure, efficient, and policy-compliant operations Collaborate with multiple...

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

10-14 years experienced Project cum Technical Manager with 3-4 years of project management experience Experience in handling and managing end to end project taking complete ownership Good understanding of ETL and Data Warehousing concepts along with any cloud (AWS/Azure) data services Experience in carrying out estimations, proposal writing, resource planning and loading, client presentations Delegating, tracking, and managing project tasks with project team ensuring productivity and effective utilization Experience in status reporting, risk management, client handling and to use any project management tool Experience with private and public cloud architectures, pros/cons, and migration cons...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too Required education Bachelo...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

Your primary responsibilities include: Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a variety of statistical and machine learning techniques Designing and implementing various enterprise seach applications such as Elasticsearch and Splunk for client requirements Work in an Agile, collaborative environment, partnering with other scientists, engineers, consultants and database administrators of all backgrounds and disciplines to bring analytical rigor and statistical methods to the challenges of predicting behaviors. Build teams or writing programs to cleanse and integrate data in an efficient and reus...