3201 Data Pipelines Jobs - Page 46

Role Overview: You will be proficient in JavaScript and Python, with strong skills in both front-end and back-end development. Experience with React and Angular combined with Redux for state management will enable you to create efficient, dynamic web applications. Your expertise in Node.js will be utilized for building scalable server-side applications and Serverless architectures for optimized, cost-effective solutions. You will also be familiar with data pipelines and managing RDBMS for structured data storage and efficient querying. Exposure to Gen AI technologies and experience working with AWS or Azure to deploy, manage, and scale cloud applications will be part of your responsibilities...

You are a Senior Machine Learning Engineer responsible for designing, developing, and deploying Computer Vision solutions in production environments. Your key responsibilities include: - Leading the design and deployment of computer vision models for various applications like object detection, tracking, human activity analysis, and visual quality control. - Building and optimizing image and video data pipelines to ensure robust data flow from sensors, cameras, and other sources. - Architecting real-time vision systems with a focus on latency, accuracy, and scalability for edge and cloud environments. - Mentoring and guiding junior ML engineers to maintain high technical standards and collabo...

Role Overview: You will work with Python Azure Data Factory (ADF), Azure Databricks, PySpark, Delta Lake, ETL/ELT, data pipelines, and data lakehouse architecture. Key Responsibilities: - Develop robust ETL/ELT workflows to ingest, transform, and load data into our data warehouse, Azure Synapse Analytics using Informatica. - Perform exploratory data analysis (EDA) to validate pipeline outputs and ensure data accuracy. - Implement proactive checks and monitoring to maintain data integrity and reliability. - Write and optimize complex SQL queries to support the data needs of analytical and reporting teams. - Collaborate with data analysts and business users to understand their requirements and...

As a talented and passionate RAG (Retrieval-Augmented Generation) Engineer with strong Python development skills, your role will involve working on cutting-edge NLP solutions that integrate information retrieval techniques with large language models (LLMs). The ideal candidate will have experience with vector databases, LLM frameworks, and Python-based backend development. **Key Responsibilities:** - Designing and implementing RAG pipelines that combine retrieval mechanisms with language models - Developing efficient and scalable Python code for LLM-based applications - Integrating with vector databases like Pinecone, FAISS, Weaviate, and more - Fine-tuning and evaluating the performance of ...

As a Principal ML Engineer at Ema, you will play a crucial role in shaping AI / ML initiatives that empower employees in the enterprise to be more creative and productive. You will lead the technical direction of GenAI and agentic ML systems, architect scalable production pipelines, define multi-year ML roadmap, integrate cutting-edge ML methods, optimize trade-offs, champion engineering excellence, mentor senior engineers, collaborate cross-functionally, influence data strategy, and drive system scalability and performance. **Key Responsibilities:** - Lead the technical direction of GenAI and agentic ML systems powering enterprise-grade AI agents. - Architect, design, and implement scalable...

As a Data Engineer Intern at our company, you will have the opportunity to immerse yourself in the world of Artificial Intelligence and gain valuable hands-on experience in building and managing data pipelines. Your responsibilities will include: - Collaborating with our AI team to design, build, and optimize data pipelines. - Working on real-world data challenges to ensure smooth data flow and reliability. - Assisting in preparing and structuring datasets for machine learning models. - Gaining exposure to modern tools, frameworks, and best practices in data engineering. We are looking for individuals with the following qualifications: - A strong learning attitude and willingness to grow. - ...

As an experienced MLOps Engineer, you will be responsible for designing, implementing, and maintaining scalable machine learning pipelines and infrastructure. Your role will involve a strong understanding of ML lifecycle management, CI/CD for ML models, and cloud platforms to ensure seamless integration between data science and production environments. Key Responsibilities: - Build, deploy, and manage end-to-end ML pipelines from experimentation to production. - Develop and maintain CI/CD workflows for ML models. - Automate training, testing, monitoring, and retraining processes. - Manage model versioning, deployment, and scaling in production environments. - Ensure observability, logging, a...

Role Overview: As a developer in this role, you will be responsible for building systems and APIs to collect, curate, and analyze data generated by biomedical dogs, devices, and patient data. Your immediate tasks will include developing APIs and backends to handle Electronic Health Record (EHR) data, time-series sensor streams, and sensor/hardware integrations via REST APIs. Additionally, you will work on data pipelines and analytics for physiological, behavioral, and neural signals, as well as machine learning and statistical models for biomedical and detection dog research. You will also be involved in web and embedded integrations connecting software to real-world devices. Key Responsibil...

As a Data Engineer, you will be responsible for designing and building data systems and pipelines. This includes developing data processing workflows, optimizing data storage, and ensuring data accuracy. Your role will involve the design and deployment of analytical models and dashboards to uncover insights, predict trends, and inform decision-making. You will collaborate with teams to provide data support for transformation initiatives, ensuring alignment with business objectives and digital innovation goals. Additionally, you will oversee technical designs for data models, ETL, and visualization tools such as BigQuery, Airflow, SSIS, Tableau, and SSRS. Your key responsibilities will includ...

As an AI Technical Strategist/Software Engineer at Red Hat Experience Engineering team in Pune, India, you will be responsible for shaping the technical strategy for implementing AI solutions across the business. Your role will involve early prototyping of solutions, data and model exploration, and collaboration with multi-disciplinary teams to understand problem statements and feasibility. Your foundational technical skills and ability to learn quickly will be crucial as the team modernizes platforms and tooling with an AI-first approach. **Key Responsibilities:** - Partner with product management and stakeholders to define and track value-centric metrics connecting AI system performance to...

Head of Engineering AI-Powered Fintech SaaS (India) Location: Bangalore (Hybrid) Experience: 4-7 Years Employment Type: Full-time About Autocash AI At Autocash AI, we're on a mission to reinvent how finance teams manage money. Our AI-powered SaaS platform helps mid-sized businesses take control of their cash flow, accounts receivable, and working capital areas that are traditionally manual, error-prone, and stressful. We're not just another fintech tool. We're building a category-defining platform that combines the power of AI, automation, and real-time analytics to give CFOs and finance leaders clarity, speed, and confidence in decision-making. Autocash AI is already trusted by forward-thin...

Key Result Areas And Activities Data Quality Assurance: Develop and implement data quality standards and processes. Conduct regular audits and assessments to ensure data integrity. Identify and resolve data discrepancies in collaboration with data teams. Software Testing & Validation: Create and execute detailed test plans and test cases for data validations. Validate data accuracy, transformation logic, and performance of reporting tools. Perform functional, regression, and performance testing. Process Improvement: Continuously refine QA processes to align with evolving project needs. Troubleshoot issues and adapt testing strategies accordingly. Reporting & Documentation: Maintain comprehen...

Our Mission At Palo Alto Networks everything starts and ends with our mission: Being the cybersecurity partner of choice, protecting our digital way of life. Our vision is a world where each day is safer and more secure than the one before. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for innovators who are as committed to shaping the future of cybersecurity as we are. Who We Are We believe collaboration thrives in person. That's why most of our teams work from the office full time, with flexibility when it's needed. This model supports real-time problem-solving, stronger relationships, and the kind of precision that drives...

Key Responsibilities and Duties Architectural Strategy and Design Define GenAI Architecture: Establish the architectural blueprint, reference architectures, an technology standards for deploying GenAI solutions, including Retrieval-Augmented Generation (RAG), autonomous agents, and model fine-tuning pipelines. Technology Selection and Evaluation: Conduct rigorous evaluation, benchmarking, and selection of foundational models (both commercial and open-source, e.g., GPT, Claude, Llama), vector databases (e.g., Pinecone, Weaviate), and orchestration frameworks (e.g., LangChain, LlamaIndex). Integration Planning: Design robust integration patterns (APIs, microservices, event-driven architectures...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python on Azure Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will develop custom software solutions to design, code, and enhance components across systems or applications. Your typical day will involve collaborating with cross-functional teams, utilizing m...

Design, develop, and maintain data pipelines and ETL processes using AWS and Snowflake. Implement data transformation workflows using DBT (Data Build Tool). Write efficient, reusable, and reliable code in Python. Optimize and tune data solutions for performance and scalability. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions. Ensure data quality and integrity through rigorous testing and validation. Stay updated with the latest industry trends and technologies in data engineering. Bachelor's or Master's degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer or similar role. Str...

Join us as a Data Engineer Were looking for someone to build effortless, digital first customer experiences to help simplify our organisation and keep our data safe and secure Day-to-day, youll develop innovative, data-driven solutions through data pipelines, modelling and ETL design while inspiring to be commercially successful through insights If youre ready for a new challenge, and want to bring a competitive edge to your career profile by delivering streaming data ingestions, this could be the role for you We're offering this role at associate vice president level What youll do Your daily responsibilities will include you developing a comprehensive knowledge of our data structures and me...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : AWS Glue Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, ...

We are looking for an experienced Healthcare SME CCDA & FHIR with 815 years of experience in healthcare data integration, clinical data repositories, and interoperability standards The ideal candidate will have strong expertise in CCDA parsing, FHIR resource mapping, validation, ingestion processes, and healthcare data pipelines You will work closely with data engineering, product, and clinical informatics teams to design scalable data ingestion pipelines, ensure data quality and compliance, and enable seamless exchange of clinical data across systems Hands-on skills in FHIR servers (HAPI, IRIS), SQL, Python, cloud platforms (AWS/GCP/Azure), and healthcare regulations (HIPAA, PHI) are essent...

Key Responsibilities: Canonical Architecture Design Medallion Architecture Implementation (Databricks) Raw Data Mapping and Transformation : Build ingestion pipelines to process raw files from AWS S3 into Bronze layer Map, and transform raw data into structured canonical formats aligned with logistics business rules Implement scalable DevOps pipelines using PySpark, Delta Lake , and Databricks Workflows . Business Engagement: Work closely with business SMEs, operations teams, and product managers to understand logistics processes, business entities, and KPIs. Understand the business requirements into data models and semantic layers. Collaboration & Leadership: Guide data engineers in the dev...

Seeking an experienced Data Owner with strong SQL and database expertise to support data remediation initiatives, cloud migration activities, and enterprise data governance efforts The ideal candidate will work closely with cross-functional stakeholders, analyze and resolve data issues, and contribute to improving the overall quality, accessibility, and reliability of data assets This role requires strong problem-solving skills, stakeholder management capabilities, and a solid understanding of modern cloud environments Develop, optimize, and maintain SQL queries, scripts, and data pipelines for data remediation and operational reporting Troubleshoot and resolve data discrepancies, ensuring d...

Job Summary: We are seeking a skilled and motivated Data Engineer to design, develop, and maintain scalable data pipelines and backend services using cutting-edge technologies. You will work with AWS services, PySpark, Python, and Java to implement efficient data processing solutions and APIs. Collaborating with cross-functional teams, you will gather requirements, optimize data workflows, troubleshoot performance issues, and ensure data quality across platforms. As a mentor to junior engineers, you will provide technical guidance and contribute to the teams success. Key Responsibilities: Design, develop, and maintain scalable data pipelines and systems using AWS services. Implement data pro...

Role Description We are looking for an experienced QA Lead to drive the quality engineering strategy for an AI-powered solution where machine learning, computer vision, and NLP models play a central role. The QA Lead will validate the validation of AI model outputs, ensure the accuracy and reliability of predictions, build automation frameworks for AI pipelines, and lead a team of QA engineers across API, UI, data, and performance testing. This role requires strong analytical skills, understanding of AI/ML concepts, and the ability to validate both deterministic and non-deterministic system behaviors. Role and responsibilities Define and execute AI testing strategies including model accuracy...

What you will do In this vital role as Data Engineer at Amgen you will be responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing reports, supporting and executing data initiatives and, visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes Design, develop, and optimize data pipelines/workflows using Databricks (Spark, Delta Lake) for ingestion, transformation, and proce...

Meet the Team Join Cisco's modern Manufacturing Data & Analytics team, a group of innovators dedicated to transforming manufacturing operations through data-driven digital twin solutions. This team collaborates closely with business architects, engineers, and manufacturing leaders to deliver actionable insights, process optimization, and measurable value across global supply chain and manufacturing environments. We are passionate about demonstrating sophisticated analytics, integration, and simulation to drive operational perfection and power Cisco's digital transformation. You will be working with - * Internal Teams -Business architects, manufacturing engineers, supply chain operations, dat...