3201 Data Pipelines Jobs - Page 47

Role Description As a Senior Technical Lead - Cloud Data Platform (Azure) at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise You will also work with th...

Title/Position: Datahub QA (Python) Job Location : Pune Employment Type: Full Time Shift Time : UK Shift Job Overview: We are seeking a detail-oriented and highly motivated Quality Assurance Engineer to join our dynamic team. As a QA Engineer, you will play a crucial role in ensuring the quality and reliability of our software products. The ideal candidate will possess strong analytical skills, a keen eye for detail, and a passion for delivering high-quality software solutions. Responsibilities: Develop and execute test plans, test cases, and automation scripts for ETL pipelines and data validation. Perform SQL-based data validation to ensure data integrity, consistency, and correctness. Wor...

We're seeking a Senior Manager of Engineering Data Products to accelerate the AI transformation of Clarivate's Life Sciences & Healthcare (LSH) product ecosystem . With our platforms used by leading global pharma and biotech organizations, this role offers a rare opportunity to shape the next generation of AI-driven products that empower researchers, scientists, and healthcare professionals worldwide. You will define strategy, build high-performing teams, and deliver the data foundations that infuse AI and advanced analytics across Clarivate's LSH ecosystem. Leveraging your US Healthcare expertise and leadership in AI- and data-driven product engineering, you will guide teams in building sca...

P- 1430 At Databricks, we are passionate about enabling data teams to solve the world's toughest problems from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers and customer obsessed we leap at every opportunity to tackle technical challenges, from designing next-gen UI/UX for interfacing with data to scaling our services and infrastructure across millions of virtual machines. And we're only getting started. As a Staff Software Engineer , you will build custo...

Company Description Experian is a global data and technology company, powering opportunities for people and businesses around the world. We help to redefine lending practices, uncover and prevent fraud, simplify healthcare, create marketing solutions, and gain deeper insights into the automotive market, all using our unique combination of data, analytics and software. We also assist millions of people to realize their financial goals and help them save time and money. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more industry segments. We invest in people and new advanced technologies to unlock the power of data. A...

Come build at the intersection of AI and fintech. At Ocrolus, we're on a mission to help lenders automate workflows with confidencestreamlining how financial institutions evaluate borrowers and enabling faster, more accurate lending decisions. Our AI-powered data and analytics platform is trusted at scale, processing nearly one million credit applications every month across small business, mortgage, and consumer lending. By integrating state-of-the-art open- and closed-source AI models with our human-in-the-loop verification engine, Ocrolus captures data from financial documents with over 99% accuracy. Thanks to our advanced fraud detection and comprehensive cash flow and income analytics, o...

At eBay, we're more than a global ecommerce leader we're changing the way the world shops and sells. Our platform empowers millions of buyers and sellers in more than 190 markets around the world. We're committed to pushing boundaries and leaving our mark as we reinvent the future of ecommerce for enthusiasts. Our customers are our compass, authenticity thrives, bold ideas are welcome, and everyone can bring their unique selves to work every day. We're in this together, sustaining the future of our customers, our company, and our planet. Join a team of passionate thinkers, innovators, and dreamers and help us connect people and build communities to create economic opportunity for all. Role O...

Role Overview: As a part of Schaeffler, a dynamic global technology company with a rich history of private ownership and entrepreneurial spirit, you will have the opportunity to partner with major automobile manufacturers, aerospace, and industrial sectors, offering you numerous development opportunities. Key Responsibilities: - Develop data pipelines and apply methods and tools to collect, store, process, and analyze complex data sets globally for assigned operations or functions. - Design, govern, build, and operate solutions for large-scale data architectures and applications across businesses and functions. - Select, manage, and work hands-on with big data tools and frameworks, implement...

Role Overview: You will be working as an AI/ML Architect at EnergyETA Solutions, based in Chennai/Bangalore with the flexibility for remote work. Your main responsibilities will include designing and implementing advanced AI/ML models for energy optimization, developing scalable software architectures, and integrating AI systems with other technologies. You will also collaborate with cross-functional teams, manage project lifecycles, and ensure seamless integration between AI-driven components and the ETA+ platform. Key Responsibilities: - Build and train AI/ML models for engineering data. - Work with electrical/mechanical concepts and diagrams. - Create clean data pipelines for model input....

Role Overview: As a Lead Data Engineer specializing in Databricks & Master Data Management, you will play a crucial role in designing, developing, and optimizing the next-generation data platform. Your responsibilities will include leading a team of data engineers, providing technical guidance, mentorship, and ensuring the scalability and high-performance of data solutions. Key Responsibilities: - **Technical Leadership:** - Lead the design, development, and implementation of scalable and reliable data pipelines using Databricks, Spark, and other relevant technologies. - Define and enforce data engineering best practices, coding standards, and architectural patterns. - Provide technical guid...

As a Data Scientist & Agentic AI Developer at CirrusLabs, your role will involve designing, developing, and evaluating intelligent AI agents to deliver high-quality, reliable, and compliant solutions. Your expertise in data science, AI/ML engineering, and hands-on experience building agentic systems will be crucial for this position. **Key Responsibilities:** - Design and develop agentic AI systems powered by Large Language Models (LLMs) with tool-calling capabilities - Build and optimize multi-step reasoning workflows and agent orchestration frameworks - Implement retrieval-augmented generation (RAG) pipelines for knowledge-intensive applications - Integrate external tools, APIs, and databa...

Role Overview: As a highly skilled Databricks Architect, your role is crucial in designing and optimizing large-scale data platforms. Your expertise in Databricks features such as Delta Lake, Unity Catalog, and Databricks SQL, along with strong experience in Azure Data Factory, will be instrumental in ensuring governance, security compliance, and driving innovation in advanced analytics and machine learning workflows. Your problem-solving skills and hands-on experience in performance optimization will be key in managing large-scale data pipelines effectively. Key Responsibilities: - Design and implement scalable, secure data architectures using Databricks and Azure Data Factory - Develop fra...

As a Cloud Data Architect at our company, you will be responsible for designing, implementing, and managing robust, scalable, and cost-effective cloud-based data architectures on Google Cloud Platform (GCP). Your expertise will be crucial in leveraging services like BigQuery, Cloud Dataflow, Cloud Pub/Sub, Cloud Storage, Cloud DataProc, Cloud Run, and Cloud Composer. Additionally, experience in designing cloud architectures on Oracle Cloud is considered a plus. Key Responsibilities: - Develop and maintain conceptual, logical, and physical data models to support various business needs. - Design and implement solutions for processing large datasets using technologies such as Spark and Hadoop. ...

You are hiring a Data Annotation Team Lead to manage both regular and specialised annotation projects. The role requires hands-on experience with annotation tools, strong leadership skills, and a sharp eye for quality assurance. You will oversee a team of annotators, set standards for accuracy, and ensure timely project delivery. Responsibilities - Lead, mentor, and manage a team of data annotators on image, video, text, and specialised projects - Conduct regular quality checks to maintain high annotation accuracy - Train team members on tools, processes, and specialised annotation tasks - Collaborate with project managers to plan and deliver on client requirements - Identify process improve...

Your experience should include... 10+ years validated experience in AI/ML leadership roles as a people manager, in an agile Technology/SaaS business, with a portfolio of large-scale AI/ML solutions, deployed globally Confirmed expertise in Agentic AI, autonomous systems, or multi-agent architectures in real-world applications. Designing, integrating, and scaling end-to-end global AI/ML systems, including data pipelines, model management, deployment, monitoring, etc Experience working in customer-facing domains, accelerating adoption or growth through AI/ML-powered applications Deep knowledge of industry-standard ML tools, frameworks, and cloud platforms Track record of building, leading and ...

Develop and maintain scalable and efficient data pipelines to ensure seamless data flow across various systems adddress any issues or bottlenecks in existing pipelines. Implement robust data checks to ensure the accuracy and integrity of data. Summarize and validate large datasets to ensure they meet quality standards. Monitor data jobs for successful completion. Troubleshoot and resolve any issues that arise to minimize downtime and ensure continuity of data processes. Regularly review and audit data processes and pipelines to ensure compliance with internal standards and regulatory requirements Familiar with working on Agile methodologies - scrum, sprint planning, backlog refinement etc.

Overview The Geo-MCAPS HR Consulting team is a dynamic, globally distributed organisation that partners closely with the Microsoft Customer and Partner Solutions (MCAPS) globally and all other business groups outside of the US. This organization delivers transformative, scalable, and human-centred HR solutions. Operating across regionsincluding the Americas, EMEA, and Asiathe team is structured to balance global consistency with local relevance, enabling agility and impact at scale. If you thrive in dynamic environments and are passionate about leveraging analytics to solve complex HR challenges, then this could be the role for you! Responsibilities Lead end-to-end delivery of HR data and te...

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Power BI-GCP Integration to join our team in Bangalore, Karn?taka (IN-KA), India (IN). We are seeking a skilled and proactive Developer with expertise in Power BI and Google Cloud Platform (GCP) to join our Integrations team. The ideal candidate will be responsible for designing, developing, and maintaining integration solutions that support business intelligence and cloud-based applications. Key Responsibilities: . Perform detailed design of application and technical a...

As a Team Lead in Emerging Technologies, you will be responsible for leading a team and driving projects involving cutting-edge technologies. Your role will involve the following key responsibilities: - Programming skills: You should be proficient in Python and have experience working with libraries such as TensorFlow, PyTorch, and Scikit-learn. Additionally, you should have a strong understanding of machine learning algorithms and neural networks. Experience with computer vision models and large language models (NLP) is also required. - Data Engineering: You should possess knowledge of data cleaning, pre-processing, feature engineering, and data pipelines to ensure smooth data flow and proc...

About The Role The ideal candidate should have a solid background in backend development, AI/ML orchestration, and data management , with hands-on experience in Generative AI and Agentic AI frameworks . They will be responsible for building REST APIs , managing data pipelines , and implementing AI/ML solutions such as retrieval-augmented generation (RAG) , intent detection models , and autonomous AI agents to deliver intelligent, production-ready solutions. Key Responsibilities Backend Development: Design, develop, and maintain REST APIs using Python to integrate AI/ML services. Agentic AI Development: Design and orchestrate AI agents capable of reasoning, planning, and executing multi-step ...

Key Responsibilities Architect Scalable Data & AI Solutions: Design and architect end-to-end data and AI systems, including data pipelines, model workflows, and AI services, ensuring scalability, reliability, and performance across enterprise use cases. GenAI Enablement: Help Integrate Generative AI capabilities such as entity extraction, summarization, and retrieval-augmented generation (RAG) into enterprise data platforms to enrich and contextualize data assets. Agentic AI Frameworks: Architect autonomous AI agent systems using frameworks like LangGraph, CrewAI, or similar, enabling multi-agent collaboration and orchestration for complex business tasks. AI/ML Strategy & Governance: Define ...

One of our client Hiring for a CTO in Bangalore or Pune with 12 to 20 years experience in cybersecurity leadership, application security architecture, and driving AI powered security innovation. Key Responsibilities: 1. Establish & Lead India R&D Centre Set up the India development centre including infrastructure, team structure, and operating processes. Build a high-performance engineering team aligned with the company's global goals and technical culture. Act as the primary point of leadership for all India-based engineering activities. 2. Drive Product Engineering & Delivery Own the design, architecture, and delivery of core product components. Work closely with product and AI teams to tr...

Scapia! A product that's out there to make travel happen for people, by converting their everyday expenses into travel experiences. We're a bunch of passionate people who work together, brainstorm and debate with each other, and don't stop until we're proud of our work. Customer delight tops everything else! We've worked hard to create an environment of honesty and passion that sets everyone up for success. We are looking to expand our Product team at Scapia! Focus areas: 1. Drive Product Strategy Across Scapia's Core Pillars a). Own and define the strategy, roadmap, and success metrics for your product group (e.g., Card Lifecycle, Travel Store, Rewards Engine, Risk Platform, Acquisition Fun...

About the role As a Data Warehouse Architect, you will be responsible for managing and enhancing data warehouse that manages large volume of customer-life cycle data flowing in from various applications within guardrails of risk and compliance. You will be managing the day-to-day operations of data warehouse i.e. Vertica. In this role responsibility, you will manage a team of data warehouse engineers to develop data modelling, designing ETL data pipeline, issue management, upgrades, performance fine-tuning, migration, governance and security framework of the data warehouse. This role enables the Bank to maintain huge data sets in a structured manner that is amenable for data intelligence. Th...

Your key responsibilities Technical Excellence We are seeking a motivated and detail-oriented Process Mining Consultant with a strong foundation in data engineering to join our BPM consulting team. This role is ideal for professionals with 2 - 3 years of experience in handling data pipelines, analytics, and process insights using tools like Celonis , UiPath Process Mining , or Signavio . You will work closely with clients and internal teams to extract, transform, and analyze process data using Python, SQL, and PQL, enabling organizations to uncover inefficiencies and drive strategic improvements Skills and attributes Collaborate on client engagements by managing data extraction, transformati...