3201 Data Pipelines Jobs - Page 29

Job Description We are seeking an experienced Gen AI Solution Architect with 8+ years of experience to lead the design and implementation of AI-powered solutions leveraging large language models (LLMs), multimodal AI, and advanced generative technologies. You will play a pivotal role in defining the technical vision, architecture, and strategy for enterprise-grade GenAI systems integrating them seamlessly into existing data, application, and cloud ecosystems. The ideal candidate combines deep technical expertise in AI/ML with strong solution design, stakeholder management, and hands-on implementation experience. Key Responsibilities Design and architect end-to-end Generative AI solutions (te...

As a Senior Data Engineer at Mindcurv, you will play a crucial role in designing and implementing scalable data solutions for our clients. You will be part of our dynamic Data and Analytics team, collaborating with cross-functional teams to ensure the organization leverages data as a strategic asset. Your responsibilities will include: - Designing, building, and maintaining scalable data pipelines and ETL processes using Databricks and other modern tools. - Architecting, implementing, and managing cloud-based data warehousing solutions on Databricks (Lakehouse Architecture). - Developing and maintaining optimized data lake architectures to support advanced analytics and machine learning use ...

As a Solution Architect with 7+ years of experience, your role will involve designing, implementing, and optimizing enterprise-scale data platforms with a focus on Databricks. You will be expected to leverage your expertise in big data, cloud-native architectures, and advanced analytics to translate business requirements into scalable solutions while engaging stakeholders effectively. Key Responsibilities: - Architect and deliver end-to-end data solutions using Databricks features like Delta Lake, MLflow, and Unity Catalog. - Design and optimize data pipelines for both batch and real-time processing utilizing technologies such as Spark, Kafka, and Event Hubs. - Collaborate closely with busin...

Functional Architect GenAI & Agentic AI Location: Mumbai / Pune Role Overview We are seeking a highly experienced Functional Architect / Senior Business Analyst with a strong background in Capital Markets / Financial Services to lead the business analysis, solution design, and drive implementation of Generative AI and Agentic AI solutions. The ideal candidate will bridge business needs and AI capabilitiesdefining requirements, designing workflows, and shaping AI-driven automation strategies that deliver measurable business impact. You will collaborate closely with business stakeholders, data scientists, AI engineers, and RPA/Agentic developers to translate business problems into intelligent,...

We are looking for a skilled Senior Technical Lead with 9 to 14 years of experience as a Senior Data Engineer to join our team at Infinite Computer Solutions India Pvt. Ltd. Roles and Responsibility Design, develop, and implement data engineering solutions using various technologies. Lead a team of data engineers to ensure timely project delivery. Collaborate with cross-functional teams to identify business requirements and develop technical solutions. Develop and maintain large-scale data pipelines and architectures. Ensure data quality, integrity, and security in all projects. Stay updated with industry trends and emerging technologies to improve existing systems. Job Requirements Strong u...

We are looking for a highly skilled and experienced Data Scientist + Computer Vision professional to join our team at Han Digital Solution (P). The ideal candidate will have a strong background in data science and computer vision, with the ability to work on complex projects and develop innovative solutions. Roles and Responsibility Develop and implement machine learning models and algorithms for computer vision tasks. Design and deploy data pipelines and architectures to support computer vision applications. Collaborate with cross-functional teams to identify business problems and develop solutions. Work on large datasets to train and test machine learning models. Implement automated testin...

Role Overview: As an Integration Lead at KKR, you will play a critical role in bridging in-house engineering efforts with third-party SaaS platforms to deliver cohesive, secure, and scalable technology solutions for stakeholders. Your responsibilities will include defining integration strategies, leading engineering efforts, overseeing delivery and implementation, and collaborating cross-functionally to ensure compliance, auditability, and risk management needs are met. Key Responsibilities: - Define and execute integration strategies for blending in-house developed systems with external SaaS platforms - Partner with solution architects and engineers to design secure, scalable, and maintaina...

Roles and Responsibility Design, develop, and implement data integration solutions using SSIS to meet business requirements. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain complex SQL queries to extract data from various sources. Create and optimize data pipelines to improve efficiency and performance. Troubleshoot and resolve issues related to data integration and processing. Ensure data quality and integrity by implementing data validation and testing procedures. Job Requirements Strong knowledge of SSIS development, including design, development, and deployment. Experience with data modeling and data warehousing concepts. Prof...

As a Senior Specialist in Software Development focusing on Artificial Intelligence at Accelya, you will lead the design, development, and implementation of AI and machine learning solutions to tackle complex business challenges. Your role will involve collaborating with cross-functional teams to create intelligent systems that enhance business operations and decision-making. **Key Responsibilities:** - **AI Solution Design & Development:** - Lead the development of AI-driven applications and platforms using machine learning, deep learning, and NLP techniques. - Design, train, and optimize machine learning models using frameworks such as TensorFlow, PyTorch, Keras, or Scikit-learn. - Implemen...

You will be responsible for designing, developing, and deploying AI/ML models and Generative AI solutions to enhance enterprise applications such as CRM, ERP, CX, and Finance. Your role will involve building and integrating machine learning pipelines into existing business systems and workflows. Collaborating with product and platform teams to identify opportunities for AI-driven automation, insights, and personalization will be crucial. Additionally, you will fine-tune and optimize LLMs and other ML models for enterprise use cases. Developing APIs and microservices to expose AI capabilities to broader platforms will also be part of your responsibilities. Ensuring that models meet requiremen...

What you''ll do You are a capable, self-motivated data engineer. You will be a member of the data engineering team working on tasks ranging from design, development, operations of data warehouse, data platform and data pipelines. We enjoy working closely with each other utilizing an Agile development methodology. Priorities can change quickly, but our team members are able to stay ahead to delight every one of our customers whether they are internal or external to Viasat. The day-to-day Ability to work on distributed remote agile teams with a high degree of self-motivation and ability to work independently. Excellent verbal and written communication abilities. You will be required to communi...

Required Skills & Experience 3+ years of hands-on experience in ML/AI development, including LLMs and generative models. Strong programming expertise in Python and PySpark , with experience in scalable data pipelines. Hands-on experience with LangChain, LlamaIndex, LangGraph or equivalent frameworks. Solid understanding of ML model deployment and serving platforms (e.g., SageMaker, Bedrock, TorchServe, BentoML, KFServing). Proficiency in containerization and orchestration tools (Docker, Kubernetes). Practical expertise in prompt engineering and RAG pipelines (embedding models, chunking, retrieval strategies, caching). Experience with vector databases (e.g., Pinecone, Weaviate, FAISS, Milvus)...

You will be joining a dynamic team at TMUS Global Solutions as a Principal Engineer within the Accounting & Finance Technology domain. In this role, you will be instrumental in shaping the next-generation financial data architecture, utilizing tools like Snowflake, dbt, and modern data engineering practices. **Key Responsibilities:** - **Architect & Lead Snowflake Solutions:** Lead the design and implementation of enterprise-grade data warehouse solutions in Snowflake to ensure scalability, reliability, and performance for finance and accounting use cases. - **Own dbt Data Modeling:** Take charge of adopting and implementing best practices in dbt for financial data transformations, lineage, ...

Roles and Responsibility Develop and implement data models and algorithms to solve complex problems. Collaborate with cross-functional teams to design and deploy data-driven solutions. Analyze large datasets to identify trends and patterns, and develop predictive models. Design and implement data visualizations to communicate insights to stakeholders. Work closely with the data engineering team to ensure seamless data pipelines. Stay up-to-date with industry trends and emerging technologies in data science. Job Requirements Strong proficiency in Python programming language. Experience with data structures, algorithms, and software design patterns. Knowledge of machine learning concepts, incl...

Roles and Responsibility Lead cross-functional teams to design and implement vision analytics solutions. Collaborate with stakeholders to identify business problems and develop data-driven solutions. Develop and maintain large-scale data pipelines and architectures. Work closely with data scientists to integrate machine learning models into production environments. Ensure timely delivery of high-quality results by managing project timelines and resources. Communicate complex technical concepts to non-technical stakeholders. Job Requirements Strong understanding of computer vision, machine learning, and deep learning techniques. Experience with programming languages such as Python, C++, or Ja...

Roles and Responsibility Lead cross-functional teams to design and implement vision analytics solutions. Collaborate with stakeholders to identify business problems and develop data-driven solutions. Develop and maintain large-scale data pipelines and architectures. Work closely with data scientists to integrate machine learning models into production environments. Ensure timely delivery of high-quality results by managing project timelines and resources. Communicate complex technical concepts to non-technical stakeholders. Job Requirements Strong understanding of computer vision, machine learning, and deep learning techniques. Experience with programming languages such as Python, C++, or Ja...

Roles and Responsibility Design and develop scalable data pipelines using various technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data warehouses and data lakes. Ensure data quality and integrity by implementing data validation and testing procedures. Optimize data systems for performance and efficiency. Participate in code reviews and contribute to the improvement of the overall codebase. Job Requirements Strong understanding of data modeling and database design principles. Experience with big data technologies such as Hadoop, Spark, and NoSQL databases. Proficiency in programming languages such as Java,...

Roles and Responsibility Design and develop scalable data pipelines using various technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data warehouses and data lakes. Ensure data quality and integrity by implementing data validation and testing procedures. Optimize data systems for performance and efficiency. Participate in code reviews and contribute to the improvement of the overall codebase. Job Requirements Strong understanding of data modeling and database design principles. Experience with big data technologies such as Hadoop, Spark, and NoSQL databases. Proficiency in programming languages such as Java,...

About The Role Backend Developer (.NET Core, WebAPI, MongoDB, InfluxDB) Location: Mysuru Experience: 6-12 years Employment Type: Full-time Choosing Capgemini means choosing a place where youll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine whats possible. Join us in building scalable backend solutions that power IoT systems and cloud integrations. Your Role As a Backend Developer, you will design and maintain robust backend services and microservices using .NET Core, MongoDB, and InfluxDB. Youll work on IoT data pipelines, containerization, and cloud deployments to deliver high-performance and secure solutions. In this role, you wi...

About The Role Backend Developer (.NET Core, WebAPI, MongoDB, InfluxDB) Location: Mysuru Experience: 6-12 years Employment Type: Full-time Choosing Capgemini means choosing a place where youll be empowered to shape your career, supported by a collaborative global community, and inspired to reimagine whats possible. Join us in building scalable backend solutions that power IoT systems and cloud integrations. Your Role As a Backend Developer, you will design and maintain robust backend services and microservices using .NET Core, MongoDB, and InfluxDB. Youll work on IoT data pipelines, containerization, and cloud deployments to deliver high-performance and secure solutions. In this role, you wi...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Oracle GoldenGate Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and im...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Google Cloud Platform Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in the development of custom software solutions that involve designing, coding, and enhancing various components across systems or appli...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Google Cloud Platform Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in the development of custom software solutions that involve designing, coding, and enhancing various components across systems or appli...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Fabric Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and imp...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Graph Databases Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating with Integration Architects ...