749 Data Pipelines Jobs - Page 5

Data Architect / Data Engineer Location: Chennai Experience: 46 years Your Role As a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable, high-performance data architectures that power intelligent digital solutions. In this role, you will: Design and maintain digital twin models for maritime systems Integrate real-time data from various sources into simulation environments Work with AWS TwinMaker and other cloud-native services for digital twin development Collaborate with simulat...

Role Overview: As an Applications Development Senior Manager, you will be responsible for managing a team or department to establish and implement new or revised application systems and programs in coordination with the Technology team. Your main objective will be to drive applications systems analysis and programming activities. Key Responsibilities: - Manage one or more Applications Development teams to accomplish established goals and conduct personnel duties for the team, such as performance evaluations, hiring, and disciplinary actions - Utilize in-depth knowledge and skills across multiple Applications Development areas to provide technical oversight across systems and applications - R...

Role Overview: As a Data Engineer at our company, you will be responsible for designing, developing, and optimizing data pipelines and architectures to ensure efficient data processing. Your role will involve working with complex datasets, integrating various data sources, and maintaining high data quality and reliability standards. Key Responsibilities: - Develop and maintain efficient ETL (Extract, Transform, Load) pipelines to handle large datasets from different sources. - Build and manage data storage solutions using both relational and non-relational databases, focusing on high availability, performance, and scalability. - Collaborate with APIs, third-party data sources, and internal d...

As a Deep Learning Engineer at CureBay, you will be an integral part of the team working on AI-driven solutions that leverage multi-modal deep learning techniques for tasks such as image, video, object detection, and audio classification. Your role will involve designing and implementing deep learning models, integrating attention mechanisms, and optimizing models for speed, accuracy, and robustness. Collaboration with cross-functional teams to deploy models into production will also be a key aspect of your responsibilities. **Key Responsibilities:** - Design and implement deep learning models for various tasks including image, video, object detection, and audio classification. - Integrate a...

Key Responsibilities Lead the design, development, and implementation of enterprise-scale AI/ML solutions optimized for real-world applications. Collaborate with cross-functional teams to identify business requirements and translate them into robust AI/ML strategies. Develop and optimize generative AI solutions using tools and frameworks such as LangChain, LangSmith, LlamaIndex, MCP, Semantic Kernel, Autogen, and Agents. Utilize Python along with frameworks such as PyTorch and TensorFlow to build sophisticated machine learning models and algorithms. Conduct analysis of data and identify trends, providing actionable insights to stakeholders. Mentor and guide junior data scientists, promoting ...

We are looking for an Analytics Engineering Manager to grow and lead a small team of 1-3 Analytics Engineers, co-own our emerging analytics engineering practice, and play a critical role in further developing our rapidly growing Data Analytics organization. Partnering with people leaders and ICs within the analytics team and around the business, this role will facilitate the production of datasets used to surface key insights and drive business decision making. This role requires someone with strong analytical and technical skills, and who is comfortable working across multiple functional areas in a fast-paced, challenging environment. We are looking to speak to candidates who are based in G...

Role Overview: You will be responsible for designing, developing, and deploying solutions on the Salesforce Data Cloud platform. Your role will involve collaborating with stakeholders to gather requirements and translating them into technical specifications. Additionally, you will develop and optimize data models to support business processes and reporting needs, ensuring data governance and security best practices for data integrity and compliance. As part of your responsibilities, you will be required to perform troubleshooting, debugging, and performance tuning of Salesforce Data Cloud solutions. It is essential to stay updated with Salesforce Data Cloud updates, best practices, and indus...

Key Deliverables : Build and optimize scalable data pipelines and infrastructure. Automate data ingestion, transformation, and integration processes. Collaborate with AI/ML teams to ensure quality data access. Enhance performance and cost-efficiency in data workflows. Role Responsibilities : Streamline manual processes for automation. Monitor and troubleshoot data workflows and systems. Implement ETL/ELT for AI/ML readiness. Ensure data compliance, security, and scalability.

Key Deliverables : Build and optimize scalable data pipelines and infrastructure. Automate data ingestion, transformation, and integration processes. Collaborate with AI/ML teams to ensure quality data access. Enhance performance and cost-efficiency in data workflows. Role Responsibilities : Streamline manual processes for automation. Monitor and troubleshoot data workflows and systems. Implement ETL/ELT for AI/ML readiness. Ensure data compliance, security, and scalability.

Key Deliverables : Build and optimize scalable data pipelines and infrastructure. Automate data ingestion, transformation, and integration processes. Collaborate with AI/ML teams to ensure quality data access. Enhance performance and cost-efficiency in data workflows. Role Responsibilities : Streamline manual processes for automation. Monitor and troubleshoot data workflows and systems. Implement ETL/ELT for AI/ML readiness. Ensure data compliance, security, and scalability.

Key Deliverables : Build and optimize scalable data pipelines and infrastructure. Automate data ingestion, transformation, and integration processes. Collaborate with AI/ML teams to ensure quality data access. Enhance performance and cost-efficiency in data workflows. Role Responsibilities : Streamline manual processes for automation. Monitor and troubleshoot data workflows and systems. Implement ETL/ELT for AI/ML readiness. Ensure data compliance, security, and scalability.

Key Deliverables : Build and optimize scalable data pipelines and infrastructure. Automate data ingestion, transformation, and integration processes. Collaborate with AI/ML teams to ensure quality data access. Enhance performance and cost-efficiency in data workflows. Role Responsibilities : Streamline manual processes for automation. Monitor and troubleshoot data workflows and systems. Implement ETL/ELT for AI/ML readiness. Ensure data compliance, security, and scalability.

Key Deliverables : Build and optimize scalable data pipelines and infrastructure. Automate data ingestion, transformation, and integration processes. Collaborate with AI/ML teams to ensure quality data access. Enhance performance and cost-efficiency in data workflows. Role Responsibilities : Streamline manual processes for automation. Monitor and troubleshoot data workflows and systems. Implement ETL/ELT for AI/ML readiness. Ensure data compliance, security, and scalability.

Key Deliverables : Build and optimize scalable data pipelines and infrastructure. Automate data ingestion, transformation, and integration processes. Collaborate with AI/ML teams to ensure quality data access. Enhance performance and cost-efficiency in data workflows. Role Responsibilities : Streamline manual processes for automation. Monitor and troubleshoot data workflows and systems. Implement ETL/ELT for AI/ML readiness. Ensure data compliance, security, and scalability.

As a member of the team focusing on end-to-end development of features for a major Technology company, your role will involve collaborating with various teams to work on different aspects of the search features development process. Your responsibilities will include: - Extracting data from external websites using Python and other internal applications - Ingesting the extracted data into the Client's databases - Performing Data Modelling and Schema Creation/Maintenance - Creating and maintaining data pipelines using internal applications, with a focus on Python - Engaging in tasks such as data analysis, data visualization, creating SQL reports, dashboards, and configuring business logic - Deb...

Role Overview: As a Data Engineer at the leading MNC in the Banking Domain, you will play a crucial role in simplifying the organization by developing innovative data-driven solutions through data pipelines, modeling, and ETL design. Your primary focus will be on driving customer value, ensuring commercial success while prioritizing customer and bank data security. Your responsibilities will involve understanding complex business problems, applying the most appropriate tools to build data solutions, and contributing to the strategic direction by engaging with the data engineering community. Key Responsibilities: - Build advanced automation of data engineering pipelines by eliminating manual ...

We are looking for data analyst expertized on Oracle SQL/PLSQL having 5-8 years of experience. Successful candidates will work as a part of a team and help us in building SQL Automations. As we help our clients target, measure and improve mission-critical business metrics and generate demonstrable return on investment, our SQL data analysts enjoy a high level of responsibility and immediate client interactions. In addition to technical excellence, you are expected to be excellent communicators equipped with the presentation skills to operate at an executive level. Above all, you should be curious about the big picture and passionate about bringing data to life! Responsibilities Take a leadin...

As an Assistant Product Manager at our organization, you will play a crucial role in supporting the development and enhancement of features on our OTT platform. Your responsibilities will primarily revolve around analytics, user experience, content delivery, and performance tracking within the OTT ecosystem. Collaborating with technical and business teams, you will drive product modules from ideation to release and analyze user data to improve key performance indicators related to user engagement and content consumption. - Coordinate with engineering and QA teams to test features, track issues, and facilitate smooth product releases. - Gather post-deployment feedback to assess feature perfor...

As a Lead Consultant, Salesforce Developer- Data Cloud at Genpact, you will play a crucial role in designing, developing, and implementing solutions primarily using Data Cloud and Salesforce OMS. Your responsibilities will encompass: - Data Cloud development, including designing and implementing data pipelines - Developing data models and flows - Creating data visualizations - Integrating machine learning models Additionally, you will work on Agentforce development, focusing on: - Automating tasks - Improving customer service efficiency - Integrating Agentforce with various systems Your key responsibilities will include: - Designing and implementing data pipelines to ingest, transform, and l...

As a results-driven Data Project Manager (PM) in a regulated banking environment, your role involves leading data initiatives using Databricks and Confluent Kafka. You will oversee end-to-end delivery of complex data transformation projects aligned with business and regulatory requirements. - Lead planning, execution, and delivery of enterprise data projects - Develop detailed project plans, delivery roadmaps, and work breakdown structures - Ensure resource allocation, budgeting, and adherence to timelines and quality standards Collaboration with data engineers, architects, business analysts, and platform teams is crucial. You will act as the primary liaison between business units, technolog...

Role Overview: As an AVP - Databricks, you will be responsible for leading and managing Databricks-based project delivery to ensure that all solutions meet client requirements, best practices, and industry standards. Your role will involve serving as a subject matter expert (SME) on Databricks, providing guidance to teams on architecture, implementation, and optimization. Collaboration with architects and engineers to design optimal solutions for data processing, analytics, and machine learning workloads will be a key aspect of your responsibilities. Additionally, you will act as the primary point of contact for clients, ensuring alignment between business requirements and technical delivery...

As a Data Engineering Manager at GoKwik, you will lead a team of data engineers and collaborate with various teams to design and implement data-driven strategies. You will be responsible for designing the data architecture to drive valuable insights for the company. - Lead and guide the data engineering team in developing optimal data strategies based on business needs - Identify and implement process improvements to enhance data models, architectures, pipelines, and applications - Ensure data optimization processes, manage data governance, security, and analysis - Hire and mentor top talent within the team You will also be responsible for managing data delivery through dashboards, visualiza...

As an Associate Project Manager specializing in AI/ML, you will leverage your 8+ years of experience, including 3+ years in project management, to lead and oversee the successful delivery of AI/ML projects. You will play a pivotal role in managing cross-functional teams, steering complex software projects, and spearheading AI/ML initiatives from inception to deployment. Your expertise will encompass a blend of project management proficiency and technical knowledge in machine learning systems, data pipelines, and model lifecycle management. - Project planning, tracking, and execution using methodologies such as Agile, Scrum, and SDLC/Waterfall. - Juggling multiple projects and stakeholders ac...

Role Overview: As a Software Engineer (Data SaaS Product), your main responsibility will be to build robust and scalable systems. You may also be required to work on UI or scraping tasks as needed. Your willingness to learn and contribute in various areas is highly valued, regardless of your level of expertise in each domain. Key Responsibilities: - Own and enhance the full stack of data pipelines, including ingestion, processing, and delivery - Design, develop, and manage scalable data infrastructure in a cloud environment - Write efficient, production-ready code primarily in Python or a similar scripting language - Collaborate closely with engineers and business teams to translate real-wor...

Role Overview: As a Lead Data Engineer specializing in Databricks, you will be responsible for designing, developing, and optimizing the next-generation data platform. Your role will involve leading a team of data engineers, providing technical guidance, mentorship, and ensuring scalability and high performance of data solutions. Key Responsibilities: - Lead the design, development, and implementation of scalable and reliable data pipelines using Databricks, Spark, and other relevant technologies. - Define and enforce data engineering best practices, coding standards, and architectural patterns. - Provide technical guidance and mentorship to junior and mid-level data engineers, conduct code ...