749 Data Pipelines Jobs - Page 8

**Job Description:** At PwC, your role in managed services will involve focusing on a variety of outsourced solutions to support clients across various functions. You will help organisations streamline their operations, reduce costs, and enhance efficiency by managing key processes and functions on their behalf. Your expertise in project management, technology, and process optimization will be crucial in delivering high-quality services to clients. As a part of managed service management and strategy at PwC, you will be responsible for transitioning and running services, managing delivery teams, programmes, commercials, performance, and delivery risk. Your work will revolve around continuous...

Role & responsibilities We are looking for Prompt Engineer (Gen AI) permanent position with MNC company for Mumbai (Goregaon) location for Hybrid mode.

We are seeking a highly skilled Senior Data Engineer with 5+ years of experience for our Bengaluru location (max 30 days notice period). The ideal candidate will have strong expertise in designing, developing, and maintaining robust data ingestion frameworks, scalable pipelines, and DBT-based transformations. Responsibilities include building and optimizing DBT models, architecting ELT pipelines with orchestration tools like Airflow/Prefect, integrating workflows with AWS services (S3, Lambda, Glue, RDS), and ensuring performance optimization on platforms like Snowflake, Redshift, and Databricks. The candidate will implement CI/CD best practices for DBT, manage automated deployments, trouble...

As a Cloud Engineer at Google Cloud Consulting Professional Services, you will have the opportunity to work from your preferred location in Hyderabad, Telangana, India or Bengaluru, Karnataka, India. You will be part of a team that guides customers through pivotal moments in their cloud journey, leveraging Google's global network, web-scale data centers, and software infrastructure to drive business transformation and innovation. Your role will be integral in helping businesses of all sizes connect with customers, employees, and partners through technology. **Role Overview:** In this role, you will play a crucial part in ensuring strategic customers have a seamless experience transitioning t...

Job Description: As a Cloud Engineer at Google Cloud Consulting Professional Services, you will have the opportunity to work in Gurugram, Haryana, India; Bengaluru, Karnataka, India; or Mumbai, Maharashtra, India. You will be responsible for designing and implementing machine learning solutions for customer use cases using core Google products like TensorFlow, DataFlow, and Vertex AI. Your key responsibilities will include: - Delivering effective big data and machine learning solutions and solving complex technical customer issues. - Acting as a trusted technical advisor to Google's customers. - Identifying new product features and feature gaps, providing guidance on existing product tests, ...

Role Overview: Solenis, a leading global producer of specialty chemicals, is looking to hire a Snowflake Sr Developer for their Global Excellence Center (GEC) in Hyderabad, India. As a Snowflake Sr Developer, you will be responsible for designing, developing, and maintaining robust and scalable Snowflake data pipelines and architectures. You will work closely with data engineers, analysts, and business stakeholders to understand data needs and deliver solutions, ensuring data quality, integrity, and consistency. Additionally, you will implement data security and access controls using Snowflake's RBAC features and monitor data workloads to optimize performance and cost of Snowflake warehouses...

As a skilled Technical Project Manager at our company, you will lead and deliver projects in data engineering and analytics. Your role involves managing cross-functional teams to execute data platform, pipeline, and analytics initiatives, ensuring alignment with business goals and timely delivery. **Key Responsibilities:** - Plan, execute, and deliver technical projects on time, within scope, and within budget. - Strong understanding of data pipelines, ETL/ELT, and analytics workflows. - Collaborate with engineering, product, QA, and operations teams to define project requirements and success metrics. - Familiarity with cloud data platforms (AWS, GCP, Azure, Snowflake, Databricks). - Develop...

Role Overview: As a Software Engineer at Bharat Atomic, you will be responsible for building control and imaging software to unify the user experience and data pipelines of the Scanning Electron Microscope (SEM). Your main mission will be to make a complex instrument feel simple by developing control software that ensures quick first image acquisition, synchronized multi-channel data collection, and analysis-ready data with detailed metadata, all wrapped in a user-friendly UI. Key Responsibilities: - Own the control layer that integrates imaging, analytics, motion, safety, and diagnostics. - Implement a high-throughput, lossless data pipeline with structured metadata focusing on reproducibil...

As a QA Data Testing professional, your role will involve the following responsibilities and qualifications: Role Overview: You will be responsible for conducting QA testing of Data Pipelines & Dashboards, along with hands-on experience in end-to-end Data Quality Testing. Your key focus will be on ensuring data lineage and implementing best practices in Data QA testing. Key Responsibilities: - Conduct QA testing of Data Pipelines & Dashboards - Perform end-to-end Data Quality Testing - Ensure data lineage is maintained - Implement best practices in Data QA testing Qualifications Required: - Minimum 6 years of experience in QA testing of Data Pipelines & Dashboards - Minimum 6 years of hands-...

Develop and optimize AI models for insurance use cases, apply data science for predictive insights, innovate with latest AI, integrate with engineering teams, and ensure scalable, cost-efficient, reliable deployment and maintenance. Required Candidate profile Hands-on with GenAI, LLMs, prompt engineering, and fine-tuning; skilled in Python, TensorFlow, PyTorch; strong in data science, predictive analytics, and MLOps for scalable AI deployment.

Were Hiring Engineering Lead (Cloud & Data) | Data Engineer SME Location: Hinjewadi, Pune Work Mode: Hybrid (2 - 3 days from office) Experience: 12 - 17 Years Key Skills: Cloud Platforms (AWS preferred) Data Engineering (Databricks, Spark, Python, SQL) Application & Data Integration in Cloud ETL, Data Pipelines, Airflow Strong Leadership & Mentorship skills

As an experienced Software Engineer specialized in Internal Tooling and Support, you will be responsible for strengthening the ingestion infrastructure and internal operations tooling at the intersection of Engineering and Operations. Your role will involve ensuring smooth data ingestion, reliable scraping infrastructure, and efficient tooling for Ops teams. Additionally, you will act as the first layer of triage between Ops and Engineering Oncall, driving faster resolutions and building long-term automation to reduce operational overhead. - **Maintain and optimize the ingestion and scraping infrastructure, ensuring high reliability and performance. - **Design, build, and improve internal to...

As a Tech Lead, your role will involve guiding a small engineering team to ship scalable and reliable products. You will be responsible for setting the technical direction, improving code quality, and mentoring developers while still actively coding 99% of the time. **Key Responsibilities:** - Own architecture and delivery for key projects - Lead and mentor a team of 58 engineers, drive code reviews, and maintain coding standards - Collaborate with Product and Design teams to define project scope, milestones, and trade-offs - Ensure continuous integration/continuous delivery (CI/CD), testing, and observability are maintained at a high standard; handle incidents and postmortems effectively **...

Role Overview: As an Engineer in the Digital Solutions team at Operation Center, India (INOPC-PG) for Hitachi Energy PowerGrids, you will play a crucial role in optimizing maintenance policies, enhancing equipment availability, and supporting clients globally. Your responsibilities will include configuring Substation models in a cutting-edge Digital platform, collaborating with clients and the R&D team, troubleshooting equipment malfunctions, integrating systems with various protocols, and ensuring compliance with regulations. Key Responsibilities: - Support clients worldwide in optimizing maintenance policies and improving equipment availability. - Configure Substation models in the Digital...

As an AI Engineer at InteligenAI, you will play a crucial role in leading AI solution delivery for various client engagements. Your responsibilities will involve understanding business problems, designing technical solutions, and overseeing the complete product lifecycle of AI systems. You will collaborate with clients, founders, and the AI team to create impactful solutions. This dynamic role requires a proactive approach, constant learning, and the ability to handle multiple responsibilities simultaneously. Key Responsibilities: - Understand business problems and develop solution architectures for end-to-end AI solution delivery. - Design and implement production-grade ML/GenAI systems tai...

You will be responsible for utilizing advanced analytics, machine learning, and statistical modeling techniques to help the retail business make data-driven decisions. You will work closely with teams across marketing, product management, supply chain, and customer insights to drive business strategies and innovations. **Key Responsibilities:** - Utilize your deep understanding of the retail industry to design AI solutions that address critical retail business needs. - Gather and clean data from various retail sources like sales transactions, customer interactions, inventory management, website traffic, and marketing campaigns. - Apply machine learning algorithms like classification, cluster...

About the Role We are looking for a seasoned Engineering Manager well-versed with emerging technologies to join our team. As an Engineering Manager, you will ensure consistency and quality by shaping the right strategies. You will keep an eye on all engineering projects and ensure all duties are fulfilled . You will analyse other employees tasks and carry on collaborations effectively. You will also transform newbies into experts and build reports on the progress of all projects. What you will do Design tasks for other engineers as per Meeshos guidelines Perform regular performance evaluation and share and seek feedback Keep a closer look on various projects and monitor the progress Carry on...

Inviting applications for the role of Lead Consultant - MLOps Engineer! In this role, you will define, implement and oversee the MLOps strategy for scalable, compliant, and cost-efficient deployment of AI/ GenAI models across the enterprise. This role combines deep DevOps knowledge, infrastructure architecture, and AI platform design to guide how teams build and ship ML models securely and reliably. You will establish governance, reuse, and automation frameworks for AI infrastructure, including Terraform-first cloud automation, multi-environment CI/CD, and observability pipelines. Responsibilities Architect secure, reusable, modular IaC frameworks across cloud and regions for MLOps Lead the ...

As a GenAI Technical Solutions Architect, your role involves developing and implementing architecture strategies for Gen AI to enhance AI ML model deployment and monitoring efficiency. You will focus on developing cutting-edge architectural strategies for Gen AI components and platforms, leading the implementation of LLM operations, and working closely with data scientists and AI professionals to drive digital transformation. Your responsibilities include: - Developing cutting-edge architectural strategies for Gen AI components and platforms, leveraging advanced techniques such as chunking, Retrieval-Augmented Generation (RAG), AI agents, and embeddings. - Leading working sessions for Arch A...

As a Technical Architect specialized in Informatica CDI (Cloud Data Integration), your role will involve leading the end-to-end architecture and solution design using Informatica Cloud Data Integration (IICS). You will be responsible for defining a data integration strategy, roadmap, and best practices that are in alignment with the enterprise goals. Your expertise will be utilized in architecting and implementing solutions utilizing IICS B2B Gateway for secure data exchange. Collaboration with business stakeholders to capture requirements and design scalable, high-performance data solutions will be a key aspect of your responsibilities. Ensuring compliance with ITAR and data security standa...

As a highly skilled Full Stack Python Developer, your role will involve designing and building a next-generation Stock Market Trading Portal. This platform aims to offer real-time trading capabilities, portfolio management, advanced analytics, and integrated financial news feeds for various user roles such as individual traders, institutional traders, and brokers. You will need to leverage your technical expertise in Python and full-stack development, along with practical knowledge of financial markets and trading systems, to contribute to system architecture and product innovation in a dynamic environment. Key Responsibilities: - Platform Development: Design, develop, and deploy a robust st...

Role Overview: As an Engineer of the Digital Solutions team at Hitachi Energy PowerGrids, you will be a part of the Operation Center in India (INOPC-PG). Your primary goal will be to contribute to the development of a global value chain, facilitating the sharing of key business activities, resources, and expertise across geographic boundaries to enhance value for Hitachi Energy PowerGrids customers worldwide. Key Responsibilities: - Support clients globally in optimizing maintenance policies and increasing equipment availability. - Configure Substation models in the advanced Digital platform and analyze systems to develop efficient Reliability-based maintenance plans. - Serve as a liaison be...

The Company PayPal has been revolutionizing commerce globally for more than 25 years. Creating innovative experiences that make moving money, selling, and shopping simple, personalized, and secure, PayPal empowers consumers and businesses in approximately 200 markets to join and thrive in the global economy. We operate a global, two-sided network at scale that connects hundreds of millions of merchants and consumers. We help merchants and consumers connect, transact, and complete payments, whether they are online or in person. PayPal is more than a connection to third-party payment networks. We provide proprietary payment solutions accepted by merchants that enable the completion of payments...

You have a total experience of 7-17 years with strong expertise in Artificial Intelligence and Machine Learning. It is essential to have experience with common data science toolkits such as Python. Your work should include Concurrency, Data pipelines, and Data Ingestion for models. You must have hands-on experience with ML models beyond parameter tuning and interfacing. Additionally, experience with data visualization tools like Tableau, Power BI, D3.js, Gplot, etc. is mandatory, especially for the Architect role. Familiarity with SQL databases, time series databases, and optionally with noSQL databases like MongoDB, Cassandra, HBase would be advantageous. As for other skills, you are requir...

You will be responsible for designing and developing scalable Martech / AdTech solutions across web, mobile, and backend systems. This includes building and integrating APIs to support campaign delivery, personalization, and tracking. You will collaborate with product, data, and engineering teams to ensure reliable and performant ad & marketing experiences. Additionally, you will implement targeting and measurement capabilities using first- and third-party data and contribute to the architecture and technical roadmap of the Martech/AdTech stack. It is crucial to ensure security, compliance, and data quality across integrations and data flows, as well as troubleshoot and resolve issues relate...