1617 Data Pipelines Jobs - Page 43

Role Overview: As a Software Engineer at Bharat Atomic, you will be responsible for building control and imaging software to unify the user experience and data pipelines of the Scanning Electron Microscope (SEM). Your main mission will be to make a complex instrument feel simple by developing control software that ensures quick first image acquisition, synchronized multi-channel data collection, and analysis-ready data with detailed metadata, all wrapped in a user-friendly UI. Key Responsibilities: - Own the control layer that integrates imaging, analytics, motion, safety, and diagnostics. - Implement a high-throughput, lossless data pipeline with structured metadata focusing on reproducibil...

As a QA Data Testing professional, your role will involve the following responsibilities and qualifications: Role Overview: You will be responsible for conducting QA testing of Data Pipelines & Dashboards, along with hands-on experience in end-to-end Data Quality Testing. Your key focus will be on ensuring data lineage and implementing best practices in Data QA testing. Key Responsibilities: - Conduct QA testing of Data Pipelines & Dashboards - Perform end-to-end Data Quality Testing - Ensure data lineage is maintained - Implement best practices in Data QA testing Qualifications Required: - Minimum 6 years of experience in QA testing of Data Pipelines & Dashboards - Minimum 6 years of hands-...

Develop and optimize AI models for insurance use cases, apply data science for predictive insights, innovate with latest AI, integrate with engineering teams, and ensure scalable, cost-efficient, reliable deployment and maintenance. Required Candidate profile Hands-on with GenAI, LLMs, prompt engineering, and fine-tuning; skilled in Python, TensorFlow, PyTorch; strong in data science, predictive analytics, and MLOps for scalable AI deployment.

Were Hiring Engineering Lead (Cloud & Data) | Data Engineer SME Location: Hinjewadi, Pune Work Mode: Hybrid (2 - 3 days from office) Experience: 12 - 17 Years Key Skills: Cloud Platforms (AWS preferred) Data Engineering (Databricks, Spark, Python, SQL) Application & Data Integration in Cloud ETL, Data Pipelines, Airflow Strong Leadership & Mentorship skills

As an experienced Software Engineer specialized in Internal Tooling and Support, you will be responsible for strengthening the ingestion infrastructure and internal operations tooling at the intersection of Engineering and Operations. Your role will involve ensuring smooth data ingestion, reliable scraping infrastructure, and efficient tooling for Ops teams. Additionally, you will act as the first layer of triage between Ops and Engineering Oncall, driving faster resolutions and building long-term automation to reduce operational overhead. - **Maintain and optimize the ingestion and scraping infrastructure, ensuring high reliability and performance. - **Design, build, and improve internal to...

As a Tech Lead, your role will involve guiding a small engineering team to ship scalable and reliable products. You will be responsible for setting the technical direction, improving code quality, and mentoring developers while still actively coding 99% of the time. **Key Responsibilities:** - Own architecture and delivery for key projects - Lead and mentor a team of 58 engineers, drive code reviews, and maintain coding standards - Collaborate with Product and Design teams to define project scope, milestones, and trade-offs - Ensure continuous integration/continuous delivery (CI/CD), testing, and observability are maintained at a high standard; handle incidents and postmortems effectively **...

Role Overview: As an Engineer in the Digital Solutions team at Operation Center, India (INOPC-PG) for Hitachi Energy PowerGrids, you will play a crucial role in optimizing maintenance policies, enhancing equipment availability, and supporting clients globally. Your responsibilities will include configuring Substation models in a cutting-edge Digital platform, collaborating with clients and the R&D team, troubleshooting equipment malfunctions, integrating systems with various protocols, and ensuring compliance with regulations. Key Responsibilities: - Support clients worldwide in optimizing maintenance policies and improving equipment availability. - Configure Substation models in the Digital...

As an AI Engineer at InteligenAI, you will play a crucial role in leading AI solution delivery for various client engagements. Your responsibilities will involve understanding business problems, designing technical solutions, and overseeing the complete product lifecycle of AI systems. You will collaborate with clients, founders, and the AI team to create impactful solutions. This dynamic role requires a proactive approach, constant learning, and the ability to handle multiple responsibilities simultaneously. Key Responsibilities: - Understand business problems and develop solution architectures for end-to-end AI solution delivery. - Design and implement production-grade ML/GenAI systems tai...

You will be responsible for utilizing advanced analytics, machine learning, and statistical modeling techniques to help the retail business make data-driven decisions. You will work closely with teams across marketing, product management, supply chain, and customer insights to drive business strategies and innovations. **Key Responsibilities:** - Utilize your deep understanding of the retail industry to design AI solutions that address critical retail business needs. - Gather and clean data from various retail sources like sales transactions, customer interactions, inventory management, website traffic, and marketing campaigns. - Apply machine learning algorithms like classification, cluster...

About the Role We are looking for a seasoned Engineering Manager well-versed with emerging technologies to join our team. As an Engineering Manager, you will ensure consistency and quality by shaping the right strategies. You will keep an eye on all engineering projects and ensure all duties are fulfilled . You will analyse other employees tasks and carry on collaborations effectively. You will also transform newbies into experts and build reports on the progress of all projects. What you will do Design tasks for other engineers as per Meeshos guidelines Perform regular performance evaluation and share and seek feedback Keep a closer look on various projects and monitor the progress Carry on...

Inviting applications for the role of Lead Consultant - MLOps Engineer! In this role, you will define, implement and oversee the MLOps strategy for scalable, compliant, and cost-efficient deployment of AI/ GenAI models across the enterprise. This role combines deep DevOps knowledge, infrastructure architecture, and AI platform design to guide how teams build and ship ML models securely and reliably. You will establish governance, reuse, and automation frameworks for AI infrastructure, including Terraform-first cloud automation, multi-environment CI/CD, and observability pipelines. Responsibilities Architect secure, reusable, modular IaC frameworks across cloud and regions for MLOps Lead the ...

As a GenAI Technical Solutions Architect, your role involves developing and implementing architecture strategies for Gen AI to enhance AI ML model deployment and monitoring efficiency. You will focus on developing cutting-edge architectural strategies for Gen AI components and platforms, leading the implementation of LLM operations, and working closely with data scientists and AI professionals to drive digital transformation. Your responsibilities include: - Developing cutting-edge architectural strategies for Gen AI components and platforms, leveraging advanced techniques such as chunking, Retrieval-Augmented Generation (RAG), AI agents, and embeddings. - Leading working sessions for Arch A...

As a Technical Architect specialized in Informatica CDI (Cloud Data Integration), your role will involve leading the end-to-end architecture and solution design using Informatica Cloud Data Integration (IICS). You will be responsible for defining a data integration strategy, roadmap, and best practices that are in alignment with the enterprise goals. Your expertise will be utilized in architecting and implementing solutions utilizing IICS B2B Gateway for secure data exchange. Collaboration with business stakeholders to capture requirements and design scalable, high-performance data solutions will be a key aspect of your responsibilities. Ensuring compliance with ITAR and data security standa...

As a highly skilled Full Stack Python Developer, your role will involve designing and building a next-generation Stock Market Trading Portal. This platform aims to offer real-time trading capabilities, portfolio management, advanced analytics, and integrated financial news feeds for various user roles such as individual traders, institutional traders, and brokers. You will need to leverage your technical expertise in Python and full-stack development, along with practical knowledge of financial markets and trading systems, to contribute to system architecture and product innovation in a dynamic environment. Key Responsibilities: - Platform Development: Design, develop, and deploy a robust st...

Role Overview: As an Engineer of the Digital Solutions team at Hitachi Energy PowerGrids, you will be a part of the Operation Center in India (INOPC-PG). Your primary goal will be to contribute to the development of a global value chain, facilitating the sharing of key business activities, resources, and expertise across geographic boundaries to enhance value for Hitachi Energy PowerGrids customers worldwide. Key Responsibilities: - Support clients globally in optimizing maintenance policies and increasing equipment availability. - Configure Substation models in the advanced Digital platform and analyze systems to develop efficient Reliability-based maintenance plans. - Serve as a liaison be...

The Company PayPal has been revolutionizing commerce globally for more than 25 years. Creating innovative experiences that make moving money, selling, and shopping simple, personalized, and secure, PayPal empowers consumers and businesses in approximately 200 markets to join and thrive in the global economy. We operate a global, two-sided network at scale that connects hundreds of millions of merchants and consumers. We help merchants and consumers connect, transact, and complete payments, whether they are online or in person. PayPal is more than a connection to third-party payment networks. We provide proprietary payment solutions accepted by merchants that enable the completion of payments...

You have a total experience of 7-17 years with strong expertise in Artificial Intelligence and Machine Learning. It is essential to have experience with common data science toolkits such as Python. Your work should include Concurrency, Data pipelines, and Data Ingestion for models. You must have hands-on experience with ML models beyond parameter tuning and interfacing. Additionally, experience with data visualization tools like Tableau, Power BI, D3.js, Gplot, etc. is mandatory, especially for the Architect role. Familiarity with SQL databases, time series databases, and optionally with noSQL databases like MongoDB, Cassandra, HBase would be advantageous. As for other skills, you are requir...

You will be responsible for designing and developing scalable Martech / AdTech solutions across web, mobile, and backend systems. This includes building and integrating APIs to support campaign delivery, personalization, and tracking. You will collaborate with product, data, and engineering teams to ensure reliable and performant ad & marketing experiences. Additionally, you will implement targeting and measurement capabilities using first- and third-party data and contribute to the architecture and technical roadmap of the Martech/AdTech stack. It is crucial to ensure security, compliance, and data quality across integrations and data flows, as well as troubleshoot and resolve issues relate...

As a Senior Software Engineer at our fast-growing healthcare technology company, you will play a crucial role in designing and implementing innovative cloud-based solutions. Your primary responsibility will be to develop scalable, secure, and high-performance systems using your strong Python development skills and expertise in Azure Cloud services. You will work closely with cross-functional teams to create backend services and APIs utilizing Python frameworks such as FastAPI, Django, and Flask. Your role will involve implementing and securing cloud solutions through Azure services like App Services, Functions, Storage, and SQL. Additionally, you will collaborate with teams to define archite...

The Retail Specialized Data Scientist will play a pivotal role in utilizing advanced analytics, machine learning, and statistical modeling techniques to help the retail business make data-driven decisions. This individual will work closely with teams across marketing, product management, supply chain, and customer insights to drive business strategies and innovations. The ideal candidate should have experience in retail analytics and the ability to translate data into actionable insights. Key Responsibilities: - Utilize deep understanding of the retail industry to design AI solutions for critical business needs. - Gather and clean data from various retail sources like sales transactions, cus...

At Capgemini Invent, we believe that difference drives change. As inventive transformation consultants, we blend our strategic, creative, and scientific capabilities to collaborate closely with clients in delivering cutting-edge solutions tailored to address the challenges of today and tomorrow. Our approach is informed and validated by science and data, superpowered by creativity and design, and all underpinned by purpose-driven technology. Your role will involve proficiency in various technologies such as MS Fabric, Azure Data Factory, Azure Synapse Analytics, Azure Databricks Lakehouses, OneLake, Data Pipelines, Real-Time Analytics, Power BI Integration, and Semantic Model. You will be re...

You are an experienced Senior Consultant with a strong background in Java development and practical exposure to Generative AI (GenAI) technologies. Your main responsibilities will include designing and delivering scalable solutions, integrating AI-driven capabilities into enterprise applications, and providing technical leadership to development teams. Your key responsibilities will involve designing, developing, and maintaining scalable applications using Java, Spring Boot, and Microservices. You will also be responsible for architecting and integrating Generative AI solutions such as LLMs, embeddings, and RAG pipelines into business applications. Collaborating with data scientists and AI e...

About The Company BP Energy is a global leader in the energy sector, committed to providing innovative and sustainable energy solutions. With a rich history of operational excellence and a focus on future-forward initiatives, BP Energy strives to meet the evolving needs of customers and stakeholders worldwide. The company emphasizes safety, integrity, and environmental responsibility, fostering a culture of continuous improvement and technological advancement. As part of its strategic growth, BP Energy invests heavily in digital transformation, harnessing data analytics and innovative technologies to optimize operations, enhance decision-making, and deliver value across its diverse portfolio...

Job Description Data Scientist/Data Analyst/ Data Engineer Location: Optum Noida Job Type: Full-time About the Role: We are seeking a highly skilled Data Scientist to join our dynamic team. The ideal candidate will have a strong background in SQL, Excel, Power BI, Python, PySpark, and data pipelines. You will be responsible for analyzing complex data sets, creating excel reports and Power BI dashboards, developing predictive models, and providing actionable insights to drive business decisions. Responsibilities: Collect, clean, and analyze data from various sources. Design and maintain data pipelines to ensure data quality and integrity. Develop and maintain reports and dashboards in excel a...

10+ yrs experience with 2+ yrs in SAP DataSphere; expertise in BDC/DataSphere & integration. Skilled in system setup, optimizing data flows, Python transformations & integrating SAP/non-SAP data across platforms.