1617 Data Pipelines Jobs - Page 32

As a Senior Azure Data Engineer, you should have a minimum experience in working on projects involving Azure Data Engineering. Your responsibilities will include: - Analyzing data using Python, Spark streaming, SSIS/Informatica Batch ETL, and database tools like SQL, Mongo DB for processing data from various sources. - Designing, operating, and integrating different systems to enhance efficiencies in key business areas. - Understanding business requirements, interacting with business users, and reverse engineering existing data products. - Having a good understanding and working knowledge of distributed databases and pipelines. - Ability to analyze and identify the root cause of technical is...

As a highly skilled and motivated Senior Technical Analyst at Merkle in Mumbai, you will play a crucial role in driving the development of scalable data-driven products and solutions. Your primary responsibilities will include: - Analyzing and critically evaluating client-provided technical and functional requirements. - Collaborating with stakeholders to identify gaps, ambiguities, and areas needing clarification. - Partnering with stakeholders to align business objectives with data capabilities and develop a roadmap for new data features and enhancements. - Documenting and communicating a clear understanding of requirements to internal teams, ensuring alignment with project objectives. You...

Role Overview: As a fintech company where Machine Learning (ML) is a key driver of impact, ensuring the building and deployment of state-of-the-art ML capabilities is critical. Your role will involve transforming ML models into high-performance production-level code, implementing sophisticated machine learning algorithms, robustness monitoring, system logging/alarming, and DevOps. This position will be hybrid from our Bengaluru office, offering excellent employee benefits such as healthcare, internet/cell phone reimbursement, a learning and development stipend, and opportunities to collaborate with teams in our Palo Alto HQ and Bangkok Site. Key Responsibilities: - Lead a team of Machine Lea...

The Senior Product Manager will be responsible for designing, developing, and overseeing activities related to the core Clearwater investment data management platform. Our market leading, cloud native, single instance multi-tenant architecture intakes data from 1200+ sources and creates a golden source of truth. Reporting to a senior product leader based in the U.S, this role will oversee defining the product requirements and planning its development to production and working closely with clients to make them successful. Additionally, the Product Manager is tasked with crafting the product roadmap necessary to achieve bookings, client NPS, and gross margin targets associated with their compo...

Summary We are seeking a highly motivated and data-savvy Business Analyst to join our growing Data &Analytics team. In this role, you will be a key liaison between business stakeholders and the data team, translating business needs into actionable data requirements and driving the development of impactful reporting and analytics solutions. You will be responsible for understanding what the business teams need to solve for, identifying relevant data sources, and collaborating with the Data Center of Excellence to deliver high-quality data solutions that support informed decision-making across the organization. Detailed Description Requirements Gathering: Elicit and document requirements for r...

As a Data Engineer at UPS, your role involves participating in the support of batch and real-time data pipelines for Marketing and Finance business units. You will be responsible for integrating data from various sources, performing ETL data conversions, and facilitating data cleansing and enrichment. Your duties will include full systems life cycle management activities, such as analysis, technical requirements, design, coding, testing, and implementation of systems and applications software. Additionally, you will contribute to synthesizing disparate data sources to support reusable and reproducible data assets. **Key Responsibilities:** - Supervising and supporting data engineering projec...

We're Hiring: Senior Manager Channel Management | DTDC Location: Mumbai What You'll Do: Lead end-to-end data analytics projects: from requirement gathering, data preparation, and modeling to delivering actionable insights. Design and implement advanced dashboards and reporting solutions for senior leadership. Apply statistical and predictive modeling techniques to uncover trends, risks, and opportunities. Collaborate with business stakeholders to translate business challenges into analytical solutions. Mentor and guide junior analysts, ensuring high-quality insights and accuracy. Partner with IT/engineering teams to enhance data infrastructure, pipelines, and governance. Automate reports, KP...

You are a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. Your focus will be on implementing batch and streaming pipelines, applying the bronze-silver-gold data lakehouse model, and ensuring scalable and reliable data solutions. - Design, develop, and operationalize scalable data pipelines on Databricks following medallion architecture principles. - Migrate and transform large data volumes from traditional on-prem systems (Oracle, Hadoop, Exadata) into cloud data platforms. - Develop efficient Spark (PySpark/Scala) jobs for ingestion, transformation, aggregation, and publishing of data. - Implement dat...

Role Overview: As a Compliance Data Analytics at Barclays, you will play a crucial role in spearheading the evolution of the digital landscape and driving innovation. Your primary responsibility will be to harness cutting-edge technology to revolutionize digital offerings and ensure unparalleled customer experiences. You will be assessed on critical skills such as experience with risk/compliance and job-specific skill sets. Key Responsibilities: - Investigate and analyze data issues related to quality, lineage, controls, and authoritative source identification. - Execute data cleansing and transformation tasks to prepare data for analysis. - Design and build data pipelines to automate data m...

Key Responsibilities Own end-to-end architecture for the platform including infrastructure, data, application, and integration layers. Define and validate technical approaches for: Kubernetes-based microservices setup (Rancher, 2-node HA) SQL Server 2022 with Always On availability CI/CD using GitLab, Jenkins, Harbor Secure architecture (TLS 1.3, SAML, RBAC) Collaborate with backend, frontend, mobile, and data teams to ensure scalable and loosely coupled component designs. Drive API architecture and real-time messaging using SignalR and other event-driven approaches. Define ETL architecture integrating SAP, WMS, and POS systems into the data warehouse. Guide Power BI and SSRS implementation ...

About Us At SentinelOne, we're redefining cybersecurity by pushing the limits of what's possibleleveraging AI-powered, data-driven innovation to stay ahead of tomorrow's threats. From building industry-leading products to cultivating an exceptional company culture, our core values guide everything we do. We're looking for passionate individuals who thrive in collaborative environments and are eager to drive impact. If you're excited about solving complex challenges in bold, innovative ways, we'd love to connect with you. What are we looking for We are building SentinelOne's next-generation, cloud-based data pipeline and are looking for a strong backend software engineer. As our new colleague...

Job Title: AI/ML Test Engineer Location: Bangalore: Onsite Position Type: Permanent (Bangalore Local Required:: Min Exp: 8 Years) Leveraging AI platform exp will not work : Need real time AI OR Gen AI testing exp required The AI Test Sr. Engineer II is part of the Software Applications Development Team and is responsible for analyzing requirements, designing, and implementing test strategies AI-enabled solutions across mobile, cloud, and analytics platforms. This role emphasizes validating AI/ML models, data pipelines, and intelligent features to ensure accuracy, fairness, security, and regulatory compliance. The AI Test Sr. Engineer will develop and maintain automation frameworks, regressio...

You are a highly skilled AI/ML Architect with a strong foundation in Data Engineering and the proven ability to apply Design Thinking in solving complex business challenges. You will play a key role in shaping end-to-end AI/ML solutions from data architecture to model deployment, ensuring the design remains user-centric, scalable, and aligned with business objectives. Key Responsibilities: - Lead the architecture and design of AI/ML solutions across multiple business domains. - Collaborate with stakeholders to identify use cases and translate them into scalable, production-ready ML architectures. - Leverage design thinking methodologies to drive innovative and user-centric solution design. -...

As a NiFi Data Engineer at the company, your role involves designing, developing, and maintaining scalable data pipelines using NiFi. You will ensure the efficient flow and transformation of data to support the platform's analytical needs. Responsibilities: - Bring the guiding principles to life by enhancing experiences for dealerships and customers, collaborating with colleagues, experimenting with new ideas, taking ownership of work, and adapting to growth and changes. - Collaborate with cross-functional teams to understand data requirements and deliver solutions. - Champion data quality and integrity across the organization. - Apply deep technical knowledge of data engineering principles ...

Join us as a Senior Data Engineer at Barclays where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unapparelled customer experiences. As a part of team of developers, you will deliver technology stack, using strong analytical and problem solving skills to understand the business requirements and deliver quality solutions. To be successful as a Senior Data Engineer you should have experience with: AWS hands on with S3, EC2, Lambda, RDS, Glue, Athena, data pipelines, step function and knowledge of Analytical services. Experience of distributed computing architect...

As an experienced GCP Administrator, your role will involve managing and configuring roles/permissions in GCP IAM, optimizing Big Query service, collaborating with various teams for efficient data management in GCP, creating automations and monitoring mechanisms, designing GCP-specific cloud architecture, provisioning and de-provisioning GCP accounts, and keeping technical documentation up to date. You will also be required to stay up to date on GCP announcements and services. Key Responsibilities: - Manage and configure roles/permissions in GCP IAM following the principle of least privileged access - Optimize Big Query service by managing slot assignments and SQL Queries, adopting FinOps pr...

Hi, We are hiring Senior Data engineer for our Client located at Chennai location. Hybrid mode. Job Overview: We are seeking an experienced Senior Data Engineer to join our dynamic team. The ideal candidate will be responsible for Design and implement the data engineering framework. Responsibilities Strong Skill in Big Query, GCP Cloud Data Fusion (for ETL/ELT) and PowerBI. Need to have strong skill in Data Pipelines Able to work with Power BI and Power BI Reporting Design and implement the data engineering framework and data pipelines using Databricks and Azure Data Factory. Document the high-level design components of the Databricks data pipeline framework. Evaluate and document the curren...

Responsibilities: * Design, develop & maintain data pipelines using Airflow, Spark & Big Query * Optimize performance through Snowflake & Kafka Ecosystem * Collaborate with cross-functional teams on data initiatives

As a Co-Founder & Chief Technology Officer (CTO) at Neuromancer Technologies Private Limited, you will play a crucial role in spearheading the development of cutting-edge, AI-powered platforms for impactful industries like Healthcare, Energy, Finance, and Education. Your responsibilities will encompass defining the long-term technology vision, leading product development, nurturing a high-performing tech team, overseeing AI/ML strategy, ensuring platform scalability, aiding in fundraising endeavors, and fostering cross-functional collaboration. Key Responsibilities: - Define the company's long-term technology vision and strategy in alignment with its mission. - Drive end-to-end product archi...

As a Technology Architect at Kale Logistics, a leading software SaaS product-based firm, you will play a crucial role in overseeing and optimizing the technical architecture of our software products, driving innovation, and ensuring exceptional user experiences. Your responsibilities will include: - Leading the design and architecture of Java / Python based applications. - Creating and maintaining architectural documentation, including diagrams, design documents, and guidelines to support development teams and ensure architectural consistency. - Working directly with the CTO to define and execute the technical strategy for our cloud-based products. - Designing and architecting robust, scalab...

As a Data Engineer, your role involves designing, building, and maintaining data pipelines and infrastructure to support data-driven initiatives. Your primary focus will be to ensure efficient collection, storage, and processing of data for analysis and business use. Key Responsibilities: - Designing, implementing, and optimizing end-to-end data pipelines for ingesting, processing, and transforming large volumes of both structured and unstructured data. - Building and maintaining data infrastructure that facilitates effective data utilization within organizations. - Designing and maintaining data models, schemas, and database structures to support various analytical and operational use cases...

Experience : 5.00 + years Salary : Confidential (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Indefinite Contract(40 hrs a week/160 hrs a month) (*Note: This is a requirement for one of Uplers client - Ireland IT Service Company) What do you need for this opportunity Must have skills required: Analytical Mindset, Business Central, Dynamics 365, machine learning workflows within Fabric, Microsoft Certified: Fabric Analytics Engineer Associate, BI, Data Analytics, Lakehouse, Microsoft Fabric, PMO, Synapse Analytics, warehouse implementation, Azure Data Factory Ireland IT Service Company is Look...

As a Data Engineer with hands-on experience on Snowflake data warehouse and Snowflake Architecture, your key responsibilities will include: - Configuring stages, formats, and utilizing Snowpipe integrations - Understanding Time Travel and Fail-safe Features, Data Sharing, Collaboration in Snowflake - Implementing Clustering and Partitioning, as well as Query Optimization Techniques - Working with External and Hybrid tables and Stages in Snowflake - Developing Data Pipelines, Tables, Views, Stored Procedures & Functions, Tasks in Snowflake - Familiarity with Snowflake costing model, Warehouse Optimization, and Cost Tracking - Setting up Tags, policies, ABAC & RBAC in Snowflake - Experience in...

Required Experience Bachelor's degree in computer science or related field or equivalent relevant experience Strong engineering background, preferred in fields such as Computer Science, Mathematics, Software Engineering, Physics, and Data Science. Proficient in programming languages such as Python, Java, or JavaScript. Familiarity with EHR systems (Epic, Cerner, Meditech), healthcare interoperability standards and national health data sets Familiarity with parallel health care industries such as Pharma, Life Sciences, Population Health, Payer, National Health Systems, or State based health programs 10+ years of experience in Engineering, Analytics and Data Science in health care What you wil...

Location: Bangalore, India Thales people architect solutions that enable two-thirds of planes to take off and land safely. We create in-flight entertainment systems that engross 50 million fliers every year and we develop the avionics that control the world's largest commercial aircrafts. Our simulators train the next generation of pilots for fighter jets, transporters and search and rescue helicopters. And, together, each and every member of our aerospace team makes a difference. Present in India since 1953, Thales is headquartered in Noida, Uttar Pradesh, and has operational offices and sites spread across Bengaluru, Delhi, Gurugram, Hyderabad, Mumbai, Pune among others. Over 1800 employee...