1617 Data Pipelines Jobs - Page 14

Title and Summary Manager, Data Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow Overview: The Mastercard Account Level Management (ALM) platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend. Role: Managing multiple scrum teams of Software developers and testers to develop quality software solutions in a timely and cost-effective manner. Successfully lead definition, development and delivery of major...

Position Overview: The candidate for this position will focus on Data Unification across different data assets, enabling a single unified view of data from multiple sources and support the development of new innovative data driven products, services and actionable insights that will help business to take decisions. Experience with LLMs or generative AI for automation to build data pipelines & AI - Enhanced Data Processing. The Role: We are seeking a Senior Analyst, Data Unification & Analytics who will: Perform data ingestion, aggregation, processing to drive and enable relevant insights from available data sets. Partner with various teams (i.e., Product Manager, Data Science, Platform Strat...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Power Business Intelligence (BI) Good to have skills : Snowflake Data Warehouse Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will engage in the design, development, and maintenance of data solutions that facilitate data generation, collection, and processing. Your typical ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qualit...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Power Business Intelligence (BI) Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Data Science Good to have skills : Generative AI Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education SUMMARY:We are seeking a Senior Technical – Gen AI Lead with deep expertise in Python, AI/ML concepts, and data engineering to spearhead the design and development of Data Agents powered by Agentic AI. As a senior t...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and imp...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and bu...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Power Business Intelligence (BI) Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, en...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Architect, you will be responsible for architecting the data platform blueprint and implementing the design, which includes various relevant data platform components. Extensive experience in building and managing modern data platforms on Azure using Lakehouse architecture. The ideal candidate will have stro...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transf...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Google Cloud SQL, Google BigQuery, GCP Dataflow Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agent...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Apache Hadoop Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will analyze, design, code, and test multiple components of application code across one or more clients. You will perform maintenance, enhancements, and/or development work, contributing to the overall success of the projects. Roles & Responsibili...

Roles and responsibilities Design AWS architectures based on business requirements. Create architectural diagrams and documentation. Present cloud solutions to stakeholders. Skills and Qualifications: Design, develop, and maintain scalable ETL/ELT pipelines using AWS services like Glue, Lambda, and Step Functions. Work with batch and real-time data processing using AWS Glue, Kinesis, Kafka, or Apache Spark. Optimize data pipelines for performance, scalability, and cost-effectiveness. Identify bottlenecks and optimize query performance on Redshift, Athena, and Glue. Strong knowledge of AWS services: EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation, CloudWatch, etc. Experience with serverless ar...

Role - Artificial Intelligence Engineer Location - Gurugram Haryana (WFO) About Company- This is an innovative AI-driven company with a focus on revolutionizing Real Estate with AI. As we expand our operations and scale new heights, we are looking for a detail-oriented and strategic Finance Manager to join our dynamic team and manage the financial health of the organization. Role Overview: We are seeking a highly skilled AI R&D Engineer with expertise in large language models, startup dynamics, and building production-grade AI products. You will play a pivotal role in designing, implementing, and optimizing LLM-driven systems that power our next-generation conversational AI solutions. Key Re...

Position: Python Developer (Mid-Level) Location: Indore (Hybrid) Experience: 36 Years About the Role We're looking for a skilled Python Developer who's passionate about building robust, scalable systems and is eager to explore the intersection of AI, modern software architectures, and automation . You'll work closely with our AI and backend engineering teams to design, develop, and deploy intelligent applications that power next-generation solutions at Ccube . Key Responsibilities Design, build, and maintain efficient, reusable, and reliable Python-based applications . Collaborate with cross-functional teams to integrate AI/ML models into production environments. Develop APIs and microservic...

hackajob is collaborating with Comcast to connect them with exceptional tech professionals for this role. Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and move at an amazing pace, thanks to our remarkable people, who bring cutting-edge products and services to life for millions of customers every day. If you share in our passion for teamwork, our vision to revolutionize industries and our ...

About The Role We are seeking a Senior Manager - Measurement Programs to lead our Technical Implementation and Marketing Sciences teams. This role sits at the intersection of marketing analytics, engineering and customer success, ensuring that Lifesights marketing measurement products are seamlessly deployed, customized, and continuously improved for our enterprise customers. You will own the end-to-end delivery of measurement solutions - from implementation of data pipelines and API integrations to translating model outputs into business insights. This role demands strong technical skills (JS, APIs, SQL, data pipelines), deep understanding of marketing measurement science (MMM, attribution,...

Role Overview: In this role, you will collaborate with cross-functional teams to identify opportunities to apply data-driven insights and develop innovative solutions to complex business problems. You will develop, implement, and maintain SQL data pipelines and ETL processes to collect, clean, and curate large and diverse datasets from various sources. Design, build, and deploy predictive and prescriptive machine learning models, generative AI model prompt engineering to help the organization make better data-driven decisions. You will also perform exploratory data analysis, feature engineering, and data visualization to gain insights and identify potential areas for improvement. Additionall...

Role Overview: As a Snowflake Database Developer, your primary responsibility will be to design, develop, and maintain Snowflake databases and data warehouse solutions. You will collaborate with cross-functional teams to implement data models and pipelines, ensuring data security, quality, and compliance in Snowflake environments. Additionally, you will monitor and troubleshoot Snowflake and SQL systems for performance issues, while also providing expertise as a technical resource to solve complex business issues related to data integration and database systems designs. Key Responsibilities: - Design, develop, and maintain Snowflake databases and data warehouse solutions - Build and optimize...

As an Assistant Director, Data Quality and Governance at HSBC, your role will involve managing internal and external data used for automated decisions within the decisioning ecosystem for Fraud, Credit, and Collections. Your responsibilities will include: - Analyzing and documenting Data profile, Data lineage, Data Inventory, and data quality rules - Defining and implementing data resiliency and data quality standards for multiple data sources and consumption use cases - Managing data quality, resiliency, and governance for data ingested from multiple source systems into GCP - Creating reports to monitor data quality trends and involving the right stakeholders to resolve identified issues - ...

As a Data Engineer at Hexagon, you will be responsible for various tasks including: - Strong time management and prioritisation skills. - Strong communication and interpersonal skills. - High level of personal drive and self-motivation. - Desire to expand your knowledge and skill set as well as share knowledge. - Review, validate and contribute to technical documentation relating to the deployment of new data definition releases. - Communicate progress status of work. - Provide accurate estimates of remaining work. - Compliance with Hexagons Workplace Health and Safety policies and procedures, participation in audits and compliance with instructions given in respect to the health and safety ...

As a Data Platform Developer Analyst at Barclays, you will play a crucial role in supporting the successful delivery of Location Strategy projects. Your responsibilities will include planning, budgeting, and ensuring adherence to quality and governance standards. You will lead the evolution of the digital landscape, promoting innovation and excellence. Key Responsibilities: - Define API specifications (REST, SOAP, GraphQL) and maintain accurate documentation for internal and external consumers. - Proficiency in SQL, data analysis tools, and data modeling concepts. - Support QA and UAT for API endpoints, ensuring performance, reliability, and adherence to non-functional requirements. - Implem...

**Job Description:** As a QA/testing professional, you will play a crucial role in ensuring the quality of data and analytics projects. Your responsibilities will include: - Conducting QA/testing activities for data and analytics projects. - Testing BI tools and dashboards such as Power BI, Tableau, Qlik, or similar. - Validating and verifying data using SQL. - Utilizing test management tools like JIRA, Azure DevOps, and defect tracking systems. - Performing ETL testing, analyzing data warehouses, and understanding data pipelines. - Applying strong analytical and problem-solving skills with a keen attention to detail. - Writing clear test cases, scenarios, and documentation. - Collaborating ...