1175 Data Pipeline Jobs - Page 23

Role & responsibilities The individual will be responsible for designs, builds, and maintains scalable data solutions including data models, ETL pipelines, and real-time processing systems He/she is also responsible for mentoring junior team members and play a pivotal role in overseeing the technical aspects of data related projects. MUST HAVE Experience on working with ETL on a data warehouse or big data projects. Experience with cloud services like Azure or GCP or AWS with respect to the data related services, could be just ETL ,cleanup or BI but has potential to be groomed in a 1-2 month period. Should have energy and enthusiasm to get into new things, able to stretch. Good SQL skills and...

Role & responsibilities We are recruiting for a technically strong, people-centric Data Engineering Manager to lead a high-impact AI & Data engineering team based in India. This group will build the data platform and products to support the analytics, insights and data science needs for our core subscription business. Data has always been at the heart of the Economist Group, and ultimately we aim to help the business make data driven judgements based on real time, actionable insights How you will contribute in this role: Work with data product managers, analysts, and data scientists to build data and ML pipelines, data warehouse/data lake-house for analytics, reporting and prediction. Build ...

Job Descripon Senior Data Lead Posion Senior Data Lead Loca¢on [Insert Loca¢on / Remote / Hybrid] About the Role We are looking for a Senior Data Lead to work closely with our Data Architect and play a key role in execu¢ng the data strategy, building pipelines, and leading delivery of cri¢cal data projects. This is a hands-on technical leadership role youll design, code, review, and mentor engineers, while ensuring the data pla¢orm is reliable, governed, and future-ready. You will be the bridge between architecture and engineering execu¢on, transla¢ng architectural blueprints into scalable, produc¢on-grade solu¢ons. Key Responsibili¢es Pla¢orm & Pipeline Development ¢ ¢ ¢ ¢ Design and build ...

Overview Annalect is currently seeking a data engineering lead to join our technology team. In this role you will be building data pipelines and developing data set processes. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will lead teams working on one or more software and data products in the Annalect Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions. You will also help us drive the vision forward for data engineering projects by helping us exte...

Role & responsibilities Support in preparation of IT intervention requirements and implementation roadmap The Data Scientist will be responsible for supervision of the key ICT interventions under the project including supervising (a) Designing & implementation monitoring of dashboard by leveraging indicators from District Socio-economic Review and SDG District Indicator Framework to consolidated view of fund flow to district and state machinery, (b) Creation of a data dissemination portal and other IT interventions envisaged under the project. (C) Implementation monitoring of existing MIS systems such as MPSIMS, iPAS, BEAMs and GoIs PFMS system Help prepare techno functional requirements for...

IBS Software is looking for Senior Data Engineer to join our dynamic team and embark on a rewarding career journey A Senior Data Engineer is a technical expert responsible for designing, building, and maintaining the systems and infrastructure needed to support data-driven applications and analytics The job responsibilities of a Senior Data Engineer may include: Designing and implementing scalable and reliable data pipelines, data models, and data infrastructure for processing large and complex datasets Developing and maintaining databases, data warehouses, and data lakes that store and manage the organization's data Developing and implementing data integration and ETL (Extract, Transform, L...

Responsibilities: * Develop computer vision models using Python and SQL. * Optimize data pipelines with Tableau and Power BI. * Collaborate on geospatial data projects with cross-functional teams. Provident fund Health insurance

Job Title: Data Engineer | Python & SQL | Intelligence AI Platform Experience: 2-5 Years Job Description:We are looking for a skilled Data Engineer (2-5 years) to join our team working on Intelligine, an AI-powered content creation and marketing platform. The ideal candidate will have strong expertise in Python, SQL, and ETL/ELT pipelines with a proven ability to work on scalable data solutions. Key Responsibilities: * Design, build, and maintain robust ETL/ELT pipelines using Python and SQL * Develop optimized SQL queries (joins, CTEs, window functions) * Integrate data from multiple sources: APIs, flat files, databases, and third-party tools * Optimize workflows, query performance, and dat...

Responsibilities Be a bridge between business and digital organizations and part of a cross-disciplinary team, working closely with other analysts, product managers, data scientists, data engineers, software engineers, data managers and business partners. Provide actionable, data-driven business and product insights by combining deep statistical skills, data manipulation capabilities and business acumen. Maintain metrics and build dashboards. Autonomously execute data analysis. You apply existing data & analytics strategies relevant to your immediate scope You partner with data engineers to define and build simple data models. You integrate existing tools to automate data ingestion, data man...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

Role & responsibilities Build and deploy data platforms, data warehouses, and big data solutions across industries (BFSI, Manufacturing, Healthcare, eCommerce, IoT, Digital Twin, etc) Integrating, transforming, and consolidating data from various structured and unstructured data systems. Expert in data ingestion, transformation, storage, and analysis, often using Azure services and migration from legacy on-premise services Essential skills include SQL, Python, R and knowledge of ETL/ELT processes and big data technologies like Apache Spark, Scala, PySpark. Maintain data integrity, resolve data-related issues, and ensure the reliability and performance of data solutions Work with stakeholders...

Architect – Data Engineering Governance & Data Security Req number: R5966 Employment type: Full time Worksite flexibility: Remote Who we are CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise. Job Summary We are seeking an accomplished Archi...

Overview We are seeking a highly skilled and detail-oriented Data Analyst to join our BI Analytics & Governance team in Hyderabad. This role is pivotal in transforming complex data into meaningful insights that drive s strategic decision-making across the organization. You will work closely with backend systems and large datasets, applying advanced analytical techniques to uncover trends, optimize processes, and support data governance initiatives. The ideal candidate will bring a strong analytical mindset, technical proficiency, and a passion for data integrity and business impact. Responsibilities Uphold company values and ensure alignment with iCIMS policies, procedures, and core competen...

Role Responsibilities : - Design and implement data pipelines using MS Fabric. - Develop data models to support business intelligence and analytics. - Manage and optimize ETL processes for data extraction, transformation, and loading. - Collaborate with cross-functional teams to gather and define data requirements. - Ensure data quality and integrity in all data processes. - Implement best practices for data management, storage, and processing. - Conduct performance tuning for data storage and retrieval for enhanced efficiency. - Generate and maintain documentation for data architecture and data flow. - Participate in troubleshooting data-related issues and implement solutions. - Monitor and...

Role Responsibilities : - Design and implement data pipelines using MS Fabric. - Develop data models to support business intelligence and analytics. - Manage and optimize ETL processes for data extraction, transformation, and loading. - Collaborate with cross-functional teams to gather and define data requirements. - Ensure data quality and integrity in all data processes. - Implement best practices for data management, storage, and processing. - Conduct performance tuning for data storage and retrieval for enhanced efficiency. - Generate and maintain documentation for data architecture and data flow. - Participate in troubleshooting data-related issues and implement solutions. - Monitor and...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

Role Responsibilities : - Design and implement data pipelines using MS Fabric. - Develop data models to support business intelligence and analytics. - Manage and optimize ETL processes for data extraction, transformation, and loading. - Collaborate with cross-functional teams to gather and define data requirements. - Ensure data quality and integrity in all data processes. - Implement best practices for data management, storage, and processing. - Conduct performance tuning for data storage and retrieval for enhanced efficiency. - Generate and maintain documentation for data architecture and data flow. - Participate in troubleshooting data-related issues and implement solutions. - Monitor and...

About the job : Role : Microsoft Fabric Data Engineer Experience : 6+ years as Azure Data Engineer including at least 1 E2E Implementation in Microsoft Fabric. Responsibilities : - Lead the design and implementation of Microsoft Fabric-centric data platforms and data warehouses. - Develop and optimize ETL/ELT processes within the Microsoft Azure ecosystem, effectively utilizing relevant Fabric solutions. - Ensure data integrity, quality, and governance throughout Microsoft Fabric environment. - Collaborate with stakeholders to translate business needs into actionable data solutions. - Troubleshoot and optimize existing Fabric implementations for enhanced performance. Skills : - Solid foundat...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

6-month extendable Hybrid role in Indore, Noida, Bangalore, Hyderabad, Gurgaon, or Pune. Requires to go 4 days a month in office 8+ yrs in ETL & pipeline expert skilled in Azure, Spark, SQL, Python/Scala, Synapse, Snowflake, and data architecture.

About the job : Role : Microsoft Fabric Data Engineer Experience : 6+ years as Azure Data Engineer including at least 1 E2E Implementation in Microsoft Fabric. Responsibilities : - Lead the design and implementation of Microsoft Fabric-centric data platforms and data warehouses. - Develop and optimize ETL/ELT processes within the Microsoft Azure ecosystem, effectively utilizing relevant Fabric solutions. - Ensure data integrity, quality, and governance throughout Microsoft Fabric environment. - Collaborate with stakeholders to translate business needs into actionable data solutions. - Troubleshoot and optimize existing Fabric implementations for enhanced performance. Skills : - Solid foundat...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

Role Responsibilities : - Design and implement data pipelines using MS Fabric. - Develop data models to support business intelligence and analytics. - Manage and optimize ETL processes for data extraction, transformation, and loading. - Collaborate with cross-functional teams to gather and define data requirements. - Ensure data quality and integrity in all data processes. - Implement best practices for data management, storage, and processing. - Conduct performance tuning for data storage and retrieval for enhanced efficiency. - Generate and maintain documentation for data architecture and data flow. - Participate in troubleshooting data-related issues and implement solutions. - Monitor and...