757 Data Pipelines Jobs - Page 14

Are you passionate about leveraging the latest technologies for strategic change Do you enjoy problem-solving in clever ways Are you organized enough to drive change across complex data systems If so, you could be the right person for this role. As a DevOps data engineer, you will join an existing team in the EA Team in Group CTO supporting our strategic initiatives across the bank. You'll be working in the Technology Services GCTO EA Team. Technology Services is a group-wide function that provides integrated and secure infrastructure services for the organization by offering best-fit, easy-to-leverage, reliable, and cost-effective technology services and strategic products that provide func...

Summary: Charles River Development (CRD) is the FinTech division of State Street. Together with State Street's Middle and Back-office services, Charles River's cloud-based Front Office technology forms the foundation of the State Street Alpha Platform, the first front-to-back solution in the industry.The Alpha Data Platform, lets you load, enrich and aggregate investment data. Leveraging this, our clients will be able to manage multi-asset class data from any service provider or data vendor for a more holistic and integrated view of their holdings. This platform reflects State Street's years of experience servicing complex instruments for our global client base and our investments in buildin...

You will be responsible for defining the overall BI solution structure from data source to dashboard, ensuring that the BI solutions effectively support strategic decision-making and operational reporting. Your role will involve establishing reusable data models, naming conventions, and governance frameworks, as well as implementing standards and controls to validate the accuracy and trustworthiness of data. Additionally, you will guide developers in designing intuitive, insightful, and performant visualizations, and ensure clear, consistent documentation of KPIs, datasets, and business logic. You will be expected to align the BI layer with data models, transformations, and data pipelines, a...

As an Azure Data Engineer at our organization, you will be an integral part of our dynamic team. Your primary responsibility will be to design, develop, and maintain data pipelines and ETL processes using Azure cloud services. Your expertise in Azure Data Factory, Azure Databricks, and Azure Synapse Analytics will be essential in creating scalable data solutions to ensure data quality and availability across various platforms. Collaboration is key in this role as you will work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver effective solutions. You will also be tasked with building and optimizing data storage solutions using Azure...

As a Product Lead in Ad Tech at Times Internet, you will be responsible for taking ownership of and enhancing the data layer that powers Colombia's AdTech stack. Your role will involve defining and prioritizing product requirements for AI-driven ad serving, integrating with various AdTech ecosystem components such as SSPs, DSPs, DMPs, CDPs, and internal/external APIs to improve audience intelligence and campaign performance. Privacy and compliance will also be key focus areas for you. Collaboration with cross-functional teams including engineering, analytics, sales, and operations will be essential for executing product roadmaps and go-to-market strategies. Staying updated with the latest ad...

Join us as a Data Engineer. You'll be the voice of our customers, using data to tell their stories and put them at the heart of all decision-making. We will look to you to drive the build of effortless, digital-first customer experiences. If you're ready for a new challenge and want to make a far-reaching impact through your work, this could be the opportunity you're looking for. This role is based in India, and as such, all normal working days must be carried out in India. We're offering this role at vice president level. As a Data Engineer, you'll be looking to simplify our organization by developing innovative data-driven solutions through data pipelines, modeling, and ETL design, aiming ...

Greetings from Ashra Technologies! We are currently looking to hire a skilled professional for the role of Azure Microsoft Fabric with at least 7+ years of experience. This position is based in Pune, Mumbai, Chennai, or Bangalore. Key Responsibilities & Requirements: - Hands-on experience with Microsoft Fabric, specifically Lakehouse, Data Factory, and Synapse. - Strong expertise in PySpark and Python for large-scale data processing and transformation. - Deep knowledge of Azure data services such as ADLS Gen2, Azure Databricks, Synapse, ADF, Azure SQL, etc. - Proven experience in designing, implementing, and optimizing end-to-end data pipelines on Azure. - Familiarity with Azure infrastructu...

About Quantanite Quantanite is a global provider of outsourcing solutions that enable businesses to achieve digital transformation through cutting-edge technology and deep domain expertise. We deliver next-generation AI-driven solutions to optimize front office, back-office, and shared services environments. Our mission is to provide innovative, scalable, and cost-effective solutions that enhance operational efficiency and drive business growth. Role Overview We are seeking an experienced Senior Technical Project Manager based in India to coordinate and oversee technical project delivery in collaboration with Nexgai, Quantanite's technical partner, and our offshore delivery teams. This role ...

As a Data Engineer at StratLytics, you will be part of a dynamic team dedicated to crafting cutting-edge data pipelines. Your primary responsibility will involve playing a pivotal role in the architecture, development, and refinement of data infrastructure that is specifically tailored for data science endeavors. Life @ StratLytics is all about empowering individuals to take charge of their own professional journeys. We value opinions and contributions from every team member, recognizing that passion is the driving force behind excellence. Continuous learning, introspection, and constructive debates are integral parts of our work culture, fostering an environment where transparency in office...

Staff Data Engineer Are you excited about the opportunity to contribute to an industry leader in Energy Technology As a Staff Data Engineer, you will play a pivotal role in ensuring the highest standards of quality in our digital transformation. Our Digital Technology Team provides top-tier products and services, and your expertise will be crucial in solving complex challenges and innovating for the future. Partner with the best As a Staff Data Engineer, you will leverage your expertise in data engineering to deliver high-quality data solutions. Your role will involve designing, developing, and maintaining data pipelines, adhering to best practices, and driving continuous improvement to achi...

Who We Are Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact. To succeed, organizations must blend digital and human capabilities. Our diverse, global teams bring deep industry and functional expertise and a range of perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate...

Required Experience Bachelor's degree in computer science or related field or equivalent relevant experience Strong engineering background, preferred in fields such as Computer Science, Mathematics, Software Engineering, Physics, and Data Science. Proficient in programming languages such as Python, Java, or JavaScript. Familiarity with EHR systems (Epic, Cerner, Meditech), healthcare interoperability standards and national health data sets Familiarity with parallel health care industries such as Pharma, Life Sciences, Population Health, Payer, National Health Systems, or State based health programs 10 years of experience in Engineering, Analytics and Data Science in health care What you will...

Senior Data Engineer (Remote, Contract 6 Months) Databricks, ADF, and PySpark. We are hiring a Senior Data Engineer for a 6-month remote contract position. The ideal candidate is highly skilled in building scalable data pipelines and working within the Azure cloud ecosystem, especially Databricks, ADF, and PySpark. You'll work closely with cross-functional teams to deliver enterprise-level data engineering solutions. #KeyResponsibilities Build scalable ETL pipelines and implement robust data solutions in Azure. Manage and orchestrate workflows using ADF, Databricks, ADLS Gen2, and Key Vaults. Design and maintain secure and efficient data lake architecture. Work with stakeholders to gather da...

We are looking for a highly skilled and experienced Data Engineer with over 5 years of experience to join our growing data team. The ideal candidate will be proficient in Databricks, Python, PySpark, and Azure, and have hands-on experience with Delta Live Tables. In this role, you will be responsible for developing, maintaining, and optimizing data pipelines and architectures to support advanced analytics and business intelligence initiatives. You will collaborate with cross-functional teams to build robust data infrastructure and enable data-driven decision-making. Key Responsibilities: .Design, develop, and manage scalable and efficient data pipelines using PySpark and Databricks .Build an...

We are seeking an experienced Azure Data Engineer with 36 years of experience for a 6-month remote contract. The candidate will be responsible for developing and supporting IT solutions using technologies like Azure Data Factory, Azure Databricks, Azure Synapse, Python, PySpark, Teradata, and Snowflake. The role involves designing ETL pipelines, developing Databricks notebooks, handling CI/CD pipelines via Azure DevOps, and working on data warehouse modeling and integration. Strong skills in SQL, data lake storage, and deployment/monitoring are required. Prior experience in Power BI and DP-203 certification is a plus. Location: Remote- Bengaluru,Hyderabad,Delhi / NCR,Chennai,Pune,Kolkata,Ahm...

Hiring an AWS Data Engineer for a 6-month hybrid contractual role based in Bellandur, Bengaluru. The ideal candidate will have 7+ years of experience in data engineering, with strong expertise in AWS services (S3, EC2, RDS, Lambda, EKS), PostgreSQL, Redis, Apache Iceberg, and Graph/Vector Databases. Proficiency in Python or Golang is essential. Responsibilities include designing and optimizing data pipelines on AWS, managing structured and in-memory data, implementing advanced analytics with vector/graph databases, and collaborating with cross-functional teams. Prior experience with CI/CD and containerization (Docker/Kubernetes) is a plus.

Hiring an AWS Data Engineer for a 6-month hybrid contractual role based in Bellandur, Bengaluru. The ideal candidate will have 46 years of experience in data engineering, with strong expertise in AWS services (S3, EC2, RDS, Lambda, EKS), PostgreSQL, Redis, Apache Iceberg, and Graph/Vector Databases. Proficiency in Python or Golang is essential. Responsibilities include designing and optimizing data pipelines on AWS, managing structured and in-memory data, implementing advanced analytics with vector/graph databases, and collaborating with cross-functional teams. Prior experience with CI/CD and containerization (Docker/Kubernetes) is a plus.

The Platform Data Engineer will be responsible for designing and implementing robust data platform architectures, integrating diverse data technologies, and ensuring scalability, reliability, performance, and security across the platform. The role involves setting up and managing infrastructure for data pipelines, storage, and processing, developing internal tools to enhance platform usability, implementing monitoring and observability, collaborating with software engineering teams for seamless integration, and driving capacity planning and cost optimization initiatives.

JOB DESCRIPTION: Designation: Manager Bex Data and Insights Band : 3A Experience: 05 Years + Location: Baddi Qualification: B. Pharma / M. Pharma / B. Tech. / M. Tech. / MBA knowledge of Microsoft applications including Power Automate and Power BI Hands on experience of LEAN Tools. Green Belt Certified It's an Individual Contributor Role, where individual will be Responsible for AI and Advance analytics in Operations, The BEx Data and Insights Manager is responsible for/ helps delivering targeted business impact per initiative in collaboration with key stakeholders. Manage regular business and IT stakeholder interactions to understand needs, get feedback and update on project progress. Condu...

As a part of DataWeave's Product Engineering team, you will play a crucial role in developing and maintaining advanced sales optimization solutions for Digital Commerce businesses, consumer brands, delivery intermediaries, and marketplaces. Our machine learning-enabled SaaS platform caters to over 400 global brands and retailers, providing them with actionable insights through Digital Shelf Analytics and Dynamic Pricing solutions. Your responsibilities will include ensuring the quality of code developed by the team, overseeing the delivery of solutions into production, and mentoring developers while contributing to capacity planning and career development. Collaborating with technical projec...

You are an experienced Quality Engineer with 6 to 8 years of experience (B2 level) and possess a strong skillset in testing analytical systems. Joining the RE&ILS Operations value stream, you will play a crucial role in ensuring the quality and reliability of data solutions within the Operations Value Stream. Your responsibilities include developing and executing comprehensive test plans and test cases for data solutions such as data pipelines, ETL processes, and data warehouses. You will conduct data validation and verification to guarantee data accuracy, completeness, and consistency. It is essential for you to identify, document, and track defects and issues while collaborating with devel...

You will be joining Soothsayer Analytics, a global AI & Data Science consultancy based in Detroit, with a thriving delivery center in Hyderabad. The company specializes in designing and implementing custom Machine Learning solutions encompassing predictive analytics, optimization, NLP, and GenAI to assist leading enterprises in forecasting, automation, and gaining a competitive advantage. As a Senior AI Scientist, your role will involve leading the development of scalable AI/LLM solutions. You will be responsible for designing, fine-tuning, and deploying models such as LLMs and RAG architectures, while ensuring the robustness of data pipelines and MLOps practices. Your key responsibilities w...

You should have at least 5 years of IT experience with a good understanding of analytics tools for effective data analysis. You must be capable of leading teams and have prior experience working in production deployment and production support teams. Proficiency in Big Data tools such as Hadoop, Spark, Apache Beam, Kafka, etc., and object-oriented/object function scripting languages like Python, Java, C++, Scala, etc., is required. Experience with DW tools like BQ, Redshift, Synapse, or Snowflake, as well as ETL and Data Warehousing, is essential. You should have a solid understanding of relational and non-relational databases such as MySQL, MS SQL Server, Postgres, MongoDB, Cassandra, etc., ...

As a Data Engineer, you will play a crucial role in designing and developing business-critical backend systems using stream processors and high-quality data pipelines. Your responsibilities will include assembling large, complex data sets to meet both functional and non-functional business requirements. You will be tasked with building the necessary infrastructure for optimal extraction, transformation, and loading of data from various sources using SQL and Azure "big data" technologies. Additionally, you will be responsible for constructing a cloud-native, real-time stream processing and data lake platform that can scale into the Zettabytes and beyond. Developing a data pipeline to offer ac...

The primary purpose of this role is to lead and manage engineering teams, providing technical guidance, mentorship, and support to ensure the delivery of high-quality software solutions. As a leader, you will drive technical excellence, foster a culture of innovation, and collaborate with cross-functional teams to align technical decisions with business objectives. Your key responsibilities will include leading engineering teams effectively, fostering a collaborative and high-performance culture to achieve project goals and meet organizational objectives. You will oversee timelines, team allocation, risk management, and task prioritization to ensure the successful delivery of solutions withi...