6525 Data Engineering Jobs - Page 22

We are looking for a seasoned professional with 7+ years of experience in pricing operations, data engineering, or analytics to lead global pricing operations and analytics initiatives The ideal candidate will act as a hands-on Data and QA Engineering lead, ensuring the accuracy and quality of pricing data, trends, and models Responsibilities include building QA workflows, leading distributed teams, mentoring analysts, and collaborating with engineering, product, and data science teams You will also be responsible for automation efforts, dashboard/report development, offshore coordination, and ensuring SLA adherence and consistency across pricing operations Experience with Redmine, JIRA, and...

and solutions designedexecution, idealFirm'sThe firm's Note:- We are seeking an immediate joiner or a candidate with a notice period of up to 15-20 days. As this is a senior management role, the candidate should be open to working in a flexible shift or be willing to operate in a flexible mode as per business requirements. Executive Summary We are launching a full-spectrum digital transformation consulting firm offering services across AI, cloud, CRM, QA/QE, blockchain, and custom software development. We're seeking a founding Assistant Vice President of Technology to lead our technical vision, oversee project delivery, and drive client engagement. This position combines strategic leadership...

Design and implement scalable data architectures to optimize data flow and analytics capabilities Develop ETL pipelines, data warehouses, and real-time data processing systems Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery Work closely with data scientists to enhance machine learning models with structured and unstructured data Prior experience in handling large-scale datasets is preferred Mandatory Key Skillspython,data warehousing,etl,amazon redshift,bigquery,data engineering,data architecture,aws,machine learning,data flow,etl pipelines,real-time data processing,java,spring boot,microservices,spark,kafka,cassandra,scala,nosql,mongodb,rest...

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key SkillsSQL,Python,data warehousing,etl,amazon redshift,bigquery,data engineering,AWS,machine learning,real-time data processing,Java,spring boot,microservices,spark,Kafka,Cassandra,Scala,NoSQL,mongodb,Redis,data architecture*

Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy. Job responsibilities You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solution...

Role Overview We are looking for an experienced AI Data Architect to design and implement robust, scalable, and secure data architectures that power AI/ML solutions. The role involves defining data strategies, enabling advanced analytics, ensuring data quality/governance, and optimizing infrastructure to support modern AI-driven applications. Key Responsibilities Design and implement end-to-end data architectures to support AI/ML workloads. Define data strategy, governance, and frameworks for structured, semi-structured, and unstructured data. Architect scalable data pipelines, warehouses, and lakehouses optimized for AI/ML. Collaborate with Data Scientists, ML Engineers, and business teams ...

We are looking for a seasoned professional with 7+ years of experience in pricing operations, data engineering, or analytics to lead global pricing operations and analytics initiatives The ideal candidate will act as a hands-on Data and QA Engineering lead, ensuring the accuracy and quality of pricing data, trends, and models Responsibilities include building QA workflows, leading distributed teams, mentoring analysts, and collaborating with engineering, product, and data science teams You will also be responsible for automation efforts, dashboard/report development, offshore coordination, and ensuring SLA adherence and consistency across pricing operations Experience with Redmine, JIRA, and...

Role & responsibilities We are looking for an accomplished Technical Lead - Data Engineering to design and develop of a cloud-agnostic, open-source data ingestion and processing solution that will be embedded within a larger Low-Code platform to strengthen the overall low code platform capabilities. The ideal candidate will bring deep expertise in large-scale Data Engineering platforms design, development and execution experience , with hands-on experience in ETL, Real Time Streaming, Distributed Data Processing, Python, Spark , and will have the ability to guide a product development team through the entire lifecycle - from concept to deployment. This role involves architecting and deliveri...

Position Overview: We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and implement scalable data solutions, optimise performance, and lead a high-performing team to deliver data-driven insights. Key Responsibilities: Technical Leadership Lead and mentor a team of data engineers, fostering best practices in coding, design, and delivery. Drive the adoption of modern data engineering frameworks, tools, and methodologies to ensure high-quality and...

Job DescriptionAn ETL Tester (4+ Years Must) is responsible for testing and validating the accuracy and completeness of data being extracted, transformed, and loaded (ETL) from various sources into the target systems. These target systems can be On Cloud or on Premise They work closely with ETL developers, Data engineers, data analysts, and other stakeholders to ensure the quality of data and the reliability of the ETL processes Understand Cloud architecture and design test strategies for data moving in and out of Cloud systems Roles And Responsibilities Strong in Data warehouse testing - ETL and BI Strong Database Knowledge Oracle/ SQL Server/ Teradata Snowflake Strong SQL skills with exper...

Oracle Health & AI (OHAI) is a newly formed business unit committed to transforming the healthcare industry through our expertise in IaaS and SaaS. Our mission is to deliver patient-centered care and make advanced clinical tools accessible globally (). We're assembling a team of innovative technologists to build the next-generation health platforma greenfield initiative driven by entrepreneurship, creativity, and energy. If you thrive in a fast-paced, innovative environment, we invite you to help us create a world-class engineering team with a meaningful impact. The OHAI Patient Accounting Analytics Team focuses on delivering cutting-edge reporting metrics and visualizations for healthcare f...

Data Bricks and Python Engineer Job Responsibilities 1. Software Development: - Design, develop, test, and deploy high-performance and scalable data solutions using Python,PySpark, SQL - Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. - Implement efficient and maintainable code using best practices and coding standards. 2. Databricks Platform: - Work with Databricks platform for big data processing and analytics. - Develop and maintain ETL processes using Databricks notebooks. - Implement and optimize data pipelines for data transformation and integration. 3. Continuous Learning: - Stay updated on the latest indust...

Job Summary We are seeking a talented Data Engineer to join our dynamic team, focusing on big data solutions for the banking industry. In this role, you will lead the design and development of Big Data Warehouse and Data Lake systems, playing a crucial part in our clients' digital transformation journeys. Your expertise in data engineering will empower financial institutions to harness the power of their data, enabling better decision-making and enhanced customer experiences. Key Responsibilities Big Data Warehouse and Data Lake Development : Lead the design and implementation of Big Data Warehouse and Data Lake systems, utilizing the Hadoop ecosystem and cloud technologies. Data Pipeline Ar...

Context : In modern banking age financial institutions need to bring Classical Data Drivers and Evolving Business Drivers together in a single platform. These drivers also need to communicate with each other and share the data products for enterprise consumption. Traditional data platforms are able to handle classical data drivers well but fail to communicate with evolving business drivers due to limitations of technologies and implementation approaches. Modern Data Platform helps to fill this gap, and take the business to the next level of growth and expansion using data driven approaches. The technology transformation in recent years make such implementations feasible. Your Opportunity You...

Job Summary As a Microsoft Fabric Data Engineer/Developer, you will play a vital role in designing, developing, and implementing robust and scalable data solutions within the Microsoft Fabric ecosystem. You will collaborate closely with data architects, business stakeholders, and cross-functional teams to transform raw data into actionable insights, driving informed decision-making across the organization. If you are passionate about data engineering, possess a strong technical background, and excel in collaborative environments, we invite you to join our growing data team. Career Level - IC2 Responsibilities Microsoft Fabric Development : Design, develop, and deploy end-to-end data solution...

Required Experience Bachelors degree in computer science or related field or equivalent relevant experience Strong engineering background, preferred in fields such as Computer Science, Mathematics, Software Engineering, Physics, and Data Science. Proficient in programming languages such as Python, Java, or JavaScript. Familiarity with EHR systems (Epic, Cerner, Meditech), healthcare interoperability standards and national health data sets Familiarity with parallel health care industries such as Pharma, Life Sciences, Population Health, Payer, National Health Systems, or State based health programs 10 years of experience in Engineering, Analytics and Data Science in health care Responsibiliti...

Oracle Health & AI (OHAI) is a newly formed business unit committed to transforming the healthcare industry through our expertise in IaaS and SaaS. Our mission is to deliver patient-centered care and make advanced clinical tools accessible globally (). We're assembling a team of innovative technologists to build the next-generation health platforma greenfield initiative driven by entrepreneurship, creativity, and energy. If you thrive in a fast-paced, innovative environment, we invite you to help us create a world-class engineering team with a meaningful impact. The OHAI Patient Accounting Analytics Team focuses on delivering cutting-edge reporting metrics and visualizations for healthcare f...

Job Title : Snowflake Developer with Oracle Golden Gate/ Data Engineer About Oracle FSGIU - Finergy: The Finergy division within Oracle FSGIU is dedicated to the Banking, Financial Services, and Insurance (BFSI) sector. We offer deep industry knowledge and expertise to address the complex financial needs of our clients. With proven methodologies that accelerate deployment and personalization tools that create loyal customers, Finergy has established itself as a leading provider of end-to-end banking solutions. Our single platform for a wide range of banking services enhances operational efficiency, and our expert consulting services ensure technology aligns with our clients' business goals R...

Job Title : Snowflake Developer with Oracle Golden Gate/ Data Engineer About Oracle FSGIU - Finergy: The Finergy division within Oracle FSGIU is dedicated to the Banking, Financial Services, and Insurance (BFSI) sector. We offer deep industry knowledge and expertise to address the complex financial needs of our clients. With proven methodologies that accelerate deployment and personalization tools that create loyal customers, Finergy has established itself as a leading provider of end-to-end banking solutions. Our single platform for a wide range of banking services enhances operational efficiency, and our expert consulting services ensure technology aligns with our clients' business goals R...

Looking for a DevOps Senior Engineer in the Data Engineering team who can help us support next-generation Analytics applications over Oracle cloud. This posting is for DevOps Senior Engineer in the Oracle Analytics Warehouse product development organization. Fully handled Cloud service that provides customers a turn-key enterprise warehouse on the cloud for Fusion Applications. The service is being built on a sophisticated technology stack demonstrating a brand-new data integration platform and the industry's most sophisticated analytical business analytics platform. https://www.oracle.com/solutions/business-analytics/analytics-for-applications.html We are looking for senior engineer with ex...

Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold data lakehouse model, and ensuring scalable and reliable data solutions. Required Skills and Experience: 6+ years of hands-on data engineering experience, with 2+ years specifically working on Databricks in Azure or AWS. Proficiency in building and optimizing Spark pipelines (batch and streaming). Strong experience implementing bronze/silver/gold data models. Working knowledge of cloud storage systems (ADLS, S3) and comput...

Responsibilities As part of the OCI Gen AI and Data Solutions for strategic customers team, you will be responsible for developing innovative Gen AI and data services for our strategic customers.As a Principal Applied Data Scientist, you'll lead the development of advanced Gen AI solutions using the latest ML technologies combined with Oracle's cloud expertise. Your work will significantly impact sectors like financial services, telecom, healthcare, and code generation by creating distributed, scalable, high-performance solutions for strategic customers. Work directly with key customers and accompany them on their Gen AI journey understanding their requirements, help them envision and design...

Role Overview: We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS . The role involves designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data. Required Skills and Experience: 8+ years of experience in data architecture or engineering roles, with at least 3+ years specializing in cloud-based big data solutions. Hands-on expertise with Databricks on Azure or AWS . Dee...

We are seeking a highly skilled Senior Data Engineer with 5+ years of experience for our Bengaluru location (max 30 days notice period). The ideal candidate will have strong expertise in designing, developing, and maintaining robust data ingestion frameworks, scalable pipelines, and DBT-based transformations. Responsibilities include building and optimizing DBT models, architecting ELT pipelines with orchestration tools like Airflow/Prefect, integrating workflows with AWS services (S3, Lambda, Glue, RDS), and ensuring performance optimization on platforms like Snowflake, Redshift, and Databricks. The candidate will implement CI/CD best practices for DBT, manage automated deployments, trouble...

Job Summary We are seeking a skilled Azure Data Engineer with 4 years of overall experience , including at least 2 years of hands-on experience with Azure Databricks (Must) . The ideal candidate will have strong expertise in building and maintaining scalable data pipelines and working across cloud-based data platforms. Key Responsibilities Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse. Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS). Collaborate with data scientists, analysts, and engineering teams to design and deliver end-to-end data solutions. Develop...