10328 Data Engineering Jobs - Page 50

Role Overview: As a Senior Data Engineer, you will be responsible for building and optimizing data systems that support batch processing, real-time streaming, pipeline orchestration, data lake management, and data cataloging. You will leverage your expertise in solving big data problems and apply design thinking, coding, and analytical skills to develop data pipelines that facilitate marketing data products. Key Responsibilities: - Build and optimize data systems for batch processing and real-time streaming. - Manage pipeline orchestration to ensure smooth data flow. - Oversee data lake management and data cataloging processes. - Develop data pipelines that support marketing data products. Q...

As a Product Data Analyst at Responsive, you will play a crucial role in driving data-informed decisions by analyzing product data and providing valuable insights. Your responsibilities will include designing, developing, and maintaining robust data pipelines using Python, analyzing product data from various sources, creating interactive reports and dashboards using Tableau, implementing data quality checks, collaborating with product and analytics teams, and presenting analytical findings to stakeholders. Additionally, you will document data architecture, ETL processes, and analytical findings for internal reference and compliance. Key Responsibilities: - Design, develop, and maintain robus...

As a Data Engineer at Viraaj HR Solutions, your role will involve the following responsibilities: - Designing and implementing data models in Snowflake for optimized storage and retrieval. - Developing ETL processes to ensure robust data integration pipelines. - Collaborating with data analysts and business stakeholders to gather requirements for data solutions. - Performing data profiling to understand data quality and cleanse data as necessary. - Optimizing query performance using Snowflake-specific features. - Monitoring data warehouse performance and troubleshooting any data-related issues. - Ensuring data security and compliance with company policies and regulations. - Creating and main...

As a motivated Python and Snowflake Developer with around 2 years of hands-on experience, your role at PTC will involve supporting data engineering initiatives by building, optimizing, and maintaining scalable data pipelines and integrations between Python applications and Snowflake's cloud data platform. Key Responsibilities: - Develop and maintain data pipelines using Python for ETL/ELT processes. - Write efficient SQL queries and scripts to process and analyze data in Snowflake. - Design, create, and maintain Snowflake schemas, tables, views, and stored procedures. - Implement and schedule data jobs using Snowflake Tasks, Streams, and Snowpipe. - Optimize Python code and SQL logic for per...

As an Associate Systems Engineer - Data Engineer - Analytics at Airbus Commercial Aircraft, you will play a crucial role in designing and building solutions that involve data engineering, integration, analysis, visualization, and application development within the Skywise Framework. Your primary responsibilities will include: - Working closely with the tech lead, Product Manager & Product Owners to understand processes, capture requirements, and solve business problems by leveraging data. - Designing, building, and maintaining robust analytics modules on the Palantir Skywise platform. - Engineering scalable and reliable data pipelines to ingest, transform, and model data from diverse enterpr...

As a Data Engineer at QualMinds, you will play a crucial role in maintaining and supporting existing MSSQL processes, pipelines, and schemas. Additionally, you will be responsible for migrating existing pipelines and processes to the cloud, specifically Snowflake and GCP. Your role will involve analyzing and organizing raw data sets to meet functional and non-functional requirements, as well as developing and testing new pipelines and processes in both MSSQL and cloud environments. Working closely with the data engineering team, you will design and implement scalable solutions to meet business needs and support analytics and reporting initiatives. Furthermore, you will collaborate with the s...

As a member of the Expedia Group team, you will be a part of powering global travel for everyone, everywhere by designing cutting-edge tech and creating groundbreaking solutions for partners. Your role will involve architecting and building advanced analytics products that combine data engineering with AI/ML intelligence and LLM capabilities. You will lead end-to-end processes, mentor peers, and continuously improve reliability, scalability, and performance in a high-impact environment. Your innovative work will involve technologies like Python, Scala, Java, Apache Spark, AWS Cloud Services, and more. You will have the freedom to identify AI opportunities and implement production-grade solut...

As a Lead Test Engineer at Jet2, you will play a crucial role in our Data Engineering & Analytics program by working closely with colleagues across business and technical teams. You will be responsible for testing and ensuring the quality of various data sources, cleansing, structuring, and transforming data to support a range of use cases from self-service analytics to data warehousing and data science. Your expertise in Cloud Data Engineering will help us efficiently deliver solutions and evolve our Data Engineering processes to align with industry best practices. Key Responsibilities: - Plan, monitor, and direct testing activities to deliver high-quality, well-modelled, clean, and trustwo...

As a Data Scientist in our company, you will have the following responsibilities: - Designing, developing, and deploying sophisticated machine learning models to solve complex business challenges. - Building and optimizing end-to-end ML pipelines, including data preprocessing, feature engineering, model training, and deployment. - Driving Generative AI initiatives, creating innovative products and solutions. - Conducting in-depth analysis of large, complex datasets to generate actionable insights and recommendations. - Working closely with cross-functional stakeholders to understand business requirements and deliver data-driven strategies. In addition to the above key responsibilities, you w...

As a member of the Digital Advisory team at Arcadis, your role will involve assisting in data extraction from various sources such as PDFs, images, and databases. You will also support optical character recognition processes for digitizing data from images and contribute to understanding data through natural language processing. Your responsibilities will extend to collaborating with business domain experts to derive business value drivers and documenting model design choices and algorithm selection processes. Additionally, you will collaborate effectively in cross-functional teams within the CoE and the organization at large, proactively seeking opportunities to contribute beyond assigned t...

As a Senior AI Scientist at Soothsayer Analytics, you will play a crucial role in leading the development of scalable AI/LLM solutions. Your expertise in ML fundamentals and data engineering will be instrumental in designing, fine-tuning, and deploying models such as LLMs and RAG architectures. Your responsibilities will include: - AI/LLM Development: - Fine-tune and optimize LLMs (e.g., GPT, Llama) and traditional ML models for production. - Implement retrieval-augmented generation (RAG), vector databases, and orchestration tools (e.g., LangChain). - Data Engineering: - Build scalable data pipelines for unstructured/text data using tools like Spark, Kafka, and Airflow. - Optimize storage/re...

Experience: 6-8 years of hands-on experience in data engineering and architecture. Demonstrated expertise with: Palantir Foundry (Quiver pipelines, Ontology modeling, Workshop) AWS data services (S3, Glue, Redshift, Lambda, IAM, Athena) Snowflake (warehouse design, query tuning, secure sharing) Key Responsibilities Design and maintain an integrated data architecture connecting Palantir Foundry , AWS services , and Snowflake for secure and scalable data access. Drive performance optimization strategies including partitioning , clustering , caching , and materialized views . Ensure interoperability across Foundry (Quiver, Workshop, Ontology) , Snowflake schemas , and AWS S3-based data lakes . ...

Senior Data Engineer - Palantir Foundry We are looking for a Senior Data Engineer with strong hands-on experience in Palantir Foundry to design, build, and optimize scalable data pipelines and analytics solutions. Required Skills & Qualifications: 5+ years of experience in data engineering, analytics, or software development. Proven expertise in Palantir Foundry (pipelines, ontology, fusion, transformations). Strong programming skills in Python and SQL . Experience with AWS , data lakes, and cloud data warehouses. Familiarity with ETL processes, CI/CD pipelines, and Git. Strong problem-solving and debugging skills. Excellent communication and teamwork abilities. Required Skills Python,AWS,Pa...

We're hiring Data Engineers with 5+ yrs experience in SQL, Python, PySpark, and cloud platforms (Azure/AWS). Build scalable data pipelines, optimize ETL workflows, and work with Databricks/Snowflake. Cloud certs & Airflow are a plus.

Data Engineer (3-4 yrs) needed with strong PySpark, AWS, Airflow & Kafka skills. Build & maintain scalable data pipelines. Immediate to 30 days notice period. Max CTC 15 LPA. Join us to drive data solutions & analytics.

Data Engineer 3-5 yrs Bangalore Pyspark AWS DBT Kafka CI/CD Snowflake

Data Engineering Lead: Design and implement scalable data pipelines using technologies such as Apache Spark, Kafka, and AWS Glue. Develop and maintain ETL processes to ingest, transform, and store structured and unstructured data. Optimize data storage solutions, including data lakes, data warehouses, and relational databases. Collaborate with cross functional teams to ensure data availability and quality. Work with big data technologies such as Hadoop, Snowflake, or Big Query for large-scale data processing. Monitor and troubleshoot data pipeline failures, optimizing performance and reliability. Implement security best practices for data storage, access control, and encryption. Stay up to d...

You will be work closely in a world class AI ML team comprised of experts in AI ML modeling, ML & LLMOps engineers, data science and data engineering teams. You will contribute to engineering and developing solutions for ML operations and be a critical part of leading S&Ps AI-driven transformation to drive value internally and for our customers. S&P is a leader in automation and AI/ML to transform risk management. This role is a unique opportunity for ML/MLOps engineers to grow into the next step in their career journey. Responsibilities and Impact: Lead ML Engineering to architect, build and deploy production grade GenAI services and solutions. Work on large-scale stateful and stateless dis...

Maintenance & Material Data Engineer Vadodara, LTTS India JOB DESCRIPTION Experience in machinery maintenance (Pumps, compressors, Turbines, etc....) exposure and addition to Hands on experience and familiar in SAP transaction codes Knowledge of various equipment failures and their PM maintenance ¢ Knowledge and ability to understand different documents and drawings. ¢ Skilled in extracting and analyzing maintenance data from SAP. ¢ Well trained and knowledgeable on Maintenance and Material Data creation, cleansing, classification, verification, validation, standardization, and enrichment activities for ERP / CMMS master data management (MDM) as per SAP PM / MM module compliance ¢ Working kn...

Job Purpose The Senior Data Engineer will be responsible for designing, building, and maintaining scalable and efficient data pipelines and architectures for the Enterprise Data Platform. This role will focus on enabling high-quality, reliable, and timely data access for analytics, reporting, and business decision-making. Working closely with business analysts, data scientists, and architects, the Senior Data Engineer will ensure data solutions meet business needs and adhere to best practices and governance standards. Duties and Responsibilities Develop and execute the data lake strategy, including architecture, integration, and data lifecycle management. Lead the design, implementation, and...

Are you excited by the prospect of wrangling data, helping develop information systems/sources/tools, and shaping the way businesses make decisions? The Go-To-Markets Data Analytics team is looking for a skilled Senior Data Engineer who is motivated to deliver top notch data-engineering solutions to support business intelligence, data science, and self-service data solutions. About the Role: In this role as a Senior Data Engineer, you will: Design, develop, optimize, and automate data pipelines that blend and transform data across different sources to help drive business intelligence, data science, and self-service data solutions. Work closely with data scientists and data visualization team...

Are you excited by the prospect of wrangling data, helping develop information systems/sources/tools, and shaping the way businesses make decisions? The Go-To-Markets Data Analytics team is looking for a skilled Data Engineer / Senior Data Engineer who is motivated to deliver top notch data-engineering solutions to support business intelligence, data science, and self-service data solutions. About the Role: In this role as a Data Engineer / Senior Data Engineer, you will: Design, develop, optimize, and automate data pipelines that blend and transform data across different sources to help drive business intelligence, data science, and self-service data solutions. Work closely with data scient...

Key Responsibilities Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources. Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems. Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs. Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery. Data Strategy & Business Value: Art...

We are Hiring | Lead Data Engineer------------------INR 120 to 140 LPM Client: MNC Location: Remote - C2H Join: Immediate to 15 days Key Skills & Expertise:---8-9 years Data Engineering (ML | Data & AI Engineering) Strong in Python & SQL Development Experience with Azure / GCP / Big Data platforms CI/CD Pipeline implementation Adaptability & strong problem-solving mindset Exposure to Data Analyst roles is a plus Interested candidates can please share me the resume to karthika@venpastaffing or call 9036237987.

Position Purpose As a member of WM IT DCIO team, the candidate will work on WM Data Governance workstreams as prioritized (Data Quality, Data literacy, Data Lineage/Architecture, Data Privacy by Design, Data Protection workstreams). Support WM IT DCIO team in driving the Data initiatives transversally with WM Leadership, Application Development & Maintenance (ADM), Engineering & Production (E&P), Security (CISO) teams. Support the development & testing of software / applications for Data Management. Note: DCIO complements Chief Data Office (CDO) within Wealth Management IT organization. Responsibilities Direct Responsibilities Work closely with WM IT DCIO team to execute the Data Governance ...