10148 Data Engineering Jobs - Page 25

Your role and responsibilities As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You€™ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you€™ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you€™ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: * Implementing and validating predictive models as well as creating and maintain statistical models wi...

Your role and responsibilities Architect and deliver production-grade AI agents and tools using IBM Watsonx Orchestrate. Oversee data pipeline strategy, reliability, and compliance. Lead technical innovation and process optimization initiatives. Collaborate with global teams and stakeholders to translate business needs into AI solutions. Mentor and coach team members; contribute to hiring and talent development. Ensure adherence to enterprise data platform governance and standards. Create and maintain clear, comprehensive documentation for solutions and processes. Develop and maintain a test and evaluation framework to assess performance and quality. Design test plans and collaborate with te...

Your role and responsibilities As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform...

Your role and responsibilities As an entry level Application Developer at IBM, you'll work with clients to co-create solutions to major real-world challenges by using best practice technologies, tools, techniques, and products to translate system requirements into the design and development of customized systems. In your role, you may be responsible for: Working across the entire system architecture to design, develop, and support high quality, scalable products and interfaces for our clients Collaborate with cross-functional teams to understand requirements and define technical specifications for generative AI projects Employing IBM's Design Thinking to create products that provide a great ...

About the Role As a Data Engineer on the Data & Analytics (D&A) team, you will ensure the data powering business decisions is accurate, well-structured, and accessible. Youll work with technologies such as Snowflake, DBT, Power BI, Fivetran, AWS, and Python to deliver clean, reliable, and performant data. Your initial focus will be on building robust data models in Snowflake and semantic models in Power BI, creating the trusted foundation for dashboards and analyses across Quickbase. Over time, you will also contribute to broader data engineering responsibilities including pipeline design, data integration, compute optimization, governance enforcement, and data quality improvements. This rol...

About The Position We are looking for a dynamic and experienced System Analyst Data Scientist Lead to join our growing AI & Data Science team. In this role, you will lead projects and collaborate with cross-functional teams to build and deploy cutting-edge machine learning solutions that drive business value. Technical and Professional Requirements Minimum 5+ years of experience in data science, with at least 2 years in a leadership or team management role. Proficiency in Natural Language Processing (NLP) techniques such as LDA, embeddings, Retrieval-Augmented Generation (RAG). Experience in time series forecasting, statistical modeling, and predictive analytics. Hands-on experience with Dat...

Job Description Core Responsibilities: Design and develop data pipelines and workflows within Palantir Foundry Build and manage Ontology objects to enable semantic reasoning over data Configure and maintain data integrations from various sources (JDBC, SFTP, APIs) Write clean, efficient code using Python, Java, Scala, and SQL Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions Perform data quality checks and ensure reliability across Foundry applications Participate in code reviews, agile ceremonies, and contribute to best practices Troubleshoot and resolve issues in Foundry applications and pipelines Stay updated on Foundr...

Job Summary: The Data Engineering Specialist will be responsible for building robust, efficient, and scalable data pipelines, managing large datasets, and ensuring data quality and reliability. The role requires collaboration with data scientists, analysts, and business stakeholders to ensure data is available, accurate, and ready for analysis. Key Responsibilities: Design, develop, and maintain ETL/ELT pipelines for ingestion, transformation, and integration of structured and unstructured data. Build and manage scalable data architectures to support analytics, BI, and AI/ML initiatives. Ensure data quality, consistency, and reliability across multiple sources and systems. Optimize data stor...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Neo4j, Stardog Good to have skills : Java Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and imp...

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Reltio Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect/MDM Architect is a senior technology leader responsible for designing, building, and overseeing the enterprise's Master Data Management solution. This role is pivotal in establishing a "single source of truth" for critical data domains such as Customer, Product, Vendor, and Employee.You will be the chief t...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Business Agility Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data p...

We are looking for a skilled Data Engineer with expertise in Integration and Data Processing to join our team. The ideal candidate will have hands-on experience with Spark and Python as programming skills, along with advanced SQL programming skills. This position is available in Bengaluru, Hyderabad, Pune, or Gurgaon. Roles and Responsibility Design and develop data integration solutions using various tools and technologies. Process and analyze large datasets to extract insights and trends. Develop and maintain complex databases and data warehouses. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure data quality and integrity by implementing data ...

We are looking for a skilled Data Engineer with 7 to 10 years of experience to join our team in Bangalore, Hyderabad, Chennai, and Pune. The ideal candidate will have expertise in data engineering, Azure cloud, Snowflake, and Snowflake ELT methodologies. Roles and Responsibility Design and develop scalable data pipelines using Azure cloud and Snowflake. Implement ETL processes on Azure and manage data management tasks. Develop automation scripts using Python, Scala, or other languages. Collaborate with cross-functional teams to ensure seamless data integration. Ensure data integrity and accuracy during migration efforts. Optimize data processing workflows for improved efficiency. Job Require...

SUMMARY Job Description Key Responsibilities: Python Development: Proficient in Python, with strong knowledge of design patterns and both object-oriented and functional programming paradigms. Hands-on experience with modern IDEs such as VS Code, PyCharm, and tools like CoPilot or Cursor for efficient development and testing. Familiarity with searching and sorting algorithms, with the ability to apply them effectively in problem - solving. Experience working with multi-module and package-based project structures. Strong expertise in unit testing frameworks such as pytest and unittest, with a focus on writing robust and maintainable test cases. Proficient in managing virtual environments using...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creat...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve cre...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Palantir Foundry, PySpark, Python (Programming Language), MySQL Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with various teams to understand their needs, developing solutions that align with business objectives, and ensuring that applications ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Microsoft Azure Databricks Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creat...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Business Agility Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data p...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Data Services Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Job Summary :We are seeking a skilled Azure Data Engineer to design, build, and manage scalable data pipelines and integrations within the Microsoft Azure ecosystem. The ideal candidate will have hands-on experience with Azure Data Factory (ADF), Azure Data Lake, and Azure SQL/Synapse, as well as a solid understanding of ETL/ELT processes, data mod...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

About The Role Job Title Data Science/Data Engineering ML9 - Sales Excellence COE - Data Engineering Specialist Management Level :ML9 Location:Open Must have skills: strong GCP cloud technology experience, Big query, Data Science basics. Good to have skills: Build and maintain data models from different sources. Experience: Minimum 5 year(s) of experience is required Educational Qualification: Graduate/Post graduate Job Summary : The Center of Excellence (COE) makes sure that the sales and pricing methods and offerings of Sales Excellence are effective. The COE supports salespeople through its business partners and Analytics and Sales Operations teams. The Data Engineer helps manage data sou...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code across multiple clients. Your day will involve collaborating with team members to perform maintenance and enhancemen...

This role offers the opportunity to leverage your cloud-native deployment skills and experience with modern AI platforms to build scalable ML pipelines, LLM-based applications, and intelligent agent frameworks. You will play a key role in accelerating the delivery of innovative solutions for telecom, enterprise, and next-generation autonomous networks. If you thrive in a challenging and rewarding environment, we encourage you to apply. HOW YOU WILL CONTRIBUTE AND WHAT YOU WILL LEARN Employ MLOps best practices for CI/CD, model deployment, and monitoring. Focus on fine-tuning, prompt engineering, RAG pipelines, and LLM monitoring. Enhance AI/ML systems with Agentic AI frameworks for autonomou...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Data Engineering Sr. Advisor demonstrates expertise in data engineering technologies with the focus on engineering, innovation, strategic influence and product mindset. This individual will act as key contributor of the team to design, build, test and deliver large-scale software applications, systems, platforms, services or t...