2087 Data Engineer Jobs - Page 18

Role Description: We are seeking a highly skilled and detail-oriented Data Engineering Test Automation Engineer to ensure the quality, reliability, and performance of our data pipelines and platforms. The ideal candidate has strong experience in data testing, ETL validation, and automation frameworks, and will work closely with data engineers, analysts, and DevOps to build robust test suites. This role involves designing and executing both manual and automated tests for real-time and batch data pipelines across AWS and Databricks platforms, while applying QA best practices in test planning, defect tracking, and lifecycle management to ensure high-quality data delivery. In addition, the resou...

Data Engineers As a Data Engineer for Cora, you will design and maintain robust data pipelines and architectures that power our next-generation Agentic AI and Generative AI capabilities. Cora handles over 15 million customer conversations annually, and we are evolving it into a financial coach and smart digital assistant. Your work will enable seamless integration of conversational data, advanced analytics, and AI-driven insights. Key Responsibilities & Skills 1. Programming Proficiency Strong proficiency in Python and SQL. Experience with data manipulation libraries (Pandas, PySpark ) and API integration. 2. Data Pipelines Expertise in ETL processes, data warehousing, and real-time streamin...

**Job Description** As a RTOC specialist with experience in real-time monitoring and analysis of drilling data, your role will involve coordinating with customers and rig site simultaneously. Your excellent communication skills will be essential in ensuring seamless operations. Previous field experience as a Data Engineer or M/LWD Engineer, along with exposure to software for drilling optimization, will provide you with a competitive advantage. **Key Responsibilities** - Real-time monitoring and analysis of drilling data - Coordinating with customers and rig site simultaneously - Utilizing software for drilling optimization - Ensuring seamless operations through effective communication **Qua...

Role Overview: You will be responsible for designing, building, and maintaining a robust data platform as a Data Platform Engineer (Tableau Analytics) at a rapidly growing SaaS product company. Your main focus will be on data engineering, analytics modeling, and dash boarding, particularly using Tableau, Power BI, and SQL-based data warehouses like Snowflake. Your role will involve creating data pipelines, modeling datasets, and optimizing analytics workflows to provide actionable insights to business teams. Key Responsibilities: - Develop and maintain scalable data pipelines for ingestion, transformation, and storage using Snowflake and dbt. - Design, optimize, and maintain data models to s...

Role Overview: You will be responsible for leading Data Engineer teams in developing enterprise-grade data processing pipelines on Google Cloud. Your main focus will be on migrating ETL pipelines and Data warehouses to the cloud, including at least one project of medium to high complexity. Your expertise with Google Cloud Platform services, especially BigQuery, Dataform, and Dataplex, will be crucial in this role. Additionally, your exceptional communication skills will enable you to effectively collaborate with Data Engineers, Technology, and Business leadership. Key Responsibilities: - Lead Data Engineer teams in developing data processing pipelines on Google Cloud - Migrate ETL pipelines ...

As a Data Modeler/Solution Designer at MetLife, your primary responsibility will be to design, build data models, and oversee the implementation of data pipelines on the Snowflake data platform (DAX). You will collaborate with Snowflake, Erwin, and Matillion to develop scalable and efficient data pipelines that align with the business needs. A strong understanding of data modeling principles is crucial for building robust data pipelines based on the Data Architecture, along with familiarity with DevOps models, CI/CD workflows, and best practices. **Key Responsibilities:** - Develop and deliver Conceptual/Logical/Physical data models. - Develop data mappings and transformation rules document....

As an experienced Graph Database Data Engineer, you will be responsible for designing and building cutting-edge data solutions. Your role will involve designing, implementing, and maintaining graph database solutions. You will play a crucial role in building robust data pipelines, ensuring data quality, and optimizing query performance. It is essential to have a deep understanding of Graph Database Architecture, Data Structures, and Operations. You should also have expertise in graph query languages such as SPARQL and Gremlin, along with proven experience with AWS Neptune. Key Responsibilities: - Design, implement, and maintain graph database solutions. - Build robust data pipelines and ensu...

Job Title: Azure Data Engineer Job Summary: We're seeking a skilled Azure Data Engineer to join our team, leveraging expertise in Databricks, Data Factory, and SQL to design and implement data solutions. Key Responsibilities: - Design and implement data pipelines using Azure Data Factory and Databricks - Develop and maintain data architectures on Azure - Analyze data using SQL and Databricks to inform business decisions - Collaborate with cross-functional teams to understand business requirements - Optimize data solutions for performance, scalability, and cost-effectiveness Requirements: - Strong knowledge of Azure data services (e.g., Data Factory, Databricks, Synapse) - Proficiency in SQL ...

Job Title: Azure Data Engineer Job Summary: We're seeking a skilled Azure Data Engineer to join our team, leveraging expertise in Databricks, Data Factory, and SQL to design and implement data solutions. Key Responsibilities: - Design and implement data pipelines using Azure Data Factory and Databricks - Develop and maintain data architectures on Azure - Analyze data using SQL and Databricks to inform business decisions - Collaborate with cross-functional teams to understand business requirements - Optimize data solutions for performance, scalability, and cost-effectiveness Requirements: - Strong knowledge of Azure data services (e.g., Data Factory, Databricks, Synapse) - Proficiency in SQL ...

Job Title: Azure Data Engineer Job Summary: We're seeking a skilled Azure Data Engineer to join our team, leveraging expertise in Databricks, Data Factory, and SQL to design and implement data solutions. Key Responsibilities: - Design and implement data pipelines using Azure Data Factory and Databricks - Develop and maintain data architectures on Azure - Analyze data using SQL and Databricks to inform business decisions - Collaborate with cross-functional teams to understand business requirements - Optimize data solutions for performance, scalability, and cost-effectiveness Requirements: - Strong knowledge of Azure data services (e.g., Data Factory, Databricks, Synapse) - Proficiency in SQL ...

Job Title: Azure Data Engineer Job Summary: We're seeking a skilled Azure Data Engineer to join our team, leveraging expertise in Databricks, Data Factory, and SQL to design and implement data solutions. Key Responsibilities: - Design and implement data pipelines using Azure Data Factory and Databricks - Develop and maintain data architectures on Azure - Analyze data using SQL and Databricks to inform business decisions - Collaborate with cross-functional teams to understand business requirements - Optimize data solutions for performance, scalability, and cost-effectiveness Requirements: - Strong knowledge of Azure data services (e.g., Data Factory, Databricks, Synapse) - Proficiency in SQL ...

Job Title: Azure Data Engineer Job Summary: We're seeking a skilled Azure Data Engineer to join our team, leveraging expertise in Databricks, Data Factory, and SQL to design and implement data solutions. Key Responsibilities: - Design and implement data pipelines using Azure Data Factory and Databricks - Develop and maintain data architectures on Azure - Analyze data using SQL and Databricks to inform business decisions - Collaborate with cross-functional teams to understand business requirements - Optimize data solutions for performance, scalability, and cost-effectiveness Requirements: - Strong knowledge of Azure data services (e.g., Data Factory, Databricks, Synapse) - Proficiency in SQL ...

Job Title: Azure Data Engineer Job Summary: We're seeking a skilled Azure Data Engineer to join our team, leveraging expertise in Databricks, Data Factory, and SQL to design and implement data solutions. Key Responsibilities: - Design and implement data pipelines using Azure Data Factory and Databricks - Develop and maintain data architectures on Azure - Analyze data using SQL and Databricks to inform business decisions - Collaborate with cross-functional teams to understand business requirements - Optimize data solutions for performance, scalability, and cost-effectiveness Requirements: - Strong knowledge of Azure data services (e.g., Data Factory, Databricks, Synapse) - Proficiency in SQL ...

Data Engineer with below skills and experience 8 Years of experience in any 2 of the below skills AWS DevOps CICD Jenkins GitHub Show a good understanding of cloud infrastructure best practices Experience range 5 to 7 years Mandatory skills- AWS DevOps,Terraforms,CICD,Jenkins,GitHub

* Provide expertise in analysis, requirements gathering, design, coordination, customization, testing and support of reports, in client’s environment * Develop and maintain a strong working relationship with business and technical members of the team * Relentless focus on quality and continuous improvement * Perform root cause analysis of reports issues * Development / evolutionary maintenance of the environment, performance, capability and availability. * Assisting in defining technical requirements and developing solutions * Effective content and source-code management, troubleshooting and debugging. Required education Bachelor's Degree Preferred education Master's Degree Required technica...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform * Responsibilities: * Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS * Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform * Experience in d...

Role Description As a Senior Cloud Data Platform (Azure) Engineer at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics. You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the se...

Role Description As a Technical Lead - Cloud Data Platform (Azure) at Incedo, you will be responsible for managing and optimizing the Microsoft Azure environment, ensuring its performance, scalability, and security. You will work closely with data analysts and data scientists to develop data pipelines and run data science experiments. You will be skilled in cloud computing platforms such as AWS or GCP and have experience with data warehousing technologies such as Azure Synapse Analytics. You will be responsible for configuring and optimizing the Azure environment, ensuring that data pipelines are efficient and accurate, and troubleshooting any issues that arise. You will also work with the s...

Role & responsibilities Experience :- 6 + Experience At least 5 years of experience in AWS based projects. Technical skills Proficiency in Python and PySpark for data engineering tasks. Big Data Strong knowledge of Big Data technologies and data warehousing concepts. AWS services Experience with AWS Data Engineering stack, including S3, RDS, Athena, Glue, Lambda, and Step Functions. SQL Strong SQL skills for data manipulation and querying. CI CD Experience with CI CD tools like Terraform and Git Actions. Soft skills Good communication skills and ability to work in a multicultural team.

Roles and Responsibilities : Design, develop, test, deploy and maintain large-scale data pipelines using Python and SQL. Collaborate with cross-functional teams to gather requirements and deliver high-quality data solutions. Ensure scalability, reliability, and performance of the data infrastructure on AWS cloud platform. Troubleshoot complex issues related to data processing, storage, and retrieval. Job Requirements : 5-8 years of experience in Data Engineering with expertise in Python programming language. Strong understanding of SQL database management systems (e.g., MySQL) for querying large datasets. Proficiency in developing ETL processes using Python libraries like Pandas, NumPy, etc.

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Dataiku Data Science Studio (DSS), Google Cloud Platform Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will develop custom software solutions that involve designing, coding, and enhancing components across various sy...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Cloud Data Migration, Google BigQuery, Data Building Tool Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data ...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure DevOps Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality,...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : PySpark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Python (Programming Language) Good to have skills : Google Cloud Platform Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in the development of custom software solutions that involve designing, coding, and enhancing various components across systems or appli...