2084 Data Engineer Jobs - Page 15

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Spark Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time educationBTech or MTech or MCA with IT or CSE or EEE or ECE Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creatin...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse Good to have skills : Data Engineering, Databricks Unified Data Analytics Platform Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day wi...

We are looking for a Data Engineer with a passion for Coding. Job Description: 2-3 years of relevant work experience To work in the capacity of AWS Databricks, Python, PySpark Hands-On developer Work with stakeholders for regular updates, requirement understanding, and design discussions. Hands-on experience in designing and developing scripts for custom ETL processes and automation in AWS, data bricks, Python, PySpark, etc. Should be skilled in creating architecture and design documentation, and have knowledge of data engineering tools & technologies Expertise in Cloud-related Big Data integration and infrastructure Tech stack using Databricks & Apache Spark framework Well-versed with scrip...

The Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large datasets. Qualifications:- Data Engineering and Data Modeling skills Experience with Extract, Transform, Load (ETL) pipelines Expertise in implementing data warehousing solutions Analytical skills for performing data analytics on large datasets Strong programming skills in languages like Python, Java, or Scala Experience with Big Data and cloud-based technologies like Hadoop, Spark, and AWS Understanding of data governance and security principl...

Lead Data Engineer - (Datawarehouse) - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow Overview Mastercard is looking for a Lead Software Engineer to join the Account Level Management(ALM) team in our Pune office thats focused on building ALM Services with Data warehouse skills The Mastercard Account Level Management platform empowers real-time card level decisioning As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend. Skill Requirements: MUST Technical 8-12 ...

Design, architect, and implement scalable data solutions on Google Cloud Platform (GCP) to meet the strategic data needs of the organization. Lead the integration of diverse data sources into a unified data platform, ensuring seamless data flow and accessibility across the organization. Develop and enforce robust data governance, security, and compliance frameworks tailored to GCP's architecture. Collaborate with cross-functional teams, including data engineers, data scientists, and business stakeholders, to translate business requirements into technical data solutions. Optimize data storage, processing, and analytics solutions using GCP services such as BigQuery, Dataflow, and Cloud Storage...

Job Overview The Senior Software Engineer will do the design, development, and delivery of advanced big data solutions within the Hadoop ecosystem. This role involves architecting and implementing scalable data processing frameworks, ensuring high performance and reliability across distributed systems. The engineer will research and evaluate emerging technologies to optimize data workflows and meet evolving business needs. Additionally, the position requires hands-on expertise in Cloudera distribution and related tools, ensuring seamless orchestration and integration of data pipelines. The Senior Software Engineer will also be responsible for maintaining operational excellence, meeting SLA r...

What You''ll Do You will be part of our Data Platform & Product Insights data engineering team. As part of this agile team, you will work in our cloud native environment to Build & support data ingestion and processing pipelines in cloud. This will entail extraction, load and transformation of big data from a wide variety of sources, both batch & streaming, using latest data frameworks and technologies Partner with product team to assemble large, complex data sets that meet functional and non-functional business requirements, ensure build out of Data Dictionaries/Data Catalogue and detailed documentation and knowledge around these data assets, metrics and KPIs. Warehouse this data, build dat...

Role Description : As a Senior Big Data Platform Engineer at Incedo, you will be responsible for designing and implementing big data platforms to support large-scale data integration projects. You will work with data architects and data engineers to define the platform architecture and build the necessary infrastructure. You will be skilled in big data technologies such as Hadoop, Spark, and Kafka and have experience in cloud computing platforms such as AWS or Azure. You will be responsible for ensuring the performance, scalability, and security of the big data platform and troubleshooting any issues that arise. Roles & Responsibilities: Designing, developing and maintaining large-scale big ...

Overall 5+ years of experience with software development. Excellent on Scala/Spark cloudera development. Experience in writing SQL queries. Excellent problem solving Nice to have : Python Mandatory Competencies Programming Language - Scala - Scala Big Data - Big Data - SPARK Beh - Communication Database - Database Programming - SQL Big Data - Big Data - Cloudera

Title and Summary The Software Engineer II will contribute to the design, development, and maintenance of big data solutions within the Hadoop ecosystem The role involves working with distributed data processing frameworks and supporting the creation of reliable, high-performance data pipelines The engineer will be responsible for hands-on development and troubleshooting using the Cloudera distribution, along with related ecosystem tools such as Apache Ozone, Apache Iceberg, Apache Airflow, and Apache NiFi The position requires hands on experience in Apache Spark to support large-scale, massively parallel data processing tasks The Software Engineer II will collaborate closely with senior tea...

Title and Summary Data Engineer II-2Who is Mastercard? Overview Technical Implementation team is part of MasterCard Data & Services group and one of the most rapidly growing organization in the space D&S Technology Teams provides analytic software tools that enable large, consumer-focused businesses to seize the Big Data analytics opportunity by triangulating between business strategy, algorithmic math, and large databases to improve decisions The Delivery Engineering Platform team is a core component to consulting services, managing the data acquisition, integration and transformation of client provided data within the Test & Learn platform for global engagements Role The Data Engineer will...

Your Impact As a Software Data Engineer, you will invent, build, and optimize real-time data pipelines and ETL/ELT workflows using AWS services and Amazon Redshift. Youll ensure our data infrastructure is reliable, scalable, and high performing to support business analytics. Key responsibilities include developing and automating data pipelines, optimizing data models and Redshift schemas, managing AWS data lakes and warehouses, and championing data quality, security, and best practices. Youll also collaborate across teams and mentor others to foster a culture of innovation and excellence. Minimum Qualifications (Required) 8+ years of experience in data engineering, with a focus on AWS cloud-...

Summary We are looking for a Data Engineer to join the Data Engineer team. This is a pivotal role, responsible for supporting multiple Data Analysts and Data Scientists day-to-day and assisting various data-driven requests across the company. The position involves a wide variety of technical skills, from coding to infrastructure, from data analysis to database management. The ideal candidate will have experience working with large-scale data and building automated data ETL processes for large-scale data analysis. ODS or data warehousing experience would be ideal. Key responsibilities include: Designing, implementing, and maintaining the tooling and infrastructure that enables our Analysts an...

Design,architect, and implement scalable data solutions on Google Cloud Platform (GCP)to meet the strategic data needs of the organization. Leadthe integration of diverse data sources into a unified data platform, ensuringseamless data flow and accessibility across the organization. Developand enforce robust data governance, security, and compliance frameworkstailored to GCP's architecture. Collaboratewith cross-functional teams, including data engineers, data scientists, andbusiness stakeholders, to translate business requirements into technical datasolutions. Optimizedata storage, processing, and analytics solutions using GCP services such asBigQuery, Dataflow, and Cloud Storage. Drivethe ...

Job Summary: We are looking for a highly experienced Senior Lead Data Engineer / Architect specializing in Snowflake data warehousing, with strong skills in Power BI. The ideal candidate will have 8-14 years of experience in data engineering and analytics, with proven leadership in designing, implementing, and optimizing large-scale Snowflake architectures and developing high-impact business intelligence solutions using Power BI. Key Responsibilities: Lead the end-to-end architecture, design, and implementation of enterprise-grade data solutions on Snowflake. Build and maintain complex data pipelines and advanced ETL/ELT frameworks, leveraging Snowflakes native features for scalability and p...

Job Title Sr.Azure Data Engineer | Hyderabad Job Description Summary Cushman & Wakefield is seeking a motivated Azure Data Engineer to join the Data Engineering & Analytics team. In this early-career role, you will support the design, development, and optimization of data pipelines on Azure to drive key business initiatives. Working under the guidance of senior engineers and architects, youll gain hands-on experience with modern data tools while contributing to high-impact, enterprise-scale projects. This is an excellent opportunity for professionals eager to grow their skills in a collaborative, client-centric environment that values innovation and data-driven decision-making. Job Descripti...

Project description We are seeking a skilled and domain-expert Machine Learning Engineer to develop and deploy data-driven solutions in the context of Digital Oilfield (DOF) systems. The ideal candidate will have a strong foundation in machine learning, model development, and data analytics, with the ability to apply these skills to subsurface and production engineering workflows.This is a hands-on technical role focused on building ML models that enhance forecasting, optimization, and operational decision-making across complex oilfield environments. Experience with agent-based or generative AI systems is a bonus, but not a requirement. Responsibilities Develop and maintain machine learning ...

Role Description Job Summary: We are looking for a skilled Data Engineer with strong expertise in Python programming and hands-on experience with Azure Data Services , including Synapse , Data Lake , App Logic , and DevOps integration . The ideal candidate will have a strong understanding of data warehousing , MS SQL/PLSQL , and building scalable data pipelines and solutions on the cloud. Key Responsibilities: Develop and optimize scalable data pipelines using Python and Azure Data Services .Design and implement end-to-end data solutions using Azure Synapse Analytics , Data Lake , and Azure Logic Apps .Build and maintain efficient data models, transformations, and workflows supporting busine...

Overall 5+ years of experience with software development. Excellent on Scala/Spark Cloudera development. Experience in writing SQL queries. Excellent problem solving Nice to have : Python Mandatory Competencies Programming Language - Scala - Scala Big Data - Big Data - SPARK Beh - Communication Database - Database Programming - SQL Big Data - Big Data - Cloudera

Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation. Job Description Solid experience, knowledge and skills in Data Engineering, BI/software development such as ELT/ETL, data extraction and manipulation in Data Lake/Data Warehouse environment. Proven experience in data modelling, analysis, and profiling. Experience of working in diverse data domains. Continuous improvement and performance optimisation practice ensuring high levels of performance, availability and integrity. Proven consulting and mentoring experience. Experience in working within an Agile environment. Experience in applying DevOps practices, SDLC, CI/CD principles to build automated pip...

What you will do: In this vital role you will be responsible for designing, developing, and maintaining software applications and solutions that meet business needs and ensuring the availability and performance of critical systems and applications. This role involves working closely with product owners, designers, data engineers, and other engineers to create high-quality, scalable software solutions and automating operations, monitoring system health, and responding to incidents to minimize downtime. Possesses strong rapid prototyping skills and can quickly translate concepts into working code Contribute to both front-end and back-end development using cloud technology Develop innovative so...

Company:MNC Domain:Data Engineer Experience:5+ years Package:Open package Upto 20LPA Qualification:Any Degree Location:Hyderabad Good Communication Skills Mandatory Hybrid Mode

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : AWS Analytics Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implem...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensu...