14177 Data Engineering Jobs - Page 39

Job Summary We are looking for a skilled data engineer with hands on experience in DBT and Snowflake to build and maintain scalable data pipelines and models. The role involves working closely with analytics and business teams to transform raw data into clean reliable datasets for reporting and decision making. Responsibilities Develop and manage data transformation workflows using DBT Design and optimize data models in Snowflake Collaborate with stakeholders to understand data requirements Ensure data quality and consistency across pipelines Monitor and troubleshoot data jobs and performance issues Maintain documentation for data processes and models Strong knowledge of DBT and Snowflake Pr...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education Bachel...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Role Purpose The purpose of this role is to interpret data and turn into information (reports, dashboards, interactive visualizations etc) which can offer ways to improve a business, thus affecting business decisions. Do 1. Managing the technical scope of the project in line with the requirements at all stages a. Gather information from various sources (data warehouses, database, data integration and modelling) and interpret patterns and trends b. Develop record management process and policies c. Build and maintain relationships at all levels within the client base and understand their requirements. d. Providing sales data, proposals, data insights and account reviews to the client base e. I...

Job Purpose Responsible for all Risk related data reporting to Senior Management Team and MD’s office. This position is also responsible for running a robust Daily Pre-approved Offer generation process, campaign control and governance process that would enable excellence in campaign execution and display of Pre-approved offers in the 3in1 App which is a key strategy of the Company. Responsible for creating and implementing Auth BRE process which will be common across all offers generated by campaign governance process or generated online based on customer’s inputs to reduce difference in two processes of offer generation. Enabling all the Risk team with daily/weekly/monthly data with automat...

Job Purpose We are seeking a skilled Data Engineer who can work independently on data pipeline development, troubleshooting, and optimisation tasks. The ideal candidate will have strong SQL skills, hands-on experience with Databricks, and familiarity with cloud platforms such as AWS and Azure. You will be responsible for building and maintaining reliable data workflows, supporting analytical teams, and ensuring high-quality, secure, and accessible data across the organisation. Duties and Responsibilities Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL/ELT workflows. Build, optimise, and troubleshoot SQL queries, transformations, and Databricks data processe...

Position Summary Data Engineer with strong expertise in building scalable data pipelines and solutions using PySpark, SQL, and AWS. The ideal candidate will have hands-on experience in designing, developing, and optimizing data workflows to enable high-quality, reliable, and timely data delivery for business use cases. Job Responsibilities Design, develop, and maintain data pipelines and ETL workflows using PySpark and SQL. Work with large-scale datasets to ensure data accuracy, consistency, and quality. Implement and manage data solutions on AWS Cloud services (e.g., S3, Glue, EMR, Redshift, Lambda). Collaborate with Business Analysts and business stakeholders to understand requirements and...

Position Summary Highly skilled GenAI Application Leader with 15+ years of total experience who can drive the design, development, testing, and deployment of Generative AIbased applications focused on Data and Analytics in Life Sciences domain . The ideal candidate will have a strong background in Python, RAG, knowledge graphs, Gen AI/LLM frameworks (LangChain, LangGraph), AWS/Azure cloud services with hands-on experience integrating and fine-tuning GPT, Anthropic Claude, Mistral, or Snowflake Cortex for real-world business use cases. Strong client problem-solving skills across life sciences data and analytics is a plus. This role bridges AI engineering, data analytics, and full-stack develo...

Your Role Design Architecture & Solution End-to-end solution design and user experience expertise and Demonstrated ability to analyze requirements and recommend multiple, well-structured solution designs aligned with business objectives Azure AI Strong experience with Azure AI services and Azure AI Foundry Agentic AI Proficiency in Copilot Studio for building agentic workflows and automation and Expertise in prompt engineering Your Profile Data Engineering Expertise in Microsoft Fabric and Databricks Strong command of SQL and PySpark for data processing and transformation Data Science Familiarity with model creation, training, and evaluation Understanding of statistical methods and machine l...

We are hiring an AWS + Elasticsearch Data Engineer with strong experience in building scalable data pipelines and transformations. The role involves working on Medallion-style architecture , ETL frameworks , and DBT-based modeling to deliver analytics-ready datasets. You will collaborate with business teams as a technical advisor , so strong communication skills are essential. Key Responsibilities Design and manage data pipelines using AWS services (S3, Lambda, Glue) and orchestration tools. Implement Elasticsearch (ELK stack) for data indexing, query optimization, and cluster management. Develop ETL workflows and automate transformations using DBT . Apply data modeling and governance best p...

Data Engineer Pyspark Expertise in Data Architecture, Data Strategy and Roadmap for large and complex organization and systems and implemented large scale end-to-end Data Management & Analytics solutions Experience in transforming traditional Data Warehousing approaches to Big Data based approaches and proven track record of managing risks and data security Expertise with DW Dimensional modeling techniques, Star & Snowflake schemas, modeling slowly changing dimensions and role playing dimensions, dimensional hierarchies, and data classification Experiences in cloud native principals, designs and deployments. Extensive experience working with and enhancing Continuous Integration (CI) and Cont...

As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the clients needs. Your primary responsibilities include: * Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements. * Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. * Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too. Required education ...

Responsibilities: Hands-on MS SQL, ETL , SSIS Hands-on experience on cloud side and migration exp from AWS and GCP Hands -on experience cloud data platform: Snowflake MS SQL Server, SQLServer Performance Tuning, ANSI SQL, SQL Server,Data Modeling, ETL,CI & CD

Dear Candidates, Greetings from TCS!!!! TCS is looking for Google Data Engineer Experience: 3-5 years Mode of interview: Face-to-face Date of interview: 20/12/2025 Location: Hyderabad: Synergy Park (Non-SEZ) Campus, TCS Synergy Park, Indian Immunological Colony, Gachibowli, Hyderabad Chennai: Chennai Drive Location: TCS SNR-Kumaran Nagar, 415/21-24, TNHB Main Rd, Chennai, Tamil Nadu 600119 Job description: Experience Experience level of 3 to 5 years in data engineering, data warehousing, or a related field. Experience with dashboarding tools like plx dashboard and looker studio Experience with building data pipelines, reports, best practices and frameworks. Experience with design and develop...

What you will do In this vital role you will be responsible for the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Data Engineer, you will play a crucial role in building and optimizing our data pipelines and platforms in a SAFE Agile product team. Roles & Responsibilities: Chip into the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions. Deliver for data pipeline projects from development to deployment, managing, timelines, and risks. Ensure data quality and integrity through meticulous testing and monitoring. Levera...

Overview ML Engineering team leads AI/ML deployments across Mastercard platforms. The team is responsible for planning the implementation of solutions, choosing the right technologies, and evaluating the evolution of the architecture as the needs change. For this team, MasterCard is seeking a Senior Data Engineer who is passionate about implementation of AI/ML assets across platform (on premise, on cloud, hybrid). The person would be working closely with Program Team as well as Data Science team. Technical & Other Skills 5+ years of working experience in scalable data pipeline using sparkSQL, Kafka, Nifi, Big data technologies. Experience of working with Databases like Oracle, Netezza and ha...

What you will do In this vital role you will work closely with data engineers, architects, and product owners to understand the applications being built. The role will be responsible for developing test automation scripts, develop reusable common components for testing, develop load and scalability test scripts, analyze production issues and develop innovative automation for early detection and prevention of those issues, or for self-healing. Roles & Responsibilities: Design, develop, and maintain automated test scripts for data pipelines, ETL jobs, and data integrations. Validate data accuracy, completeness, transformations, and integrity across multiple systems. Collaborate with data engin...

Description: We are seeking a highly skilled Python Data Engineer to design, build, and maintain scalable data pipelines and analytics solutions. The ideal candidate will have strong proficiency in Python, Pandas, NumPy, and AWS, along with hands-on experience in processing large datasets and optimizing data workflows in cloud environments. Requirements: Required Skills & Qualifications Proficient experience in Python for data engineering and backend processing Strong hands-on experience with Pandas and NumPy for data manipulation and analysis Solid experience with AWS, including services such as: S3 EC2 Lambda Glue Redshift / Athena Experience building and maintaining ETL pipelines Strong u...

Axtria: -Axtria is a global provider of award-winning cloud software and data analytics to the life sciences industry. Axtria enables life sciences organizations to transform the product commercialization journey and deliver much-improved healthcare outcomes for patients worldwide. We are acutely aware that our work impacts millions of people and are incredibly passionate about the improvement we can bring to patients lives. Our focus is on delivering solutions that help pharmaceutical, medical device, and diagnostics companies complete the journey from data to insights to action and get superior returns from their investments. As a participant of the United Nations Global Compact, Axtria is...

Job Summary We are looking for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing building and maintaining scalable data infrastructure that drives business intelligence advanced analytics and machine learning initiatives. You must be comfortable working autonomously navigating complex challenges and driving projects to successful completion in a dynamic cloud environment. Responsibilities Cloud Platform Expertise (GCP Focus): Extensive hands-on experience working in dynamic cloud environments with a strong preference for Google Cloud Platform (GCP) services specifically: BigQuery: Expert-level skills in data ingestion perform...

Data Scientist/GenAI Engineer Team: AWS Data Engineering Location: BGIL,Pune Job Description : We are actively seeking a highly skilled and accomplished Senior Data Scientist with a minimum of 3 years of experience. The ideal candidate should have deep understanding in designing and developing applications based on Large Language Models (LLMs). A deep understanding of foundational models, frameworks, and techniques is crucial for success in this role, apply innovative solutions to complex problems. Additionally, expertise in working within cloud computing environments to deploy and manage machine learning models is essential. Key Responsibilities: Design, develop, and implement state-of-the-...

Develop and implement tools and processes to streamline data resolution paths and prevent reoccurrence. Collaborate with internal teams to ensure single source of truth for all data and drive data standardization and harmonization. Optimize and automate current portfolio of tools to provide accurate and timely data in a usable format. Ensure foundational data and data models are at high quality for completeness, timeliness, and accuracy by developing proactive data cleansing processes. Translate and enhance business requirements into timely validated deliverables adhering to governance policies. Participate in key projects as assigned by leadership. Disclaimer: This job description has been ...