14177 Data Engineering Jobs - Page 34

About The Role Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client que...

Job Purpose and Impact The Senior Professional, Data Engineering job designs, builds and maintains complex data systems that enable data analysis and reporting. With minimal supervision, this job ensures that large sets of data are efficiently processed and made accessible for decision making. Key Accountabilities DATA INFRASTRUCTURE: Prepares data infrastructure to support the efficient storage and retrieval of data. DATA FORMATS: Examines and resolves appropriate data formats to improve data usability and accessibility across the organization. DATA & ANALYTICAL SOLUTIONS: Develops complex data products and solutions using advanced engineering and cloud based technologies, ensuring they are...

ETL/ELT, data warehousing, cloud data platforms, governance, and data quality. platforms/tools such as ETL, data engineering, data warehousing, governance, and cloud transformation, Data bricks, Data analytics and Azure data pipeline

Role & responsibilities Understand the business requirements for analytics and data interpretation Understands requirements and is involved in the discussions relating to technical and functional design of the sprint/ module/project Design and implement end-to-end data solutions (storage, integration, processing, visualization) in Azure. Used various sources to ingest data into Azure Data Lake Storage (ADLS) such as SQL Server, Excel, Oracle, SQL Azure etc. Extract data from one database and load it into another Build data architecture for ingestion, processing, and surfacing of data for large-scale applications Use many different scripting languages, understanding the nuances and benefits o...

Overview Key Responsibilities Architectural Vision & Strategy: Design and own the end-to-end architecture for our data platform, encompassing data ingestion, processing, storage, and consumption layers System Design: Create detailed architectural diagrams, design documents, and technical specifications for new platform capabilities Define the standards for how services interact Technology Evaluation & Governance: Research, evaluate, and prototype new technologies (e. g,table formats, query engines, streaming platforms) Establish and govern technical standards and bestpractices across all data engineering teams Cross-Functional Leadership: Collaborate with engineering leaders, product manager...

Role Description: Medical Data Scientist will play a vital role in supporting Global Medical Affairs by contributing to the design and deployment of data science solutions including advanced statistical methods, predictive modeling, and machine learning to deliver meaningful, data-driven insights that inform scientific engagement, strategic decision-making, and patient-focused strategies. As a key member of the Medical Data & Analytics (MDnA) team, you will analyze and translate structured and unstructured data into actionable intelligence to inform medical strategy and improve patient outcomes. This is a hands-on, technical role that requires strong analytical ability and problem-solving sk...

What you will do Role Description: We are seeking a Data Solutions Architect with deep R&D expertise in Biotech/Pharma to design, implement, and optimize scalable and high-performance data solutions that support enterprise analytics, AI-driven insights, and digital transformation initiatives. This role will focus on data strategy, architecture, governance, security, and operational efficiency, ensuring seamless data integration across modern cloud platforms. The ideal candidate will work closely with R&D and engineering teams, business stakeholders, and leadership to establish a future-ready data ecosystem, balancing performance, cost-efficiency, security, and usability. This position requir...

Design and implement scalable data pipelines using Microsoft Fabric, Azure Data Factory, Dataflows, and Spark SQL Develop robust ETL processes to extract, transform, and load data from diverse sources into Lakehouse using Microsoft Fabric Optimize SQL queries and data models for performance and scalability Collaborate with data analysts, scientists, and business stakeholders to deliver clean, reliable, and well-documented datasets Monitor and troubleshoot data workflows, ensuring high availability and performance Ensure data security, compliance, and governance across all data engineering processes Participate in Agile development cycles and contribute to architectural decisions

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Google BigQuery Good to have skills : Oracle Procedural Language Extensions to SQL (PLSQL), Data Engineering, Google Cloud Platform Architecture Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Python (Programming Language), Microsoft SQL Server, Databricks Unified Data Analytics Platform, PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processin...

Job Title: Senior Data Engineer Experience: 6+ Years Skills: Python, Spark, Azure Required Skills & Experience 5+ years of hands-on experience in Data Engineering . Strong working knowledge of the Azure ecosystem , including: Azure Databricks Azure Data Lake Storage (ADLS) Azure Functions Azure Data Factory (optional but preferred) Strong expertise in Apache Spark with Python (PySpark) . Advanced SQL skills, including query optimization. Strong understanding of ETL/ELT methodologies and data warehousing concepts . Experience with Delta Lake , including schema evolution, ACID transactions, and time travel. Experience working with PostgreSQL or similar relational databases. Strong problem-solv...

Job Title: Senior Data Engineer - Azure & Databricks Overview We are seeking a highly skilled Senior Data Engineer with 5+ years of hands-on experience in building scalable, high-performance data solutions within the Azure ecosystem . The ideal candidate will have strong expertise in Databricks, Apache Spark (Java), modern data lake architectures , and end-to-end ETL pipeline development. This role involves designing, developing, and optimizing data systems that support business-critical analytics and operational use cases. Key Responsibilities Design, develop, and maintain scalable data pipelines using Azure services and Databricks. Build efficient data ingestion and transformation workflow...

Job Title: Senior Data Engineer Experience: 6+ Years Key Responsibilities Design, develop, and maintain scalable and reliable data pipelines using Azure services and Databricks . Build efficient data ingestion and transformation workflows using Databricks, PySpark, and Delta Lake . Develop, optimize, and maintain ETL/ELT pipelines using Python and SQL . Implement best practices for data modeling, data quality, governance, and performance optimization . Work with relational and lakehouse databases , including PostgreSQL and Delta Lake . Monitor, support, and troubleshoot production data pipelines . Collaborate with cross-functional teams including product, analytics, and engineering stakehold...

We are seeking a skilled Oracle, MS Access Developer with at least 2+ years of experience to join our team. The ideal candidate will be responsible for designing, developing, and maintaining MS Access databases and applications. The role involves collaborating with various stakeholders to understand requirements, optimize database performance, and ensure data integrity and security. Key Responsibilities: Design, develop, and maintain Oracle, and MS Access databases and applications. Create and manage tables, queries, forms, and reports in MS Access. Develop and implement VBA (Visual Basic for Applications) code to automate tasks and enhance database functionality. Optimize database performan...

Job Title: Python Specialist Data Engineer Experience Level: 58 Years Employment Type: Full-Time Location: Chennai Notice period : Immediate to 15days joiners Shift time : 1 to 10pm -5days office in week Interview process: L1 or L2- F2F interview client interview Job Summary: We are looking for a skilled Data Engineer with strong expertise in Python programming and hands-on experience with Azure Data Services , including Synapse , Data Lake , App Logic , and DevOps integration . The ideal candidate will have a strong understanding of data warehousing , MS SQL/PLSQL , and building scalable data pipelines and solutions on the cloud. Key Responsibilities: Develop and optimize scalable data pipe...

About Zywave Zywave is a global leader in building market-leading SaaS products that transform and disrupt the insurance industry. With our innovative solutions, we empower brokers and agencies with cutting-edge tools for client engagement, analytics, and growth. Our culture thrives on innovation, collaboration, and continuous improvement, and we are expanding our Product Development team to drive our next wave of growth. Job Title: Senior Software Engineer – Data Platform Location : Pune, India Work Mode: Hybrid Experience: 5 –10 years Company: Zywave About the Role Zywave is looking for a highly skilled Senior Software Engineer (Data Platform) to join our Data Engineering team. In this rol...

Looking to onboard a skilled professional with 8-16 years of experience in the field, located anywhere in India. Roles and Responsibility Design and develop scalable data pipelines using Google Data Products such as Cloud Data Fusion, BigQuery, Dataflow, Dataproc, AI Building Blocks, Looker, Dataprep, etc. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data engineering solutions using E2E Data Engineering and Lifecycle management techniques. Ensure data quality and metadata management through effective MDM tools. Implement data visualization literacy for business insights. Participate in prototyping, usability testing...

Migrate Hive/Impala tables and associated metadata to Databricks Delta tables. Re-engineer ingestion pipelines from Cloudera to Databricks using PySpark. Convert transformation logic from HiveQL/Impala SQL to PySpark. Optimize data workflows for performance and scalability in Databricks. Implement best practices for data governance, security, and compliance on AWS.

Design scalable and secure data architecture on Databricks and AWS by working alongside the architect. Lead a team of data engineers and provide technical guidance. Oversee table migration from Hive/Impala tables to Delta Tables. Oversee conversion of HiveQL/Impala-based transformations to PySpark. Ensure adherence to best practices for performance, security, and cost optimization. Collaborate with stakeholders to define requirements and deliverables. Conduct code reviews, troubleshoot issues, and mentor team members.

Roles and Responsibility Design, develop, and implement data pipelines and architectures to support business intelligence and analytics. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and infrastructure. Ensure data quality, integrity, and security through data validation and testing procedures. Optimize data processing workflows to improve performance and efficiency. Participate in code reviews and contribute to the improvement of the overall codebase. Job Requirements Strong understanding of data engineering principles and practices. Experience with data modeling, data warehousing, and ETL processes. Pr...

Responsibilities: designing, developing, and maintaining scalable data pipelines using Databricks, PySpark, Spark SQL, and Delta Live Tables. Collaborate with cross-functional teams to understand data requirements and translate them into efficient data models and pipelines. Implement best practices for data engineering, including data quality, and data security. Optimize and troubleshoot complex data workflows to ensure high performance and reliability. Develop and maintain documentation for data engineering processes and solutions. Requirements: Bachelor's or Master's degree. Proven experience as a Data Engineer, with a focus on Databricks, PySpark, Spark SQL, and Delta Live Tables. Strong ...

Greetings of the day!! My name is Arumugam Veera, and I'm reaching out to you regarding an exciting opportunity with TechMango. You can connect with me on LinkedIn https://www.linkedin.com/in/arumugamv/ About Techmango At Techmango, we believe that true transformation happens at the intersection of deep engineering and business intelligence. For over 15 years, we have operated as a Gold Standard Service Provider, delivering over 350+ engineering solutions that help global organizations scale with resilience. We are a team of 260+ technical experts who do more than just write codewe build with purpose. Our philosophy is simple: Impact grows when strategy aligns with execution.If you are looki...

We are looking for a highly skilled Data Engineer with expertise in Snowflake and ETL to join our team at IDESLABS PRIVATE LIMITED. The ideal candidate will have a strong background in data engineering and experience working with large datasets. Roles and Responsibility Design, develop, and implement data pipelines using Snowflake and ETL tools. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain databases and data systems to support business intelligence and analytics. Ensure data quality and integrity by implementing data validation and testing procedures. Optimize data processing workflows to improve performance and efficiency. Tro...

Extensive experience with Google Data Products (Cloud Data Fusion,BigQuery, Dataflow, Dataproc, AI Building Blocks, Looker, Dataprep, etc.). Expertise inCloud Data Fusion,BigQuery & Dataproc Experience in MDM, Metadata Management, Data Quality and Data Lineage tools. E2E Data Engineering and Lifecycle (including non-functional requirements and operations) management. Experience with SQL and NoSQL modern data stores. E2E Solution Design skills - Prototyping, Usability testing and data visualization literacy. Excellent knowledge of the software development life cycle

We are looking for a highly skilled, hands on and self motivated system integrator to join us as consultant and work on the data center migration efforts for our electronic finance systems. The role will perform hands on system migration work to seamless relocate our sophisticated, large scale finance systems to the new data center in Asia region. The ideal candidate is expected to have hands on experience of system migration, deployment under UNIX/Linux environment, with excellent communication skills. By performing the role, the candidate will have the opportunity to operate on the large scale electronic financial systems by working with cross Asia region teams. The responsibilities of thi...