14139 Data Engineering Jobs - Page 29

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Microsoft Azure PaaS Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will engage in the development of custom software solutions that involve designing, coding, and enhancing various components across systems or applications. Your typical day wi...

About The Role Project Role : Data Platform Engineer Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models. Must have skills : Data Engineering Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Platform Engineer, you will assist with the data platform blueprint and design, encompassing the relevant data platform components. Your typical day will involve collaborating with Integration Architects...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project...

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Data Engineering Good to have skills : Machine Learning Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Lead, you will be responsible for developing and configuring software systems, either end-to-end or for specific stages of the product lifecycle. Your typical day will involve...

Required Skills: 1+ years of experience in AI+Python Absolute clarity in Machine Learning models and Algorithms Must have hands-on experience in NumPy, Pandas, TensorFlow, and Keras, etc Knowledge of data preprocessing, feature engineering, model training, and evaluation Excellent written and verbal communication and presentation skills. Roles and responsibilities: Maintain and improve existing projects Collaborate with the technical team to develop new features and troubleshoot issues Lead projects to understand the requirements and distribute work to the technical team Follow the project/task timelines and quality. Knowledge in Databricks.

About The Role Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Data Engineering Good to have skills : Python (Programming Language), Apache Spark, Databricks Unified Data Analytics Platform Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Custom Software Engineer, you will assist in defining requirements and designing applications to meet business process and ap...

About the Role As a Data Engineer on the Data & Analytics (D&A) team, you will ensure the data powering business decisions is accurate, well-structured, and accessible. Youll work with technologies such as Snowflake, DBT, Power BI, Fivetran , AWS, and Python to deliver clean, reliable, and performant data. Your initial focus will be on building robust data models in Snowflake and semantic models in Power BI, creating the trusted foundation for dashboards and analyses across Quickbase. Over time, you will also contribute to broader data engineering responsibilities including pipeline design, data integration, compute optimization, governance enforcement, and data quality improvements. This ro...

Senior AWS Data Engineer Experience: 6-12 Role Overview: We are looking for a Senior Big Data Engineer to join our team and work closely with project leads and clients. You will design and develop scalable data processing systems, gather and translate complex business requirements into end-to-end technical solutions, and oversee projects from conception through production. You will also mentor junior team members and ensure delivery of high-quality, robust solutions using cutting-edge technologies. Key Responsibilities: Design and develop scalable big data pipelines and solutions. Collaborate with project leads and clients to gather and refine requirements. Translate complex business needs i...

The role focuses on designing and optimizing scalable data pipelines, Ontology modeling, and building interactive applications using Palantir Foundry modules Candidates should have 8+ years of data engineering experience, including 2+ years of hands-on Palantir Foundry, with strong skills in Python, PySpark, SQL, and Foundry DSL Experience with AWS services, data governance/compliance, and CI/CD pipelines is essential, along with the ability to work cross-functionally in Agile/Waterfall environments . Please share resumes with the following details clearly mentioned: Current CTC Expected CTC Current Location Primary Skills Send profiles to

Role & responsibilities We are seeking a Data Engineer Lead with strong expertise in Databricks-based data platforms and deep exposure to pharmaceutical or healthcare data domains . The role will lead the design, development, and optimization of scalable data pipelines and analytics platforms that support clinical, medical, regulatory, commercial, and real-world evidence use cases. The ideal candidate will combine hands-on technical leadership with strong domain understanding, governance awareness, and stakeholder collaboration. Key Responsibilities Technical Leadership Lead the architecture, design, and implementation of enterprise-scale data pipelines using Databricks (Spark, Delta Lake, U...

The Principal Data Engineer sets the technical direction that assists engineers and data engineers to take on large, complex data problems/initiatives. This role has considerable technical influence within the Data and Software Engineering teams at JustGiving. This individual acts as an evangelist for proper data strategy with other teams at JustGiving. What youll do: Maintain and assess a legacy SQL Server-based Kimball-style data warehouse, identifying opportunities for modernization and optimization. Design and build scalable data pipelines and ETL/ELT processes using modern tools and frameworks. Collaborate with peers to define and evolve reusable tools and pipeline patterns that support...

Design, develop, and optimize complex SQL queries, stored procedures, and functions. Maintain and enhance relational database structures, indexes, and data integrity. Troubleshoot and resolve SQL performance issues. Design and build interactive dashboards, reports, and visualizations in Tableau. Collaborate with stakeholders to understand reporting needs and translate them into impactful dashboards. Optimize dashboard performance through best practices in calculations, data blending, and extracts. Maintain a library of standard reports and ensure data accuracy. Develop and manage ETL/ELT processes using Snowflake for large-scale data warehousing. Create and maintain Snowflake schemas, tables...

Define, Design, and Build an optimal data pipeline architecture to collect data from a variety of sources, cleanse, and organize data in SQL & NoSQL destinations (ELT & ETL Processes). Define and Build business use case-specific data models that can be consumed by Data Scientists and Data Analysts to conduct discovery and drive business insights and patterns. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS big data’ tech...

Job Summary We are seeking a skilled AWS Data Engineer to design, build, and maintain scalable data pipelines and data platforms on Amazon Web Services (AWS). The ideal candidate will work closely with data scientists, analysts, and business stakeholders to ensure reliable, high-quality data availability for analytics and decision-making. Key Responsibilities Design, develop, and optimize end-to-end data pipelines using AWS services Build and manage ETL/ELT processes for structured and unstructured data Develop data ingestion frameworks from multiple data sources (APIs, databases, files, streams) Implement scalable data lakes and data warehouses on AWS Ensure data quality, integrity, securit...

Role Overview: You will be joining a fast-growing consultancy at the forefront of AI-driven delivery innovation, working on projects that influence enterprise data strategies. Your main responsibility will be to play a central role in delivering data ingestion and transformation solutions for SAP data into Snowflake. This role exists because of a strategic proof-of-concept project with a major client, requiring a senior consultant to own technical delivery and shape future SAP-focused initiatives. Key Responsibilities: - Leading technical delivery for SAP-to-Snowflake integration projects - Designing and implementing dimensional data models - Performing data transformations using ETL tools -...

As a Senior Associate at EY, you will collaborate with business, reporting, and other teams to understand business requirements and perform data analysis. You will lead in project transitions from different teams, make enhancements, and modifications post-transition when necessary. Working with back-end data architects and systems engineers, you will construct data objects to support business requirements. Your specialized knowledge will support the organization's vision and direction, making you a subject matter expert for your team. Key Responsibilities: - Create SSIS/SQL packages for ETL processes, troubleshoot existing processes using SSIS and Azure Data Factory. - Analyze large datasets...

As a Cloud Platform Administrator, your primary role will involve managing and optimizing a cloud-based environment to ensure smooth operations. Your key responsibilities will include: - User & Access Management: - Creating users, setting roles, and managing access controls. - Cluster & Resource Management: - Provisioning clusters, monitoring resource usage, and optimizing performance. - Job Management: - Scheduling, managing, and optimizing jobs and workflows. - Monitoring & Troubleshooting: - Monitoring system performance and troubleshooting any issues that arise. - Platform Maintenance: - Managing updates, backups, integrations, and disaster recovery. - Collaboration: - Working closely wi...

As a Solutions Architect with expertise in Google Cloud Cortex Framework, your role will involve leading end-to-end cloud architecture, data modernization, and enterprise analytics initiatives. You will need to apply strong architectural thinking, hands-on technical execution, and collaborate with global stakeholders to deliver scalable, reliable, and insight-driven cloud solutions. Key Responsibilities: - Define end-to-end cloud strategy, architecture, and execution including migration, modernization, and optimization of enterprise workloads. - Design robust architectures utilizing Google Cloud Cortex Framework, BigQuery, Dataflow, Dataform, Looker/LookML, Vertex AI, and related GCP service...

Job Description: Design and maintain distributed data infrastructure , ETL/ELT pipelines , and real-time data processing systems . Collaborate with cross-functional teams to build scalable data solutions, modernize applications, and establish best practices for data engineering. Must-Have Skills 5--7 years in software engineering with strong data engineering focus. Expertise in OOP , design patterns , and algorithm optimization . Proficient in Python (Java/Scala is a plus). Deep experience with ETL/ELT pipelines , data integration , and distributed computing frameworks . Strong knowledge of real-time data processing and streaming frameworks . Hands-on experience with cloud data platforms (AW...

Job Description : 6-9 years of experience with data analytics, data modeling, and database design. 3+ years of coding and scripting (Python, Java, Scala) and design experience. 3+ years of experience with Spark framework. 5+ Experience with ELT methodologies and tools. 5+ years mastery in designing, developing, tuning and troubleshooting SQL. Knowledge of Informatica Power center and Informatica IDMC. Knowledge of distributed, column- orientated technology to create high-performant database technologies like - Vertica, Snowflake. Strong data analysis skills for extracting insights from financial data Proficiency in reporting tools (e.g., Power BI, Tableau). Note: Data Engineer, Python, ETL, ...

Hi All, SuccessPartner Consultant is hiring for a Senior Data Engineer for one of our product based japanese organization. Job Location: Kolkata(work from office) Designation : Senior Data Engineer Job Role: Understandthebusinessrequirementsforanalyticsanddatainterpretation Understandsrequirementsandisinvolvedinthediscussionsrelatingtotechnicalandfunctionaldesignof the sprint/ module/project Designandimplementend-to-enddatasolutions(storage,integration,processing,visualization)inAzure. UsedvarioussourcestoingestdataintoAzureDataLakeStorage(ADLS)suchasSQLServer,Excel,Oracle, SQL Azure etc. Extractdatafromonedatabaseandloaditinto another Builddataarchitectureforingestion,processing,andsurfacin...

What role will you play? In this role, you will design, implement and maintain scalable end-to-end data pipelines in cloud environments and optimise SQL queries for data extraction, transformation and reporting. Youll establish templates and methods, while managing deadlines and solving technical challenges. Your AI-first mindset will be essential to increasing your efficiency, proactively automating processes and continuously challenging legacy practices. What you offer * Proficiency in SQL, relational database concepts and DBT * Hands-on experience with any cloud and familiarity with data warehousing concepts * Strong Python programming skills * Experience with data pipelines orchestration...

A Project Manager have a good exp in Project Management. Also candidate has exp. in Agile Methodology, Waterfall, SDLC, & Jira. A Candidate who has done certification more preferable. Certification eg. PMP, Prince2 Required Candidate profile A Project Manager Must have exp. in Project Management. He have to worked on Agile Methodology and Hybrid. Also Exp. In Waterfall, SDLC & Jira Tool. A Candidate Must Exp. In Telecom Domain

MUST HAVE • Experience on working with ETL on a data warehouse or big data projects. • Experience with cloud services like Azure or GCP or AWS with respect to the data related services, could be just etl , data cleanup or BI but has potential to be groomed in a 1-2 month period. Should have energy and enthusiasm to get into new things, able to stretch. • Good SQL skills and able to solve complex problems in database SQL language efficiently. • Able to identify and resolve performance and scalability issues. • Can work as an individual contributor. • Basic understanding of reporting tools and basic visuals. • Actively participate and manage design and code reviews. • Help in estimation the ta...

About the Role We are seeking a highly experienced and strategic Senior Data Engineer for the development and optimization of our modern cloud data platform infrastructure. This role is ideal for someone who thrives in a fast-paced environment, is passionate about data architecture, and has a deep understanding of data transformation, modeling, and orchestration using modern tools like dbt-core , Snowflake , and Python . Key Responsibilities Design and implement scalable data pipelines using dbt-core, Python, and SQL to support analytics, reporting, and data science initiatives. Design and optimize data models in Snowflake to support efficient querying and storage. Development and maintenanc...