6525 Data Engineering Jobs - Page 28

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Do 1. Instrumental in understanding the requirements and design of the product/ software Develop software solutions by studying information needs, studying systems flow, data usage and work processes Investigating problem areas followed by the software development life cycle Facilitate root cause analysis of the system issues and problem statement Identify ideas to improve system performance and impact availability Analyze client requirements and convert requirements to fe...

Qualification Bachelors or masters degree in computer science, Information Technology, or a related field 12+ years of experience in data architecture and engineering Proven expertise with Snowflake data platform Strong understanding of ETL/ELT processes and data integration Experience with data modelling and data warehousing concepts Familiarity with performance tuning and optimization techniques Excellent problem-solving skills and attention to detail Strong communication and collaboration skills Responsibilities Design and develop robust data architecture solutions using Snowflake Collaborate with data engineers and analysts to optimize data pipelines Implement data migration strategies a...

Role Purpose The purpose of the role is to create exceptional architectural solution design and thought leadership and enable delivery teams to provide exceptional client engagement and satisfaction. Do 1.Develop architectural solutions for the new deals/ major change requests in existing deals Creates an enterprise-wide architecture that ensures systems are scalable, reliable, and manageable. Provide solutioning of RFPs received from clients and ensure overall design assurance Develop a direction to manage the portfolio of to-be-solutions including systems, shared infrastructure services, applications in order to better match business outcome objectives Analyse technology environment, enter...

Position Description: Founded in 1976, CGI is among the world's largest independent IT and business consulting services firms. With 94,000 consultants and professionals globally, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services, and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68billion, and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more atcgi.com....

SUMMARY Role: Python/Data Engineer: Level Expected: 4-9 yrs Must Haves: 1. Good analytical and problem-solving skills. 2. Good hands-on experience in developing Python programs with Python 3.10 version 3. Familiarity with Python frameworks Django, Flask etc. 4. Good knowledge of Database technologies like RDBMS, MongoDB, Hibernate etc. 5. Good knowledge of REST API, creation and consumption 6. Basic knowledge of AWS services - EC2, S3, Lambda function, ALB 7. Familiarity with Git, JIRA and other dev tools Good to have: 1. Hands on experience with AWS services, mainly Lambda function creation. 2. Basic knowledge of Databricks

Role & responsibilities : Create and manage robust data ingestion pipelines leveraging Databricks, Airflow, Kafka, and Terraform. Ensure high performance, reliability, and efficiency by optimizing large-scale data pipelines. Develop data processing workflows using Databricks, Delta Lake, and Spark technologies. Maintain and improve the Data Lakehouse, utilizing Unity Catalog for efficient data management and discovery. Construct automation, frameworks, and enhanced tools to streamline data engineering workflows. Collaborate across teams to facilitate smooth data flow and integration. Enforce best practices in observability, data governance, security, and regulatory compliance Preferred candi...

SUMMARY Must have: Experience with AWS, SQL, and Data Modeling tools Good to have: Exposure to data warehousing concepts and tools (e.g., Redshift, Snowflake) Minimum Experience: 5+ years Requirements Position Summary Position Title Position Brief Summary No. of Roles Data Modeler The Data Modeler in this role will collaborate with IDP’s Data Engineering and Governance team to design and implement long-term data solutions by analyzing business needs, evaluating and optimizing data systems, creating conceptual and physical data models, establishing best practices, ensuring system compatibility, and working closely with cross-functional teams including product owners, data scientists, engineer...

*Minimum 4+ years of development and design experience in Java/Scala with Flink, Beam (or spark streaming) and Kafka *Experience in JVM tuning for performance *Working on Caching systems, with experience using Apache Ignite will be preferable.

We are looking for a skilled Data Engineer with strong hands-on experience in Clickhouse, Kubernetes, SQL, Python, and FastAPI, along with a good understanding of PostgreSQL. The ideal candidate will be responsible for building and maintaining efficient data pipelines, optimizing query performance, and developing APIs to support scalable data services. - Design, build, and maintain scalable and efficient data pipelines and ETL processes. - Develop and optimize Clickhouse databases for high-performance analytics. - Create RESTful APIs using FastAPI to expose data services. - Work with Kubernetes for container orchestration and deployment of data services. - Write complex SQL queries to extrac...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

Job Title : Sr. Data Engineer Ontology & Knowledge Graph Specialist Department : Platform Engineering Summary : We are seeking a highly skilled Data Engineer with expertise in ontology development and knowledge graph implementation. This role will be pivotal in shaping our data infrastructure and ensuring the accurate representation and integration of complex data sets. You will leverage industry best practices, including the Basic Formal Ontology (BFO) and Common Core Ontologies (CCO), to design, develop, and maintain ontologies, semantic and syntactic data models, and knowledge graphs on the Databricks Data Intelligence Platform that drive data-driven decision-making and innovation within ...

About The Opportunity : Join a pioneering consulting firm in the Data Analytics and Cloud Solutions sector, where transformative data architectures empower global enterprises. We specialize in leveraging cutting-edge Snowflake technologies and innovative cloud solutions to drive real-time insights and business intelligence. This remote role, based in India, offers the opportunity to work on high-impact projects while collaborating with a diverse team of experts. Role & Responsibilities : - Design, implement, and optimize scalable data warehousing solutions using Snowflake Cortex. - Develop robust ETL pipelines that ensure data quality, reliability, and efficient integration across platforms....

SUMMARY Data Engineer Position Overview Role Summary We are searching for a talented and motivated Data Engineer to join our team. The ideal candidate will have expertise in data modeling, analytical thinking, and developing ETL processes using Python. In this role, you will be pivotal in transforming raw data from landing tables into reliable, curated master tables, ensuring accuracy, accessibility, and integrity within our Snowflake data platform. Experience Overall 6+ yrs of experience with relevant experience of 4+ years Main Responsibilities Design, Develop, and Maintain ETL Processes: o Build and maintain scalable ETL pipelines in Python to extract, transform, and load data into Snowfl...

Role: Data Engineer Experience: 4 - 6 years Location: Coimbatore Job Type: Full Time Mode of work: Hybrid (Weekly 2 days WFO) Notice period: Immediate Mandatory Skills Required: Python, PySpark, AWS, Data Bricks, SQL. Job Description: Roles and Responsibilities: Design, develop, and maintain efficient ETL processes using Python, SQL, AWS Glue, and Redshift. Automate data flows and integrations using AWS Lambda and other serverless services. Propose improvements and optimizations to existing pipelines, prioritizing performance, scalability, and maintainability. Collaborate on the design of scalable and resilient data architectures in AWS. Develop and manage infrastructure as code using Terraf...

Developing software, managing cloud infrastructure and implementing AI solutions. Work on deploying, maintaining optimizing cloud-based systems and databases. Designing and coding software in Python, managing cloud resources, ensuring system security

We build AI solutions to solve real-world retail problems, and were looking for brilliant minds to join us. Our team is focused on revolutionizing the retail industry through AI-driven innovations that enhance customer experiences, optimize operations, and drive business growth. We are seeking a talented and motivated AI Researcher to join our AI team. In this role, you will design, develop, and implement advanced AI models and algorithms tailored to the unique challenges of the retail domain. Work on projects ranging from personalized recommendation systems to work force optimization, demand sensing, multi agent systems, Digital Humans, Personified AI, Embodied AI etc. Research and develop ...

Minimum 5 years of experience in the IT Developmentindustry. Must be well versed inJava, Python (OOP), Relational Database, Git, Maven, HTML, CSS, JavaScript, Agile Methodology and Spring Boot/Similar frameworks. Good to have knowledge of React and Typescript. Good to have knowledge of other technology landscapes like AI, Data Engineering. Experience in designing and delivering technical training plans. Excellent communication and presentation skills. Strong organizational and time-management abilities. Ability to work collaboratively with cross-functional teams and manage multipletraining programs simultaneously. Adaptability and a proactive approach to problem-solving. #LI-MR1

Job Title: Data Engineer (Azure) Location: Chennai Shift Timings: 4:30 PM 2:00 AM IST Experience: 4+ years About the Role We are seeking a highly skilled and experienced Azure Data Engineer to join our team, focusing on building and maintaining scalable data pipelines and infrastructure for our U.S. healthcare payer operations. The ideal candidate will be proficient in modern data engineering practices, cloud-based platforms, and healthcare data management. This role will involve designing, developing, and optimizing data workflows to ensure secure, reliable, and high-quality data delivery across the organization. Key Responsibilities Design, develop, and optimize scalable ETL/ELT pipelines ...

Locations:Pune Indore Ahmedabad Hyderabad Bangalore We are seeking an experienced Database & Cloud Advisory Specialist with strong expertise in SQL Server and Oracle , along with working knowledge of MongoDB (optional) . The role is primarily advisory in nature , focusing on Google Cloud Platform (GCP) services such as Compute Engine, Cloud SQL, Observability, Backup & Disaster Recovery (DR), and GCVE (Google Cloud VMware Engine) . The candidate will play a key role in guiding teams and clients through cloud migration planning and ensuring best practices in database management and cloud adoption. Key Responsibilities Database Advisory: Provide expert guidance on SQL Server and Oracle databas...

This is a remote position. We are seeking a highly experienced and motivated Senior SAP BW Developer with a minimum of 8 years of hands-on experience. The ideal candidate will possess an in-depth, expert-level understanding of all SAP BW artifacts and demonstrate strong, proven programming proficiency in SAP ABAP and SQL. This role requires a candidate who can independently design, develop, implement, and optimize complex data warehousing solutions within the SAP BW environment to meet critical business requirements. You will be a key technical expert, providing guidance and mentorship to junior team members and contributing to the overall data strategy. Work with customer technical leads, c...

Hands-on experience with AI/ML platforms (Azure ML, AWS SageMaker, GCP Vertex AI), MLOps, and data engineering,experience in technical project management, experience in AI/ML project delivery

As a Data Engineering Consultant , you will be responsible for architecting and implementing robust data solutions that support the Data Science teams analytical and modeling efforts. You will work closely with Data Scientists, Analysts, and cross-functional teams to ensure seamless data access, processing, and integration. Your expertise in Python, SQL, ETL, Big Data technologies, reporting, and cloud platforms will be pivotal in advancing our data-driven healthcare initiatives. Key Responsibilities Data Pipeline Development and Management: Design, develop, and optimize ETL pipelines to extract, transform, and load healthcare data from various sources. Build scalable data workflows to proce...

Role : Minimum 10 years of experience and 8 years in Markit EDM mandatory. We are seeking a highly skilled and motivated Senior MarkIT EDM Data Engineer to join our team. The ideal candidate will be a self-starter who can work independently and collaborate effectively with both internal and external stakeholders. This role requires a deep understanding of data engineering principles, strong technical skills, and the ability to drive projects to successful completion. Key Responsibilities. - Minimum 10 years of experience and 8 years in Markit EDM mandatory. - Design, develop, and maintain data solutions using MarkIT EDM. - Collaborate with internal teams and external stakeholders to gather r...