779 Etl Pipelines Jobs - Page 9

As a Backend GoLang Developer at our company, you will play a crucial role in designing high-performance backends, implementing complex business logic, and managing system performance in a computation-heavy environment. Your responsibilities will include: - Developing and maintaining backend services in GoLang. - Designing, managing, and optimizing large relational database schemas (MySQL/Postgres or similar). - Implementing and managing ORM frameworks (e.g., GORM or equivalent) for efficient DB interactions. - Building APIs (REST/GraphQL) for internal and external system integration. - Writing efficient SQL queries, stored procedures, and ETL pipelines for data transformation. - Building sc...

About the Role We are looking for a Software Development Engineer III specializing in Infrastructure and Data Engineering. You will design, build, and optimize scalable infrastructure and data pipelines that enable our product, analytics, and machine learning teams to deliver reliable insights and services. As a senior IC, you will work on cloud infrastructure, data modeling, and distributed systems while collaborating with product, backend, and analytics stakeholders. What You Will Do 1. Infrastructure Engineering a. Design, build, and maintain scalable cloud infrastructure (AWS/GCP/Azure). b. Implement Infrastructure-as-Code (IaC) using Terraform, CloudFormation, or similar tools. c. Ensur...

Design, develop, and implement ETL pipelines using Azure Data Factory to extract, transform, and load data from various sources into target systems. Architect and implement Azure Synapse, Data Warehouse, and Lakehouse solutions, ensuring scalability, performance, and reliability. Utilize Notebooks and Spark for data analysis, processing, and visualization to derive actionable insights from large datasets. Define and implement enterprise data platform architecture, including the creation of gold, silver, and bronze datasets for downstream use. Hands-on development experience in cloud-based big data technologies, including Azure, Power Platform, Microsoft Fabric/Power BI, leveraging languages ...

Role & responsibilities Job Description: Job Summary: We are looking for a skilled Data Engineer to join our data team. The ideal candidate will have hands-on experience in building robust data pipelines using Airflow, managing data warehouses in Snowflake and Redshift, and working with cloud platforms such as AWS and Azure (Databricks, Glue). You will work closely with Data Scientists, Analysts, and Engineers to ensure data availability, quality, and reliability across the organization. Key Responsibilities: l Design, develop, and maintain scalable ETL/ELT pipelines using Apache Airflow, AWS Glue, and Databricks. l Integrate data from multiple sources into Snowflake and Redshift data wareho...

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Ex...

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Ex...

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Ex...

Key responsibilities include: Data Architecture: Perform all technical aspects of data architecture and database management for ID&A, including developing data pipelines, new database structures and APIs as applicable Data Design: Translate logical data architectures into physical data designs, ensuring alignment with data modeling best practices and standards Data Process and Monitoring: Ensure proper data ingestion, validation, testing, and monitoring for ID&A data lake Support database and data platform administration for initiatives building, enhancing, or maintaining databases, data warehouses and data pipelines Data Migration: Design and support migration to a data model that is indepe...

ETL pipelines, Python/R/SQL, and cloud/on-prem integration. Skilled in data warehousing, governance, metadata, and lifecycle management, ensuring data integrity, security, and delivering insights via reports and dashboards.

Lead Databricks Data Engineer Ecolab is looking for a Data Engineer to be part of a dynamic team that's at the forefront of technological innovation. We're leveraging cutting-edge AI to create novel solutions that optimize operations for our clients, particularly within the restaurant industry. Our work is transforming how restaurants operate, making them more efficient and sustainable. As a key player in our new division, you'll have the unique opportunity to help shape its culture and direction. Your contributions will directly impact the success of our innovative projects and help define the future of our product offerings.Additionally, you will experience the best of both worlds with thi...

As a Qualcomm Software Engineer, your role involves designing, developing, creating, modifying, and validating embedded and cloud edge software, applications, and/or specialized utility programs to launch cutting-edge products that exceed customer needs. You will collaborate with various teams to design system-level software solutions, gather performance requirements, and understand interfaces. **Key Responsibilities:** - Complete assigned coding tasks to specifications on time without significant errors or bugs - Adapt to changes and setbacks to meet deadlines - Collaborate with the project team to achieve project objectives - Quickly resolve complex software issues and bugs - Seek opinions...

You are a strategic thinker passionate about driving solutions in financial process transformation. You have found the right team. **Key Responsibilities:** - Lead the design, development, and deployment of automation solutions for FP&A processes using Alteryx, Python, and SQL. - Build and maintain complex dashboards, reports, and analytics using BI tools such as Tableau, Alteryx, and Databricks. - Develop and optimize data models, data warehouses, and ETL pipelines to support financial planning, analysis, and reporting. - Collaborate with business managers, product owners, and finance teams to translate business requirements into actionable automation and analytics solutions. - Implement pr...

The Oracle Cloud Infrastructure (OCI) Security and Compliance Platform Engineering organization presents a rare opportunity to contribute to the development of next-generation, AI-driven cybersecurity solutions at cloud scale. This effort centers on ingesting and processing massive volumes of telemetry and security event data across OCI, leveraging advanced techniques including generative AI (GenAI), large language models (LLMs), and machine learning (ML) to build intelligent detection, response, and mitigation systems. The goal is to deliver autonomous, adaptive security capabilities that protect OCI, Oracle, and our global customer base against evolving threat landscapes. Inviting you to b...

The Oracle Cloud Infrastructure (OCI) Security Services organization presents a rare opportunity to contribute to the development of next-generation, AI-driven cybersecurity solutions at cloud scale. This effort centers on ingesting and processing massive volumes of telemetry and security event data across OCI, leveraging advanced techniques including generative AI (GenAI), large language models (LLMs), and machine learning (ML) to build intelligent detection, response, and mitigation systems. The goal is to deliver autonomous, adaptive security capabilities that protect OCI, Oracle, and our global customer base against evolving threat landscapes. Inviting you to build along the high scale, ...

Role Overview: As a Senior Data Management Professional in the Company Financials Markets team at Bloomberg, you will play a crucial role in leveraging your subject matter expertise and technical skills to develop data-driven strategies and workflows around exchanges and 3rd party data providers. Your responsibilities will include crafting solutions in collaboration with engineering and product departments, managing reliable and efficient workflows, analyzing critical observability checkpoints, and communicating effectively with cross-functional teams. Key Responsibilities: - Develop data-driven strategies by combining Technical, Product, Financial, and Market knowledge - Own reliable and ef...

As a Senior Machine Learning Engineer at our company, you will be an integral part of the AI team, leveraging your 4+ years of experience in building and deploying production-grade ML models. Your role involves designing, developing, and deploying machine learning and deep learning models, conducting advanced data preprocessing, and implementing optimization techniques for algorithm performance and scalability. You will work with Python frameworks such as Scikit-learn, TensorFlow, PyTorch, and Keras, and build interactive dashboards using Streamlit, Plotly, and other visualization tools. Collaboration with cross-functional teams, research, and implementation of state-of-the-art ML/AI algorit...

You will be responsible for the following tasks: - Experience in GCP. - Data migration experience from legacy systems including SQL, Oracle. - Experience with Data lake, data warehouse ETL pipelines build and design on GCP. - GCP data and analytics services like Cloud Dataflow, Cloud Dataprep, Apache Beam/Cloud composer, Cloud BigQuery, Cloud Fusion, Cloud PubSub, Cloud storage & Cloud Functions. - Using Cloud Native GCP CLI/gsutil along with scripting using Python & SQL. - Experience with Data Governance, Metadata Management, Data Masking & Encryption using GCP tools like Cloud Data Catalog, GCP KMS tools. No additional details about the company are mentioned in the job description.,

Job description Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

Job description Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

Job description Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

As a Team Member at the company, your role involves extracting, analyzing, transforming, and loading client data from various formats and sources into the database. You will be responsible for designing, building, modifying, and maintaining efficient database objects and reports to meet business needs. Additionally, you will collaborate with client teams to understand requirements and translate them into technical solutions. Your responsibilities will include: - Extracting, analyzing, transforming & loading client data into the database - Designing, building, modifying, and maintaining database objects and reports - Generating and updating database models and diagrams - Maintaining data dict...

As a Senior Software Engineer Java at SAP, you will be part of the App2App Integration team within SAP Business Data Cloud. Your role is crucial in accelerating the integration of SAP's application ecosystem with its unified data fabric, ensuring low-latency, secure, and scalable data exchange. Your responsibilities will include: - Designing and developing App2App integration components and services using Java, RESTful APIs, and messaging frameworks like Apache Kafka. - Building and maintaining scalable data processing and ETL pipelines to support real-time and batch data flows. - Integrating data engineering workflows with tools such as Databricks, Spark, or other cloud-based processing pla...

You are needed to join the Media Data Engineering team as a Senior Data Engineer. Your primary responsibilities will include: - Building, maintaining, and enhancing the data infrastructure that currently manages billions of advertising events per hour - Designing and implementing both streaming and batch pipelines for data ingestion and delivery - Managing a data warehouse for business and technical stakeholders - Contributing to GumGum's proprietary machine-learning forecasting systems - Developing scripts and APIs to cater to internal and external reporting requirements - Exploring and evaluating emerging data technologies - Regularly collaborating with cross-functional teams - Taking the ...

As a Senior Data Engineer, you will be responsible for designing and optimizing large-scale data pipelines using Databricks and the AWS ecosystem. Your expertise in Databricks and AWS with a minimum of 7 years of experience is mandatory for this role. Key Responsibilities: - Designing and optimizing large-scale data pipelines using Databricks and AWS technologies - Working with Databricks tools such as PySpark, Delta Lake, and MLflow - Utilizing AWS services including Glue, S3, Lambda, Redshift, and EMR - Developing and maintaining Data Lake, ETL pipelines, CI/CD processes - Proficiency in Python and SQL for data processing and analysis Qualifications Required: - Minimum 7 years of experienc...

The Oracle Cloud Infrastructure (OCI) Security Services organization presents a rare opportunity to contribute to the development of next-generation, AI-driven cybersecurity solutions at cloud scale. This effort centers on ingesting and processing massive volumes of telemetry and security event data across OCI, leveraging advanced techniques including generative AI (GenAI), large language models (LLMs), and machine learning (ML) to build intelligent detection, response, and mitigation systems. The goal is to deliver autonomous, adaptive security capabilities that protect OCI, Oracle, and our global customer base against evolving threat landscapes. Inviting you to build along the high scale, ...