790 Etl Pipelines Jobs - Page 13

#JobOpening Data Engineer (Contract | 6 Months) Location: Hyderabad | Chennai | Remote Flexibility Possible Type: Contract | Duration: 6 Months We are seeking an experienced Data Engineer to join our team for a 6-month contract assignment. The ideal candidate will work on data warehouse development, ETL pipelines, and analytics enablement using Snowflake, Azure Data Factory (ADF), dbt, and other tools. This role requires strong hands-on experience with data integration platforms, documentation, and pipeline optimizationespecially in cloud environments such as Azure and AWS. #KeyResponsibilities Build and maintain ETL pipelines using Fivetran, dbt, and Azure Data Factory Monitor and support p...

Role Overview: You will join a dynamic team of business and technology experts at Macquarie, collaborating across teams to ingest data and implement essential liquidity calculations on an innovative platform. Your focus will be on delivering a high-performing, robust, and stable solution that meets the needs of internal and external stakeholders. Key Responsibilities: - Use your data engineering and big data skills to build and maintain data services and pipelines with industry best practices - Develop, test, and support data assets, automate testing and delivery, infrastructure optimization, and help maintain code quality and security standards in a DevOps environment - Participate in code ...

The Oracle Cloud Infrastructure (OCI) Security and Compliance Platform Engineering organization presents a rare opportunity to contribute to the development of next-generation, AI-driven cybersecurity solutions at cloud scale. This effort centers on ingesting and processing massive volumes of telemetry and security event data across OCI, leveraging advanced techniques including generative AI (GenAI), large language models (LLMs), and machine learning (ML) to build intelligent detection, response, and mitigation systems. The goal is to deliver autonomous, adaptive security capabilities that protect OCI, Oracle, and our global customer base against evolving threat landscapes. Inviting you to b...

As a Lead Database Engineer, you will spearhead the design, development, and optimization of large-scale data solutions. Your deep understanding of Oracle SQL, PL SQL, Data Modeling, Python, and proven leadership capabilities will be crucial in building and maintaining robust ETL pipelines. Ensuring data integrity, performance, and guiding your team towards best practices and continuous improvement are key aspects of your role. - Design database objects like tables and views for data modeling - Develop and fine-tune high-performance ETL pipelines using Oracle SQL and PL/SQL - Provide technical leadership by mentoring a team of data engineers - Collaborate with stakeholders to understand data...

This job is with Amazon, an inclusive employer and a member of myGwork the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Description Fulfillment by Amazon (FBA) enables sellers to scale their businesses globally by leveraging Amazon&aposs world-class fulfillment network. Sellers using FBA benefit from fast, reliable shipping, Prime delivery eligibility, and hassle-free returns-allowing them to focus on growth while we handle operations. The WW FBA Central Analytics team builds and operates scalable, enterprise-grade data infrastructure, tools, and analytics solutions that power WW FBA business. We partner across global product, progr...

Exp- 8-15 years 3+ years of hands on experience in Azure Data Engineering development project 2+ years of experience in Databricks development 2+ years of experience in PySpark. 2+ years of experience in SQL Proficient in SQL 2+ years of experience in leading at least a 5+ member team in data engineering delivery Must be fluent in communication Role & responsibilities Preferred candidate profile

Dear Candidate, find the below details & JD Dear Candidate, find the below details & JD Experience: 4-6 Years(1 Position) 6-9 years(1 Position) Location: Bangalore(Hybrid) NP: Immediate -15 Days Interview: 02(Virtual) Job Description: 1. CI/CD pipeline implementation for ETL and GoDAP. Currently end-to-end workflow is not fully automated. Our next year focus should be to create standardized process establishment for on-prem as well as in cloud journey. 2. ETL Pipeline establishment/Optimization and performance tuning. 3. Unit test framework setup and integrate into CI/CD process to identify and fix the incidents well advance. 4. Test coverage tools integration. 5. Real-time monitoring and lo...

Hiring Now: Data Engineer / ETL Developer (Talend + Power BI) Location : Bengaluru | Experience : 13 Years | Immediate Joiners Preferred (15 days) About the Role We are looking for a Data Engineer / ETL Developer passionate about designing and developing robust ETL pipelines and data models using Talend Enterprise and delivering insights through Power BI . Key Responsibilities Analyze and understand business requirements to provide end-to-end BI solutions. Design and implement scalable ETL pipelines using Talend / Informatica . Integrate data from Oracle, MSSQL, file systems, FTP, REST APIs, and more. Develop data models, document solutions, and build data catalogs. Optimize ETL processes, t...

Role Overview We are seeking a highly experienced People Analytics Leader to drive data-driven decision-making within our HR function. This role will be responsible for leveraging data insights to enhance workforce planning, employee experience, and overall business outcomes. A Leader who can bridge the gap between business and technology by translating business requirements into technical solutions. The ideal candidate should have expertise in data engineering, analytics, and HR technology (preferably Workday) while working in the US time zone to support global teams. The ideal candidate will have a strong background in HR analytics, data science, and strategic workforce planning. Key Respo...

Common Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow,Experience on Spark/Hive/HDFS,Data modeling for Data conversion Resources Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skillsCommon Skils - SQL, GCP BQ, ETL pipelines using Pythin/Airflow Experience on Spark/Hive/HDFS,Data modeling for Data conversion Resources Prior experience working on a conv/migration HR project is additional skill needed along with above mentioned skills Data Engineer - Knows HR Knowledge , all other requirement from Functional Area given by UBER

Role & responsibilities Experience : Associate should have 3+ years of IT experience with good exposure into diagnosis and troubleshooting the complex issues . Technologies : IData Ingestion & ETL Pipelines,Dataflow/Dataproc/Pub/Sub,datasets,Vertex AI,BigQuery,Python,CI/CD for ML,Containerization,Proficiency in TensorFlow,Understanding of LLMs/Transformer,Prompt Engineering Must Have : Good communication customer handling skills with good knowledge into Bigquery, TensorFlow and Understanding of LLMs Good to Have : Monitoring and Logging and SQL Skills Certification : Google ACE,Machine Learning or equivalent certification

Design and implement scalable data architectures to optimize data flow and analytics capabilities Develop ETL pipelines, data warehouses, and real-time data processing systems Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery Work closely with data scientists to enhance machine learning models with structured and unstructured data Prior experience in handling large-scale datasets is preferred Keywords Python,AWS Redshift,Google BigQuery,ETL pipelines,data warehousing,data architectures,SQL*

Design and implement scalable data architectures to optimize data flow and analytics capabilities Develop ETL pipelines, data warehouses, and real-time data processing systems Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery Work closely with data scientists to enhance machine learning models with structured and unstructured data Prior experience in handling large-scale datasets is preferred Keywords python,data warehousing,etl,amazon redshift,bigquery,data engineering,data architecture,aws,machine learning,data flow,etl pipelines,real-time data processing,java,spring boot,microservices,spark,kafka,cassandra,scala,nosql,mongodb,rest,redis,SQL*

About the Role: We are hiring a Senior Data Engineer with strong expertise in Palantir Foundry or Gotham to lead the design, development, and optimization of data engineering solutions across large-scale enterprise environments. The ideal candidate will have deep experience building secure, high-performance data pipelines using Python, ETL/ELT practices, distributed computing frameworks, and cloud platforms ( AWS ,Azure ,GCP)while working closely with DevOps, analytics, and business teams to enable data-driven decisions. Key Responsibilities: Architect, build, and optimize large-scale ETL/ELT pipelines using Palantir Foundry/Gotham . Integrate diverse data sources including SQL , NoSQL , API...

Roles & Responsibilities: Design, develop, and optimize scalable ETL/ELT pipelines using Snowflake , AWS Glue , and dbt (Data Build Tool) . Build and maintain robust data models (star/snowflake schema) to support business intelligence and analytics use cases. Use PySpark and SQL for data processing, transformation, and querying large-scale datasets efficiently. Integrate data from various sources using AWS Lambda , APIs, and event-driven architecture where needed. Monitor and manage data pipeline performance, reliability, and cost-efficiency on the AWS cloud platform. Collaborate with data analysts, product managers, and other stakeholders to gather requirements and implement technical solut...

About the role : Gartner is looking for a well-rounded and driven leader to become a part of its Conferences Technology & Insight Analytics team, which is tasked with creating the reporting and analytics to support its Conference reporting operations. What youll do: Provide technical leadership and guidance to software development teams, guaranteeing alignment with project objectives and adherence to industry best practices. Leading and mentoring a team of software engineers, delegating responsibilities, offering support, and promoting a collaborative environment. Collaborate with business stakeholders, design, build advanced analytic solutions for Gartner Conference Technology Business. Exe...

This opening is for PAN India locations (Hybrid). Experience in Design / Implementation of Data Pipelines for processing large volumes of data Experience in ingesting batch and streaming data from various data sources. Strong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.) Data Modeling: Proficiency in creating both normalized and denormalized database schemas. Proficient in developing applications in Python. Exposed to python libraries such as NumPy, pandas, beautiful soup, etc Experience in developing ETL, OLAP based and Analytical Applications. Good working experience in Azure / AWS services Experience working in Databricks, Snowflake or other cloud...

Job DescriptionDesign and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred.Keywordssql,python,data warehousing,etl,amazon redshift,Data Engineering*

Job Description Design and implement scalable data architectures to optimize data flow and analytics capabilities Develop ETL pipelines, data warehouses, and real-time data processing systems Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery Work closely with data scientists to enhance machine learning models with structured and unstructured data Prior experience in handling large-scale datasets is preferred KeywordsPython,AWS Redshift,Google BigQuery,ETL pipelines,data warehousing,data architectures,SQL*

Job DescriptionDesign and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred.KeywordsSQL,Python,AWS Redshift,Google BigQuery,machine learning models,ETL,data architectures,Data engineering*

Data Scientist Profile Skill-Data Scientist, Demand Planning,Forecasting, SCM, Supply Chain, Data Brick,Pyspark,DeltaLake,ETL,Azure,AWS,Data Modeling Exp-8-12Yrs PKG Upto-32LPA Loc-Mumbai NP-Imm-30Days Ritika-8587970773 ritikab.imaginators@gmail.com Required Candidate profile Skill-Data Scientist, Demand Planning, Forecasting, SCM, Supply Chain, Data Brick, Pyspark, Delta Lake, ETL, Cluster Management, ML Model, Validation, Azure, AWS, Data Modeling NP-Imm-30Days

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key Skills Data analytics,ETL,SQL,Python,Google Big Query,AWS Redshift,Data architecture

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key Skills SQL,Python,AWS Redshift,Google BigQuery,machine learning models,ETL,data architectures,Data engineering.

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key Skills ETL pipelines,data warehouses,SQL,Python,cloud data platforms,AWS Redshift,Google BigQuery,machine learning models,Data Engineering.

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key Skills ETL pipelines,data warehouses,SQL,Python,cloud data platforms,AWS Redshift,Google BigQuery,machine learning models,Data Engineering