779 Etl Pipelines Jobs - Page 10

The Oracle Cloud Infrastructure (OCI) Security Services organization presents a rare opportunity to contribute to the development of next-generation, AI-driven cybersecurity solutions at cloud scale. This effort centers on ingesting and processing massive volumes of telemetry and security event data across OCI, leveraging advanced techniques including generative AI (GenAI), large language models (LLMs), and machine learning (ML) to build intelligent detection, response, and mitigation systems. The goal is to deliver autonomous, adaptive security capabilities that protect OCI, Oracle, and our global customer base against evolving threat landscapes. Inviting you to build along the high scale, ...

The Oracle Cloud Infrastructure (OCI) Security Services organization presents a rare opportunity to contribute to the development of next-generation, AI-driven cybersecurity solutions at cloud scale. This effort centers on ingesting and processing massive volumes of telemetry and security event data across OCI, leveraging advanced techniques including generative AI (GenAI), large language models (LLMs), and machine learning (ML) to build intelligent detection, response, and mitigation systems. The goal is to deliver autonomous, adaptive security capabilities that protect OCI, Oracle, and our global customer base against evolving threat landscapes. Inviting you to build along the high scale, ...

The Oracle Cloud Infrastructure (OCI) Security Services organization presents a rare opportunity to contribute to the development of next-generation, AI-driven cybersecurity solutions at cloud scale. This effort centers on ingesting and processing massive volumes of telemetry and security event data across OCI, leveraging advanced techniques including generative AI (GenAI), large language models (LLMs), and machine learning (ML) to build intelligent detection, response, and mitigation systems. The goal is to deliver autonomous, adaptive security capabilities that protect OCI, Oracle, and our global customer base against evolving threat landscapes. Inviting you to build along the high scale, ...

Role Overview: You will play a key role in a dynamic, agile, and collaborative team at Deutsche Bank, reshaping the organization using Artificial Intelligence, Machine Learning, and Automation. As a Senior Full-Stack Developer, you will be a technical specialist, data scientist, and business analyst, analyzing raw data to improve processes across the organization. Your responsibilities will include maintaining the event management portfolio, ensuring tech roadmap compliance, and mitigating risks. Key Responsibilities: - Develop Python-based microservices and APIs - Create interactive dashboards using JavaScript and React with real-time data - Deploy microservices and web applications onto cl...

Role Overview: As a Data Engineer at BeautifulCode in Hyderabad, India, with the option for limited work from home, you will play a crucial role in developing high-quality, scalable products for clients. Your passion for writing clean Python code, building robust ETL pipelines, and utilizing cloud platforms like GCP will be key in this role. Key Responsibilities: - Write clean, maintainable, and well-documented code in Python, incorporating libraries such as Pandas and NumPy for data processing and manipulation. - Design, build, and maintain ETL pipelines to facilitate data transformation, loading, and integration into a data warehouse, with a preference for Google BigQuery. - Collaborate wi...

As a Data Engineer with over 12 years of experience, you will be responsible for leading Data Engineer teams in developing enterprise-grade data processing pipelines on Google Cloud. Your role will involve leading projects involving the migration of ETL pipelines and Data warehouses to the cloud, with a focus on medium to high complexity projects. You should have a minimum of 3 to 4 years of experience in this capacity and at least 3 to 5 years with premium consulting companies. Your expertise should include hands-on experience with Google Cloud Platform services such as BigQuery, Dataform, Dataplex, etc. Additionally, you should possess exceptional communication skills to effectively engage...

MUST HAVE SKILLS-PYTHON,SQL ETL PIPELINES ETL pipelines using AWS Glue, Spark/PySpark, and Python

We are seeking an experienced Data Engineer (AI/ML Ops) to design, build, and optimize data pipelines, orchestration frameworks, and data infrastructure supporting large-scale AI/ML programs. This role is pivotal in ensuring seamless data flow, from acquisition and preparation to annotation, validation, and delivery enabling AI/ML models to train on clean, well-structured, and compliant datasets at scale. This role will collaborate with Data Scientists, AI Engineers, IT Operations and Product Teams, working across cloud environments (i.e., AWS, GCP, Azure) and integrating with internal and third-party tools to deliver end-to-end data solutions. The ideal candidate brings a blend of technical...

Hello Connections !! We are hiring for Data Engineer+Java. Exp : 4+Years Loc : Pune (Hybrid) Shift Timings : General Shift Notice Period: Immediate joiners(notice period served or serving candidate) Mandatory Skills : Data Engineer ETL Pipelines Java Coding (atleast 6months to 1Year) DBT (Data Build Tool) Apache Airflow NOTE: We are looking for Immediate joiners(notice period served or serving candidate) Apply only If you are Immediate joiners(notice period served or serving candidate) Apply only if you are having 4+Years of relevant experience into the above mentioned mandatory skills. Key Responsibilities: Design, implement, and optimize ETL/ELT pipelines using DBT for data modeling and tr...

Description Fulfillment by Amazon (FBA) enables sellers to scale their businesses globally by leveraging Amazon's world-class fulfillment network. Sellers using FBA benefit from fast, reliable shipping, Prime delivery eligibility, and hassle-free returns-allowing them to focus on growth while we handle operations. The WW FBA Central Analytics team builds and operates scalable, enterprise-grade data infrastructure, tools, and analytics solutions that power WW FBA business. We partner across global product, program, and operations teams to unify diverse datasets, deliver self-service analytics, and develop next-generation capabilities using LLMs to unlock insights. Our charter includes buildin...

7+ years of experience as a Data Engineer / Data Architect or similar role: Proven track record of designing and implementing data solutions on Google Cloud Platform. Strong analytical and problem-solving skills: Ability to analyze complex data challenges and provide innovative solutions. Excellent communication and collaboration skills: Proven ability to effectively communicate technical concepts to both technical and non-technical audiences. Passion for data and technology: A genuine interest in data, its potential, and the latest advancements in data technology. Continuous learner: A proactive and enthusiastic approach to learning new technologies and techniques. Location : Hyderabad Hybr...

About the Role We are seeking detail-oriented Data QA/QC Engineer who will work closely with the database and analytics team members to ensure the quality, accuracy, and consistency of organizational data. The role involves performing QA/QC checks on data pipelines, validating data in PostgreSQL databases, and supporting day-to-day data operations using Excel and SQL. The ideal candidate has strong analytical skills, attention to detail, and experience in managing large datasets. Key Responsibilities: Perform QA/QC checks on incoming and processed datasets to ensure accuracy, completeness, and consistency. Perform data cleaning, transformation, and validation in Excel and PostgreSQL . Collab...

1. Design and develop and execute manual and automated test cases for Azure Data Factory ETL pipelines using python and pytest. 2. Validate the data transformations, data mappings, and data integrity through SQL queries and data profiling. 3. Automate functional, regression, and perfomance tests of ETL workflows to ensure pipeline reliability. 4. Collaborate with data engineers, analysts and developers to understand ETL and POWER BI Specifications and data flow requirements 5. Document Test plans, Test Cases, defects, and provide the timely feedback on issues. 6. Maintain Test automation frameworks, leveraging Pytest fixtures and libraries such as to validate Azure data factory activities.

**Role Overview:** As a Lead Talent Insights at Carelon Global Solutions India, you will be responsible for creating advanced reports and dashboards in Workday to support all HR functional areas for HR and Business Leader customers across the enterprise. Your subject areas will include workforce, DEI, learning, performance, engagement/surveys, associate relations, HR operations, and more. You must have knowledge of Workday report writing, and advanced report writing as well as Workday Prism report writing are preferred. Your role will involve strong collaboration skills to solve complex challenges and find innovative ways to display data for improved user experience and business decision-mak...

As a Data Scientist at RBHU ETG Pvt. Ltd., you will be part of a forward-looking company specializing in Data, AI, and Analytics. The culture at RBHU is based on collaboration, mentorship, and impact, providing you with a place where your ideas matter and continuous learning is encouraged. **Key Responsibilities:** - Analyse large, varied datasets to extract actionable insights and inform strategic decisions. - Design, develop, and deploy machine learning models (classification, regression, clustering, etc.) with scalability and production-grade performance. - Perform feature engineering, data cleaning, preprocessing, and exploratory data analysis. - Collaborate with product, engineering, bu...

Experience: 7+ Years Location: Bangalore Key Responsibilities Design, develop, and maintain scalable ETL pipelines using AWS Glue and PySpark . Lead the data engineering team , ensuring best practices in coding, testing, and deployment. Implement workflow orchestration solutions for complex data pipelines. Optimize data pipelines and queries for advanced SQL performance. Collaborate with data scientists, analysts, and stakeholders to deliver reliable data solutions. Ensure data quality, governance, and security across systems. Drive continuous improvements in ETL processes and architecture. Requirements 7+ years of hands-on experience in Data Engineering . Strong expertise in AWS Glue , ETL ...

Experience- 8 to 12 years Location- Pan India Key Responsibilities: Design and build scalable ELT pipelines in Snowflake using DBT/SQLand Python . Develop efficient, well-tested DBT models (staging, intermediate, and marts layers). Implement data quality, testing, and monitoring frameworks to ensure data reliability and accuracy. Optimize Snowflake queries, storage, and compute resources for performance and cost-efficiency. Collaborate with cross-functional teams to gather data requirements and deliver data solutions. Required Qualifications: 6+ years of experience as a Data Engineer, with at least 5 years working with Snowflake . Proficient with DBT (Data Build Tool) including Jinja templat...

Key Responsibilities: As a Data Engineer , you will be involved in data Lakehouse development including requirements gathering, database modeling, ETL job design & development, and dashboard/report development activities. You will be working with the Customer Experience team to build and enhance a cloud-based warehouse of operational data to drive analytics. You will be responsible for developing ETL/data pipelines using Talend, SQL, and Python, and ingesting data from various external sources into large MPP data warehouses like Azure Synapse, Hive, Snowflake or similar. You will frequently conduct data analysis, ingest data from various external & internal sources, write advanced database q...

you should apply if you: having 1-3 years of experience in ETL and data engineering are able to read and write complex SQL have prior experience in at least one programming language are aware of your way around data modeling, data warehousing and lakehouse (we use redshift and databricks) come with experience in working on cloud services, preferably AWS constantly learning and looking for ways to improve yourself and the processes around you can be a team player with strong analytical, communication, and troubleshooting skills. how is life at CRED? working at CRED would instantly make you realize one thing: you are working with the best talent around you. not just in the role you occupy, but...

you should apply if you: having 1-3 years of experience in ETL and data engineering are able to read and write complex SQL have prior experience in at least one programming language are aware of your way around data modeling, data warehousing and lakehouse (we use redshift and databricks) come with experience in working on cloud services, preferably AWS constantly learning and looking for ways to improve yourself and the processes around you can be a team player with strong analytical, communication, and troubleshooting skills. how is life at CRED? working at CRED would instantly make you realize one thing: you are working with the best talent around you. not just in the role you occupy, but...

Ecolab is looking for a Data Engineer to be part of a dynamic team that's at the forefront of technological innovation. We're leveraging cutting-edge AI to create novel solutions that optimize operations for our clients, particularly within the restaurant industry. Our work is transforming how restaurants operate, making them more efficient and sustainable. As a key player in our new division, you'll have the unique opportunity to help shape its culture and direction. Your contributions will directly impact the success of our innovative projects and help define the future of our product offerings.Additionally, you will experience the best of both worlds with this team at Ecolab: the agility ...

Key Responsibilities: Develop, test, and deploy applications using Python. Write efficient and optimized SQL queries, stored procedures, and database functions. Design and maintain data models, ETL pipelines, and reporting solutions. Collaborate with product managers, analysts, and other developers to deliver requirements. Ensure application performance, data integrity, and security across platforms. Debug, optimize, and refactor existing Python/SQL code on a needed basis. Document technical solutions and follow best practices for coding and version control. Implement and manage CI/CD pipelines (GitHub Actions, or similar). Containerize applications using Docker and manage orchestration with...

Responsibilities: Work closely with product managers to understand customer needs and translate those into technical requirements. • Build and maintain scalable data management and serving infrastructure on cloud, managing terabytes of data and integrating cost. • Design a comprehensive target data architecture vision working closely with product, design and development and NatCo teams to plan transition towards the target vision • Responsible for implementation of architecture concepts in product development and services • Consult and engage with engineering teams to solve problems at their root cause • Create deliverables that provide exceptional clarity and connections to business objecti...

As an AI/ML Engineer at our company, you will be responsible for designing, developing, and optimizing traditional AI/statistical models and deep learning architectures such as RNN, LSTM, CNN, and Transformers. You will work with SQL, EDA, feature engineering, and data visualization to generate actionable insights. Additionally, you will build and fine-tune Generative AI, NLP, LLMs, Chatbots, Agentic AI, and MCP-based systems using frameworks like OpenAI, GPT, and beyond. Your role will also involve developing scalable backend solutions and model deployment pipelines using Django, FastAPI, and Flask. Furthermore, you will contribute to data engineering & ETL pipelines, including big data eco...

Role Overview: As a Power BI Developer, you will be responsible for developing, publishing, and maintaining advanced Power BI dashboards and reports. You will also build complex DAX measures, calculated tables, and data models for optimal performance. Managing Power BI workspaces, datasets, and deployment pipelines will be a key part of your role. Additionally, designing and implementing data refresh schedules, security roles (RLS), and usage monitoring will be crucial tasks to ensure the efficiency of the reports. Your role will also involve optimizing report performance, reducing query latency, and implementing visual best practices. As a Microsoft Fabric Engineer, your responsibilities wi...