774 Etl Pipelines Jobs - Page 8

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Ex...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : DevOps Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a DevOps Engineer, you will be responsible for solutioning end to end dev-ops architecture and suggesting tool for AWS, build automations, ETL pipelines, code quality & security. A typical day involves utilizing your expertise in continuous in...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : DevOps Good to have skills : NAMinimum 15 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a DevOps Engineer, you will be responsible for solutioning end to end dev-ops architecture and suggesting tool for AWS, build automations, ETL pipelines, code quality & security. A typical day involves utilizing your expertise in continuous i...

What we are looking for- You'll build and maintain systems for efficient data collection, storage, and processing to ensure data pipelines are robust and scalable for seamless integration and analysis. We are seeking an individual who not only possesses the requisite expertise but also thrives in the dynamic landscape of a fast-paced global firm. What youll do? Design/implement complex and scalable enterprise data processing and BI reporting solutions. Design, build, and optimize ETL pipelines or underlying code to enhance data warehouse systems. Work towards optimizing the overall costs incurred due to system infrastructure, operations, change management, etc. Deliver end-to-end data soluti...

Responsibilities - Design relational and document data models for agentic AI systems. - Manage SQL and NoSQL databases (Postgres, MongoDB, etc.). - Build ETL pipelines and API-based integrations. - Write optimized queries, stored procedures, and indexes. - Support microservices with Docker/Kubernetes and CI/CD. Associate: Develop and maintain DB schemas, write queries, support integration. Sr. Associate: Optimize performance, design ETL flows, mentor juniors. Manager: Architect hybrid SQL+NoSQL solutions, manage large data estates, define governance. Mandatory Skill Sets - SQL (PostgreSQL, MySQL, MS SQL). - NoSQL (MongoDB, DynamoDB, Cassandra). - Data modeling (normalized, denormalized, sche...

Key Responsibilities: Data Engineering: Design, develop, and maintain large-scale data warehouses and ETL pipelines using tools such as SSIS, Power Automate, and other relevant technologies. Create and implement data models to improve data accessibility and ensure consistency across systems. Develop and enforce data governance policies to maintain high data quality, security, and compliance. Collaborate with cross-functional teams including product, sales, and business stakeholders to refine and prioritize data requirements. Business Intelligence Development: Design, develop, and maintain business intelligence solutions using tools like Power BI and Pyramid Analytics. Build effective data vi...

Job Description : YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth - bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future. We are looking forward to hireMicrosoft Fabric Professionals in the following areas : Experience 8 Yrs to 10 Yrs Job Description 8+ years of experience in Microsoft Azure Data Engi...

Job Category Data Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn't a buzzword - it's a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agentic era You're in the right place! Agentforce is the future of AI, and you are the future of Salesforce. As a Senior Data Engineer within the Mark...

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future. We are looking forward to hire Microsoft Fabric Professionals in the following areas : Experience 8 Yrs to 10 Yrs Job Description 8+ years of experience in Microsoft Azure Data Engineering for analyti...

Role Overview: As a Data Analyst at Grexa AI, you will play a crucial role in supporting data-driven decision-making by building dashboards, automating workflows, and setting up ETL pipelines. Your contribution will be essential in enhancing business processes with your strong analytical skills and proactive mindset. Key Responsibilities: - Design and maintain dashboards to visualize key metrics. - Conduct data analysis to uncover trends and insights for informed business decisions. - Collaborate with cross-functional teams to understand data needs and provide effective solutions. - Align data strategies with the product, sales, and marketing teams. - Automate repetitive workflows and data p...

1. Must have at least 4- 8 years experience in implementing Data warehousing solutions with at least 2 year in Snowflake 2. Hands-on experience with building productionized data ingestion and processing pipelines. 3. Must have solid understanding of architecting, designing and operationalizing large scale data and analytics solutions on Snowflake Cloud Data warehouse 4. Must have experience Developing ETL Pipelines in and out of data warehouse using a combination of Python and SnowSQL 5. Must be proficient in writing queries against SnowFlake 6. Develop scripts Unix, Python etc. to do Extract, Load and Transform data. 7. Working knowledge to Provide production support for Data Warehouse issu...

Skills: Python, SQL, ETL (Talend), Data Transformation, Performance Tuning, API Integration, Cloud (AWS/Azure/GCP), DevOps CI/CD, Agile, Pandas/NumPy, Big Data (Spark/Kafka), Docker/K8s.

need handson on snowflake , dbt , azure in creating models , pipelines . basic idea on devops

Role Overview: At PwC, as a member of the business intelligence team, you will be focused on leveraging data and analytics to provide strategic insights and drive informed decision-making for clients. You will have the opportunity to develop and implement innovative solutions to optimize business performance and enhance competitive advantage. Your role will involve designing, building, and maintaining scalable ETL pipelines and data solutions while collaborating with cross-functional teams to uphold data integrity and quality. Key Responsibilities: - Design, build, and maintain exemplary ETL pipelines and data solutions - Collaborate with cross-functional teams to uphold data integrity and q...

As a Data Test Lead Architect at LTIMindtree Quality Assurance team in Gurugram or Ahmedabad, you will be responsible for the following: - Utilize your 14-16 years of experience in Advance SQL, ETL Testing, Azure Cloud data testing, BI Report Testing, and Automation for ETL and BI reports validations. - Define E2E Test strategy for large/medium scale cloud migration programs, preferably Azure. - Demonstrate strong hands-on experience with Azure tools such as Azure Data Factory (ADF), Azure Data Bricks, Azure Data Lake (ADLS), Azure SQL DB, and Postgres SQL. - Implement Data test automation solutions for data validations, BI validations, and exposure to data automation tools like Data Gaps, Q...

Role Overview: You will be a part of the Data Center Engineering team, where cutting-edge strategies are developed, tested, and implemented to take the physical design of data centers into the future. Working alongside a team of innovative minds, you will delve into complex topics such as power usage efficiency and environmentally-friendly facility operations. As a visionary, you will constantly seek opportunities for optimization and drive improvements, no matter how small, that can have a significant impact. Your role will involve generating ideas, presenting recommendations to senior executives, and collaborating with facilities technicians to implement changes. You will also be a vital m...

You are applying for the role of Principal Engineer within the Accounting & Finance Technology domain at TMUS Global Solutions, a subsidiary of T-Mobile US, Inc. In this role, you will be responsible for shaping next-generation financial data architecture by leveraging Snowflake, dbt, and modern data engineering practices to build scalable, trusted, and cost-optimized financial data solutions. Your main focus will be on transforming complex business requirements into robust financial systems that drive insights, compliance, and long-term growth in close collaboration with Finance and Accounting stakeholders. **Key Responsibilities:** - Architect & Lead Snowflake Solutions: Drive design and i...

We are seeking an experienced and highly skilled Senior Data Engineer to drive data-driven decision-making and innovation. In this role, you will leverage your expertise in advanced analytics, machine learning, and big data technologies to solve complex business challenges. You will be responsible for designing predictive models, building scalable data pipelines, and uncovering actionable insights from structured and unstructured datasets. Collaborating with cross-functional teams, your work will empower strategic decision-making and foster a data-driven culture across the organization. Role & responsibilities 1 Position Overview: We are seeking an experienced and highly skilled Senior Data ...

Data Engineering experience Strong expertise in Apache Spark (Scala) Hands-on experience with AWS EMR and AWS Glue (must-have) Proficiency in SQL and working knowledge of NoSQL databases Strong understanding of ETL pipelines and data warehousing Exposure to AWS cloud ecosystem and related data services Good to have: Oracle ERP migration experience

Position Summary We are seeking a Data Engineer / Lead Data Engineer with deep experience in data architecture, ETL pipelines, and advanced analytics support. This role is crucial for designing robust pipelines to process structured and unstructured data, integrate ML models, and ensure data reliability. The ideal candidate will be proficient in Python, R, SQL, and cloud-based tools, and possess hands-on experience in creating end-to-end data engineering solutions that support data science and analytics teams. Key Responsibilities Design and optimize data pipelines to ingest, transform, and load data from diverse sources. Build programmatic ETL pipelines using SQL and related platforms. Unde...

As a Backend GoLang Developer at our company, you will play a crucial role in designing high-performance backends, implementing complex business logic, and managing system performance in a computation-heavy environment. Your responsibilities will include: - Developing and maintaining backend services in GoLang. - Designing, managing, and optimizing large relational database schemas (MySQL/Postgres or similar). - Implementing and managing ORM frameworks (e.g., GORM or equivalent) for efficient DB interactions. - Building APIs (REST/GraphQL) for internal and external system integration. - Writing efficient SQL queries, stored procedures, and ETL pipelines for data transformation. - Building sc...

About the Role We are looking for a Software Development Engineer III specializing in Infrastructure and Data Engineering. You will design, build, and optimize scalable infrastructure and data pipelines that enable our product, analytics, and machine learning teams to deliver reliable insights and services. As a senior IC, you will work on cloud infrastructure, data modeling, and distributed systems while collaborating with product, backend, and analytics stakeholders. What You Will Do 1. Infrastructure Engineering a. Design, build, and maintain scalable cloud infrastructure (AWS/GCP/Azure). b. Implement Infrastructure-as-Code (IaC) using Terraform, CloudFormation, or similar tools. c. Ensur...

Design, develop, and implement ETL pipelines using Azure Data Factory to extract, transform, and load data from various sources into target systems. Architect and implement Azure Synapse, Data Warehouse, and Lakehouse solutions, ensuring scalability, performance, and reliability. Utilize Notebooks and Spark for data analysis, processing, and visualization to derive actionable insights from large datasets. Define and implement enterprise data platform architecture, including the creation of gold, silver, and bronze datasets for downstream use. Hands-on development experience in cloud-based big data technologies, including Azure, Power Platform, Microsoft Fabric/Power BI, leveraging languages ...

Role & responsibilities Job Description: Job Summary: We are looking for a skilled Data Engineer to join our data team. The ideal candidate will have hands-on experience in building robust data pipelines using Airflow, managing data warehouses in Snowflake and Redshift, and working with cloud platforms such as AWS and Azure (Databricks, Glue). You will work closely with Data Scientists, Analysts, and Engineers to ensure data availability, quality, and reliability across the organization. Key Responsibilities: l Design, develop, and maintain scalable ETL/ELT pipelines using Apache Airflow, AWS Glue, and Databricks. l Integrate data from multiple sources into Snowflake and Redshift data wareho...

As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution. Your primary responsibilities include: Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements. Strive for continuous improvements by testing the build solution and working under an agile framework. Discover and implement the latest technologies trends to maximize and build creative solutions Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Ex...