785 Etl Pipelines Jobs - Page 14

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key Skills - sql,python,data warehousing,etl,amazon redshift,Data Engineering.

Job Summary: We are seeking a highly skilled and motivated Technical Lead with 10 to 18 years of strong experience in Java, Kafka , data transformation, and ETL pipelines . The ideal candidate will have a deep understanding of Azure cloud services and Data Lake architecture , and will play a key role in designing and implementing scalable data solutions to support business analytics and decision-making. Key Responsibilities: Write efficient and scalable code in Java for data ingestion, transformation, and analytics. Design, develop, and maintain robust ETL pipelines for large-scale data processing. Implement real-time and batch data streaming solutions using Apache Kafka . Collaborate with d...

As a Solution Architect at Techvantage.ai, you will play a crucial role in designing robust, scalable, and secure architectures that support AI-driven applications and enterprise systems. Your responsibilities will include architecting end-to-end solutions, guiding teams in selecting the right technologies, collaborating with AI/ML teams, defining system architecture diagrams, and providing leadership on best practices for software development, DevOps, and cloud-native architecture. Key Responsibilities: - Architect end-to-end solutions for enterprise and product-driven platforms, including components such as data pipelines, APIs, AI model integration, cloud infrastructure, and user interfac...

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key Skills Data analytics,ETL,SQL,Python,Google Big Query,AWS Redshift,Data architecture*

Position: API & Data Integration Engineer Experience: 5-8 Years Location: Gurgaon / Noida / Pune / Bangalore Type: Full-Time Team: Advanced Intelligence Work Group Contact : 9258253740 About the Role: We are seeking an experienced API & Data Integration Engineer to design, build, and maintain backend integrations across internal systems, third-party APIs, and AI copilots. The role involves API development, data pipeline engineering, no-code automation, and cloud-based architecture with a focus on scalability, security, and compliance. Key Responsibilities: Build and maintain RESTful APIs using FastAPI Integrate third-party services (CRMs, SaaS tools) Develop and manage ETL/ELT pipelines for ...

Design and implement scalable data architectures to optimize data flow and analytics capabilities Develop ETL pipelines, data warehouses, and real-time data processing systems Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery Work closely with data scientists to enhance machine learning models with structured and unstructured data Prior experience in handling large-scale datasets is preferred Mandatory Key SkillsETL pipelines,data warehouses,SQL,Python,AWS Redshift,Google BigQuery,ETL*

Design and implement scalable data architectures to optimize data flow and analytics capabilities Develop ETL pipelines, data warehouses, and real-time data processing systems Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery Work closely with data scientists to enhance machine learning models with structured and unstructured data Prior experience in handling large-scale datasets is preferred Mandatory Key SkillsPython,AWS Redshift,Google BigQuery,ETL pipelines,data warehousing,data architectures,SQL*

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key SkillsData analytics,ETL,SQL,Python,Google Big Query,AWS Redshift,Data architecture*

Design and implement scalable data architectures to optimize data flow and analytics capabilities Develop ETL pipelines, data warehouses, and real-time data processing systems Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery Work closely with data scientists to enhance machine learning models with structured and unstructured data Prior experience in handling large-scale datasets is preferred Mandatory Key Skillspython,data warehousing,etl,amazon redshift,bigquery,data engineering,data architecture,aws,machine learning,data flow,etl pipelines,real-time data processing,java,spring boot,microservices,spark,kafka,cassandra,scala,nosql,mongodb,rest...

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key SkillsSQL,Python,data warehousing,etl,amazon redshift,bigquery,data engineering,AWS,machine learning,real-time data processing,Java,spring boot,microservices,spark,Kafka,Cassandra,Scala,NoSQL,mongodb,Redis,data architecture*

Urgent Hiring in Genpact for Senior Data Engineer Location: Bangalore, Genpact office Prestige Park Shift Timings- 12 PM to 10 PM IST Work Mode: Hybrid Permanent role Looking for candidate with immediate to 30 days' notice period Title: Senior Data Engineer AWS | ETL | SQL | Python Job Description: We are looking for a Senior Data Engineer (2+ years with strong expertise in AWS cloud technologies, ETL pipelines, SQL optimization, and Python scripting . The role involves building and maintaining scalable data pipelines while leveraging AWS services to enable seamless data transformation and accessibility. Key Responsibilities: Build and optimize ETL pipelines using AWS Step Functions & AWS La...

As a Senior Technical Lead for gaming content at Aristocrat, your role will involve leading data validation and testing for the QA strategy in data engineering. You will be responsible for establishing and leading the QA strategy for the data engineering stack, including pipelines, transformations, reporting, and data quality checks. Your key responsibilities will include: - Designing and implementing test strategies for ETL pipelines, data transformations, and BI dashboards. - Conducting manual and automated testing for data pipelines and reports. - Validating Looker dashboards and reports for data correctness, layout integrity, and performance. - Automating data validations using SQL and P...

The Oracle Cloud Infrastructure (OCI) Security and Compliance Platform Engineering organization presents a rare opportunity to contribute to the development of next-generation, AI-driven cybersecurity solutions at cloud scale. This effort centers on ingesting and processing massive volumes of telemetry and security event data across OCI, leveraging advanced techniques including generative AI (GenAI), large language models (LLMs), and machine learning (ML) to build intelligent detection, response, and mitigation systems. The goal is to deliver autonomous, adaptive security capabilities that protect OCI, Oracle, and our global customer base against evolving threat landscapes. Inviting you to b...

Essential Duties and Responsibilities (include the following, and other duties may be assigned): Data Modeling: ? Strong foundation in data modeling, and reporting to ensure our data infrastructure supports efficient analytics and reporting operations. ? Collaborate with stakeholders and cross functional teams to understand business requirements and define data structures and relationships. ? Design, develop and maintain robust, and scalable data models and schemas to support analytics and reporting requirements. Data Integration: ? Integrate data from different sources, both internal and external, to create a unified and comprehensive view of the data. ? Work closely with cross-functional t...

Join us as we work to create a thriving ecosystem that delivers accessible, high-quality, and sustainable healthcare for all. athenahealth is a progressive & innovative U.S. health-tech leader , delivering cloud-based solutions that improve clinical and financial performance across the care continuum. Our modern, open ecosystem connects care teams and delivers actionable insights that drive better outcomes. Acquired by Bain Capital in a $17B deal , we're growing fast and investing in bold, strategic product innovations. We foster a values-driven culture focused on flexibility, collaboration, and work-life balance . Headquartered in Boston , we have offices in Atlanta , Austin , Belfast , Bur...

Role & responsibilities Design, develop, and optimize data pipelines using PySpark and AWS services. Implement and manage data workflows, ETL processes, and schema validations. Ensure data quality, integrity, and consistency by applying validation frameworks (e.g., Deequ, Great Expectations). Work with data in different zones (raw, staging, curated) and implement partitioning, schema evolution, and governance best practices. Collaborate with analysts, data scientists, and cross-functional teams to deliver reliable and consumable datasets. Support data lineage, metadata management, and compliance requirements. Strong hands-on experience with PySpark & Python for ETL, data transformation, and ...

Role & responsibilities Skill - Data Engineer- Python ,AWS ,glue, Lamba ,API Exp - 10+ Yrs. Location - Gurugram Notice period - Immediate Preferred candidate profile PFB JD We are seeking an experienced Lead Data Engineer with strong expertise in Python, AWS cloud services, ETL pipelines, and system integrations. The ideal candidate will lead the design, development, and optimization of scalable data solutions and ensure seamless API and data integrations across systems. You will collaborate with cross-functional teams to implement robust DataOps and CI/CD pipelines. Key Responsibilities: Responsible for implementation of scalable, secure, and high-performance data pipelines. Design and deve...

Job Application Link: https://app.fabrichq.ai/jobs/e1003d62-f76d-4ee1-b787-da40ce6f717f Job Summary: You will act as a key member of the Data consulting team, working directly with partners and senior stakeholders. You will design and implement big data and analytics solutions. Communication and organisational skills are key for this position. Key Responsibilities Develop data solutions within a Big Data Azure and/or other cloud environments Working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams Build and design Data Architectures using Azure Data factory, Databricks, Data lake, Synapse Liaising with CTO, Product Owners and other Operations t...

Job Application Link: https://app.fabrichq.ai/jobs/b41f52d2-09e3-4f5e-9bf2-c587f6a0551f Job Summary: Junior Data Engineer role at Aays Analytics focused on designing and implementing data and analytics solutions on Google Cloud Platform (GCP). The position involves working with clients to reinvent their corporate finance functions through advanced analytics. Key responsibilities include architecture design, data modeling, and mentoring teams on GCP-based solutions. Key Responsibilities Design and drive end-to-end data and analytics solution architecture from concept to delivery on Google Cloud Platform (GCP) Design, develop, and support conceptual, logical, and physical data models for advan...

DESCRIPTION Are you interested in building high-performance, globally scalable Financial systems that support Amazon's current and future growth Are you seeking an environment where you can drive innovation Does the prospect of working with top engineering talent get you charged up If so, Amazon Finance Technology (FinTech) is for you.We have a team culture that encourages innovation and we expect developers to take a high level of ownership for the product vision, technical architecture,build a scalable,service-oriented platform and continuously innovate on behalf of our customers. FinTech systems process large scale data sets eliminating several thousand hours of manual work for global Acc...

Role Overview: At WRD, we are redefining the world of IT consulting by merging human expertise with cutting-edge AI technology. Join us to work on the forefront of AI-powered innovation, where your skills drive real impact, creativity meets advanced technology, and each project sets a new standard in IT excellence. Key Responsibilities: - Develop & Maintain data pipelines to support business and analytical needs. - Work with structured and unstructured data to ensure high data quality and availability. - Build scalable and efficient data workflows using SQL, Python, and Java/Scala. - Manage and process large datasets on AWS EMR and other cloud platforms. - Develop and maintain batch and stre...

Greetings!!! Role : Senior Data Engineer with GCP, ETL Location- 100 % Remote Exp Range- 4+ Yrs Notice Period- Immediate Joiners only. Duration- 4 months Contract Time: 11 am to 8 pm IST Must have skills: 1. GCP - GCS, PubSub, Dataflow or DataProc, Bigquery, Airflow/Composer, Python(preferred)/Java 2. ETL on GCP Cloud - Build pipelines (Python/Java) + Scripting, Best Practices, Challenges 3. Knowledge of Batch and Streaming data ingestion, build End to Data pipelines on GCP 4. Knowledge of Databases (SQL, NoSQL), On-Premise and On-Cloud, SQL vs No SQL, Types of No-SQL DB (At least 2 databases) 5. Data Warehouse concepts - Beginner to Intermediate level If you are interested , please share yo...

You will be responsible for testing ETL pipelines with a focus on source to target validation. Your key skills will include: - Proficiency in SSMS (SQL Server Management Studio) - Familiarity with Azure Synapse, including understanding of medallion architecture and PySpark notebooks - Strong understanding of Data Warehousing - Excellent communication skills - Extensive experience working in Agile Qualifications required for this role: - Minimum 5 years of experience as an ETL Test Engineer - Proficiency in SSMS, Azure Synapse, and testing ETL pipelines - Strong understanding of Data Warehousing concepts - Excellent communication skills - Experience working in Agile environments The company o...

Why Choose Decision Point At Decision Point , we empower data-driven transformation by delivering innovative, scalable, and future-ready analytics solutions. With a proven track record in the CPG, Retail, and Manufacturing industries, we combine deep domain expertise with cutting-edge technologies to enable smarter decisions at every level of the enterprise. By joining our team, youll be part of a collaborative culture that values creativity, learning, and continuous improvement. We offer opportunities to work on high-impact projects with global clients, and leverage the latest cloud and data engineering tools to solve real-world business challenges. Key Responsibilities Design, develop, and...

Walk-in Drive | Senior Data Engineer | 310 Years Experience | 16th18th Sep 2025 | 10 AM–5 PM Are you ready to take the next big leap in your data engineering career? We are hiring Senior Data Engineers with 3–10 years of experience for a dynamic team that's shaping the future of data-driven solutions. Walk-in Dates: 16th, 17th, and 18th September 2025 Time: 10:00 AM – 5:00 PM Location: One International Center, Tower 2, 27th Floor, Senapati Bapat Marg, Near Prabhadevi Railway Station, Mumbai - 400013 Role: Senior Data Engineer Must-Have Skills Python (Advanced): Data processing & automation ETL Pipelines: Design, build, maintain using Talend Studio SQL & NoSQL: Complex queries and data handl...