1149 Etl Pipelines Jobs

Job Title: Data Engineer Location: Pune, India Experience: 3 to 7 Years Job Type: Full-Time Job Summary: We are seeking a highly skilled Data Engineer with 3 to 7 years of experience to join our data engineering team in Pune. The ideal candidate must have a very strong background in designing, building, and optimizing ETL/ELT pipelines and data workflows across various cloud environments, with expertise in SQL and Python. You will play a crucial role in building and maintaining enterprise-grade data infrastructure to support analytics and data science initiatives. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines . Write advanced SQL queries for data extraction, t...

Employment Type: Contract (1 Year Extendable) Job Summary We are hiring an experienced Reltio MDM Developer with strong exposure to Life Sciences domain data (HCP/HCO, Products, Clinical, Pharma Data). The candidate will work closely with business, data, and engineering teams to build, enhance, and support enterprise-grade MDM solutions using Reltio Cloud MDM. Key Responsibilities Develop, configure, and maintain Reltio MDM solutions, including: Data models Match/merge rules Survivorship logic Workflows & validation rules Work with Life Science master data entities (HCPs, HCOs, Products, Research Data, etc.) Implement data quality and stewardship rules to support governance frameworks. Build...

As a Senior Data Engineer (Azure) at our company, you will be responsible for managing large-scale data and delivering exceptional results. Your expertise in Azure data services, ETL pipelines, and database management will be crucial for this role. If you are a proactive problem solver with a strong technical background and a positive attitude, we are looking forward to hearing from you. **Key Responsibilities:** - Develop, monitor, and maintain end-to-end data pipelines on Azure. - Work with Azure services such as Azure Data Factory (ADF), Azure Synapse, Databricks, and Azure Blob Storage for data ingestion, processing, and analytics. - Develop and optimize data ingestion, transformation, a...

Description Amazon Business (AB) is redefining B2B eCommerce by offering business customers the same selection, pricing, and convenience that millions of consumers enjoy today. The WW Ops Amazon Business team is building the next generation of operations and supply chain technology to support AB's rapid global expansion: from bulk and consolidated deliveries to palletized shipments and new services tailored to business needs. As a Data Engineer on this team, you will design and scale the data architecture that powers AB Ops worldwide, enabling high-quality, real-time insights for Products, Programs, and Supply Chain operations. You will play a critical role in shaping the foundational data s...

We are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines. You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our Databricks Data Lakehouse. You will also be provisioning and maintaining the data clusters and data catalogs, monitoring existing pipelines. Job Description DataOps Responsibilities Manage and optimize data pipelines and operations within the Databricks platform and cloud-based data lakes. Perform DML operations, data exports/imports, and sc...

Data Engineer Location: Bangalore Mode: Hybrid Role Overview We are seeking an experienced Data Engineer to design, build, and optimize data pipelines and solutions on modern big data platforms. The ideal candidate will have strong expertise in PySpark , Databricks , and distributed data processing frameworks, with a passion for delivering scalable and efficient data solutions. Key Responsibilities Design, develop, and maintain ETL pipelines using PySpark and Databricks . Work with large-scale datasets to ensure data quality, integrity, and availability. Optimize data workflows for performance and cost efficiency in cloud environments (Azure/AWS/GCP). Collaborate with data scientists, analys...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Spark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative Java-based solutions, and ensuring that applications are optimized for performance and usability. You will engage in ...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Apache Spark Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative Java-based solutions, and ensuring that applications are optimized for performance and usability. You will engage in ...

Description Would you like to join a customer-obsessed team focused on driving improved customer experiences across Amazon products and services Customer Experience & Business Trends (CXBT) is looking for a Data Engineer to design, manage, and continuously enhance our analytics infrastructure. CXBT is focused on deeply understanding and improving Amazon customer experiences globally and uses this infrastructure to develop and deliver analytics applications for metrics generation, metrics correlation, econometrics, ML models, and other use cases to ultimately help provide insights that drive enhanced customer experiences. You will drive data engineering initiatives, and build end-to-end data ...

Role :- Data Engineer Experience: 3 to 5 Years Location: Pune (Baner) Type: Full-time Role Overview We are looking for a skilled Data Engineer with deep AWS expertise to help operationalize and scale our SaaS platform. The ideal candidate should have strong hands-on experience in AWS analytics services (EMR, Glue, Athena, S3, Postgres/RDS) , data pipeline development, and cloud-native architectures. You will design, build, and maintain scalable data pipelines, implement secure cloud data architectures, optimize storage and compute performance, and ensure end-to-end operational reliability of our SaaS platform. While the role is primarily AWS-focused, some exposure to AI, vector search, or mo...

About The Role Project Role : Custom Software Engineer Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : SAP FI CO Finance Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that project goals are met, facilitating discussions to address challenges, and guiding your team through the development process. You ...

As a Microsoft Purview Data Governance Consultant / Sr. Consultant, you will be responsible for developing and deploying solutions with Microsoft Purview or similar data governance platforms. Your expertise in data governance principles, such as Metadata management, Data cataloging, Lineage tracking, and Compliance frameworks will be crucial. Additionally, you should have proficiency in Microsoft Azure services, including Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, and Azure Blob Storage. Your responsibilities will include program management where you will lead the program as a Program Leader using Agile Methodology. You will guide the team on Data Governance, Microsoft ...

As a Business Analyst at Airtel Digital Channels, your role will involve developing an in-depth understanding of user journeys and generating data-driven insights to support product decision-making. Your responsibilities will include: - Taking end-to-end ownership of key metrics and collaborating with product owners to ensure progress in the right direction. - Formulating strong hypotheses, conducting A/B experiments, and identifying opportunities with confidence. - Working cross-functionally to define problem statements, collect data, build analytical models, and provide recommendations. - Implementing efficient processes for data reporting, dashboarding, and communication. - Collaborating ...

About Gruve Gruve is an innovative software services startup dedicated to transforming enterprises to AI powerhouses. We specialize in cybersecurity, customer experience, cloud infrastructure, and advanced technologies such as Large Language Models (LLMs). Our mission is to assist our customers in their business strategies utilizing their data to make more intelligent decisions. As a well-funded early-stage startup, Gruve offers a dynamic environment with strong customer and partner networks. About The Role Are you a skilled Data Engineer passionate about building robust data pipelines that drive business decisions at global scale As a Data Engineer, you'll architect and implement the data p...

Job Summary We are seeking a highly experienced MIS Manager to lead and scale our Management Information Systems (MIS) function within the Revenue Cycle Management (RCM) domain. This role requires strong leadership, deep RCM knowledge, and advanced technical expertise to drive data strategy, automation, operational analytics, and client-facing insights. The Senior MIS Manager will oversee the MIS team, improve reporting frameworks, enhance system utilization, and ensure high-quality data-driven support for internal and external stakeholders. Key Responsibilities 1. Strategic Reporting & Advanced Analytics Oversee the design and governance of enterprise-level RCM reporting frameworks. Drive t...

Responsibilities Develop an in-depth understanding of user journeys on Airtel Digital Channels and generate data driven insights & recommendations to help product business in meticulous decision making. End-to-end ownership of key metrics, work with respective product owners to understand areas we need to measure and ensure the needle is moving in the right direction. Develop strong hypothesis, execute A/B experiments and identify area of opportunities with strong confidence level. Work cross-functionally to define problem statements, collect data, build analytical models and make recommendations. Identify and implement streamlined processes for data reporting, dash boarding and communicatio...

As an Analyst at our company, your role will involve supporting data-driven decision-making through tasks such as building dashboards, automating workflows, and setting up ETL pipelines. Your strong analytical skills and proactive mindset will be crucial in enhancing our business processes. Key Responsibilities: - Designing and maintaining dashboards to visualize key metrics. - Conducting data analysis to uncover trends and insights for business decisions. - Collaborating with cross-functional teams to understand data needs and deliver solutions. - Working closely with the product, sales, and marketing teams to understand their requirements. - Automating repetitive workflows and data process...

Description Amazon is looking for a motivated individual with strong database, analytical skills and technology experience to join the DIGI (Ad Sales Finance analytics ) team. In this position the successful candidate will be responsible for partnering with Finance and Business leaders to expand and optimize data infrastructure that supports weekly, monthly, quarterly and annual for the Display Ads Finance group and our stakeholders Key job responsibilities Owning the design, operations and improvements for the Organizations Datawarehouse infrastructure Maintain, improve and manage all ETL pipelines and clusters Explore and learn the latest AWS technologies to provide new capabilities and in...

Role Overview: As an Architect at HCLSoftware, you will be responsible for designing scalable data processing pipelines for large-scale telemetry and network data. You will play a crucial role in evaluating and implementing modern architectural patterns to ensure reliability and scalability. Additionally, you will lead integrations using various protocols such as SNMP, SSH, WMI, LLDP, CDP, REST, and gRPC. Your expertise will be utilized to oversee Kafka (streaming) and ClickHouse (OLAP) components. You will also have the opportunity to mentor development teams, drive engineering best practices, and automate DevOps processes. Your role will involve documenting and communicating architectural ...

Description We are seeking a highly skilled and experienced Software Engineer with 4-8 years of professional experience in Python and Django, specifically in building REST APIs using frameworks like FASTAPI and Django Rest Framework (DRF). The ideal candidate should have hands-on experience with Redis cache, Docker, PostgreSQL, Kafka, Elasticsearch, and ETL pipelines. Responsibilities Collaborate with cross-functional teams to design, develop, and maintain high-quality software solutions using Python, Django (including DRF), FastAPI, and other modern frameworks. Build robust and scalable REST APIs, ensuring efficient data transfer and seamless integration with frontend and third-party system...

As an AI Engineer with 4+ years of experience in building and deploying AI/ML solutions, you will be responsible for the following key responsibilities: - Designing, developing, and deploying machine learning and deep learning models for various business use cases. - Building scalable, end-to-end AI pipelines including data preprocessing, model training, evaluation, and production deployment. - Collaborating with product, engineering, and data teams to translate business requirements into AI-driven solutions. - Optimizing models for performance, accuracy, and scalability in production environments. - Conducting research on emerging AI/ML techniques and evaluating their applicability to ongoi...

Role Overview: As an experienced developer for the MART application, your main focus will be on creating detailed member-level information by developing the application's user interface and integrating it with data sources. This role involves Application (UX) development and ETL pipeline development using tools like R Shiny, JavaScript, and CSS. Key Responsibilities: - Design, develop, and maintain the user interface (UI) of the MART application using R Shiny, JavaScript, and CSS to ensure a seamless and intuitive user experience. - Develop and maintain efficient and scalable ETL pipelines using GCP Dataform and BigQuery for data extraction, transformation, and loading from various on-premis...

Design and maintain scalable ETL/ELT data pipelines Validate, enrich & prepare data for analytics & ML Manage schemas, versioning & data contracts Use PostgreSQL/SQLite, Spark/DuckDB & Airflow At dext ai, we refer candidates to AI-training companies Required Candidate profile Background in CS, data engineering or information systems Strong in Python, pandas, SQL Experience with PostgreSQL/SQLite Knowledge of Spark or DuckDB Workflow orchestration with Airflow Perks and benefits WFH at $14 per hour with flexible schedule

As a Data Test Lead Architect in the Quality Assurance team at LTIMindtree, your role will involve the following: - Utilize your 14-16 years of experience in Advanced SQL, ETL Testing, Azure Cloud data testing, BI Report Testing, and Automation for ETL and BI reports validations. - Demonstrate expertise in defining E2E Test strategy for large/medium scale cloud migration programs, with a preference for Azure. - Showcase strong hands-on experience with Azure, including Azure Data Factory (ADF), Azure Data Bricks, Azure Data Lake (ADLS), Azure SQL DB, and Postgres SQL. - Implement data test automation solutions for data validations and BI validations. - Possess exposure to data automation tool...

Role Overview: You will be part of the Data Center Engineering team where you will contribute to taking the physical design of data centers to the next level. Working in a research and development environment, you will be involved in cutting-edge strategies related to power usage, running environmentally-friendly facilities, and driving efficiency improvements. As a visionary, you will generate ideas, communicate recommendations to senior-level executives, and lead the implementation process alongside facilities technicians. Key Responsibilities: - Provide ongoing support for client users by maintaining reports, queries, and dashboards. - Size and plan for dependency changes such as system m...