772 Etl Pipelines Jobs

Infilon Technologies , a prominent software development company based in Ahmedabad, is hiring a Data Scientist (Immediate Joiner) with expertise in ETL, data management, and advanced analytics. The role requires hands-on experience with ClickHouse , strong knowledge of similarity algorithms , and the ability to build scalable data pipelines in collaboration with product, engineering, and analytics teams. Job Location: Ahmedabad, Gujarat (WFO) Required Experience: 3+ years Key Responsibilities Design, build, and maintain ETL pipelines for large-scale structured and unstructured data. Work with ClickHouse for fast, reliable querying, aggregation, and performance optimization. Develop and apply...

As the Head of Data at our company, you will have the responsibility to oversee and manage the data processes to ensure efficiency and accuracy. Your role will involve the following key responsibilities: - Design, develop, and optimize ETL/ELT pipelines for structured and unstructured data processing. - Maintain a modern data warehouse/lakehouse architecture. - Implement data partitioning, indexing, and performance tuning strategies for improved efficiency. - Establish robust cataloging, data quality rules, validation checks, and monitoring systems with a focus on data privacy and security guidelines. - Take ownership of business metrics from data extraction to analysis, hypothesis generatio...

Role Overview: As a Senior Analyst in Data & Marketing Analytics at Bain, you will play a crucial role in establishing the foundation of the marketing analytics ecosystem. This position provides an exciting opportunity for an experienced analyst to broaden responsibilities and contribute to strategic outcomes. You will be involved in designing data infrastructure, providing insights, and facilitating scalable reporting, all while collaborating closely with marketing, digital, and technology stakeholders. Your role will encompass tasks ranging from constructing data pipelines and dashboards to leading agile projects and engaging in important discussions to influence how analytics drives strat...

About The Role: We are looking for ambitious and authentic Support Engineers who are excited to bring fresh ideas from all areas to their work, including artificial intelligence, natural language processing, UI design, mobile, information retrieval, distributed computing, large-scale system design, networking and data storage, security, and more. As a Support Engineer at DevRev, you will have the opportunity to build things that truly matter and to work with a thriving global team. What You'll Do: Bachelor's in Computer Science or related technical field/equivalent practical experience. 3-6 years of experience in a technical support, solutions engineering, or integration support role. Hands-...

Roles and Responsibilities A Databricks Platform Administrator is a crucial role responsible for the effective design, implementation, maintenance, and optimization of the Databricks Lakehouse Platform within an organization. This individual ensures the platform is scalable, performant, secure, and aligned with business objectives, providing essential support to data engineers, data scientists, and analysts. Key Responsibilities: 1. Provision and configure Databricks workspaces, clusters, pools, and jobs across environments. 2. Create catalogs, schemas, access controls, and lineage configurations. 3. Implement identity and access management using account groups, workspace-level permissions, ...

Design, Develop, and Maintain ETL Processes: o Build and maintain scalable ETL pipelines inPython to extract, transform, and load data into Snowflake master tables.Automate data mastering, manage incremental updates, and ensure consistencybetween landing and master tables. Data Modeling: o Create and optimize logical and physical datamodels in Snowflake for efficient querying and reporting. Translate businessneeds into well-structured data models, defining tables, keys, relationships,and constraints. Analytical Thinking and Problem Solving: o Analyze complex datasets, identify trends, andwork with analysts and stakeholders to resolve data challenges. Investigatedata quality issues and design...

Interested candidates please share your resume to vaibhavi-goyal@hcltech.com Dear Talent, Greetings from HCL Technologies!! We are pleased to inform you that we currently have opening for GCP Role Skill required: GCP, Location -Hyderabad Experience -5+ years Notice: Immediate- 60 Days Interview mode Face to Face Please revert with the below details along with your Update CV. Name: Contact Number: Email ID: Total Exp: Relevant Exp: Current CTC: Expected CTC: Current Org: Current Location: Preferred location: Notice Period: Available Date 8-Nov-25: Yes/No Available Timing (8:00 AM- 4:00 PM):

Key Responsibilities: The ideal candidate will have strong expertise in Snowflake, Hadoop ecosystem, PySpark, and SQL, and will play a key role in enabling data-driven decision-making across the organization. Design, develop, and optimize robust data pipelines using PySpark and SQL. • Implement and manage data warehousing solutions using Snowflake. Work with large-scale data processing frameworks within the Hadoop ecosystem. Collaborate with data scientists, analysts, and business stakeholders to understand data requirements. Ensure data quality, integrity, and governance across all data platforms. Monitor and troubleshoot data pipeline performance and reliability. Automate data workflows an...

Job Title: Hadoop Administrator Location: Chennai, India Experience: 4+yrs of experience in IT, with At least 3+ years of experience with cloud and system administration. At least 3 years of experience with and strong understanding of big data technologies in Hadoop ecosystem Hive, HDFS, Map/Reduce, Flume, Pig, Cloudera, HBase Sqoop, Spark etc. Company: Smartavya Analytica Private limited is a niche Data and AI company. Based in Pune, we are pioneers in data-driven innovation, transforming enterprise data into strategic insights. Established in 2017, our team has experience in handling large datasets up to 20 PBs in a single implementation, delivering many successful data and AI projects acr...

Role & responsibilities : Data Pipeline Development & Management Design and implement robust, scalable ETL/ELT pipelines using Databricks and Apache Spark Process large volumes of structured and unstructured data Develop and maintain data workflows using Databricks workflows, Apache Airflow, or similar orchestration tools Optimize data processing jobs for performance, cost efficiency, and reliability Implement incremental data processing patterns and change data capture (CDC) mechanisms Databricks Platform Engineering Build and maintain Delta Lake tables and implement medallion architecture (bronze, silver, gold layers) Develop streaming data pipelines using Structured Streaming and Delta Li...

The Oracle Cloud Infrastructure (OCI) Security and Compliance Platform Engineering organization presents a rare opportunity to contribute to the development of next-generation, AI-driven cybersecurity solutions at cloud scale. This effort centers on ingesting and processing massive volumes of telemetry and security event data across OCI, leveraging advanced techniques including generative AI (GenAI), large language models (LLMs), and machine learning (ML) to build intelligent detection, response, and mitigation systems. The goal is to deliver autonomous, adaptive security capabilities that protect OCI, Oracle, and our global customer base against evolving threat landscapes. Inviting you to b...

The Oracle Cloud Infrastructure (OCI) Security and Compliance Platform Engineering organization presents a rare opportunity to contribute to the development of next-generation, AI-driven cybersecurity solutions at cloud scale. This effort centers on ingesting and processing massive volumes of telemetry and security event data across OCI, leveraging advanced techniques including generative AI (GenAI), large language models (LLMs), and machine learning (ML) to build intelligent detection, response, and mitigation systems. The goal is to deliver autonomous, adaptive security capabilities that protect OCI, Oracle, and our global customer base against evolving threat landscapes. Inviting you to b...

Must-have Skills BS/MS degree or equivalent in related technical field involving coding or equivalent practical experience with 5+ years of overall experience Experience in building and designing microservices and/or cloud native applications. Either strong on databases front or on building big data systems (including ETL pipelines) Being a problem solver with strong can-do attitude and ability to think on the go would be critical for success on this role. Strong fundamentals on OS, networks, distributed systems, designing fault tolerant and high available systems. Strong on at least one of the modern programming languages (Java, Kotlin, Python, C#) along with containers experiences (likes o...

Job Purpose and Impact The Professional, Data Engineering job designs, builds and maintains moderately complex data systems that enable data analysis and reporting. With limited supervision, this job collaborates to ensure that large sets of data are efficiently processed and made accessible for decision making. Key Accountabilities DATA & ANALYTICAL SOLUTIONS: Develops moderately complex data products and solutions using advanced data engineering and cloud based technologies, ensuring they are designed and built to be scalable, sustainable and robust. DATA PIPELINES: Maintains and supports the development of streaming and batch data pipelines that facilitate the seamless ingestion of data f...

Read Full JD To Apply - Submit Details Via this form (Mandatory)- https://docs.google.com/forms/d/e/1FAIpQLSfkidUD2wwenJTQVCKuLSYofPUBQv935gy42e5J6WjSroWfvA/viewform Job Title: T&T | Engineering | ADMM | Consultant | AWS Location: Bengaluru Designation: Consultant As a Consultant in our team, youll build and nurture positive working relationships with both internal teams and clients, with the intention to exceed client expectations. You will actively contribute to the design, development and delivery of cloud-native, data-driven solutions that help clients transform their technology landscapes and make better use of their data. Role & responsibilities Develop, maintain and enhance web applic...

Role & responsibilities We are seeking a skilled and motivated Azure Cloud Data Engineer to join our cloud engineering team. In this role, you will design, develop, and maintain scalable data systems and cloud-based solutions using Microsoft Azure. This role is ideal for someone who thrives at the intersection of data and cloud, with responsibilities split evenly between data a nd cloud engineering. You will play a key role in shaping our cloud data strategy, mentoring junior engineers, and driving best practices across the organization. Key Responsibilities: Data Engineering: Design data architectures that support scalability, security, and performance spanning multiple cloud environments. ...

Role and Responsibilities Design, develop, and maintain ETL pipelines across Zoho applications and SaaS platforms. Implement Deluge scripts to automate workflows and data transformations within Zoho. Configure and manage Zoho Analytics for data modeling, cleansing, dashboards, and BI reporting. Integrate Zoho with external SaaS tools and cloud platforms using Zoho Flow, REST APIs, and third-party connectors (Zapier, Make, etc.). Perform data migration, validation, and quality checks to ensure accuracy and consistency across systems. Collaborate with product, finance, sales, and operations teams to deliver data-driven insights. Ensure data governance, security, and compliance within SaaS and ...

What you'll do: Create and maintain optimal data pipeline architecture. Identify, design, and implement internal process improvements, automating manual processes, optimizing data delivery, re-designing infrastructure for scalability. Design, develop and deploy high volume ETL pipelines to manage complex and near-real time data collection. Develop and optimize SQL queries and stored procedures to meet business requirements. Design, implement, and maintain REST APIs for data interaction between systems. Ensure performance, security, and availability of databases. Handle common database procedures such as upgrade, backup, recovery, migration, etc. Collaborate with other team members and stakeh...

As a Senior Analyst, Data & Marketing Analytics at Bain, you will play a crucial role in building the foundation of the marketing analytics ecosystem. Your responsibilities will involve designing data infrastructure, delivering insights, and enabling scalable reporting in collaboration with marketing, digital, and technology stakeholders. This opportunity allows you to shape how analytics powers strategic marketing at Bain, from building data pipelines to leading high-stakes discussions. **Responsibilities:** - **Data Analytics & Insight Generation (30%)** - Analyze marketing, digital, and campaign data to uncover patterns and deliver actionable insights. - Support performance measurement, e...

As a Technology Leader specializing in AI/ML and Generative AI, your role will involve architecting, designing, and implementing enterprise-grade AI platforms. Your expertise in LLMs, RAG, Agentic AI, and Azure AI Services will be crucial in driving the AI-first transformation journey for large enterprises. Additionally, you will be responsible for building AI-powered digital expert systems and leading teams to deliver scalable, secure, and business-aligned AI solutions. Key Responsibilities: - Architect and implement AI/ML and Generative AI platforms for large-scale enterprise adoption. - Develop RAG pipelines, Agentic AI workflows, and LLMOps frameworks using LangChain, LangGraph, and Hugg...

Role Overview: As the Lead Data Scientist Healthcare Domain Specialist at RT Global Infosolutions Pvt Ltd, you will play a key leadership role in the data science team, defining strategies, leading projects, and collaborating with healthcare professionals, engineers, and product teams to deploy scalable AI solutions. Your primary focus will be on developing AI models for elderly fall risk assessment, analyzing healthcare-specific data, applying domain expertise in healthcare, collaborating with experts, managing data engineering tasks, evaluating and optimizing models, ensuring compliance with healthcare data regulations, staying updated with the latest research, managing the team, and stake...

As a skilled Sr. Production Support Engineer at Yubi, you will be an integral part of the Engineering team, responsible for ensuring the smooth operation of systems and processes. Your primary focus will be on debugging day-to-day issues, identifying root causes, and implementing solutions to enhance system performance and reliability. Key Responsibilities: - **Incident Debugging and Resolution:** - Investigate and resolve daily production issues to minimize downtime and ensure stability. - Perform root cause analysis and implement solutions to prevent recurring issues. - **Data Analysis and Query Writing:** - Write and optimize custom queries for MySQL, Postgres, MongoDB, Redshift, or other...

Analyzing solutions through the lens of client requirement metrics as well as business domain Conceptual thinking and the ability to find innovative ways to solve analytical problems Engage with leadership and diversified stakeholder groups to understand their analytical needs and recommend Business intelligence solutions. Own the design, development, and maintenance of ongoing performance metrics, reports, analyses, dashboards, etc. to drive key business decisions Work with data engineering, Machine learning and software development teams to enable the appropriate capture and storage of key data points Conduct written and verbal presentations to share insights and recommendations to audienc...

About WPP Media WPP is the creative transformation company. We use the power of creativity to build better futures for our people, planet, clients and communities. For more information, visit wpp.com. WPP Media is WPP's global media collective. In a world where media is everywhere and in everything, we bring the best platform, people, and partners together to create limitless opportunities for growth. For more information, visit wppmedia.com Role At WPP Media, we believe in the power of our culture and our people. It's what elevates us to deliver exceptional experiences for both our clients and each other. In this role it will be critical to embrace WPP & WPP Media's shared core values: Be E...

Job Description :- Python Developer (Airflow & ETL Specialist) Experience: 5+ Years Location: Gurgaon / Remote (as applicable) About the Role We are looking for an experienced Python Developer with strong hands-on experience in Apache Airflow and ETL pipeline development. The ideal candidate will be responsible for designing, building, and maintaining data workflows, ensuring scalability, performance, and reliability of data processing systems. This role requires a deep understanding of data integration, orchestration, and automation within modern cloud or on-prem data ecosystems. Key Responsibilities Design, develop, and maintain ETL workflows and data pipelines using Python and Apache Airf...