867 Data Pipeline Jobs - Page 13

Salary: 15 to 25 LPA Exp: 4 to 7 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Dat...

UK-based company needed Responsibilities: * Design data solutions using Azure Data Architecture principles. * Collaborate with cross-functional teams on data integration projects. * Ensure data quality through warehousing best practices. Office cab/shuttle Food allowance Provident fund Annual bonus Health insurance

Responsibilities : - Develop and maintain data pipelines using GCP. - Write and optimize queries in BigQuery. - Utilize Python for data processing tasks. - Manage and maintain SQL Server databases. Must-Have Skills : - Experience with Google Cloud Platform (GCP). - Proficiency in BigQuery query writing. - Strong Python programming skills. - Expertise in SQL Server. Good to Have : - Knowledge of MLOps practices. - Experience with Vertex AI. - Background in data science. - Familiarity with any data visualization tool

Role Responsibilities : - Design and implement data pipelines using MS Fabric. - Develop data models to support business intelligence and analytics. - Manage and optimize ETL processes for data extraction, transformation, and loading. - Collaborate with cross-functional teams to gather and define data requirements. - Ensure data quality and integrity in all data processes. - Implement best practices for data management, storage, and processing. - Conduct performance tuning for data storage and retrieval for enhanced efficiency. - Generate and maintain documentation for data architecture and data flow. - Participate in troubleshooting data-related issues and implement solutions. - Monitor and...

Role & responsibilities Data Engineering & Analytics: Strong background in building scalable data pipelines and analytics platforms. Databricks (AWS preferred): Mandatory hands-on expertise in Databricks, including cluster management, notebooks, job orchestration, and optimization. AWS Cloud Services: Proficiency in AWS ecosystem (S3, Glue, EMR, Lambda, Redshift, IAM, CloudWatch). Programming: Expertise in PySpark and Python for ETL, transformations, and analytics. GenAI & LLMs: Experience with Large Language Models (LLM), fine-tuning, and enterprise integration. CI/CD & DevOps Knowledge: Familiarity with Git-based workflows, deployment pipelines, and automation. Preferred candidate profile ...

We are looking for skilled Data Engineer to join our team. This role involves robust ETL/ELT pipelines, developing dashboards using Power BI. Work in AWS & Conduct data profiling, validation & QC. Follow best practices in data architecture. Health insurance Provident fund

About Loadshare: LoadShare is one of India’s most innovative and resilient logistics platforms, transforming how goods move across the country. Founded in 2017, we’ve grown to become a pan-India, multi-category last-mile network with a unique presence in both Tier 1 metros and deep Tier 2/3 towns. What sets us apart: • Scale with depth: We handle ~400K deliveries/day across food, e-commerce (B2C), B2B retail, and digital commerce, powered by a 20,000+ rider network. • Strong financials, stronger ambition: With 430 Cr in FY25 revenue and support from global investors (Tiger Global, Matrix, BII, Stellaris, BeeNext), we have a long runway and a path to profitability • Dual-engine model: We not ...

Role Responsibilities : - Design and implement data pipelines using MS Fabric. - Develop data models to support business intelligence and analytics. - Manage and optimize ETL processes for data extraction, transformation, and loading. - Collaborate with cross-functional teams to gather and define data requirements. - Ensure data quality and integrity in all data processes. - Implement best practices for data management, storage, and processing. - Conduct performance tuning for data storage and retrieval for enhanced efficiency. - Generate and maintain documentation for data architecture and data flow. - Participate in troubleshooting data-related issues and implement solutions. - Monitor and...

Primary Roles And Responsibilities : - Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack. - Ability to provide solutions that are forward-thinking in data engineering and analytics space. - Collaborate with DW/BI leads to understand new ETL pipeline development requirements. - Triage issues to find gaps in existing pipelines and fix the issues. - Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs. - Help joiner team members to resolve issues and technical challenges. - Drive technical discussion with client architect and team members. - Orchestrate the data pipelines in scheduler via Airflow. Skills An...

Build data pipelines using Spark, PySpark, Python. Strong in Data Lake/Warehouse, SQL, EMR, Iceberg, Parquet. Expertise in NoSQL/Relational DBs, data modeling, AWS, APIs, CI/CD (GitLab), Docker, Kubernetes, microservices, and messaging systems.

Hi Everyone, We are hirnig for Immediate to serving candidates only. Share your resume in the given mail id rachel.sabastian@innovation.com

Job Description: Azure Databricks Engineer Position: Azure Databricks Engineer Location: [Specify Location / Remote / Hybrid] Experience Required: 4 10 years (depending on role level) Role Overview We are seeking an experienced Azure Databricks Engineer to design, develop, and optimize data pipelines and analytics solutions on Azure. The ideal candidate will have strong expertise in building scalable big data solutions using Databricks, Spark, and Azure cloud services, with a focus on delivering reliable, secure, and high-performing data platforms. Key Responsibilities Design, build, and optimize scalable ETL/ELT pipelines on Azure Databricks . Work with structured, semi-structured, and unst...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

Snowflake Developer DBT Python to design scalable data pipelines, App design optimize SQL queries, and build models using DBT. Must have strong Python skills, experience with Snowflake architecture, and a passion for data engineering best practices

SUMMARY This position is responsible for the design, development, and management of data workflows and pipelines in our Integrated Data and Analytics environment. The role combines technical leadership, team leadership, and hands-on development. RESPONSIBILITIES / TASKS Collect, move, store, and prepare data for analytics enablement. Participate in project planning sessions, working closely with business analysts and team members to analyze requirements and provide design recommendations for complex systems. Design and develop new data pipelines for ingesting high-volume data sets. Develop pipelines using disciplined processes, adhering to industry standards and best practices, with full pro...

Duration : 6 Months Timings : General IST Notice Period : within 15 days or immediate joiner About The Role : As a Data Engineer for the Data Science team, you will play a pivotal role in enriching and maintaining the organization's central repository of datasets. This repository serves as the backbone for advanced data analytics and machine learning applications, enabling actionable insights from financial and market data. You will work closely with cross-functional teams to design and implement robust ETL pipelines that automate data updates and ensure accessibility across the organization. This is a critical role requiring technical expertise in building scalable data pipelines, ensuring ...

Job Title: BI Engineer (Data Pipelines, DBT & Visualization) Experience Required: 35 Years Location: [Specify Location or Remote] Employment Type: Full-time Job Summary We are looking for a highly skilled BI Engineer with strong experience in building data pipelines, working with DBT, and creating interactive dashboards using Power BI or Symphony. The ideal candidate will be responsible for building data infrastructure and converting raw data into meaningful business insights. Key Responsibilities Design, build, and maintain ETL/ELT data pipelines. Develop and manage models using DBT (Data Build Tool). Create dashboards and reports using Power BI or Symphony. Work closely with data analysts,...

The Java Fullstack Developer + Data Engineering position is currently open in Bangalore, Chennai, Hyderabad, Mumbai, and Pune. As a candidate, you should be an Any Graduate with a minimum of 8 years of experience. You will be responsible for demonstrating a strong proficiency in Java (Java 8 or 11), Spring Boot, and REST API development. Additionally, hands-on experience with Angular (version 8 or higher), TypeScript, and RxJS is required. Experience in working with relational databases such as SQL Server or PostgreSQL is also essential. Moreover, a strong knowledge of Azure Cloud Services including Azure Data Factory, Azure Data Lake, and Azure Synapse Analytics (or similar DWH experience) ...

About Us: Our data and research teams at YipitData transform raw data into strategic intelligence, delivering accurate, timely, and deeply contextualized analysis that our customers, ranging from the world's top investment funds to Fortune 500 companies, depend on to drive high-stakes decisions. From sourcing and licensing novel datasets to rigorous analysis and expert narrative framing, our teams ensure clients get not just data, but clarity and confidence. We operate globally with offices in the US (NYC, Austin, Miami, Mountain View), APAC (Hong Kong, Shanghai, Beijing, Guangzhou, Singapore), and India. Our award-winning, people-centric culture, recognized by Inc. as a Best Workplace for t...

You will be responsible for working as an AWS Data Engineer at YASH Technologies. Your role will involve performing tasks related to data collection, processing, storage, and integration. It is essential to have proficiency in data Extract-Transform-Load (ETL) processes, data pipeline setup, as well as knowledge of database and data warehouse technologies on the AWS cloud platform. Prior experience in handling timeseries and unstructured data types, such as image data, is a necessary requirement for this position. Additionally, you should have experience in developing data analytics software on the AWS cloud, either as a full-stack or back-end developer. Skills in software quality assessment...

Job Description Summary As an experienced Technical Product Manager (TPM), youll lead the strategy, development and evolution of our Control Tower for the Subscriptions Program This role is pivotal in building a centralized intelligence and monitoring platform that provides real-time visibility, diagnostics, and decision support across the subscription lifecycle, You will work closely with engineering, data science, operations, and business stakeholders to define and deliver a robust control tower that enhances operational efficiency, customer experience, and business agility, GE HealthCare is a leading global medical technology and digital solutions innovator Our purpose is to create a worl...

We are hiring a Data Engineer to design and manage data pipelines from factory floors to the Azure cloud, supporting our central data lakehouse architecture You'll work closely with OT engineers, architects, and AI teams to move data from edge devices into curated layers (Bronze ? Silver ? Gold), ensuring high data quality, security, and performance Your work will directly enable advanced analytics and AI in production and operations, Key Job functions Build data ingestion and transformation pipelines using Azure Data Factory, IoT Hub, and Databricks 2) Integrate OT sensor data using protocols like OPC-UA and MQTT Design Medallion architecture flows with Delta Lake and Synapse Monitor and op...

Overview Of The Role The Sisal AI & Automation group is looking for a motivated and versatile expert to develop and operationalize next-generation Agentic AI systems across our business As a Senior Generative AI Engineer , you will play a critical role in shaping the software development lifecycle (SDLC) of AI products?guiding them from concept to production deployment?while also mentoring junior team members and managing multiple concurrent initiatives, Youll be joining an industry-leading team and building transformative AI solutions that drive real-world impact across Sisals portfolio, including Sports Betting, Gaming, and other domains This hybrid role combines remote work flexibility wi...

Job Title: Data Engineer Job Type: Full-time Department: Data Engineering / Data Science Reports To: Data Engineering Manager / Chief Data Officer About the Role: We are looking for a talented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining robust data pipelines and systems that process and store large volumes of data. You will collaborate closely with data scientists, analysts, and business stakeholders to deliver high-quality, actionable data solutions. This role requires a strong background in data engineering, database technologies, and cloud platforms, along with the ability to work in an Agile environment to drive dat...

You should have 6-10 years of experience in development, specifically in Java/J2EE, with a strong knowledge of core Java. Additionally, you must be proficient in Spring frameworks, particularly in Spring MVC, Spring Boot, and JPA + Hibernate. It is essential to have hands-on experience with Microservice technology, including development of RESTFUL and SOAP Web Services. A good understanding of Oracle DB is required. Your communication skills, especially when interacting with clients, should be excellent. Experience in building tools like Maven, deployment, and troubleshooting issues is necessary. Knowledge of CI/CD tools such as Jenkins and experience with GIT or similar source control tools...