1569 Data Pipeline Jobs - Page 8

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL. Works independently and has a deep understanding of data warehousing solutions including Snowflake BigQuery Lakehouse and Delta Lake. Capable of calculating costs and understanding performance issues related to data solutions. Outcomes: Act creatively to develop pipelines and applications by selecting appropriate technical options optimizing application development mainten...

Key Responsibilities Design, develop, and maintain end-to-end data pipelines using Azure Data Factory (ADF) , Databricks , Synapse Analytics , and related Azure services. Implement ETL/ELT processes to integrate data from multiple structured and unstructured data sources. Build and optimize data lake and data warehouse solutions in Azure Data Lake Storage (ADLS) and Azure Synapse . Collaborate with data scientists, analysts, and business stakeholders to deliver scalable data solutions. Develop CI/CD pipelines for data workflows using Azure DevOps or equivalent tools. Implement data governance, quality, and security best practices following enterprise standards. Monitor, troubleshoot, and opt...

Design and develop end-to-end data solutions using Microsoft Fabric, including Data Pipelines, Lakehouse, Notebooks, and Dataflows. Build and maintain efficient ETL/ELT pipelines using Data Factory in Fabric. Integrate data from diverse sources into OneLake and organize it into structured, queryable formats (Delta Lake, Parquet, etc.). Collaborate with data analysts, data scientists, and business stakeholders to deliver high-quality, reliable data models for analytics. Optimize data performance and storage for large-scale data processing using Synapse Real-Time Analytics and SQL Endpoints. Implement CI/CD pipelines for Fabric projects using Git integration and deployment pipelines. Ensure da...

Design and implement robust, scalable data pipelines using Snowflake and modern ETL/ELT frameworks. Collaborate with data architects, analysts, and business stakeholders to understand data requirements and translate them into technical solutions. Optimize Snowflake performance through clustering, partitioning, and query tuning. Develop and maintain data models (star/snowflake schemas) and data marts for enterprise reporting. Integrate data from diverse sources including APIs, cloud storage (AWS/GCP/Azure), and on-prem systems. Ensure data quality, security, and governance through automated validation, masking, and role-based access controls. Support CI/CD workflows and infrastructure-as-code...

Were Hiring: Senior Data Engineer | Bangalore If you love building things that actually move data with speed and clarity, this role will feel like home. You’ll spend your days shaping scalable pipelines, owning cloud-first solutions, and partnering with people who genuinely care about doing good work. Here’s what the job looks like: What you’ll do • Refactor and build reusable data pipelines in AWS and Databricks • Work closely with analysts, data scientists, architects, and business teams • Build cloud-native solutions across data lakes, warehouses, ETL and backend services • Take part in code reviews and solid documentation • Tune pipelines for cost, scale, reliability, and security • Put ...

We are looking for a skilled Sr Technical Lead-Data Engg to join our team at Birlasoft (India) Limited. The ideal candidate will have a strong background in data engineering and technical leadership. Roles and Responsibility Design and implement large-scale data pipelines and architectures. Lead the development of data engineering solutions using various technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain technical documentation for data engineering projects. Troubleshoot and resolve complex technical issues related to data engineering. Mentor junior team members to improve their skills and knowledge. Disclaimer: This jo...

SUMMARY About tsworks: tsworks is a leading technology innovator, providing transformative products and services designed for the digital-first world. Our mission is to provide domain expertise, innovative solutions and thought leadership to drive exceptional user and customer experiences. Demonstrating this commitment , we have a proven track record of championing digital transformation for industries such as Banking, Travel and Hospitality, and Retail (including e-commerce and omnichannel), as well as Distribution and Supply Chain, delivering impactful solutions that drive efficiency and growth. We take pride in fostering a workplace where your skills, ideas, and attitude shape meaningful ...

Company Description: Tatvic is a marketing analytics company that focuses on generating insights from data through its long-standing association with Google and its infrastructure. We believe in breeding, recognizing, and rewarding performance. As a company, we are growing rapidly and undergoing a major transformation. To enable this evolution, we seek future leaders who can balance sharp execution with strong strategic foresight. Website: www.tatvic.com Were Hiring: Principal Solution Architect Agentic AI & Cloud Location: Ahmedabad Department: Strategy What You’ll Do Architect end-to-end AI, cloud, and data solutions. Design scalable multi-agent and LLM-integrated systems. Build reference ...

Title: Lead Machine Learning Engineer Location: Vashi, Navi Mumbai As a Lead Machine Learning Engineer, you will be the hands-on technical owner of ML systems that power large-scale data collection, extraction, enrichment, and understanding of unstructured content. You’ll design, build, and operate end-to-end solutions—from feature generation and training to low-latency inference and observability. These solutions will measurably improve coverage, freshness, quality, and unit cost across our data pipelines. Your toolbox spans classical ML, NLP, LLMs/GenAI, Agentic AI, Retrieval-Augmented Generation (RAG) frameworks, and Model Context Protocol (MCP). You will use these to deliver retrieval, e...

Core Python Development Exceptional Debugging and Troubleshooting Skills Advanced Python Programming Front-End Debugging Awareness Proficiency with Git Budget - Upto 25 LPA Required Candidate profile Strong Python programmer with expertise in Pandas, NumPy, debugging, and API workflows. Skilled in code maintenance, data processing, and front-end debugging. Understanding of statistics and Git. Perks and benefits Pick and Drop Cab Facility

Description : About The Role : We are looking for a motivated SQL/Python Developer with hands-on experience in SQL, Python, and basic exposure to Snowflake. The ideal candidate should have a good understanding of querying databases, working with datasets, and supporting data pipelines. Basic knowledge of Git for version control is a plus. Key Responsibilities : - Write, execute, and optimize SQL queries for data extraction, transformation, and analysis. - Develop Python scripts to automate data processing and reporting tasks. - Work with Snowflake to access and run queries on cloud-based data warehouses. - Support data integration, validation, and ETL processes. - Collaborate with team membe...

Position Overview : We are looking for a seasoned Data Architect with deep expertise in the Azure and Microsoft ecosystem to design, build, and optimize enterprise-grade data solutions across hybrid environments. You will play a pivotal role in defining the data architecture strategy, leading complex data initiatives, and ensuring our data platforms are secure, scalable, and aligned with business objectives. Architecture & Design : - Design and implement end-to-end data architectures leveraging Azure cloud and on-premises Microsoft technologies. - Develop data strategy, standards, and governance frameworks to ensure data consistency, integrity, and availability. - Create and maintain data mo...

A Quantitative Developer, often called a "Quant Dev," is a highly specialized professional who works at the intersection of finance, mathematics, and computer science. This role involves designing, implementing, and optimizing algorithms and software solutions for complex financial problems, such as trading strategies, risk management, and pricing models. A successful Quant Dev combines deep programming expertise with a strong grasp of quantitative finance principles. Key Responsibilities : - Develop, implement, and maintain complex quantitative models and algorithms for high-frequency trading, risk management, or portfolio optimization. - Write high-performance, low-latency code in language...

Role & responsibilities Minimum 4 years of overall experience in data engineering and 2+ years leading a team as team lead and doing project management. Experience working with a global team and remote clients. Hands on experience in building data pipelines on various infrastructures. Knowledge of statistical and machine learning techniques. Hands on experience in integrating machine learning in data pipelines. Ability to work hands-on with the data engineers in the team in design and development of the solution using the relevant big data technologies and data warehouse concepts Strong knowledge of advanced SQL, data warehousing concepts, DataMart designing. Have strong experience in modern...

Experience Required : Minimum 7+ Years (Mandatory) Job Type : Full-time | Day Shift (IST) Job Description : We are looking for a skilled and experienced Databricks Engineer to join our team at our Hyderabad (Madhapur) office. The ideal candidate will have a strong background in data engineering, hands-on experience with Databricks, and a solid understanding of cloud platforms (AWS, Azure, or GCP). This is a great opportunity to work on cutting-edge data projects in a collaborative and fast-paced environment. Key Responsibilities : - Design and implement scalable and efficient data pipelines, ETL/ELT processes, and data integration solutions using Databricks. - Work with large-scale structure...

Roles and Responsibilities : - Create and maintain efficient and scalable data models as per business needs - Create and maintain optimal data pipelines against multiple data sources lie SQL, BigData on Azure / AWS cloud; - Assemble and process large, complex data sets to meet both functional and non-functional business requirements; - Analyze and improve existing data models, pipelines, related infrastructure and processes - Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics; - Monitor and improve data quality and data governance policies - Collaborate with stakehold...

About The Opportunity : We are seeking a highly skilled Lead Data Engineer with strong expertise in Python, Pandas, PySpark, AWS, and SQL to design, build, and manage scalable data solutions. The ideal candidate will lead a team of data engineers, develop robust ETL pipelines, and collaborate with analytics, data science, and business teams to ensure high data quality and performance across cloud-based environments. Role & Responsibilities : - Lead the design and development of data pipelines for ingestion, transformation, and integration from multiple sources into the enterprise data platform. - Implement data quality frameworks, validation checks, and monitoring solutions using Python and ...

About the Opportunity : Join a dynamic leader in the cloud data engineering sector, specializing in advanced data solutions and real-time analytics for enterprise clients. This role offers an on-site opportunity in India to work on cutting-edge AWS infrastructures where innovation is at the forefront of business transformation. This opportunity is ideal for professionals with 4+ years of proven experience in AWS data engineering, Python, and PySpark. You will contribute to designing, optimizing, and maintaining scalable data pipelines that drive business intelligence and operational efficiency. Role & Responsibilities : - Design, develop, and maintain robust AWS-based data pipelines using Py...

Required Skills & Qualifications: Experience: Minimum 5-8 years of experience as a Data Scientist or similar role, with a focus on NLP, machine learning, and AI. At least 3 years in a senior or lead capacity. NLP & Document Processing Expertise: Proven experience applying NLP techniques such as Named Entity Recognition (NER), Optical Character Recognition (OCR), information extraction, document classification, and semantic analysis for data extraction from unstructured text. Generative AI: Advanced knowledge of Generative AI models (e.g., GPT-3, BERT, T5) and experience applying them to real-world document and text processing tasks. Cloud Technologies: Extensive experience with cloud platfor...

Hiring Data Engineers for Pune: Strong: Python Coding, PySpark Coding Good: Data Pipelines, Airflow, CI/CD, Databricks, Azure Services 80 Years Old Reputed MNC Company

Manage the restaurant as an independent profit centre, adhering to its operating concept and Hyatt International standards. Ensure maximum guest satisfaction while maintaining budgetary control. Oversee daily operations, including staff management, inventory control, and customer service. Implement effective marketing strategies to increase sales and revenue. Maintain high standards of quality, safety, and hygiene. Analyze financial reports to optimize profitability. Job Requirements Minimum 2 years of work experience as a Restaurant Manager or Assistant Manager in a hotel or large restaurant with good standards. Relevant degree, apprenticeship, or diploma in Hospitality or restaurant manage...

Develop innovative AI-powered conversion strategies to drive business growth. Collaborate with cross-functional teams to create compelling content that resonates with target audiences. Design and implement A/B testing methodologies to optimize campaign performance. Analyze data to refine copy and AI models, building pattern recognition through volume. Create high-converting copy across various channels, including landing pages, emails, ads, and social media. Stay up-to-date with the latest trends and technologies in AI-powered marketing. Job Requirements Minimum 3 years of experience in direct-response or conversion-focused copywriting. Proven portfolio of results demonstrating expertise in ...

Our Company. Techvantage is a next-generation technology and product engineering company at the forefront of innovation in Generative AI, Agentic AI, and Autonomous Intelligent Systems. We build intelligent products that redefine industries and deliver exceptional value through cutting-edge AI technologies. Our mission is to design solutions that are not only powerful but also seamless, intuitive, and delightful to use.. About The Role. We’re looking for a Team Lead AI who can take charge of AI product initiatives and lead a cross-functional team of engineers, data scientists, and innovators. You’ll be the bridge between business goals and technical execution — ensuring your team delivers in...

We are looking for a highly skilled and experienced Senior Data Technical Product Manager to lead our team in developing innovative data solutions. The ideal candidate will have a strong background in data engineering, data architecture, and data science, with excellent problem-solving skills and the ability to work effectively in a team environment. Roles and Responsibility Develop and implement scalable and robust data pipelines to collect, process, and store data from various sources. Design and maintain data warehouse and ETL processes for data integration and transformation. Collaborate with product managers and analysts to understand data requirements and implement solutions for data m...

We are looking for a highly skilled Data Scientist - ML Ops Engineer with 8 to 13 years of experience to join our team in Pune, India. The ideal candidate will have a strong background in machine learning and operations engineering. Roles and Responsibility Design and implement robust MLOps methodologies for seamless model deployment. Develop and maintain automated workflows for building, training, and testing diverse machine learning models. Collaborate closely with data scientists, ML engineers, software engineers, and IT operations teams. Communicate complex technical findings and intricate concepts clearly to diverse audiences. Propose and implement innovative solutions to optimize exist...