1617 Data Pipelines Jobs - Page 13

We are looking for a highly skilled and motivated AWS Data Engineer who thrives on solving complex problems, building scalable systems, and driving innovation. Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL workflows using AWS services. Build and automate data processing, transformation, and integration solutions using Python . Optimize and manage SQL queries, stored procedures, and database performance across multiple environments. Implement cloud security , cost optimization , and performance tuning best practices within AWS infrastructure. Collaborate closely with business analysts, data scientists, and application teams to deliver high-quality data sol...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Microsoft Azure DevOps Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary - As a DevOps Engineer, you will be at the forefront of designing, implementing, and maintaining a robust analytics platform. Your key responsibilities will include: Roles & Responsibilities: Architecture and Design: Shape the strategic technology direction of our data platform. Architect scalable and efficient data solutions using Azure Databrick...

About the Role Your days are dynamic and impactful. You will spearhead GTM programs aimed at driving significant pipeline and revenue growth. Collaborating closely with the Front End, Inside Sales, and Demand Gen teams, you'll harness extensive knowledge of regional execution performance to identify trends and craft strategies. Your expertise will support the sales organization in smashing their quarterly and yearly pipeline targets, through meticulous project management and strategy execution. A Day in the Life Your days are dynamic and impactful. You will spearhead GTM programs aimed at driving significant pipeline and revenue growth. Collaborating closely with the Front End, Inside Sales,...

Role: The purpose of this role is to be responsible for configurating and maintaining the software and other technological aspects of the project being run for the Wipro client AI/ML solution development: Design, develop, and implement scalable AI/ML solutions using machine learning algorithms and models, primarily within the Microsoft .NET framework or Python system integration, model training and validation, and performance optimization Contribute to the full development lifecycle: Participate in activities from ideation and prototyping to deployment, monitoring, and debugging of AI features. Model management: Build and manage the AI stack, from prompt engineering and fine-tuning large lan...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Key Responsibilities Develop responsive and dynamic UIs using React.js, TypeScript, and modern frontend frameworks. Integrate Generative AI APIs (e.g., OpenAI, Azure OpenAI, Hugging Face) into user-facing applications. Build and deploy chatbots, assistants, NLP workflows using frameworks like LangChain, Streamlit, or Chainlit. Collaborate with backend engineers to connect GenAI outputs to visualization tools or custom dashboards. Optimize performance, scalability, a...

Experienced as an Splunk Architect/Splunk Search developer/ Splunk .ImplementorHands-on experience with Prometheus, Loki, OpenTelemetry, and Azure Monitor. Experience with data pipelines and redirecting metrics from AgentsProficiency in scripting and programming languages such as Python, Ansible, and Bash.Familiarity with CI/CD deployment pipelines (Ansible, GIT). Strong knowledge of performance monitoring, metrics, capacity planning, and management. Excellent communication skills with the ability to articulate technical details to different audiences.Experience with application onboarding, capturing requirements, understanding data sources, and architecture diagrams. Experience with OpenTel...

Qualification: Any Bachlor's Degree Experince Required: 3 years (minimum Must have skills: SQL, Good communication, strong stakeholder Management Good to have hiring Skills : Product analytics. Get things right the first time. Hands-on experience in SQL: full understanding of complex JOINs, WINDOW functions, and how to write queries that are readable and run fastReadability: follow style guides and write SQL that is easy to follow by others Tech debt: achieve objective using as little SQL as possible Experience working with version control systems to deliver production-level data pipelines is preferred. Detail-oriented when writing code, producing charts, creating docs, sending emailsTakes a...

Immediate opening for " Python & Big Data Engineering" Job Title: Python & Big Data Engineer Job Location: Chennai (Hybrid) Experience Required: 4 -9 Years Job Requirement: Strong proficiency in Python with OOP and functional programming experience. Experience building multi-module, package-structured applications . Expertise in unit testing using pytest / unittest. Experience managing environments using venv / conda / pyenv . Proficient in SQL for complex data querying & performance optimization. Hands-on experience with Teradata for data extraction & transformation. (Highly Preferred) Working knowledge of Hadoop ecosystem components. PySpark / Apache Spark experience for distributed data p...

We are looking for a talented PostgreSQL Developer to design, develop, and maintain robust, scalable, and secure database solutions to power our educational software platforms. Youll work closely with our backend developers, product team, and data analysts to ensure high performance and availability of mission-critical data. PostgreSQL Development Strong SQL & PL/pgSQL proficiency Database Performance Tuning & Optimization Experience with JSONB and PostgreSQL Extensions Database Schema Design for Web/SaaS Applications Familiarity with Version Control (Git) and CI/CD Pipelines

Machine Learning Engineer- 2 VACANCIES Location: Bangalore EARLY JOINERS WILL BE PREFERRED Compensation: Senior ML Engineer: Up to 40 LPA (68 years experience) ML Engineer Level 2: Up to 30 LPA (3–6 years experience) Role 1: Senior Machine Learning Engineer Position Overview: As a Senior Machine Learning Engineer , you will design, implement, and optimize cutting-edge AI and ML solutions to drive innovation and impact. You’ll lead end-to-end ML lifecycle — from research and development to deployment — working closely with cross-functional teams to deliver scalable and high-performing AI systems. Key Responsibilities: Architect, build, and optimize AI product features and ML systems. Lead the...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Snowflake Data Warehouse Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will work in a dynamic environment where you will analyze, design, code, and test application and data components for multiple clients. You will collaborate with cross-functional teams to perform maintenance, enhancements, and new imple...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Google BigQuery Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and impl...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Google BigQuery Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and im...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Talend Big Data Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and impl...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Warehouse ETL Testing Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and busin...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Power Business Intelligence (BI) Good to have skills : Snowflake Data Warehouse Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creatin...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure Analytics Services Good to have skills : Informatica Data Quality Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Roles & Responsibilities:-Develop and Optimize Data Pipelines using PySpark and SQL in Databricks to handle large-scale data transformations and batch/streaming workloads.-Design and Implement ETL Processes by leveraging Databricks notebooks, Delta Lake, and Python-based custom scripts for data ingestion and curation.-Col...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qua...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Apache Spark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure that application development aligns with business objectives, overseeing project timelines, and facilitating communication among stakeholders to drive...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Python (Programming Language) Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. You should have Data Engineering experience with strong Python programming skills and hands-on experience in building and maintaining data pipelines on AWS...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Modeling Techniques and Methodologies Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, eff...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Engineering Data and Information Management Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day w...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Large Language Models Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating efficient data pipelines, ensuring the in...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qualit...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Modeling Techniques and Methodologies Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, effic...