1569 Data Pipeline Jobs - Page 4

Immediate hiring for Senior Data Engineer Loc-Bangalore/Chennai/Hyderabad Exp- 5 to 10yrs Hybrid 4+yrs exp in SQL 4+yrs exp in Python and Pyspark( Should be strong in Coding) Exp in data pipelines and AWS Immediate joiners only

Immediate hiring for Senior Data Engineer Loc-Bangalore/Chennai/Hyderabad Exp- 5 to 10yrs Hybrid 4+yrs exp in SQL 4+yrs exp in Python and Pyspark( Should be strong in Coding) Exp in data pipelines and AWS Immediate joiners only

We are seeking a skilled Data Engineer with strong expertise in Python, PySpark, and the AWS Data Engineering stack to design, develop, and optimize large-scale ETL pipelines. The ideal candidate will have a solid foundation in data engineering best practices, automation, and modern cloud-based architectures, along with a passion for leveraging Generative AI tools to boost productivity and code quality. Core Must-Have Skills: Strong proficiency in Python and PySpark for developing and optimizing ETL pipelines. In-depth understanding of data engineering best practices , including data validation, transformation logic, and performance optimization. Experience working with large-scale data proc...

Roles and responsibilities : Duties of Lead Data/platform engineer We are looking for a Lead Engineer to join our Ascend Cloud Foundation Platform team. We unlock the power of data to create opportunities for consumers, businesses and society. At life's big moments - from buying a home or car, to sending a child to university, to growing a business exponentially by connecting it with new customers - we empower consumers and our clients to manage their data with confidence so they can maximize every opportunity. Reporting into our Engineering Director, you will join an established agile team, with a passion and lead a technical team that supports innovation, learning and collaboration. Ensure...

In Time Tec is an award-winning IT & software company. In Time Tec offers progressive software development services, enabling its clients to keep their brightest and most valuable talent focused on innovation. In Time Tec has a leadership team averaging 15 years in software/firmware R&D, and 20 years building onshore/offshore R&D teams. We are looking for rare talent to join us. People having a positive mindset and great organizational skills will be drawn to the position. Your capacity to take initiative and solve problems as they emerge, flexibility, and honesty, will be key factors for your success at In Time Tec. Job Overview: The position requires an experienced and ambitious candidate ...

Role & responsibilities Designing, building, and maintaining ETL/ELT pipelines using dbt Creating and managing data models and transformations using dbt to ensure efficient and accurate data consumption for analytics and reporting. Developing and maintaining a data quality framework, including automated testing and cross-dataset validation. Writing and optimizing SQL queries for efficient data processing within cloud components. Working with data engineers, analysts, scientists, and business stakeholders to deliver data solutions. Supporting day-to-day incident and ticket resolution related to data pipelines. Creating and maintaining comprehensive documentation for data pipelines, configurat...

Location: Bangalore Experience: 3 - 6 Years CTC: 10 - 24 LPA Notice Period: Immediate to 15 Days Role Overview We are seeking a Data Engineer (Core) Implementation Specialist to design, build, and implement robust data solutions that support business and analytics needs. In this role, you will work closely with stakeholders to translate business requirements into scalable data pipelines and reliable data models. You will play a hands-on role across the data implementation lifecycle—right from ingestion and transformation to deployment and post-go-live support—ensuring high data quality, performance, and reliability across platforms. Key Responsibilities Design, build, and implement data pipe...

Job Overview: We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for requirements gathering, designing, architecting the solution, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) & ELT data pipelines. The role involves working with customers directly, gathering requirements, discovery phase, designing, architecting the solution, using various GCP services, implementing data transformations, data ingestion, data quality, and consistency across systems, and post post-delivery support. Experience Level: ...

RESTful,the good-to-have About tsworks: tsworks is a leading technology innovator, providing transformative products and services designed for the digital-first world. Our mission is to provide domain expertise, innovative solutions and thought leadership to drive exceptional user and customer experiences. Demonstrating this commitment , we have a proven track record of championing digital transformation for industries such as Banking, Travel and Hospitality, and Retail (including e-commerce and omnichannel), as well as Distribution and Supply Chain, delivering impactful solutions that drive efficiency and growth. We take pride in fostering a workplace where your skills, ideas, and attitude ...

Job Summary: We are looking for an experienced and business-oriented Data Analytics Engineer / BI Analyst with strong expertise in Power BI and Python , and a solid understanding of the aviation aftermarket domain . The role will focus on transforming complex operational, engineering, and supply-chain data into meaningful insights that support strategic and day-to-day decision-making. The ideal candidate will design scalable analytical solutions, automate data workflows, and deliver high-impact dashboards for business and operational leaders. Key Responsibilities: Design, develop, and maintain interactive Power BI dashboards and reports to support aviation aftermarket operations such as main...

Professional & Technical Skills: - Must To Have Skills: Proficiency in Databricks Unified Data Analytics Platform. - Good To Have Skills: Experience with Python (Programming Language). - Strong understanding of data modeling techniques and best practices. - Experience with data integration tools and methodologies. - Familiarity with cloud-based data storage solutions and architectures. Additional Information: - The candidate should have minimum 7.5 years of experience in Databricks Unified Data Analytics Platform. - This position is based at our Bengaluru office. - A 15 years full time education is required.Role & responsibilities Preferred candidate profile

Hi Folks, Greeting from Raad7 Informatics...!! We are having an urgent opening for Senior AI Engineer_AI Pipelines, ADB, LLM for Bangalore_Hybrid. Role & responsibilities Overview We are seeking a senior-level engineer to build and support production-grade data and AI applications on Azure Databricks . This role is hands-on and focused on designing scalable pipelines, integrating ML and Generative AI models, and deploying reliable solutions in Azure cloud environments. Responsibilities Design, develop, and deploy end-to-end data and AI pipelines using Azure Databricks . Build robust ETL/ELT workflows using PySpark and SQL for large-scale data processing. Integrate Databricks with Azure servi...

Job Title: Principal Data Engineer, Logistics Employment Type: Full Time Experience: 12+ Years About the Role: We are looking for a Principal Data Engineer to lead the design and delivery of scalable data solutions using Azure Data Factory and Azure Databricks. This is a consulting-focused role that requires strong technical expertise, stakeholder engagement, and architectural thinking. You will work closely with business, functional, and technical teams to define data strategies, design robust pipelines, and ensure smooth delivery in an Agile environment. Responsibilities Collaborate with business and technology stakeholders to gather and understand data needs Translate functional requireme...

Develop and manage data pipelines using ADF and Azure databricks; Expert in data warehousing, data modeling & ETL,SQL,Pyspark Expertise in on-prem to azure cloud migration; Good to have datastage Immediate joiner Send CV- sachin@assertivebs.com

As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. You will also engage in strategic planning sessions to align project goals with organizational objectives, ensuring that all stakeholders are informed and involved in the development process. Your role will require a balance of technical expertise and leadership skills to drive the project forward successfully. Roles & Responsibilities: - Expected to be a...

As a member of the Data Engineering team, you will be responsible for various aspects of data extraction, such as understanding the data requirements of the business group, reverse-engineering the website, its technology, and the data retrieval process, re-engineering by developing web robots to automate the extraction of the data, and building monitoring systems to ensure the integrity and quality of the extracted data You will also be responsible for managing the changes to the website's dynamics and layout to ensure clean downloads, building scraping and parsing systems to transform raw data into a structured form, and offering operations support to ensure high availability and zero data ...

We're Celonis, the global leader in Process Intelligence technology and one of the world's fastest-growing SaaS firms We believe there is a massive opportunity to unlock productivity by placing AI, data and intelligence at the core of business processes and for that, we need your help Care to join us? The Team: As a Backend Engineer, you will bring your general software engineering expertise to our innovative projects and continuously evolving concepts The Role: You will have the opportunity to work with cutting-edge cloud technology, stay on top of trends, and drive projects with an ever-increasing degree of independence This is a unique opportunity for talented engineers to push their boun...

We are seeking an experienced Big Data Senior Developer to lead our data engineering efforts In this role, you will design, develop, and maintain large-scale data processing systems You will work with cutting-edge technologies to deliver high-quality solutions for data ingestion, storage, processing, and analytics Your expertise will be critical in driving our data strategy and ensuring the reliability and scalability of our big data infrastructure Required Profile required Role description :Lead the design and impact analysis of all new features and enhancements Lead all aspects of Software Development Lifecyle (SDLC) in-line with Agile and IT craftsmanship principles Identify methods to su...

Principal Global Services is looking for Data Engineer to join our team Roles and Responsibility Design, develop, and implement data pipelines and architectures. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems and infrastructure. Ensure data quality, integrity, and security. Optimize data processing workflows and improve performance. Participate in code reviews and contribute to the improvement of the overall codebase. Job Requirements Strong understanding of data structures, algorithms, and software design patterns. Experience with big data technologies such as Hadoop, Spark, and NoSQL databases. Proficie...

Shaw group is a global investment and technology development firm with more than $65 billion in investment capital as of , and offices in North America, Europe, and Asia Since our founding in 1988, our firm has earned an international reputation for successful investing based on innovation, careful risk management, and the quality and depth of our staff We have a significant presence in the world's capital markets, investing in a wide range of companies and financial instruments in both developed and developing economies We are looking for resourceful and exceptional candi for the Data Engineer role within our product development teams based out of Hyderabad, Bengaluru and Gurugram At DESIS,...

Shaw group is a global investment and technology development firm with more than $65 billion in investment capital as of , and offices in North America, Europe, and Asia Since our founding in 1988, our firm has earned an international reputation for successful investing based on innovation, careful risk management, and the quality and depth of our staff We have a significant presence in the world's capital markets, investing in a wide range of companies and financial instruments in both developed and developing economies We are looking for resourceful and exceptional candi for the Data Engineer role within our product development teams based out of Hyderabad, Bengaluru and Gurugram At DESIS,...

Swiss Re is looking for Associate Data & Analytics Engineer to join our team Roles and Responsibility Design and develop scalable data pipelines and architectures to support business intelligence and analytics. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems, ensuring high performance and reliability. Analyze complex data sets to extract insights and trends, providing actionable recommendations. Implement data quality checks and validation processes to ensure accuracy and integrity. Work closely with stakeholders to understand business needs and develop solutions that meet those needs. Job Requirements Str...

Aumni is looking for Data Engineer to join our team Roles and Responsibility Design and develop large-scale data pipelines and architectures. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain complex data systems and databases. Ensure data quality and integrity through data validation and testing procedures. Optimize data processing workflows for improved performance and efficiency. Implement data security measures to protect sensitive information. Job Requirements Strong understanding of data engineering principles and practices. Experience with data modeling and database design. Proficiency in programming languages such as Python ...

JD : Technical Skills Hands-on experience in Core Alteryx, Power BI, SQL Created data pipeline for data inflow and outflow Hand on experience with Power BI dashboard, modelling, DAX, Power Automate Hands on experience with Tableau Understanding python and R within Alteryx is plus Process Specific Skills Know-how of BFSI, preferably Insurance Delivery experience in a business aligned IT scenarios Soft skills (Desired) Excellent Presentation, verbal and written communication skills Excellent analytical skills and aptitude for problem solving, including data analysis and validation Able to work independently and as part of a team Soft Skills (Minimum) Good verbal and written communication skill...

Job Title: Data Engineer - Python + SQL Experience: 7+ Years Location: Bengaluru- Hybrid Job Description: Key Responsibilities: 7+ years of experience in design, build, and maintain robust data pipelines using Python and SQL. Expert in writing complex SQLs Develop reusable scripts for data extraction from various structured and semi-structured file formats. Write optimized and scalable queries to retrieve, clean, and transform data for analytics and reporting. Integrate data from different sources including APIs and multiple databases. Work closely with analysts, data scientists, and business stakeholders to deliver clean, reliable datasets for analysis. Document data workflows and ensure be...