757 Data Pipelines Jobs - Page 21

About the Role We are looking for a highly skilled and experienced Informatica Data Management Cloud (IDMC) Architect/Tech Lead to join our dynamic team at Cittabase. As the IDMC Architect/Tech Lead, your primary responsibility will be to lead the design, implementation, and maintenance of data management solutions utilizing the Informatica Data Management Cloud platform. You will collaborate closely with cross-functional teams to create scalable and efficient data pipelines, ensure data quality and governance, and oversee the successful delivery of data projects. The ideal candidate will demonstrate advanced expertise in Informatica IDMC, possess strong leadership qualities, and have a prov...

We are looking for a highly skilled and experienced Senior Python & ML Engineer with expertise in PySpark, machine learning, and large language models (LLMs). You will play a key role in designing, developing, and implementing scalable data pipelines, machine learning models, and LLM-powered applications. In this role, you will need to have a solid understanding of Python's ecosystem, distributed computing using PySpark, and practical experience in AI optimization. Your responsibilities will include designing and maintaining robust data pipelines with PySpark, optimizing PySpark jobs for efficiency on large datasets, and ensuring data integrity throughout the pipeline. You will also be invol...

Organization: At CommBank, we never lose sight of the role we play in other peoples financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things. Job Title: Staff Software Manager (Data) Location: Bangalore Business & Team: Our Bankwest Technology division is at the heart of our digital product strategy and is responsible for the management and deployment of technology change across ...

Job Description Qualifications: Overall 9+ years of IT experience Minimum of 5+ years' preferred managing Data Lakehouse environments, Azure Databricks, Snowflake, DBT (Nice to have) specific experience a plus. Hands-on experience with data warehousing, data lake/lakehouse solutions, data pipelines (ELT/ETL), SQL, Spark/PySpark, DBT,. Strong understanding of Data Modelling, SDLC, Agile, and DevOps principles. Bachelors degree in management/computer information systems, computer science, accounting information systems, computer or in a relevant field. Knowledge/Skills: Tools and Technologies: Azure Databricks, Apache Spark, Python, Databricks SQL, Unity Catalog, and Delta Live Tables. Underst...

As a Retail Sell Out Consultant, you will collaborate with CPG, FMCG businesses, data engineers, and other teams to ensure successful project delivery and tool implementation. You will need to possess a combination of business domain skills, technical expertise, and consulting skills to excel in this role. Your responsibilities will include engaging with various stakeholders (both non-technical and technical) at the client side, interpreting problem statements and use cases, and devising feasible solutions. You will be tasked with understanding different types of retail data, designing data models including Fact & Dimension table structures, and driving data load & refresh strategies. In add...

The role supports the integration, transformation, and delivery of data using tools within the Microsoft Fabric platform. You will collaborate with the data engineering team to provide Data and Insights solutions, ensuring the delivery of high-quality data to enable analytics capabilities within the organization. Your key responsibilities will include assisting in the development and maintenance of ETL pipelines using Azure Data Factory and other Fabric tools. You will work closely with senior engineers and analysts to gather requirements, develop prototypes, and support data integration from various sources. Additionally, you will play a role in developing and maintaining Data Warehouse sch...

We are seeking a skilled QA / Data Engineer with 3-5 years of experience. As the ideal candidate, you will possess expertise in manual testing and SQL, along with knowledge in automation and performance testing. Your primary responsibility will be to ensure the quality and reliability of our data-driven applications through comprehensive testing and validation. Key Responsibilities: - Utilize extensive experience in manual testing, particularly in data-centric environments. - Demonstrate strong SQL skills for data validation, querying, and testing database functionalities. - Implement data engineering concepts, including ETL processes, data pipelines, and data warehousing. - Work with Geo-Sp...

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, you will be part of a team of innovative professionals working with cutting-edge technologies. Our purpose is anchored in bringing real positive changes in an increasingly virtual world, transcending generational gaps and future disruptions. We are currently seeking SQL Professionals for the role of Data Engineer with 4-6 years of experience. The ideal candidate must have a strong academic background. As a Data Engineer at BNY Mellon in Pune, you will be...

As a Data Engineer, you will be responsible for designing, developing, and implementing data pipelines using StreamSets Data Collector. Your role involves ingesting, transforming, and delivering data from diverse sources to target systems. You will write and maintain efficient, reusable pipelines while adhering to coding standards and best practices. Additionally, developing custom processors and stages within StreamSets to address unique data integration challenges is a key aspect of your responsibilities. Ensuring data accuracy and consistency is crucial, and you will implement data validation and quality checks within StreamSets pipelines. Optimizing pipeline performance for high-volume d...

You should have an in-depth understanding of data management, including permissions, recovery, security, and monitoring. You must also possess strong experience in implementing data analysis techniques such as exploratory data profiling. Additionally, you should have a solid grasp of design patterns and hands-on experience in developing data pipelines for batch processing. Your role will require you to design and develop ETL processes that populate star schemas using various source data for data warehouse implementations supporting a product on both cloud and on-premise environments. You should be able to actively participate in the requirements gathering process and design business process ...

As the Lead AI Strategist & Architect at DivyaSree's AI Division, you will drive early-stage AI vision and system design to establish a foundation for scalable AI adoption. The AI Division at DivyaSree is a dynamic startup within the organization, focused on reshaping real estate, education, and hospitality through AI innovation. You will play a pivotal role in defining the high-level AI roadmap, architecting secure and scalable AI systems, and leading the development of AI solutions for internal workflows and customer-facing tools. Your responsibilities will include setting up data pipelines, cloud infrastructure, and MLOps practices while also focusing on research, IP creation, team buildi...

At PwC, our team in data and analytics engineering is dedicated to utilizing advanced technologies and techniques to create robust data solutions for our clients. Your role will involve transforming raw data into valuable insights, facilitating informed decision-making, and fostering business growth. As part of the intelligent automation team at PwC, you will focus on process mining, designing automation solutions, and implementing various automation technologies to enhance operational efficiencies and reduce costs for our clients. You will be responsible for building meaningful client relationships, managing and motivating others, and expanding your technical expertise. As you navigate comp...

Qualification: Education: Bachelors degree in any field. Experience: Minimum 1.5-2 years of experience in data engineering support or a related role, with hands-on exposure to AWS. Technical Skills: Strong understanding of AWS services, including but not limited to S3, EC2, CloudWatch, and IAM. Proficiency in SQL with the ability to write, optimize, and debug queries for data analysis and issue resolution. Hands-on experience with Python for scripting and automation; familiarity with Shell scripting is a plus. Good understanding of ETL processes and data pipelines. Exposure to data warehousing concepts; experience with Amazon Redshift or similar platforms preferred. Working knowledge of orch...

Experience: 3-5 years Looking for a skilled backend developer with strong experience in Java, Spring Boot, and Apache Spark. Responsible for building scalable microservices and processing large datasets in real-time or batch environments. Must have solid understanding of REST APIs, distributed systems, and data pipelines. Experience with cloud platforms (AWS/GCP) is a plus. Show more Show less

We&aposre seeking a visionary Enterprise Architect to join our CTO Office and shape cross-portfolio solutions at the intersection of AI, Customer Experience (CX), Cybersecurity, and Digital Skilling technologies. Youll architect scalable, standardized solutions for global clients, govern complex deals, and collaborate with diverse stakeholders to translate business needs into future-ready technical strategies. As a trusted advisor, you will evangelize solution value, articulating how the right technology mix enables our customers to achieve strategic outcomes. At TeKnowledge , your work makes an impact from day one. We partner with organizations to deliver AI-First Expert Technology Services...

Company Description Quantanite is a business process outsourcing (BPO) and customer experience (CX) solutions company that helps fast-growing companies and leading global brands to transform and grow. We do this through a collaborative and consultative approach, rethinking business processes and ensuring our clients employ the optimal mix of automation and human intelligence. Were an ambitious team of professionals spread across four continents and looking to disrupt our industry by delivering seamless customer experiences for our clients, backed up with exceptional results. We have big dreams and are constantly looking for new colleagues to join us who share our values, passion, and appreci...

You will be joining our Data & AI practice as an Individual Contributor and Functional AI Decision Science Consultant at Level 9, with the opportunity to work in Gurgaon, Bangalore, Mumbai, or Hyderabad. As part of a global team of skilled professionals, you will utilize cutting-edge statistical tools and methodologies to deliver data-driven insights and solutions for our clients. Your primary responsibilities will include defining data requirements for Data Driven Growth Analytics, analyzing and interpreting data, and ensuring data quality. You will work on market sizing, lift ratio estimation, non-linear optimization techniques, statistical timeseries models, store clustering algorithms, a...

As a Data Analyst with 2 to 8 years of experience, you will be based in Bangalore and will have the following responsibilities: - Demonstrating strong proficiency in SQL, Python, and Excel, along with the ability to adapt and learn other Analytics tools as required. - Building and optimizing Data Pipelines on popular Cloud Platforms. - Automation of Data extraction and insertion processes to Management Information Systems (MIS) using Python. - Extracting actionable insights from analysis results. - Possessing attention to detail, a strong data orientation, and a commitment to creating clean and reproducible code. - Showing a genuine passion for collaboration, along with exceptional interpers...

As a Python AI/ML Developer with 4-5 years of experience, your main responsibility will be to design, develop, and maintain Python applications while ensuring code quality, efficiency, and scalability. You will collaborate with cross-functional teams to understand project requirements and deliver solutions that align with business objectives. Implementing AI/ML algorithms and models to solve complex problems and extract valuable insights from data will be a key part of your role. Additionally, you will be developing and maintaining RESTful APIs to integrate Python applications with other systems. It is essential to stay updated with the latest trends and technologies in Python development an...

As a Senior Platform Engineer at Kenvue Data Platforms, you will have an exciting opportunity to be part of our growing Data & Analytics product line team. Your role involves collaborating closely with various teams such as Business partners, Product Owners, Data Strategy, Data Platform, Data Science, and Machine Learning (MLOps) to drive innovative data products for end users. You will play a key role in shaping the overall solution and data platforms, ensuring their stability, responsiveness, and alignment with business and cloud computing needs. Your expertise will be crucial in optimizing business outcomes and contributing to the growth and success of the organization. Your responsibilit...

As an Engineering Manager - Analytics & Data Engineering at Highspot, you will be responsible for leading and nurturing a team of data analysts, data scientists, and data engineers. Your primary objective will be to drive the development of cutting-edge analytics capabilities within our B2B SaaS product, while also maintaining a company-wide data warehouse to facilitate data-driven decision-making. By leveraging your expertise in statistical analysis, machine learning techniques, and business acumen, you will uncover valuable insights from our data, enabling impactful decisions and fueling our growth. Your role will involve guiding strategic decisions related to data systems, analytics capab...

As a Data Warehouse (DWH) professional with relevant experience in Google Cloud Platform (GCP), you will be responsible for developing and implementing robust data architectures. This includes designing data lakes, data warehouses, and data marts by utilizing GCP services such as BigQuery, Dataflow, DataProc, and Cloud Storage. Your role will involve designing and implementing data models that meet business requirements while ensuring data integrity, consistency, and accessibility. Your deep understanding of GCP services and best practices for data warehousing, data analytics, and machine learning will be crucial in this role. You will also be tasked with planning and executing data migratio...

As an IoT & AI Intern at Bharat Ecolabs, you will have the opportunity to support the development and integration of sensor networks, data pipelines, and AI models for our smart, modular Packaged Sewage Treatment Plants (STPs). Working out of the NASSCOM Center of Excellence for IoT & AI in Gurugram, you will collaborate closely with our core engineering team. Your key responsibilities will include assisting in the design and development of IoT-enabled sensor and control systems for STPs, building and testing data acquisition modules using sensors for various parameters, developing cloud-based or edge data pipelines for real-time monitoring, and supporting the development of AI/ML models for...

Instaworks vision is to create economic opportunities for local businesses and skilled hourly workers in communities around the world. With an AI-first approach, were supercharging the leading online labor marketplace and looking for exceptional talent to help us build the future of hourly work. Backed by world-class investors like Benchmark, Spark Capital, Craft Ventures, Greylock, Y Combinator, and more, we want you to help us continue to scale quickly and make an even greater impact. Instaworks mission is to create economic opportunities for businesses and local professionals globally. We believe AI and machine learning will be key factors across our products and company in accelerating o...

Job Summary: We are seeking a skilled Databricks Developer to join our Data Lake Modernization project. You will be responsible for migrating on-premises data lake use cases to Databricks on GCP while collaborating with business and product teams to ensure high-quality development aligned with modern data engineering standards. Key Responsibilities: Play a key role in defining and implementing migration patterns for Data Lake Modernization Migrate data and use cases from on-premises systems to Databricks on GCP Collaborate with product managers and business users to gather requirements Follow development lifecycle practices such as testing, code reviews, CI/CD, and documentation Document and...