1586 Data Pipeline Jobs - Page 38

World Wide Technology Holding Co, LLC (WWT) is a privately held global technology integrator and supply chain solutions provider. Through our culture of innovation, we inspire, build and deliver business results, from idea to outcome. Based in St. Louis, WWT works closely with industry leaders such as Cisco, VMware, NetApp, Dell EMC, HPE and several others, but also include emerging tech players. WWT employs more than 10,000 people and operates in more than 2 million square feet of state-of-the-art warehousing, distribution and integration space strategically located throughout the world. WWT ranks Glassdoors Best Places to Work and has been on Fortune’s 100 Best Companies to Work For list 1...

At Tredence AWS Data Engineer designs, builds, and maintains scalable data pipelines and infrastructure using AWS services like Glue, S3, and Redshift, focusing on data ingestion, transformation (ETL), modeling, and quality. They write SQL and Python code, orchestrate workflows with tools like Airflow, and collaborate with data scientists and analysts, aiming to ensure data is accurate, accessible, and optimized for analysis and business decision-making. Role - AWS Data Engineer Years of Experience: 2~5 years Roles and responsibilities The day-to-day work of a junior-to-mid AWS data engineer involves a mix of development, monitoring, and collaboration. Pipeline development: Designing, buildi...

Design and maintain high-performance SQL queries to support analytics and real-time decision-making. Build and scale distributed data pipelines to support a variety of e-commerce functions including order tracking, recommendations, and dynamic pricing. Implement real-time data processing using RisingWave, Azure , or ect delivering insights on user behavior, product trends, and operational efficiency. Lead and mentor a team of data engineers, setting technical direction and ensuring high-quality delivery. Collaborate with product, engineering, and analytics teams to translate business needs into scalable data solutions. Own and drive data-driven initiatives across the organization with measur...

The GCP Data Engineer will be responsible for designing, developing, and maintaining data pipelines and data infrastructure on Google Cloud Platform (GCP). This role requires expertise in data engineering best practices, cloud architecture, and big data technologies. The ideal candidate will work closely with data scientists, analysts, and other stakeholders to ensure the availability, reliability, and efficiency of data systems, enabling data-driven decision-making across the organization. Key Responsibilities Data Pipeline Development Design, develop, and maintain scalable and efficient ETL/ELT pipelines on GCP. Implement data ingestion processes from various data sources (e.g., APIs, data...

Job Description: We are seeking talented and motivated Data Engineers to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success. As a Data Engineer at VXI Global Solutions, you will play a critical role in designing, implementing, and maintaining our data infrastructure to support our customer experience and management initiatives. You will collaborate with cross-functional teams to understand business requirements, architect scalable data solutions, and ensure data quality and integrity. This is an exciting opportunity to work with cutting-edge technologies and shape the future of data-driven decision-making at VXI Global Solutions. R...

Role & responsibilities 4+ years in Data warehousing/ Business Intelligence field Architecture design and implementation experience with medium to complex on-prem to cloud migrations with any of the major cloud platforms (preferably Azure). Minimum 3+ years experience in Azure database offerings [Relational, NoSQL, Datawarehouse. 2+ years hands-on experience in various Azure services preferred Azure Data Factory, Kafka, Azure Data Explorer, Storage, Azure Data Lake, Azure Synapse Analytics, Azure Analysis Services & Databricks. Minimum of 3 years of hands-on database design, modelling and integration experience with relational data sources, such as SQL Server databases, Oracle/MySQL, Azure S...

About the Company Agoda is an online travel booking platform that offers accommodations, flights, and more. With a global network of 4.7M hotels and holiday properties, as well as flights, activities, and other travel options, Agoda connects travelers worldwide. As part of Booking Holdings and based in Asia, our diverse team of 7,100+ employees from 95+ nationalities across 27 markets fosters a work environment rich in diversity, creativity, and collaboration. We embrace a culture of experimentation and ownership to enhance our customers" travel experiences. Purpose At Agoda, we believe in bridging the world through travel. Travel not only allows people to enjoy and experience the world but ...

We are looking for a skilled and experienced Databricks Engineer to join our team at our Hyderabad (Madhapur) office. The ideal candidate will have a strong background in data engineering, hands-on experience with Databricks, and a solid understanding of cloud platforms (AWS, Azure, or GCP). This is a great opportunity to work on cutting-edge data projects in a collaborative and fast-paced environment. Key Responsibilities : - Design and implement scalable and efficient data pipelines, ETL/ELT processes, and data integration solutions using Databricks. - Work with large-scale structured and unstructured datasets using Python, PySpark, SQL, and NoSQL technologies. - Collaborate with cross-fun...

Job Description AI/ML Engineer (5 Years Experience) About Volante: Volante is a leading Financial Services technology company providing a market-leading, cloud-native Payments Processing Platform to banks and financial institutions globally. By joining our product team, you will have an opportunity to shape the future of payments technology while working on cutting-edge AI/ML solutions. Role Overview: We are seeking an experienced AI/ML Engineer with ~5 years of hands-on experience in building, deploying, and scaling machine learning solutions. The ideal candidate will have strong expertise in Python, deep learning, generative AI, and end-to-end model deployment (cloud and on-premises), with...

Why Ness We know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most innovative software companies in the world. You’ll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression. You’ll also benefit from an array of advantages like access to trainings and certifications, bonuses, and aids, socializing activities and attractive compensation. Key Responsi...

Industry/Domain: Product Engineering Big Data, Healthcare, Cyber Security, Mobile. Few words about Unify Technologies: Unify a Digital Engineering company. We help our clients by providing Digital Engineering Services to develop high-quality products. We have extensive experience in software product engineering and a successful track record of delivering on aggressive delivery plans without compromising on the quality in Cloud, Mobile, and Data practices. Job Description: Experience : 4 to 7 Year Notice Period: Immediate joiners / able to join within 15Days. The role involves working with a FAANG Company's Audio Research Lab to develop robust data tooling and infrastructure. This includes im...

About the Role : Join TA Digital (Credera), a global consulting firm delivering AI-driven customer experiences. As a Senior Salesforce CPQ Developer , you will design, develop, and implement advanced CPQ solutions tailored to client needs, driving efficiency across product configuration, pricing, and quoting processes. Key Responsibilities: Collaborate with product specialists and the Development Manager to understand complex requirements and translate them into Salesforce solutions Design and develop Salesforce CPQ solutions to streamline the sales process Customize Salesforce CPQ to meet business requirements, including product configuration, pricing, and quoting Collaborate with business ...

My linkedin linkedin.com/in/yashsharma1608. contract period - 6-12month payroll will be - ASV consulting , my company client - will disclose after 1 round Job location - Gurgaon - onsite(WFO) budget - upto 1lpa/month , depending on last (relevant hike) Exprnce - 3+ JD is About the Role We are looking for a skilled AWS Data Engineer with strong hands-on experience in AWS Glue and AWS analytics services. The candidate will be responsible for designing, building, and optimizing scalable data pipelines and ETL processes that support advanced analytics and business intelligence requirements. Key Responsibilities Design and develop ETL pipelines using AWS Glue, PySpark, and AWS services (Lambda, S...

Job Title : Customer Support Engineer/ OPS Engineer Role description :- Customer Support Engineer/ OPS Engineer We are looking for a dynamic executive to join our customer support operations team. The executive will be responsible for technical customer support and manage relationships with customers. This position is ideal for young solar photovoltaic enthusiast in renewable energy sector, who is looking for demonstrating technical understanding in challenges in solar PV power plant O&M and asset management and providing best customer support service. The executive would be closely working directly with customer support manager and operations head on daily basis. The executive will be hands...

Job Description: Complete data ingestion, data pipeline, data lineage , data quality , data wearhouse, data governance and data reconciliation. Essential Skills: Must have Data architect experience and knowledge. Data Architect with over 10 +years of hands-on experience in designing, developing, and managing large-scale data solutions. Proven expertise in building and optimizing ETL pipelines. Strong in data preprocessing, and enhancing data quality.Extracting events, processing large datasets (5 billion+ records) within (a Spark-Hadoop) cluster. Automated data processing tasks for DAAS (Data as a Service) project, streamlining workflow efficiency. Configured file and client setups, ensuring...

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, you will be part of a team of talented individuals working with cutting-edge technologies. Our purpose is centered around making real positive changes in an increasingly virtual world, transcending generational gaps and disruptions of the future. We are currently seeking AWS Data Pipeline Professionals with 3-5 years of experience in the following areas: - Designing, developing, and implementing cloud solutions on AWS, utilizing a wide range of AWS servi...

Job Functions: You will be a member of our AI Platform Team, supporting the next generation AI architecture for various research and engineering teams within the organization. You'll partner with vendors and the infrastructure engineering team for security and service availability You'll fix production issues with engineering teams, researchers, data scientists, including performance and functional issues Diagnose and solve customer technical problems Participate in training customers and prepare reports on customer issues Be responsible for customer service improvements and recommend product improvements Write support documentation You'll design and implement zero-downtime to monitor and ac...

Join us to do the best work of your career and make a profound social impact as a Data engineer on our Team in Bangalore . We are looking for Data Engineer with strong data analysis skill using platforms such as Gcp and Databricks and have experience in building pipelines using Databricks. The ideal candidate will have hands-on experience with Databricks, Gcp, and python and will ensure data accuracy and consistency. This role requires the ability to extract, analyse, and present data efficiently, enabling data-driven decision-making across the organization. You will: Write and optimize SQL queries for data extraction, aggregation, and reporting. Work with structured and semi-structured data...

Develop and fine-tune generative models (LLMs, GANs, VAEs), optimize prompts, build data pipelines, deploy AI models on cloud/on-prem, ensure scalability, conduct A/B tests, and collaborate across teams using Python, ML frameworks, and MLOps tools.

Role & responsibilities • 5+ years of experience in data engineering or data pipeline development . • Strong hands-on experience with A WS data services, including Redshift, Glue, DynamoDB, Lambda, and API Gateway. • Experience designing high-performance data architectures with both structured and semi-structured data. • Proficiency in Python, SQL, and streaming technologies like Kafka . • Solid understanding of Redis, PostgreSQL, and distributed storage principles. • Familiarity with DevOps tools and practices: CI/CD (GitHub Actions), infrastructure-as-code, monitoring, and automation. • Experience with SonarQube or similar tools for enforcing code quality and maintainability. • Excellent c...

About the Role: Looking for a Principal Data Engineer to lead the design and delivery of scalable data solutions using Azure Data Factory and Azure Data bricks. This is a consulting- focused role that requires strong technical expertise, stakeholder engagement, and architectural thinking. You will work closely with business, functional, and technical teams to define data strategies, Design robust pipelines, and ensure smooth delivery in an Agile environment. Responsibilities Collaborate with business and technology stakeholders to gather and understand data needs Translate functional requirements into scalable and maintainable data architecture Design and implement robust data pipelines Lead...

Summary We are seeking an experienced Data Engineer (5years of relevant experience) with a strong technical background to design, develop, and support cutting-edge data-driven solutions. The ideal candidate will bring expertise in data engineering, cloud technologies, and enterprise-scale solution development, along with exceptional problem-solving, communication, and leadership skills. Key Responsibilities: Design and implement data engineering pipelines using PySpark, Palantir Foundry and Python. Leverage cloud technologies (AWS) to build scalable and secure solutions. Ensure compliance with architecture best practices and develop enterprise-scale solutions. Develop data-driven application...

Role & responsibilities We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have a passion for building and optimizing robust data pipelines, managing real-time data flows, and developing solutions that drive data-driven decision-making. If you thrive in a fast-paced environment and are eager to tackle complex data challenges, we want to hear from you! Role and Responsibilities: Design, develop, and maintain scalable and high-performance ETL/ELT pipelines for batch and real-time data processing from diverse sources. Develop and implement APIs and webhooks for seamless and secure data ingestion and consumption by various internal and ...

1. Software Development: - Design, develop, test, and deploy high-performance and scalable data solutions using Python,PySpark, SQL - Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications. - Implement efficient and maintainable code using best practices and coding standards. 2. Databricks Platform: - Work with Databricks platform for big data processing and analytics. - Develop and maintain ETL processes using Databricks notebooks. - Implement and optimize data pipelines for data transformation and integration. 3. Continuous Learning: - Stay updated on the latest industry trends, tools, and technologies related to Python,...

Join us as a Data Engineer Pyspark at Barclays, where you will spearhead the evolution of our infrastructure and deployment pipelines, driving innovation and operational excellence You will harness cutting-edge technology to build and manage robust, scalable and secure infrastructure, ensuring seamless delivery of our digital solutions, To be successful as a Data Engineer Pyspark you should have experience with: Expertise in PySpark , Python, Strong SQL knowledge, Very good understanding of writing and debugging of code, Quick learner, strong analytical and problem-solving skills and should possess excellent written and verbal communication skills, Some Other Highly Valued Skills May Include...