757 Data Pipelines Jobs - Page 28

Manage, mentor, and guide a team of data engineers and analysts, ensuring their professional development and optimizing team performance. Foster a culture of collaboration, accountability, and continuous learning within the team. Lead performance reviews, provide career guidance, and handle resource planning. Data Engineering & Analytics: Design and implement data pipelines, data models, and architectures that are robust, scalable, and efficient. Develop and enforce data quality frameworks to ensure accuracy, consistency, and reliability of data assets. Establish and maintain data lineage processes to track the flow and transformation of data across systems. Ensure the design and maintenance...

Job Description : YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation. At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth - bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future. We are looking forward to hireData Engineering Professionals in the following areas : Experience 10-12 Years Job Description Location: Pune J ob Summary: We are seeking a detail-or...

6+ years of total IT experience in development projects. 4+ years experience in cloud-based solutions. 4+ years in solid hands on snowflake development. Hands on experience in Design, build data pipelines on cloud-based infrastructure having extensively worked on AWS, snowflake, Having done end to end build from ingestion, transformation, and extract generation in Snowflake. Strong hand-on experience in writing complex SQL queries. Good understanding and experience in Azure cloud services. Optimize and tune snowflake performance including query optimization and have experience in scaling strategies. Address data issues, root cause analysis and production support. Experience working in a Fina...

Ready to shape the future of work At Genpact, we don&rsquot just adapt to change&mdashwe drive it. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos , our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to , our breakthrough solutions tackle companies most complex challenges. If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that&rsquos shaping the future, this is your moment. Genpact (NYSE: G) is an advanced technology ...

We are seeking a skilled Big Data Engineer to design, build, and maintain scalable big data processing pipelines. The ideal candidate will be proficient in Python and PySpark, have hands-on experience with cloud platforms, and be familiar with CI/CD processes to automate deployments and workflows. Responsibilities: Develop and maintain data pipelines using Python and PySpark. Design and implement scalable big data solutions on cloud platforms (AWS, Azure, or GCP). Build and manage CI/CD pipelines for automated deployment and testing. Collaborate with data scientists, analysts, and other engineers to deliver robust data infrastructure. Optimize data processing workflows for performance and re...

We are seeking an experienced AWS Data Engineer to support the on-ground client team in delivering high-quality data engineering solutions. The ideal candidate will have hands-on experience with AWS data services and strong programming skills. Key Responsibilities: Collaborate with the client's onsite team to ensure timely completion of deliverables Design, develop, and maintain data pipelines using AWS services such as Lambda, Glue, and Redshift Write efficient, reusable, and optimized code in Python and SQL for data processing and transformation Monitor, troubleshoot, and optimize data workflows for performance and reliability Implement best practices in data engineering and cloud infrastr...

JobOpening Senior Data Engineer (Remote, Contract 6 Months) Remote | Contract Duration: 6 Months | Experience: 6-8 Years We are hiring a Senior Data Engineer for a 6-month remote contract position. The ideal candidate is highly skilled in building scalable data pipelines and working within the Azure cloud ecosystem, especially Databricks, ADF, and PySpark. You'll work closely with cross-functional teams to deliver enterprise-level data engineering solutions. #KeyResponsibilities Build scalable ETL pipelines and implement robust data solutions in Azure. Manage and orchestrate workflows using ADF, Databricks, ADLS Gen2, and Key Vaults. Design and maintain secure and efficient data lake archite...

Key Responsibilities: Develop, design and build scalable and modular software components for quantitative analysis and financial modeling and investment analytics for risk models, and high-volume complex data processing pipelines. Ensure quality & performance of research data pipeline and curated new premium content using different approaches Conduct research on additional content / data which can add value to models and or investment processes Perform & implement complex quantitative calculations with high accuracy and performance Collaborate with modelers, content experts to develop content expertise and implement optimized and performant solutions Apply statistical methods to real-world f...

Roles & Responsibilities Design and build scalable enterprise analytics solutions using Databricks, Power BI, and other modern data management tools. Leverage data virtualization, ETL, and semantic layers to balance need for unification, performance, and data transformation with goal to reduce data proliferation Break down features into work that aligns with the architectural direction runway Participate hands-on in pilots and proofs-of-concept for new patterns Create robust documentation from data analysis and profiling, and proposed designs and data logic Develop advanced sql queries to profile, and unify data Develop data processing code in sql, along with semantic views to prepare data f...

Roles & Responsibilities Design and build scalable enterprise analytics solutions using Databricks, Power BI, and other modern data management tools. Leverage data virtualization, ETL, and semantic layers to balance need for unification, performance, and data transformation with goal to reduce data proliferation Break down features into work that aligns with the architectural direction runway Participate hands-on in pilots and proofs-of-concept for new patterns Create robust documentation from data analysis and profiling, and proposed designs and data logic Develop advanced sql queries to profile, and unify data Develop data processing code in sql, along with semantic views to prepare data f...

In this vital role you will be responsible to design, develop, and optimize data pipelines, data integration frameworks, and metadata-driven architectures that enable seamless data access and analytics. This role prefers deep expertise in big data processing, distributed computing, data modeling, and governance frameworks to support self-service analytics, AI-driven insights, and enterprise-wide data management. Design, develop, and maintain complex ETL/ELT data pipelines in Databricks using PySpark, Scala, and SQL to process large-scale datasets Understand the biotech/pharma or related domains & build highly efficient data pipelines to migrate and deploy complex data across systems Design a...

In this vital role we are seeking a Business Systems Analyst with a good background in data and analytics to define and manage product requirements for AI-driven applications. Partner with Data Scientists, ML Engineers, and Product Managers to define business processes, product needs, and AI solution requirements. Capture and document epics, user stories, acceptance criteria, and data process flows for AI-powered analytics applications. Work closely with partners to define scope, priorities, and impact of new AI and data initiatives. Ensure non-functional requirements, such as data security, model interpretability, and system performance, are included in product backlogs. Facilitate the brea...

To lead the end-to-end management of enterprise data assets and operational data workflows. This role is critical in ensuring the availability, quality, consistency, and timeliness of data across platforms and functions, supporting analytics, reporting, compliance, and digital transformation initiatives. You will be responsible for the day-to-day data operations, manage a team of data professionals, and drive process excellence in data intake, transformation, validation, and delivery. You will work closely with cross-functional teams including data engineering, analytics, IT, governance, and business stakeholders to align operational data capabilities with enterprise needs. Roles & Responsib...

We are seeking a skilled Azure Data Engineer with deep expertise in data engineering technologies. The ideal candidate will have a strong foundation in data processing, cloud services, and data pipeline development to support our growing data needs. Key Responsibilities: - Design, implement, and manage scalable data pipelines on Azure, ensuring data integrity and performance. - Utilize Databricks and Snowflake to perform data transformation, processing, and analytics. - Conduct unit testing on developed code to ensure quality and reliability of data solutions. - Collaborate with cross-functional teams in an Agile/Scrum environment to deliver robust data solutions. Qualifications: - **Certifi...

Job Category Software Engineering Job Details About Salesforce We're Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too - driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good - you've come to the right place. Role Description Join the AI team at Salesforce and make a real impact with your software designs and code! This position...

What you will do The R&D Precision Medicine team is responsible for Data Standardization, Data Searching, Cohort Building, and Knowledge Management tools that provide the Amgen scientific community with access to Amgens wealth of human datasets, projects and study histories, and knowledge over various scientific findings. These data include clinical data, omics, and images. These solutions are pivotal tools in Amgens goal to accelerate the speed of discovery, and speed to market of advanced precision medications. The Data Engineer will be responsible for full stack development of enterprise analytics and data mastering solutions leveraging Databricks and Power BI. This role requires expertis...

Qualification Design, develop, and deploy machine learning and deep learning modls. Collaborate with data scientists, product managers, and engineers to identify opportunities for AI integration. Build scalable and efficient data pipelines to train and serve AI models. Optimize models for performance, accuracy, and resource efficiency. Monitor and maintain production AI systems, ensuring reliability and performance. Research and prototype new AI techniques and stay current with the latest advancements in AI and ML. Document models, processes, and methodologies clearly and concisely.

We are seeking a highly skilled Senior Data Engineer with strong experience in cloud-based data engineering and AI solutions. The ideal candidate will bring a combination of software engineering, big data processing, and cloud infrastructure expertise. This role requires hands-on experience in building data pipelines on AWS or Azure , with a strong emphasis on Databricks , Spark , and Python . You will work within Agile teams , contributing to the design, development, and deployment of scalable, high-performance data solutions. A passion for quality, testing, and continuous learning is key to success in this role. Required Qualifications Bachelor's degree or equivalent in Computer Science , ...

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities As a Big Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitabl...

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data...

Qualification Talend - Designing, developing, and documenting existing Talend ETL processes, technical architecture, data pipelines, and performance scaling using tools to integrate Talend data and ensure data quality in a big data environment. AWS / Snowflake - Design, develop, and maintain data models using SQL and Snowflake / AWS Redshift-specific features. Collaborate with stakeholders to understand the requirements of the data warehouse. Implement data security, privacy, and compliance measures. Perform data analysis, troubleshoot data issues, and provide technical support to end-users. Develop and maintain data warehouse and ETL processes, ensuring data quality and integrity. Stay curr...

Qualification Design, develop, and deploy machine learning and deep learning modls. Collaborate with data scientists, product managers, and engineers to identify opportunities for AI integration. Build scalable and efficient data pipelines to train and serve AI models. Optimize models for performance, accuracy, and resource efficiency. Monitor and maintain production AI systems, ensuring reliability and performance. Research and prototype new AI techniques and stay current with the latest advancements in AI and ML. Document models, processes, and methodologies clearly and concisely.

We are looking for a skilled Azure Data Engineer to design, develop, optimize data pipelines for following 1, SQL+ETL+AZURE+Python+Pyspark+Databricks 2, SQL+ADF+ Azure 3, SQL+Python+Pyspark - Strong proficiency in SQL for data manipulation querying Required Candidate profile - Python and PySpark for data engineering tasks. - Exp with Databricks for big data processing analytics. - Knowledge of data modeling, warehousing, governance. - CI/CD pipelines for data deployment. Perks and benefits Perks and Benefits

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your role and responsibilities As a Software Developer you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients hybrid-cloud and AI journeys. You'll have the opportunity to work with the latest technologies, en...

Job Description: A Pricing Revenue Growth Consultant advise to build a pricing and promotion tool for CPG client which would have pricing strategies trade promotions and revenue growth initiatives This will involve building analytics and machine learning models for price elasticity promotion effectiveness and trade promotion optimization Consultant would require collaborating with CPG business marketing data scientist and other teams for a successful delivery of project and tool Required Skills Business Domain Skills o Trade Promotion Management TPM Trade Promotion Optimization TPO Trade Spend Efficiency o Promotion Depth Frequency Forecasting Scenario and Effectiveness o Price Pack Architec...