3177 Data Pipelines Jobs - Page 14

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Work with broader team to build, analyze and improve the AI solutions. You will also work with our software developers in consuming different enterprise applications. Required education Bachelor's Degree Required technical and professional expertise Resource should have 5-7 years of experience. Sound knowledge of Python and should know how to use the ML related services. Proficient in Python with focus on Data Analytics Packages. Strategy Analyse large, complex data sets and provide actionable insights to inform business decisions. Strategy Design and implementing data models that help in identifying patterns and trends. Collaboration Work with data engineers to optimize and maintain data pi...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

Job Summary: We are seeking a skilled Data Engineer Data Integration to design, develop, and maintain efficient and scalable data integration pipelines across diverse systems The ideal candidate will have hands-on experience with ETL tools, data pipelines, and cloud-based integration platforms, ensuring seamless data flow, consistency, and reliability across the enterprise data ecosystem Key Responsibilities: Design, develop, and manage data integration workflows, ETL/ELT pipelines, and data movement solutions between multiple data sources and targets Implement and maintain integrations across on-premises and cloud environments (AWS, Azure, GCP) Ensure data accuracy, quality, and consistency...

Work with broader team to build, analyze and improve the AI solutions. You will also work with our software developers in consuming different enterprise applications Required education Bachelor's Degree Required technical and professional expertise Resource should have 5-7 years of experience. Sound knowledge of Python and should know how to use the ML related services. Proficient in Python with focus on Data Analytics Packages. Strategy Analyse large, complex data sets and provide actionable insights to inform business decisions. Strategy Design and implementing data models that help in identifying patterns and trends. Collaboration Work with data engineers to optimize and maintain data pip...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and AWS Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark, Scala, and Hive, Hbase or other NoSQL databases on Cloud Data Platforms (AWS) or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developin...

We are looking for a highly skilled Data Engineer to join our team in IBM India Pvt. Limited, responsible for designing and implementing data integration solutions. The ideal candidate will have a strong background in data engineering and experience with data integration tools. Roles and Responsibility Design and develop data integration solutions using various tools and technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Ensure data quality and integrity by implementing data validation and testing procedures. Troubleshoot and resolve complex technical issues related to data ...

We are looking for a skilled Data Engineer to join our team at IBM India Pvt. Limited, responsible for designing and implementing data platforms on AWS. The ideal candidate will have experience in the IT Services & Consulting industry. Roles and Responsibility Design and implement scalable data pipelines using AWS services such as S3, Lambda, and Glue. Develop and maintain large-scale data warehouses and data lakes on AWS. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure data quality and integrity by implementing data validation and testing procedures. Optimize data processing workflows for performance and efficiency. Troubleshoot and resolve te...

We are looking for a highly skilled Data Engineer to join our team in IBM India Pvt. Limited, responsible for designing and implementing data integration solutions. The ideal candidate will have a strong background in data engineering and experience with data integration tools. Roles and Responsibility Design and develop data integration solutions using various tools and technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data pipelines and architectures. Ensure data quality and integrity by implementing data validation and testing procedures. Troubleshoot and resolve complex technical issues related to data ...

Position Summary Data Engineer with strong expertise in managing & building scalable data pipelines and solutions using PySpark, SQL, and AWS. The ideal candidate will have hands-on experience in designing, developing, and optimizing data workflows to enable high-quality, reliable, and timely data delivery for business use cases. Job Responsibilities Design, develop, and maintain data pipelines and ETL workflows using PySpark and SQL. Work with large-scale datasets to ensure data accuracy, consistency, and quality. Implement and manage data solutions on AWS Cloud services (e.g., S3, Glue, EMR, Redshift, Lambda). Collaborate with Business Analysts and business stakeholders to understand requi...

About The Role – MLOPs (Director) Experience – 12+ yrs. Job Location – Noida / Gurgaon / Bangalore Must have skills & competencies Experience in designing innovative solutions which are aligned with client expectations and requirements and that has been helpful in crafting winning proposals in the field of MLOPS/Data Engineering and Data Science. Good experience in Developing Delivering and operationalizing scalable processes for large and complex client engagements in the field of Data science. Engage with clients to grow and deliver business. Ensure profitable delivery and great customer experience by designing end-to-end solutions and guiding the team to deliver as per established process...

Position Summary Data Engineer with strong expertise in building scalable data pipelines and solutions using PySpark, SQL, and AWS. The ideal candidate will have hands-on experience in designing, developing, and optimizing data workflows to enable high-quality, reliable, and timely data delivery for business use cases. Job Responsibilities Design, develop, and maintain data pipelines and ETL workflows using PySpark and SQL. Work with large-scale datasets to ensure data accuracy, consistency, and quality. Implement and manage data solutions on AWS Cloud services (e.g., S3, Glue, EMR, Redshift, Lambda). Collaborate with Business Analysts and business stakeholders to understand requirements and...

About The Role Project Role : Full Stack Engineer Project Role Description : Responsible for developing and/or engineering the end-to-end features of a system, from user experience to backend code. Use development skills to deliver innovative solutions that help our clients improve the services they provide. Leverage new technologies that can be applied to solve challenging business problems with a cloud first and agile mindset. Must have skills : PostgreSQL Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Project Role:Data Engineer Project Role Description:Build and maintain data pipelines, ensures data quality, ...

About The Role Project Role : Custom Software Engineer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Palantir Foundry, Python (Programming Language), PySpark, MySQL Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solut...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qualit...

The Finance Data Engineering team focuses on empowering data-informed decisions through the development of scalable data products. Collaborating with data science and engineering teams, you will play a pivotal role in delivering valuable insights into financial data by developing robust pipelines, implementing data quality processes, creating conformed data models, and building effective visualizations. Joining our team means engaging with highly intelligent and straightforward colleagues. We thrive on posing challenging questions and encouraging one another to enhance our output continuously. While we value individual drive, we also emphasize collaboration. Our primary focus is on driving g...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

The Impact you will have in this role: Work with modern PAM technologies in a supportive, learning-focused environment. Knowledge Sharing: Collaborate with IT, risk, and cybersecurity teams, contribute to documentation, and participate in technical workshops and team reviews to expand your expertise Be part of a team committed to innovation, operational excellence, and professional development. Over time, you will have the opportunity to cross-train in other IAM tools and technologies, including Active Directory, HashiCorp Vault, Terraform, Ansible, PKI/HSM, and Identity Governance platforms. Were seeking a hands-on, detail-oriented Senior/Lead PAM Systems Engineer who combines technical exp...

The Impact you will have in this role: IAM Tech Ops team is dedicated to ensure availability, security, and seamless operation of the organizations IAM systems. We play a critical role in safeguarding corporate data and enhancing user experience by managing system upgrades, onboarding and offboarding processes, troubleshooting access issues, and implementing robust observability and monitoring practices. Through proactive support and continuous improvement, the team ensures secure and reliable identity services across the enterprise. Key Responsibilities Assist in designing and implementing systems to discover and track certificates, keys, and cryptographic protocols across endpoints and ser...

Educational Requirements Bachelor of Engineering Service Line Data & Analytics Unit Responsibilities Strong programming skills in Python, Java, C++, SQL etc. Deep expertise with cloud platforms like AWS, Azure, or GCP. Hands-on experience with Databricks, Snowflake, AWS RDS, Azure SQL, or GCP Cloud SQL, Apache Spark and Apache Airflow. Strong understanding of Lakehouse architecture, Data Mesh principles, data governance frameworks, and modern data pipelines. Proven ability to deliver high-impact, API-first services at scale. Proficiency with tools like Terraform or AWS CloudFormation is critical for managing cloud infrastructure programmatically, ensuring consistency, and enabling automation...

Huron is a global consultancy that collaborates with clients to drive strategic growth, ignite innovation and navigate constant change. Through a combination of strategy, expertise and creativity, we help clients accelerate operational, digital and cultural transformation, enabling the change they need to own their future. Join our team as the expert you are now and create your future. We are looking for a technically strong and adaptable AI Solution Architect to join our growing AI practice. In this role, you will contribute to the design and implementation of AI-powered solutions across a range of client-facing projects, helping ensure that architectural decisions are sound, scalable, and ...

About the Role We are looking for a seasoned Engineering Manager well-versed with emerging technologies to join our team. As an Engineering Manager, you will ensure consistency and quality by shaping the right strategies. You will keep an eye on all engineering projects and ensure all duties are fulfilled . You will analyse other employees tasks and carry on collaborations effectively. You will also transform newbies into experts and build reports on the progress of all projects. What you will do Design tasks for other engineers as per Meeshos guidelines Perform regular performance evaluation and share and seek feedback Keep a closer look on various projects and monitor the progress Carry on...

As a Data Engineer at our company, you will play a crucial role in the design, development, implementation, and maintenance of data flow channels and data processing systems. Your responsibilities will include: - Ensuring high quality software development, with complete documentation and traceability - Developing and optimizing scalable Spark Java-based data pipelines for processing and analyzing large scale financial data - Designing and implementing distributed computing solutions for risk modeling, pricing, and regulatory compliance - Ensuring efficient data storage and retrieval using Big Data - Implementing best practices for spark performance tuning including partition, caching, and me...

As an experienced professional with over 7 years of experience, you have the opportunity to work remotely for GRG Health's client on the Kyrios 2.0 project, an AI-driven healthcare platform. Your role will involve leading the engineering team, modernizing the platform, driving AI-driven innovation, designing technical architecture, building and mentoring a high-performance team, collaborating cross-functionally, and operationalizing AI & data strategies. **Key Responsibilities:** - **End-to-End Engineering Leadership:** Lead architecture, backend, frontend, DevOps, data engineering, and security functions for Kyrios 2.0. - **Platform Modernization:** Oversee codebase handover, establish CI/C...

Educational Requirements Bachelor of Engineering,Bachelor Of Technology,Master Of Technology,Master Of Engineering,Master Of Science,Master Of Comp. Applications Service Line Data & Analytics Unit Responsibilities Job DescriptionWe are seeking a skilled and experienced SQL Server & BI Platform Administrator to manage and maintain our Microsoft SQL Server environment, including SSIS (Integration Services), SSAS (Analysis Services), and MDX cube development and administration. The ideal candidate will ensure high availability, performance, and security of databases and BI solutions, while supporting data integration and analytical reporting needs across the organization.Key Responsibilities:SQ...