3177 Data Pipelines Jobs - Page 4

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : Data Science Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qualit...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : Data Science Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will engage in the design, development, and maintenance of data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating robust dat...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering Good to have skills : Data Science Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qualit...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Data Engineering, Hive,Hbase Good to have skills : Snowflake Data Warehouse, Map Reduce,Kafka Minimum 2 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will engage in the design, development, and maintenance of data solutions that facilitate data generation, collection, and processing. Your typi...

Overview Support core financial planning processes (Month-end closing, Forecast, AOP, etc.) through data collection, verification and processing, to ensure timely submission to GBS and Sector, looking for automation, digitalization and streamlining of current processes Work closely with Finance and Non-Finance stakeholders (Sales Finance, Supply Chain Finance, FP&A, Control, etc.) supporting and ensuring a robust and working solution across PBNA Work closely with the IT/consulting houses to test the system as it is being developed and drive enhancements Escalate issues as they arise to the IT and Business design team - coordinate action plans in response to findings and ensure timely resolut...

Role Summary: Serve as the technical anchor for offshore development, driving design, implementation, and quality delivery across modernization streams. This role requires strong expertise in Java/Spring Boot, RESTful API development, and Azure integrations, with the ability to translate architecture into high-quality, maintainable code. Key Responsibilities: Define service boundaries, design RESTful APIs, and oversee microservice implementation using Java and Spring Boot. Lead the engineering team in modular design, code quality, and reusability across services. Design secure integration flows leveraging Azure API Gateway, OAuth 2.0 / OIDC, and Key Vault. Architect containerized deployments...

Design, build, and maintain Power BI reports and dashboards that provide actionable insights to business and technical stakeholders. Develop and manage data models using Power BI Desktop and Power BI Service, ensuring optimal performance and usability. Build robust, scalable solutions in Microsoft Dataverse , including table design, business rules, workflows, and integrations. Create and maintain Power BI dataflows , composite models , and semantic models to streamline data access and reuse. Integrate Power BI with Dataverse , Azure SQL, SharePoint, and other sources, ensuring secure and governed data pipelines. Design row-level security (RLS), DAX calculations, and KPI visualizations aligne...

Agentic AI Software Engineer to join our team and help build the next generation of intelligent agentdriven applications This is a handson engineering role with a strong learning focus where youll contribute to data pipelines RAG systems and AIenabled APIs while working alongside experienced engineers and technical leads Assist in developing GenAI applications using modern frameworks LangChain LangGraph AutoGen or AWS Bedrock Agents Support the design and implementation of data ingestion pipelines for structured and unstructured data Contribute to retrievalaugmented generation RAG projects by building embeddings working with vector databases and integrating context into models Integrate agen...

Design, develop, and maintain data pipelines and ETL processes using AWS and Snowflake Implement data transformation workflows using DBT (Data Build Tool) Write efficient, reusable, and reliable code in Python Optimize and tune data solutions for performance and scalability Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions Ensure data quality and integrity through rigorous testing and validation Stay updated with the latest industry trends and technologies in data engineering Bachelor''s or Master''s degree in Computer Science, Engineering, or a related field Proven experience as a Data Engineer or similar role Strong pro...

We are looking for a skilled professional with 10 to 15 years of experience to lead our team as an AI-Manager in the IT Services & Consulting industry. The ideal candidate will have a strong background in artificial intelligence and machine learning, with excellent leadership skills. Roles and Responsibility Develop and implement AI solutions using various technologies and tools. Collaborate with cross-functional teams to identify business problems and develop solutions. Design and deploy scalable data pipelines and architectures. Work closely with stakeholders to understand requirements and deliver high-quality results. Stay updated with industry trends and emerging technologies in AI. Lead...

We are looking for a highly skilled and experienced AI Consultant to join our team at Accenture Solutions Pvt Ltd. The ideal candidate will have a strong background in IT Services & Consulting, with expertise in Global Network and AI technologies. Roles and Responsibility Collaborate with cross-functional teams to design and implement AI solutions. Develop and maintain large-scale data pipelines using AI and machine learning algorithms. Provide technical leadership and guidance on AI projects. Conduct research and analysis to identify business opportunities and challenges. Design and develop predictive models to drive business growth. Work closely with stakeholders to understand business req...

Responsibilities: We are looking for a highly skilled Databricks & Azure Senior Data Engineer with at least 6 to 10 years of experience to join our vibrant Data & Analytics team. The ideal candidate should have strong background in Azure data services, including Databricks, Synapse Analytics, Microsoft Fabric, PySpark and SQL. He/She will be responsible for designing, building, and maintaining scalable data solutions that meet business requirements and align with industry best practices. What is expected out of you? 6+ years of experience as a Databricks & Data Engineer, building Azure-based data solutions using Data Factory, Synapse, Databricks. Expertise in Python, SQL (SparkSQL, TSQL, PLS...

What you'll do You are a capable, self-motivated data engineer. You will be a member of the data engineering team working on tasks ranging from design, development, operations of data warehouse, data platform and data pipelines. We enjoy working closely with each other utilizing an Agile development methodology. Priorities can change quickly, but our team members are able to stay ahead to delight every one of our customers whether they are internal or external to Viasat. The day-to-day Develop ETL processes delivering high-quality code, following coding best practices. Create and implement complex analytical data models that support reporting and analytics business requirements. Support and ...

Essential Bachelors degree or equivalent in Computer Engineering Computer Science or a related field 5 years of experience in data software engineering role 3 years of strong hands on experience with Databricks with AWS as a cloud platform which including Spark based processing data pipelines and the platforms tools for analytics and machine learning 2 years of experience with building AWS cloud based data pipelines and AI solutions 2 years of Hands on experience with Python and PySpark The role holder will possess a blend of design skills needed for Agile data development projects Proficiency or demonstratable passion for learning in data engineer techniques and testing methodologies Strong...

We are seeking a highly skilled and motivated Big Data Engineer to join our data engineering team The ideal candidate will have hands-on experience with Hadoop ecosystem, Apache Spark, and programming expertise in Python (PySpark), Scala, and Java You will be responsible for designing, developing, and optimizing scalable data pipelines and big data solutions to support analytics and business intelligence initiatives Qualification Tier : Tier 3/Senior Software Engineer

Cloud Data Architect Role: To The ideal professional for this Cloud Architect role will: Have a passion for design, technology, analysis, collaboration, agility, and planning, along with a drive for continuous improvement and innovation. Exhibit expertise in managing high-volume data projects that leverage Cloud Platforms, Data Warehouse reporting and BI Tools, and the development of relational databases. Research, identify, and internally market enabling data management technologies based on business and end-user requirements. Seek ways to apply new technology to business processes with a focus on modernizing the approach to data management. Consult with technical subject matter experts and...

* Work with broader team to build, analyze and improve the AI solutions. * You will also work with our software developers in consuming different enterprise applications. Required education Bachelor''s Degree Preferred education Master''s Degree Required technical and professional expertise * Resource should have 5-7 years of experience. Sound knowledge of Python and should know how to use the ML related services. * Proficient in Python with focus on Data Analytics Packages. Strategy Analyse large, complex data sets and provide actionable insights to inform business decisions. Strategy * Design and implementing data models that help in identifying patterns and trends. Collaboration Work with...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform * Responsibilities: * Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS * Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform * Experience in developi...

As Data Engineer, you will develop, maintain, evaluate and test big data solutions. You will be involved in the development of data solutions using Spark Framework with Python or Scala on Hadoop and Azure Cloud Data Platform Responsibilities: Experienced in building data pipelines to Ingest, process, and transform data from files, streams and databases. Process the data with Spark, Python, PySpark and Hive, Hbase or other NoSQL databases on Azure Cloud Data Platform or HDFS Experienced in develop efficient software code for multiple use cases leveraging Spark Framework / using Python or Scala and Big Data technologies for various use cases built on the platform Experience in developing strea...

Work with broader team to build, analyze and improve the AI solutions. You will also work with our software developers in consuming different enterprise applications Required education Bachelor''s Degree Required technical and professional expertise Resource should have 5-7 years of experience. Sound knowledge of Python and should know how to use the ML related services. Proficient in Python with focus on Data Analytics Packages. Strategy Analyse large, complex data sets and provide actionable insights to inform business decisions. Strategy Design and implementing data models that help in identifying patterns and trends. Collaboration Work with data engineers to optimize and maintain data pi...

Key Responsibilities: Deliver the product's objectives using Cigna International Health's agile delivery methods Break down product objectives into User Stories with Acceptance Criteria and maintain a prioritized Product Backlog Apply economic and scientific thinking to plan deliveries that maximize business value Combine inputs from multiple stakeholders including customers, data & analytics, operations, technology, and regulation to ensure balanced solutions Demonstrate creativity, attention to detail, and intellectual rigor in delivering product objectives Collaborate with the Product Manager on product discovery techniques and roadmap prioritization Assess a range of data and technology ...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Senior AI Engineer Role Overview: We are seeking a highly skilled and experienced Senior AI Engineers with a minimum of 4 years of experience, including 12 years of direct experience in generative and agentic AI (e.g., GANs, VAEs, diffusion models, LLMs, and autonomous/agent-based architectures). This role will design, build and optimize adva...

The Sr. Data Engineer in our innovative team will focus on revolutionizing healthcare through AI and generative AI technologies. This role will be instrumental in designing and implementing robust data pipelines to support the development of a Healthcare analytics data platform for a variety of healthcare applications and AI models. This is a critical role in transforming healthcare data into actionable insights, ensuring compliance with industry standards while leveraging cutting-edge technologies. Data Engineering & Pipeline Development: Design, implement, and optimize ETL/ELT pipelines to support data ingestion and transformation from diverse healthcare data sources. Develop and maintain ...

Essential Bachelors degree or equivalent in Computer Engineering Computer Science or a related field 5 years of experience in data software engineering role 3 years of strong hands on experience with Databricks with AWS as a cloud platform which including Spark based processing data pipelines and the platforms tools for analytics and machine learning 2 years of experience with building AWS cloud based data pipelines and AI solutions 2 years of Hands on experience with Python and PySpark The role holder will possess a blend of design skills needed for Agile data development projects Proficiency or demonstratable passion for learning in data engineer techniques and testing methodologies Strong...

Role & responsibilities Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using Databricks, Google BigQuery, SQL, and cloud-native tools . Build and optimize batch and streaming data pipelines to support analytics, reporting, and business intelligence use cases. Collaborate with business stakeholders, product teams, analytics engineers, and data analysts to gather requirements and deliver data solutions. Develop and manage data models, schemas, and transformations ensuring data quality, integrity, and consistency. Optimize SQL queries, partitioning, clustering, and indexing for performance and cost efficiency. Support BI tools and dashboards by providing clean, reli...