757 Data Pipelines Jobs - Page 26

As a Lead Data Engineer, you will be responsible for leveraging your 7 to 12+ years of hands-on experience in SQL database design, data architecture, ETL, Data Warehousing, Data Mart, Data Lake, Big Data, Cloud (AWS), and Data Governance domains. Your expertise in a modern programming language such as Scala, Python, or Java, with a preference for Spark/ Pyspark, will be crucial in this role. Your role will require you to have experience with configuration management and version control apps like Git, along with familiarity working within a CI/CD framework. If you have experience in building frameworks, it will be considered a significant advantage. A minimum of 8 years of recent hands-on SQL...

As the Director/Head of Data Engineering for India, you will be responsible for developing and maintaining the data strategy for Singapore implementation. Your primary goal will be to create a model implementation that can be replicated across wider PBWM Organisation for compliance in other jurisdictions. You will define and execute the data engineering strategy in alignment with business goals and technology roadmaps. Collaborating with the Chief Data Officer/Chief Operating Officer, you will understand the Critical Data Elements (CDE) and establish controls around them. Your role will involve designing data models, efficient data pipelines, ensuring data quality and integrity, collaboratin...

We are looking for a highly experienced Senior AI/ML Engineer with a strong background in cloud infrastructure and IoT to join our dynamic team in Ahmedabad. As an ML Engineer/MLOps Engineer, your primary responsibility will be to lead the design, development, and deployment of AI/ML solutions on cloud platforms, integrate IoT technologies, and drive innovation in intelligent systems. Your role will involve leading the end-to-end development and deployment of AI/ML solutions on cloud platforms such as AWS for applications like predictive analytics, anomaly detection, and intelligent automation. You will also be responsible for integrating IoT sensors, devices, and protocols like MQTT into AI...

The Lead Platform Engineer - Gen AI at Elanco, based in Bengaluru, India, will be a part of the Software Engineering & Platforms team. Reporting to the IT Engineering Associate Director, you will be instrumental in driving the direction of platform and automation capabilities, specifically focusing on generative AI and its implementation at Elanco. Your role will involve collaborating with a diverse team to work on cutting-edge engineering initiatives that ensure secure, reliable, and efficient solutions using the latest technology. As a successful candidate, you must possess a highly motivated and innovative mindset, with the ability to articulate complex technical topics, collaborate with ...

Job Summary: We are seeking a highly motivated and skilled Project Manager to lead and manage AI-driven projects from conception to deployment. The ideal candidate will bridge the gap between business, data science, and engineering teams, ensuring smooth project execution, alignment with business objectives, and timely delivery. This role requires a deep understanding of machine learning (ML) concepts and AI technologies, coupled with strong project management experience. Key Responsibilities: Project Planning & Execution: Lead the planning, execution, and delivery of machine learning and AI projects from ideation through production. Define project scope, goals, deliverables and timelines in...

About Us Thoucentric is the Consulting arm of Xoriant, a prominent digital engineering services company with 5000+ employees. We are headquartered in Bangalore with presence across multiple locations in India, US, UK, Singapore & Australia Globally. As the Consulting business of Xoriant, We help clients with Business Consulting, Program & Project Management, Digital Transformation, Product Management, Process & Technology Solutioning and Execution including Analytics & Emerging Tech areas cutting across functional areas such as Supply Chain, Finance & HR, Sales & Distribution across US, UK, Singapore and Australia. Our unique consulting framework allows us to focus on execution rather than p...

Key Responsibilities: Technology Leadership & Strategy Define and execute the technical vision, ensuring alignment with business objectives. Oversee architecture decisions, technology stack, and software development best practices. Ensure security, scalability, and compliance of all technology solutions. Guide technical teams in best practices for .NET, MEAN, MERN, and cloud-based development. Product & Engineering Management Lead the engineering and product teams, setting priorities and ensuring timely delivery of high-quality products. Manage the full software development lifecycle (SDLC) from ideation to deployment. Collaborate with stakeholders to translate business needs into technical ...

As a skilled AI expert, you will be responsible for partnering with Product Managers, Engineers, and other key stakeholders to deeply understand business requirements and translate them into actionable technical roadmaps. You will identify and prioritize AI use cases aligned with organizational goals, develop a scalable and sustainable implementation roadmap, and conduct ROI analysis for on-prem LLM deployments. Your role will involve creating sophisticated software designs driven by AI-powered experiences, focusing on performance, scalability, security, reliability, and ease of maintenance. You will define and develop complex enterprise applications through AI Agentic frameworks, ensuring r...

As an Azure Data Engineer Junior at dotSolved, you will be responsible for designing, implementing, and managing scalable data solutions on Azure. Your primary focus will be on building and maintaining data pipelines, integrating data from various sources, and ensuring data quality and security. Proficiency in Azure services such as Data Factory, Databricks, and Synapse Analytics is essential as you optimize data workflows for analytics and reporting purposes. Collaboration with stakeholders is a key aspect of this role to ensure alignment with business goals and performance standards. Your responsibilities will include designing, developing, and maintaining data pipelines and workflows usin...

Ready to shape the future of work At Genpact, we don&rsquot just adapt to change&mdashwe drive it. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos , our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to , our breakthrough solutions tackle companies most complex challenges. If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that&rsquos shaping the future, this is your moment. Genpact (NYSE: G) is an advanced technology ...

Ready to shape the future of work At Genpact, we don&rsquot just adapt to change&mdashwe drive it. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos , our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to , our breakthrough solutions tackle companies most complex challenges. If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that&rsquos shaping the future, this is your moment. Genpact (NYSE: G) is an advanced technology ...

Key Skills: Data Science, Machine Learning, NLP, Generative AI, LLM, Transformer Networks, GANs, VAEs, Prompt Engineering, Model Development, MarkLogic (preferred), Cloud-native models, Model Deployment, Data Pipelines Roles & Responsibilities: Apply deep learning and generative modeling techniques to develop LLM solutions in AI, especially in the field of Natural Language Processing (NLP). Work with various LLM technologies and Transformer Encoder Networks to enhance NLP capabilities. Design and implement state-of-the-art generative models for tasks such as text generation, text completion, language translation, and document summarization. Utilize expertise in machine learning, focusing on ...

Ford Motor Credit Company is on a mission to modernize its legacy Platforms in order to transform the business and harness the power of data to enhance customer experiences, ensure regulatory compliance, and improve operational efficiencies. The company is in the process of rearchitecting core applications and platforms to transition to a Unified, Modern, Scalable, and Secure solutions on Google Cloud. As a Solution Architect joining the FC India IT Architecture team, you will play a crucial role in defining the optimal platform and domain architecture. Your responsibilities will include creating solutions for cloud implementation across various engagements such as experimentation, proof of ...

As a Cloud DB Engineer, you will be responsible for designing and developing data pipelines to collect, transform, and store data from various sources in order to support analytics and business intelligence. Your role will involve integrating data from multiple sources, including databases, APIs, and third-party tools, to ensure consistency and accuracy across all data systems. You will also be tasked with designing, implementing, and optimizing both relational and non-relational databases to facilitate efficient storage, retrieval, and processing of data. Data modeling will be a key aspect of your responsibilities, where you will develop and maintain data models that represent data relation...

As an Ingestion Engineer at Saxon Global, you will be responsible for designing, developing, and optimizing data ingestion pipelines to integrate multiple sources into Databricks. Your expertise in CI/CD and Kubernetes will be crucial in implementing and maintaining efficient data workflows. Collaboration with Data Engineers and stakeholders is essential to streamline data ingestion strategies and ensure data integrity, security, and compliance throughout the process. Key Responsibilities: - Design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks. - Implement and maintain CI/CD pipelines for data workflows. - Deploy and manage containerized app...

You should have experience in understanding and translating data, analytic requirements, and functional needs into technical requirements while collaborating with global customers. Your responsibilities will include designing cloud-native data architectures to support scalable, real-time, and batch processing. You will be required to build and maintain data pipelines for large-scale data management in alignment with data strategy and processing standards. Additionally, you will define strategies for data modeling, data integration, and metadata management. Your role will also involve having strong experience in database, data warehouse, and data lake design and architecture. You should be pr...

At PwC, we focus on leveraging advanced technologies and techniques in data and analytics engineering to design and develop robust data solutions for our clients. As a Director - Generative AI with over 15 years of experience, you will play a crucial role in transforming raw data into actionable insights, enabling informed decision-making, and driving business growth. Your main responsibilities will involve developing and implementing advanced AI and ML solutions to drive innovation and enhance business processes. You should possess proficiency in Generative AI based application development and have a strong focus on leveraging AI and ML technologies. Strong experience in Python programming ...

The ideal candidate for the Azure Data Engineer position will have 4-6 years of experience in designing, implementing, and maintaining data solutions on Microsoft Azure. As an Azure Data Engineer at our organization, you will be responsible for designing efficient data architecture diagrams, developing and maintaining data models, and ensuring data integrity, quality, and security. You will also work on data processing, data integration, and building data pipelines to support various business needs. Your role will involve collaborating with product and project leaders to translate data needs into actionable projects, providing technical expertise on data warehousing and data modeling, as wel...

Ready to shape the future of work At Genpact, we don&rsquot just adapt to change&mdashwe drive it. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos , our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to , our breakthrough solutions tackle companies most complex challenges. If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that&rsquos shaping the future, this is your moment. Genpact (NYSE: G) is an advanced technology ...

Ready to shape the future of work At Genpact, we don&rsquot just adapt to change&mdashwe drive it. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos , our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to , our breakthrough solutions tackle companies most complex challenges. If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that&rsquos shaping the future, this is your moment. Genpact (NYSE: G) is an advanced technology ...

Hiring an AWS Data Engineer for a 6-month hybrid contractual role based in Bellandur, Bengaluru. The ideal candidate will have 7+ years of experience in data engineering, with strong expertise in AWS services (S3, EC2, RDS, Lambda, EKS), PostgreSQL, Redis, Apache Iceberg, and Graph/Vector Databases. Proficiency in Python or Golang is essential. Responsibilities include designing and optimizing data pipelines on AWS, managing structured and in-memory data, implementing advanced analytics with vector/graph databases, and collaborating with cross-functional teams. Prior experience with CI/CD and containerization (Docker/Kubernetes) is a plus.

Azure Databricks Developer Job Title: Azure Databricks Developer Experience: 5+ Years Location: PAN India (Remote/Hybrid as per project requirement) Employment Type: Full-time Job Summary: We are hiring an experienced Azure Databricks Developer to join our dynamic data engineering team. The ideal candidate will have strong expertise in building and optimizing big data solutions using Azure Databricks, Spark, and other Azure data services. Key Responsibilities: Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark. Integrate and manage large datasets using Azure Data Lake, Azure Data Factory, and other Azure services. Implement Delta Lake for efficient ...

Notice Period: Immediate About the role: We are hiring a Senior Snowflake Data Engineer with 10+ years of experience in cloud data warehousing and deep expertise on the Snowflake platform. The ideal candidate should have strong skills in SQL, ETL/ELT, data modeling, and performance tuning, along with a solid understanding of Snowflake architecture, security, and cost optimization. Roles & Responsibilities: Collaborate with data engineers, product owners, and QA teams to translate business needs into efficient Snowflake-based data models and pipelines. Design, build, and optimize data solutions leveraging Snowflake features such as virtual warehouses, data sharing, cloning, and time travel. D...

Role is for junior and senir people across level Role & responsibilities Assist in the design, development, and maintenance of ETL/ELT pipelines on AWS (Glue, Lambda, S3, Redshift) and Azure (Data Factory, Data Lake, Synapse) Perform data ingestion, transformation, and validation using Python, SQL, and cloud-native tools Work with structured and unstructured data from diverse sources such as APIs, databases, and files Monitor and optimize performance of data pipelines to ensure data quality and timely availability Support data lake and warehouse implementations on cloud platforms Collaborate with data analysts, scientists, and business users to understand data requirements Maintain clear doc...

Ready to shape the future of work At Genpact, we don&rsquot just adapt to change&mdashwe drive it. AI and digital innovation are redefining industries, and we&rsquore leading the charge. Genpact&rsquos , our industry-first accelerator, is an example of how we&rsquore scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to , our breakthrough solutions tackle companies most complex challenges. If you thrive in a fast-moving, tech-driven environment, love solving real-world problems, and want to be part of a team that&rsquos shaping the future, this is your moment. Genpact (NYSE: G) is an advanced technology ...