6525 Data Engineering Jobs - Page 50

Key Responsibilities: Design, develop, and manage data pipelines using Azure Data Factory (ADF) and Databricks. Implement and optimize data transformation using PySpark within Azure Databricks. Build and manage data integration and orchestration workflows across diverse sources. Work with Azure Synapse Analytics for data warehousing and analytics solutions. Write and optimize complex SQL queries for data extraction, transformation, and loading (ETL). Collaborate with DevOps teams to automate deployment using CI/CD pipelines. (Good to Have) Integrate real-time streaming data using Event Hub or similar technologies. Follow best practices for data governance, security, and compliance. Collabora...

Overview Technical Implementation team is part of MasterCard Data & Services group and one of the most rapidly growing organization in the space. D&S Technology Teams provides analytic software tools that enable large, consumer-focused businesses to seize the Big Data analytics opportunity by triangulating between business strategy, algorithmic math, and large databases to improve decisions. The Delivery Engineering Platform team is a core component to consulting services, managing the data acquisition, integration and transformation of client provided data within the Test & Learn platform for global engagements. Role The Data Engineer will participate on data management aspects of client en...

Role Description We are seeking a seasoned Data Science Engineer to spearhead the development of intelligent, autonomous AI systems. The ideal candidate will have a robust background in agentic AI, LLMs, SLMs, vector DB, and knowledge graphs. This role involves designing and deploying AI solutions that leverage Retrieval-Augmented Generation (RAG), multi-agent frameworks, and hybrid search techniques to enhance enterprise applications. Your key responsibilities Design & Develop Agentic AI Applications:Utilise frameworks like LangChain, CrewAI, and AutoGen to build autonomous agents capable of complex task execution. Implement RAG Pipelines: Integrate LLMs with vector databases (e.g., Milvus,...

Job Summary Build AI data products like chatbots and process automation using LLMs. Work across business domains with cross-functional teams. Focus on product development, not limited to any single area. Here is how, through this exciting role, YOU will contribute to BMC's and your own success: Develop and deploy AI chatbots, virtual assistants, and automation workflows. Implement solutions using LLMs, Lang Chain, and agentic AI frameworks. Design and optimize prompts for generative AI applications. Collaborate with product managers, analysts, and engineers. Build reusable components and APIs for AI integration. Stay updated on AI advancements and best practices. Contribute to scalable archi...

• Proficiency in Python, PySpark and SQL for data processing and manipulation. • Min 5 years of experience in data engineering, specifically working with Apache Airflow and AWS technologies. • Understanding of Snowflake Data Lake is preferred.

Title and Summary Senior Software EngineerOverview: Mastercard is a technology company in the Global Payments Industry. We operate the worlds fastest payments processing network, connecting consumers, financial institutions, merchants, governments and businesses in more than 210 countries and territories. Mastercard products and solutions make everyday commerce activities such as shopping, travelling, running a business and managing finances easier, more secure and more efficient for everyone. MasterCard is seeking for a Senior Software Engineering to join our Data and Analytics team in building new data driven products for our consumers. The candidate will work with cross-functional teams a...

Role Purpose The purpose of this role is to interpret data and turn into information (reports, dashboards, interactive visualizations etc) which can offer ways to improve a business, thus affecting business decisions. Do 1. Managing the technical scope of the project in line with the requirements at all stages a. Gather information from various sources (data warehouses, database, data integration and modelling) and interpret patterns and trends b. Develop record management process and policies c. Build and maintain relationships at all levels within the client base and understand their requirements. d. Providing sales data, proposals, data insights and account reviews to the client base e. I...

Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client queries Resolve cl...

As a Data Engineer & Analyst, you will be responsible for designing, developing, and optimizing data pipelines for ETL processes. Your role involves managing and analyzing large datasets from various sources to maintain data quality and integrity. Additionally, you will develop and maintain data models for reporting and analytics purposes, as well as create and manage dashboards and reports using BI tools such as Power BI, Tableau, and Looker Studio. In the realm of Database Management, you will be tasked with developing and optimizing SQL queries to extract insights and prepare data for analytics. Your responsibilities will also include managing databases to ensure high availability, perfor...

You will be responsible for providing strategic leadership by developing and implementing a vision for the data engineering practice in alignment with the company's goals and objectives. You will drive the adoption of best practices and ensure alignment with industry trends and emerging technologies. Collaboration with senior leadership and other departments to integrate data engineering solutions into broader business strategies will be essential. As a leader, you will be managing a high-performing team of data engineers, fostering a culture of innovation, collaboration, and continuous improvement. Your role will involve overseeing recruitment, development, and performance management of dat...

Latentbridge is looking for an experienced AI/ML Engineer to join their team in Pune. If you are passionate about leveraging cutting-edge technologies like Python, AI/ML, and NLP to solve complex problems, this role might be a great fit for you. As an AI/ML Engineer at Latentbridge, you will be responsible for developing and maintaining Python applications, with a focus on compatibility with Python 3.10 and above. You will also utilize AI/ML techniques to build and deploy models, particularly focusing on Open-Source models available on platforms like Hugging Face. Experience with Large Language Models (LLMs) and model training is preferred for this role. Additionally, you will implement clou...

You are looking for a skilled and experienced Microsoft Fabric Engineer to join the data engineering team. Your main responsibilities will include designing, developing, and maintaining data solutions using Microsoft Fabric. This will involve working across key workloads such as Data Engineering, Data Factory, Data Science, Real-Time Analytics, and Power BI. In this role, you will need to have a deep understanding of Synapse Data Warehouse, OneLake, Notebooks, Lakehouse architecture, and Power BI integration within the Microsoft ecosystem. Some of your key responsibilities will include designing and implementing scalable and secure data solutions, building and maintaining Data Pipelines usin...

As a highly skilled Solution Architect at Quest Global, your primary responsibility will be to drive innovation and deliver impactful, scalable solutions tailored to our customers" needs. In this pivotal role, you will be developing proof of concepts, designing and leading solution implementations that enhance our offerings. Upon successful completion of the POCs, you will also be mentoring and guiding engineers in developing production-ready solutions. Your role will involve building architectures, whether new or rearchitecting existing products, and creating POCs to validate new Enterprise architectures, with a focus on Cloud technologies such as AI, Gen AI, and Data pipe enhancements. You...

You are an accomplished and dynamic Data Engineering Lead with 7 to 10 years of experience in data engineering, specializing in data pipeline development, architecture, and system optimization. Your proven track record includes leading data engineering teams and successfully managing end-to-end project delivery. Your technical expertise includes proficiency in programming languages such as Python or Scala, designing and delivering data pipelines in Cloud Data Warehouses (e.g., Snowflake, Redshift) using ETL/ELT tools like Matillion, dbt, Striim, etc. You have a solid understanding of database systems (relational and NoSQL), data modeling techniques, and hands-on experience in designing and d...

You should be strong in Data Engineering and Analysis, particularly with SQL Server (Complex SQL). This hands-on role will require you to handle design, coding, and testing tasks. Collaboration with product owners and scrum masters for scrum planning, estimation, and demos will be essential. Additionally, you may need to lead and guide junior developers when necessary. You should possess 5 to 9 years of relevant experience. Mandatory technical skills include proficiency in Python, NumPy, Pandas, and SQL Server. You must be adept at writing Python code and have a good understanding of Data Structures in Python. Practical experience with the pandas and NumPy stack is crucial. You should be cap...

As a Data Engineer, you will be responsible for designing and implementing next-generation data pipelines, analytics, and Business Intelligence solutions. You will manage various AWS resources such as RDS, EMR, MWAA, and Lambda. Your primary focus will be on developing high-quality data architecture and pipelines to support business analysts and data scientists. Collaborating with other technology teams, you will extract, transform, and load data from diverse sources. Additionally, you will work towards enhancing reporting and analysis processes by automating self-service support for customers. You should have a solid background with 7-10 years of data engineering experience, including exper...

The duration of the internship will be for 6 months. This is a paid internship, and based on your performance during the internship, you will be considered for a full-time position. Recent graduates or those in the final semester of studies towards a Degree in Computer Science/Information Technology are eligible to apply (2025 Passouts). You will stand out by demonstrating strong academic excellence in your undergraduate or graduate studies. A solid understanding of computer science fundamentals and software engineering is essential. Your problem-solving skills should be top-notch, with expertise in algorithms, data structures, and programming. It is crucial to have a strong understanding of...

We have a job opening for GenAI Team Lead at PibyThree Consulting Services Pvt Ltd in Mumbai. The company is a Global Cloud Consulting & Services provider specializing in Cloud Transformation, Cloud FinOps, IT Automation, Application Modernization, and Data & Analytics. PibyThree aims to make businesses successful by leveraging technology for automation and enhanced productivity. As a Gen AI lead at PibyThree, you will be responsible for building both Traditional AI/ML systems and Generative AI-based systems. The ideal candidate should have a total experience of 5 to 7 years with hands-on experience in building language models, machine learning, and AI models using industry tools, products, ...

You will be responsible for leading GenAI projects, overseeing the development and deployment of generative AI solutions from concept to deployment. Additionally, you will need a deep understanding of advanced model architectures like transformers and attention mechanisms. Your role will involve leading the integration of large language models (LLMs) such as Azure OpenAI and OpenAI in cloud environments, particularly Azure services, and vector databases. Furthermore, you will be in charge of ensuring the scalability of AI models to accommodate large user bases across various cloud platforms. Data engineering will be a key aspect of your responsibilities, involving the extraction and preproce...

We are seeking a talented individual to join our IT team at Marsh McLennan. This role will be based in Pune/Noida/GGN/Mumbai. This is a hybrid role that has a requirement of working at least three days a week in the office. As a Data Engineer, you will be responsible for designing and implementing scalable data pipelines using Databricks and the Medallion Architecture. You will handle end-to-end ETL/ELT processes, manage large datasets, and work with tools like Python, PySpark, and AWS S3 to ensure data is transformed and optimized for analytical use. Additionally, knowledge on Informatica, Unix, and Oracle database is also a good to have. We will count on you to: Develop and maintain data p...

As a Technical Architect - Analytics at Simpplr, you will be responsible for designing, developing, and optimizing the data and analytics architecture. You will play a crucial role in defining the data strategy, designing scalable data pipelines, and implementing best practices for real-time and batch analytics solutions. Passionate about data engineering and analytics, you will drive data-driven decision-making across the organization. Your key responsibilities will include defining and owning the architecture for data processing, analytics, and reporting systems to ensure scalability, reliability, and performance. You will design and implement highly efficient, scalable, and reliable data ...

As an Agile Delivery Lead (ADL) in the Data Engineering & Analytics team at Jet2, you will play a crucial role in driving the successful delivery of data initiatives to our internal business stakeholders. Working at our Pune Technology and Innovation Centre, you will lead multiple scrum teams, acting as an enabler for the effective functioning of the Data Engineering team using Agile Methodology. Your responsibilities will include managing dependencies, removing barriers to implementation, and ensuring a focus on roadmap objectives. Collaborating closely with technology and business stakeholders from India and the UK, you will help maximize business value, maintain a healthy feature pipeline...

As a Manager, Reliability Quality Engineer at our global healthcare biopharma company based in Hyderabad, you will play a crucial role in ensuring the highest quality and reliability of our CRM solutions. You will be part of a team that is dedicated to driving innovation and execution excellence through the use of data, analytics, and insights to tackle some of the world's greatest health threats. In this role, you will collaborate closely with cross-functional teams to design and determine both functional and non-functional requirements for our CRM applications. Your responsibilities will include conducting thorough testing and validation of CRM applications, developing comprehensive test p...

The Vice President position in our Enterprise Technology division at Macquarie is a pivotal leadership role where you will drive strategic direction and operational excellence. You will be responsible for leading a talented team of engineers, fostering a culture of innovation and collaboration. With our advantage of bringing together diverse individuals, you will have the opportunity to shape various possibilities within our global financial services group. Your main responsibilities will include mentoring the engineering team, developing and executing strategic roadmaps for enterprise data platforms, ensuring alignment with business objectives, and collaborating with cross-functional teams ...

As a member of KKR's Data Engineering team, your role will involve executing against a robust data engineering book of work while establishing scalable and repeatable processes, best practices, and frameworks. You will be an integral part of KKR's enterprise data group, working towards collecting, managing, and harnessing the power of data across the diverse portfolio investments. Your primary objectives will revolve around data model design and the technical implementation and curation of consumable data sets, also known as Data Products. This function is crucial in ensuring the success of our new Data Engineering Vertical and contributing to our firm's data-driven approach. The ideal candi...