10148 Data Engineering Jobs - Page 24

Group Details Tradeweb is seeking a Data Analytics and AI Development and Operations Senior Engineer to join its Internal Audit Department, supporting the Data Analytics and AI Development and Operations Lead in building and maintaining scalable audit technology solutions. This role plays a critical part in operationalizing AI/ML models and data workflows that enhance the efficiency and effectiveness of business and technology audits. We are seeking an hybrid Full-Stack Data Systems Engineer to support the deployment and operationalization of AI/ML models and data pipelines to enable the audit software platform. This hands-on role combines practical engineering with implementation rigor, foc...

Exp : Exp 10 years + into Managed service and support mode. Roles and Responsibilities: Managed server for Data lead positions. Data Engineering, Data Analytics Cloud Analytics, Data Warehousing, Data Modelling, ETL and Database Development Proficient in communication, presentation, and interpersonal skills to interact with clients, clearly interpret business need Must have handled support/managed service team earlier. Willing to work in IST shift [ 16/5 ] coverage, India day time. Well versed with Client and stakeholder management. Hands on production and well versed on Azure platform. Hands on and good exp on Databricks and ADF pipeline. Synapse Analytics, Azure Databricks Hands on SQL Tec...

Roles and Responsibilities A Databricks Platform Administrator is a crucial role responsible for the effective design, implementation, maintenance, and optimization of the Databricks Lakehouse Platform within an organization. This individual ensures the platform is scalable, performant, secure, and aligned with business objectives, providing essential support to data engineers, data scientists, and analysts. Key Responsibilities: 1. Provision and configure Databricks workspaces, clusters, pools, and jobs across environments. 2. Create catalogs, schemas, access controls, and lineage configurations. 3. Implement identity and access management using account groups, workspace-level permissions, ...

Role Description :As a Senior Data Science and Modeling Specialist at Incedo, you will be responsible for developing and deploying predictive models and machine learning algorithms to support business decision-making. You will work with data scientists, data engineers, and business analysts to understand business requirements and develop data-driven solutions. You will be skilled in programming languages such as Python or R and have experience in data science tools such as TensorFlow or Keras. You will be responsible for ensuring that models are accurate, efficient, and scalable. Roles & Responsibilities: Developing and implementing machine learning models and algorithms to solve complex bus...

What can you expect in a VP, Data Engineering & Architecture role with TaskUs: We are seeking a hands-on Vice President of Data Engineering and Architecture to lead the strategy, design, and implementation of our enterprise data ecosystem. This person will define how data is structured, stored, and leveraged to drive analytics, automation, and AI initiatives across the organization. The ideal candidate will have deep expertise in architecting large-scale data warehouses and data lakes , with a strong command of OLAP and OLTP concepts. Key Responsibilities Data Architecture Leadership:Design and implement scalable, high-performance data architectures including data warehouses (AWS Redshift, S...

We are seeking a Senior Software Engineer (ETL) with 10-12 years of experience to join our ETL Development team. This role will report to the Engineering Manager and the candidate will be involved in the planning, design, and implementation of our centralized data warehouse solution for data acquisition, Ingestion and large data processing and automation/optimization across all the company products. About the Role: Candidate will play a crucial role in designing, developing, and leading the implementation of ETL processes and data pipeline solutions. Will collaborate with various stakeholders to ensure the seamless integration, transformation, and loading of data to support our data warehous...

What you can look forward to as Product Data Analyst- Data Engineering: End-to-End Project Ownership : Drive and manage analytics initiatives from concept to deployment, ensuring high-quality, timely deliverables with minimal supervision. Engineering Best Practices : Apply structured software development principles, including version control (e.g., Git), CI/CD, automated testing, and peer code reviews to ensure robust, scalable, and maintainable solutions. Data Architecture & Pipelines : Design, build, and optimize scalable and reliable data models and pipelines in Databricks, Azure Cloud, and other big data environments to support advanced analytics and AI use cases. Data Modeling & Perform...

We are seeking a talented and experienced Databricks Engineer to join our innovative team in Bengaluru, India. In this role, you will be responsible for designing, implementing, and optimising data pipelines and analytics solutions using the Databricks platform. You will collaborate closely with cross-functional teams to deliver high-quality, scalable data solutions that drive business insights and decision-making. Develop and optimise ETL processes using Databricks and Apache Spark Design and implement efficient data models and schemas for optimal data storage and retrieval Collaborate with data scientists and analysts to build and deploy machine learning models Ensure data quality, consist...

Design, Develop, and Maintain ETL Processes: o Build and maintain scalable ETL pipelines inPython to extract, transform, and load data into Snowflake master tables.Automate data mastering, manage incremental updates, and ensure consistencybetween landing and master tables. Data Modeling: o Create and optimize logical and physical datamodels in Snowflake for efficient querying and reporting. Translate businessneeds into well-structured data models, defining tables, keys, relationships,and constraints. Analytical Thinking and Problem Solving: o Analyze complex datasets, identify trends, andwork with analysts and stakeholders to resolve data challenges. Investigatedata quality issues and design...

We are seeking an experienced Senior Program Manager who will develop and implement data engineering project including enterprise data hub or Big data platform. Develop and implement data engineering project including data lake house or Big data platform 15+ years of exp, should have handled Data Projects specially on Azure, AI Knowledge, Scrum Master background and data projects understanding, excellent communication, should have handled multiple Pods client facing and problem solver and agile and energetic and preferably PG and B Tech in Comp science Qualifications Bachelor s degree in computer science, MCA or equivalent experience. Proven experience: Overall 10+ years of relevant Industry...

Build, maintain, and troubleshoot HR databases and data systems. Manage, pre-process, and analyze large datasets to support HR initiatives. Design and implement ETL (Extract, Transform, Load) or ELT (Extract, Load, Transform) processes to move HR data efficiently. Utilize SQL, Python, or other programming languages to analyze HR data, identify trends, and generate insights. Integrate various systems and databases to streamline data flow and accessibility. Work with the team and take the lead in updating existing datasets and implementing organizational changes to reflect in our datasets and, eventually, in our People Insight inventory of metrics and visuals. Collaborate with HR and other dep...

1. Cloud Platform Management : Manage and optimize cloud infrastructure (GCP), ensuring scalability, security, and performance. 2. Data Engineering : Design and implement data pipelines, data warehousing, and data processing solutions. 3. Kubernetes and GKE : Develop and deploy applications using Kubernetes and Google Kubernetes Engine (GKE). 4. Python Development : Develop and maintain scripts and applications using Python. What You Need to Be Successful 1. Experience: 6-9 years of experience in cloud computing, data engineering, and DevOps. 2. Technical Skills: 1. Strong understanding of GCP (Google Cloud Platform) or Azure. 2. Experience with Kubernetes and GKE. 3. Proficiency in Python p...

Lead the development of reusable software components, libraries, and frameworks for data ingestion, transformation, and orchestration. Design and implement intuitive user interfaces (dashboards, developer portals, workflow managers) using React.js and modern frontend technologies. Develop backend APIs and services to support data engineering tools and platforms. Define and enforce software engineering standards and practices across the Data COE for developing and maintaining data product. Collaborate closely with data engineers, platform engineers, and other COE leads to gather requirements and build fit-for-purpose engineering tools. Integrate observability and monitoring features into data...

Contribute to the design and implementation of state-of-the-art AI solutions. Assist in the development and implementation of AI models and systems, leveraging techniques such as Language Models (LLMs) and generative AI. Collaborate with stakeholders to identify business opportunities and define AI project goals. Stay updated with the latest advancements in generative AI techniques, such as LLMs, and evaluate their potential applications in solving enterprise challenges. Utilize generative AI techniques, such as LLMs, to develop innovative solutions for enterprise industry use cases. Integrate with relevant APIs and libraries, such as Azure Open AI GPT models and Hugging Face Transformers, t...

Key Responsibilities Good understanding of Oracle Databases SQL and PlSQL code and PYTHON AIML Development Design develop and implement scalable machine learning models and AI systems Algorithm Design Research and apply stateoftheart algorithms to solve realworld problems Data Analysis Work with large datasets to extract insights clean data and build training pipelines Model Deployment Develop and optimize productionready AI models ensuring performance scalability and reliability Collaboration Partner with product managers data engineers and other stakeholders to understand business needs and deliver tailored AI solutions Mentorship Guide and mentor junior developers sharing knowledge and be...

Design and implement data pipelines for data ingestion, transformation, and loading using Microsoft Fabric tools. Develop and maintain data warehouses and data lakes within the Fabric environment. Create and manage data models for efficient data storage and retrieval. Build and deploy data science models using Fabrics machine learning capabilities. Develop real-time analytics solutions for streaming data processing. Create and maintain Power BI reports and dashboards for data visualization and analysis. Collaborate with cross-functional teams to understand data requirements and provide data solutions. Monitor and optimize the performance of data solutions. Ensure data security and compliance...

The Microsoft Fabric role involves designing, implementing, and managing data solutions using Microsoft Fabric This includes data integration, data warehousing, data science, real-time analytics, and business intelligence The role requires a strong understanding of data engineering principles, cloud computing, and the Microsoft Fabric platform Responsibilities:Design and implement data pipelines for data ingestion, transformation, and loading using Microsoft Fabric tools Develop and maintain data warehouses and data lakes within the Fabric environment Create and manage data models for efficient data storage and retrieval Build and deploy data science models using Fabrics machine learning cap...

Design, develop, and maintain scalable data pipelines and ETL/ELT processes to process structured and unstructured data. Implement robust data models, data lakes, and data warehouses that enable analytics and machine learning use cases. Collaborate with software engineers, data scientists, and business stakeholders to deliver high-quality, production-ready data solutions. Ensure data quality, governance, and lineage tracking across all data assets. Drive operational excellence through automation, monitoring, and alerting for data systems. Apply engineering best practices (CI/CD, testing frameworks, code reviews, performance optimization) to ensure reliability and maintainability of data work...

About the Function: Our Global Business Operations (GBO) team are facilitators, providing strategic, financial, and business services that are critical to the day-to-day performance of our business. With a team of over 2,000 dedicated and passionate people supporting 21 markets across the world, we have offices in Bangalore, Budapest, Bogota, and Manila. Our global remit offers huge learning opportunities. We encourage learning and development in skills needed now and in the future across digital, industry, professional, and domain. Wherever you start, youll be rewarded with a world view and the recognition you deserve in our inclusive and supportive culture. About the Role : Responsible for...

ABOUT THE ROLE Role Description: We are seeking an experienced MDM Senior Data Engineer with 6 9 years of experience and expertise in backend engineering to work closely with business on development and operations of our Master Data Management (MDM) platforms, with hands-on experience in Informatica or Reltio and data engineering experience . This role will also involve guiding junior data engineers /analysts , and quality experts to deliver high-performance, scalable, and governed MDM solutions that align with enterprise data strategy. To succeed in this role, the candidate must have strong Data Engineering experience along with MDM knowledge, hence the candidates having only MDM experience...

The Global Quality Analytics and Innovation team leads the digital transformation and innovation effort throughout Amgens Quality organization. We are at the forefront of developing and rolling out data-centric digital tools, employing automation, artificial intelligence (AI), and generative AI to drive end-to-end quality transformation. We are seeking a highly motivated and experienced Data Scientist with a strong background in Generative AI, Large Language Models (LLMs), and MLOps, along with an understanding for Quality in regulated environments (e.g., GxP). This role will play a key part in designing, developing, and deploying scalable AI/ML solutions to drive innovation, efficiency, and...

Your role and responsibilities As a Brand Technical Specialist, you'll work closely with clients to develop relationships, understand their needs, earn their trust and show them how IBM's industry leading solutions will solve their problems whilst delivering value to their business. We're committed to success. In this role, your achievements will drive your career, team, and clients to thrive. A typical day may involve: Strategic Mainframe Solutions: Crafting client strategies for mainframe infrastructure and applications. Comprehensive zStack Solutions: Defining and detailing IBM zStack solutions for client enhancement. Effective Client Education: Delivering simplified proof of concepts and...

Role Design, Build & Optimize Scalable Data Solutions and End-to-End Pipelines Responsibilities Develop, and deploy end-to-end data pipelines and solutions on Databricks, integrating with various data sources and systems. Collaborate with cross-functional teams to understand data, and deliver effective BI solutions. Implement data ingestion, transformation, and processing workflows using Spark (PySpark/Scala), SQL, and Databricks notebooks. Develop and maintain data models, ETL/ELT processes ensuring high performance, reliability, scalability and data quality. Build and maintain APIs and data services to support analytics, reporting, and application integration. Ensure data quality, integrit...

Your role and responsibilities As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You€™ll contribute to data gathering, storage, and both batch and real-time processing. Collaborating closely with diverse teams, you€™ll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you€™ll tackle obstacles related to database integration and untangle complex, unstructured data sets. In this role, your responsibilities may include: * Implementing and validating predictive models as well as creating and maintain statistical models wi...

Your role and responsibilities * Hiring manager As a Big Data Engineer, you will develop, maintain, evaluate, and test big data solutions. You will be involved in data engineering activities like creating pipelines/workflows for Source to Target and implementing solutions that tackle the client€™s needs. * Your primary responsibilities include: * Design, build, optimize and support new and existing data models and ETL processes based on our client€™s business requirements * Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization. * Coordinate data access and security to enable data scientists and analysts to easily acces...