749 Data Pipelines Jobs - Page 11

Microsoft's Cloud business is expanding, and the Cloud Supply Chain (CSCP) organization is responsible for enabling the infrastructure underlying this growth including AI! CSCP's vision is to empower customers to achieve more by delivering Cloud Capacity Differentiated at Scale. Our mission is to deliver capacity for all cloud services predictably through intelligent systems driven by continuous learning and a world class organization. The CSCP Organization is responsible for traditional supply chain functions such as Plan, Source, Make, Deliver, but also manages supportability (spares), decommissioning and disposition of Data centre assets worldwide. We deliver the core infrastructure and f...

Are you looking for an opportunity to join a team of engineers in positively affecting the experience of every consumer who uses Microsoft products The OSSE team in OPG group is focused on building client experiences and services that light up Microsoft Account experiences across all devices and platforms. We are passionate about working together to build delightful and inclusive account experiences that empower customers to get the most out of what Microsoft has to offer. We're looking for a collaborative, inclusive and customer obsessed engineer to help us build and sustain authentication experiences like Passkeys as well as engage with our customers by building experiences to help users k...

Overview: We are seeking a highly motivated and detail-oriented individual to join our team as a Azure Data Engineer. This role requires a dynamic professional who can adapt to evolving business needs and drive value through their expertise. Key Responsibilities: Provide support and expertise in the domain of Azure Data Engineer. Collaborate with cross-functional teams to achieve business goals. Ensure timely delivery of services and maintain high-quality standards. Required Qualifications: Proven experience in a relevant field or position. Strong understanding of the responsibilities and tools associated with the role. Excellent problem-solving and communication skills. Preferred Qualificat...

Tech Stalwart Solution Private Limited is looking for Sr GCP Data Engineering to join our dynamic team and embark on a rewarding career journey Build, manage, and optimize data pipelines on Google Cloud Platform Develop ETL workflows, integrate cloud-based tools, and ensure data quality and scalability Collaborate with analytics and engineering teams to deliver data-driven insights while maintaining compliance and data security standards

You have a unique opportunity to join a pioneering IT services company that specializes in delivering end-to-end Digital, Data, AI, and GenAI solutions to drive innovation and business transformation. With over 14 years of experience, you will play a crucial role in shaping the future of the enterprise software, simulation technologies, and SaaS industry. As a key member of our team, you will leverage your 12+ years of experience in software development, simulation services, and SaaS product management to lead and manage enterprise projects effectively. Your deep understanding of Unreal Engine, NVIDIA Omniverse, Unity, and real-time 3D rendering technologies will be instrumental in pushing t...

This role is for a GCP Data Engineer who can build cloud analytics platforms to meet expanding business requirements with speed and quality using lean Agile practices. You will work on analysing and manipulating large datasets supporting the enterprise by activating data assets to support Enabling Platforms and Analytics in the GCP. You will be responsible for designing the transformation and modernization on GCP. Experience with large scale solutions and operationalizing of data warehouses, data lakes and analytics platforms on Google Cloud Platform or other cloud environment is a must. We are looking for candidates who have a broad set of technology skills across these areas and who can de...

As an ETL Automation Test Engineer with expertise in Python development, ETL testing, and CI/CD implementation, you will play a crucial role in automating manual ETL processes using Python scripting. Your primary focus will be on designing, developing, and executing ETL test cases and scripts to ensure the validation of data pipelines. You will be responsible for performing data validation, reconciliation, and integrity checks across various source and target systems. Your role will involve implementing Python-based test automation frameworks for ETL workflows and integrating automated ETL tests into CI/CD pipelines to facilitate seamless deployments. You will collaborate closely with Data E...

As a Data Engineer/Analyst, you will be responsible for designing, developing, and maintaining ETL pipelines and data processing workflows. Your role will involve migrating and optimizing legacy data warehouses to the Enterprise Data Platform (EDP). You will work with SQL (Advanced), Databricks, Python, and PowerBI to develop data models, reports, and dashboards. Additionally, performing data analysis to derive actionable insights and support business decision-making will be a key aspect of your responsibilities. You will be required to implement cloud-based data solutions using Azure and AWS. Developing data models and warehouse structures to support scalable analytics will also be part of ...

As a Data Engineer with 3-5 years of experience, you will be responsible for creating data ingestion flows for consumption in Gen AI solutions. Your role will involve designing, developing, and optimizing ETL processes and data pipelines using Azure Data Factory and Azure Databricks. Additionally, you will implement AI-driven data solutions leveraging Azure OpenAI, Prompt Engineering, and Retrieval-Augmented Generation (RAG). You will be expected to develop and maintain Azure Functions for seamless integration and automation, as well as utilize Python and C# for data transformation, integration, and AI model deployment. Managing CI/CD pipelines using Azure DevOps for efficient deployment and...

Role: Lead Data Engineer Location: Hyderabad/Chennai, Remote Experience:8+Years Overview We are looking for a highly skilled Lead Data Engineer with deep hands-on expertise in Azure and Databricks . This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in Azure and Databricks, and capable of delivering high-quality solutions with speed and precision. The ideal candidate is a hands-on problem solver who ensures efficiency in his own work while also helping the wider team become more productive and technically stronger. Key Responsibilities Design, develop, and optimize data pipelines using Azure and Databricks . Hands-on work wit...

As a Senior Technology Manager at our company based in Hyderabad, you will be responsible for overseeing simulation-based projects utilizing cutting-edge technologies such as Unreal Engine, NVIDIA Omniverse, and other 3D simulation tools. Your role will involve leading SaaS product development, deployment, and continuous improvement while effectively managing multiple cross-functional teams and bridging the gap between R&D, engineering, and business requirements. Your key responsibilities will include managing the development and deployment of simulation solutions for enterprise applications, leading teams in building high-fidelity real-time simulations using various 3D platforms, ensuring s...

As a Data Engineer with 7-10 years of experience, you will be responsible for architecting, creating, and maintaining data pipelines and ETL processes in AWS. Your role will involve supporting and optimizing the current desktop data tool set and Excel analysis pipeline to a transformative Cloud-based highly scalable architecture. You will work in an agile environment within a collaborative agile cross-functional product team using Scrum and Kanban methodologies. Collaboration is key in this role, as you will work closely with data science teams and business analysts to refine data requirements for various initiatives and data consumption needs. Additionally, you will be required to educate a...

You will be responsible for designing and implementing Enterprise Data Management systems, with at least 5 years of experience in this field. Your role will involve building integrated systems throughout the entire life-cycle, including analysis, design, testing, implementation, and support. Preferred qualifications for this position include having 12 years of experience in architecting full-scale enterprise solutions with globally distributed teams. Experience with Graph Mining models and Machine Learning applications is highly desired. You should also have expertise in evaluating, standardizing, and promoting data governance tools related to Data Catalog, Reference and Master Data Manageme...

Genpact is a global professional services and solutions firm dedicated to shaping the future through the delivery of outcomes. With over 125,000 employees in more than 30 countries, we are motivated by curiosity, agility, and a commitment to creating lasting value for our clients. Our purpose is driven by the relentless pursuit of a world that works better for people, enabling us to serve and transform leading enterprises, including the Fortune Global 500. We leverage our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. We are currently seeking applications for the position of Manager - Data Science. This role is crucial in support...

You will be responsible for developing and maintaining BI reports and dashboards, writing SQL queries for data extraction, manipulation, and analysis, troubleshooting BI tools, and resolving data-related issues. Additionally, you will support data cleansing and validation efforts. As a Full-Time employee, you are required to hold a Bachelor of Engineering in IT, while a Master's in Computer Science or a related field would be considered an added advantage. To excel in this role, you should possess advanced proficiency in SQL, data warehousing, and ETL processes. Extensive experience with BI tools like Power BI, Tableau, QlikView, or similar is essential. You must have a strong understanding ...

Location: Mumbai (Andheri East) Designation: Data Engineering/Analytics Job Summary: We are looking for a Data Engineer with up to 5 years of experience in ETL processes to lead the migration of MongoDB data to MSSQL. The ideal candidate will design, develop, and optimize data pipelines, ensuring seamless data transformation, integrity, and performance. Key Responsibilities: Design and implement ETL workflows for migrating data from MongoDB to MSSQL. Develop data transformation and cleansing processes to ensure data integrity. Optimize data pipelines for performance, scalability, and reliability. Collaborate with database administrators and business teams to define migration strategies. Work...

Role & responsibilities We are seeking a skilled Data Engineer to join our dynamic team. The Data Engineer will be responsible for designing, developing, and maintaining our data pipelines, integrations, and data warehouse infrastructure. The successful candidate will work closely with data scientists, analysts, and business stakeholders to ensure that our data is accurate, secure, and accessible for all users. Responsibilities Design and build scalable data pipeline architecture that can handle large volumes of data Develop ELT/ETL pipelines to extract, load and transform data from various sources into our data warehouse Optimize and maintain the data infrastructure to ensure high availabil...

About FYNXT FYNXT is transforming the global broking industry with innovative SaaS solutions. We empower brokers worldwide with multi-asset trading platforms, seamless payments, and scalable engagement tools. Our culture blends startup agility with structured execution to shape the future of fintech. The Role Were hiring an Engineering Manager – Data & Platform to lead a high-performing team building our real-time streaming platform and trading infrastructure. You’ll drive architecture decisions, mentor engineers, and build mission-critical systems like PAMM/MAMM, Copy Trading, and Introducing Broker platforms. Key Responsibilities Lead & scale a specialized data/platform engineering team Ar...

Looking for a Database Administrator cum Designer (2–3 yrs) in Ghaziabad. Responsible for designing, implementing, and maintaining SQL/NoSQL databases, optimizing performance, ensuring security, backups, and collaborating with development teams. Required Candidate profile Database design, SQL/NoSQL, performance tuning, query optimization, backup & recovery, high availability, disaster recovery, cloud DBs (Azure), security, ETL, data pipelines, monitoring, automation

The Precision Medicine technology team at Amgen is dedicated to developing Data Searching, Cohort Building, and Knowledge Management tools to provide visibility to Amgen's extensive human datasets, projects, study histories, and scientific findings. The team focuses on managing multiomics data, clinical study subject measurements, images, and specimen inventory data. The PMED capabilities play a crucial role in Amgen's mission to accelerate discovery and speed to market of advanced precision medications. As a Solution and Data Architect, you will be responsible for designing an enterprise analytics and data mastering solution using Databricks and Power BI. This role demands expertise in data...

Building off Oracle's Cloud momentum, a new organization - Oracle Health & AI has been created. The team is dedicated to product development and strategy for Oracle Health, focusing on modernized, automated healthcare. This innovative venture embodies an entrepreneurial spirit, fostering an energetic and creative environment. Your contribution is vital in establishing this organization as a world-class engineering center with a strong emphasis on excellence. Within the overarching Oracle Health & AI organization, the Oracle Digital Assistant (ODA) serves as an Assistant platform enabling developers to craft skills and digital assistants using Conversational AI and Generative AI capabilities ...

You will be responsible for building, optimizing, and maintaining scalable data pipelines and integrations between Python applications and Snowflake's cloud data platform. Your main tasks will include developing and maintaining data pipelines using Python for ETL/ELT processes, writing efficient SQL queries and scripts to process and analyze data in Snowflake, designing, creating, and maintaining Snowflake schemas, tables, views, and stored procedures, implementing and scheduling data jobs using Snowflake Tasks, Streams, and Snowpipe, optimizing Python code and SQL logic for performance and cost-efficiency, as well as participating in code reviews, testing, and documentation of data workflow...

Flexing It is a freelance consulting marketplace that connects freelancers and independent consultants with organizations seeking independent talent. Our client, a global leader in energy management and automation, is currently seeking a Data Engineer to prepare data and make it available in an efficient and optimized format for various data consumers, including BI, analytics, and data science applications. As a Data Engineer, you will work with current technologies such as Apache Spark, Lambda & Step Functions, Glue Data Catalog, and RedShift on the AWS environment. Key Responsibilities: - Design and develop new data ingestion patterns into IntelDS Raw and/or Unified data layers based on th...

As a Staff Engineer at our company, you will play a crucial role in leading the technical direction and hands-on development of our next-generation, agentic AI-first marketing platforms. Your responsibilities will include architecting, building, and shipping products that revolutionize how marketers interact with data, plan campaigns, and make decisions. Your day-to-day tasks will involve building Gen-AI native products, utilizing LLMs, agents, and predictive AI to power platforms. You will also stay hands-on by designing systems, writing code, debugging, and ensuring product excellence. In addition, you will lead a talented team of full stack engineers and mentor them to success. Speed to m...

The world's top banks use Zafin's integrated platform to drive transformative customer value. Powered by an innovative AI-powered architecture, Zafin's platform seamlessly unifies data from across the enterprise to accelerate product and pricing innovation, automate deal management and billing, and create personalized customer offerings that drive expansion and loyalty. Zafin empowers banks to drive sustainable growth, strengthen their market position, and define the future of banking centered around customer value. We are seeking a talented Senior Go Engineer to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining scalable applications usin...