47 Data Orchestration Jobs

Data Engineer Data Quality Build automated data quality checks using Databricks (Delta Lake) and PySpark . Perform profiling, anomaly detection, and reconciliation across systems. Investigate data issues using SQL, Python , drive root cause fixes. Collaborate on governance, metadata, and data catalog integration. Automate validations via Airflow , ADF , or Databricks Workflows . 510 years experience in data engineering or quality; strong SQL, Python, PySpark skills. NOTE: Those who have applied before or interviewed by us in the last 6 months are not eligible to apply. Only BENGALURU based candidates willing to join within 30 days upon offer should apply.

Role Overview: As the Head of Data Engineering at Spiro, you will be responsible for leading, designing, and scaling the next-generation data infrastructure. Your role will involve overseeing the development of robust, scalable data pipelines, architecting big data platforms, and ensuring the integrity and quality of the data that powers AI, analytics, and digital products. You will be a hands-on leader guiding a team of talented engineers and collaborating closely with analytics, software development, and product teams to drive business outcomes through data. This is a critical leadership position that will shape the future of data across various domains such as EV manufacturing, IoT telema...

Role Overview: As a Senior Data Engineer at EY, you will be responsible for ingesting, building, and supporting large-scale data architectures that serve multiple downstream systems and business users. You will collaborate with Data Engineer Leads and Visualization teams to ensure data quality and troubleshoot any issues. Your role will involve cleaning, aggregating, and organizing data from various sources, transferring it to data warehouses, and supporting the development, testing, and maintenance of data pipelines and platforms to enable data quality for business dashboards and tools. Key Responsibilities: - Develop and maintain scalable data pipelines in alignment with ETL principles, ut...

As a Data Engineer at WAC, you will play a pivotal role in ensuring the availability, reliability, and scalability of our data infrastructure. You will collaborate closely with cross-functional teams to support our data-driven initiatives, enabling data scientists, analysts, and business stakeholders to access high-quality data for critical decision-making. - **Data Pipeline Development:** Design, develop, and maintain efficient ETL (Extract, Transform, Load) processes and data pipelines to collect, process, and store data from various sources. - **Data Warehouse Management:** Create and manage data warehouses and data lakes, optimising storage and query performance for both structured and u...

Role Overview: At PwC, as a data and analytics engineering professional, your main focus will be on utilizing advanced technologies and techniques to create robust data solutions for clients. Your role is crucial in converting raw data into actionable insights, which facilitate informed decision-making and drive business growth. In the field of data engineering at PwC, your responsibilities will include designing and constructing data infrastructure and systems to enable efficient data processing and analysis. You will be tasked with developing and implementing data pipelines, data integration, and data transformation solutions. Key Responsibilities: - Design, develop, and maintain robust, s...

As a highly skilled GenAI Lead Engineer, your role will involve designing and implementing advanced frameworks for alternate data analysis in the investment management domain. You will leverage LLM APIs (GPT, LLaMA, etc.), build scalable orchestration pipelines, and architect cloud/private deployments to power next-generation AI-driven investment insights. Additionally, you will lead a cross-functional team of Machine Learning Engineers and UI Developers to deliver robust, production-ready solutions. **Key Responsibilities:** - Develop custom frameworks using GPT APIs or LLaMA for alternate data analysis and insights generation. - Optimize LLM usage for investment-specific workflows, includi...

Location : Chennai Hybrid (3 Days a Week in Office) Employment Type : Contract (1 Year, Extendable) Notice Period : Immediate Joiners Only Role Overview: We are hiring a Senior Python Developer / Lead with strong experience in Python, SQL, AWS, and Airflow. The candidate will design, develop, and lead backend and data solutions in a cloud-based environment. Key Responsibilities: Lead the design and development of Python-based data pipelines and APIs. Work with AWS services (Lambda, S3, Glue, Redshift, EC2) for deployment and integration. Implement Airflow DAGs for data orchestration and automation. Optimize SQL queries and database performance. Collaborate with Data Engineers and DevOps team...

Strong understanding of ADF process Ability to execute projects under tight deadlines with minimal supervision Proactive mindset with the ability to work independently and take ownership Strong understanding of ADF process Ability to execute projects under tight deadlines with minimal supervision Proactive mindset with the ability to work independently and take ownership

As a Product Data Manager, you will be responsible for ensuring the quality, consistency, and accessibility of product data across various platforms. You will assist the Senior Product Data Manager in implementing best practices in data governance and maintaining streamlined workflows. This role requires an individual who is organized, detail-oriented, and capable of collaborating with global teams to ensure product data effectively supports the clients digital marketing initiatives. Your contributions will directly impact the success and efficiency of marketing campaigns within the CPG sector. General Responsibilities / Accountabilities: Product Data Management: Organize, maintain, and upda...

As a Manager, Data Analytics at IFF, you will play a crucial role in leading the transformation of the global data ecosystem. Your strategic thinking and expertise in data architecture will be instrumental in shaping the future of data analytics within the company. Here's what you can expect in this role: Role Overview: - Lead the design and implementation of enterprise-scale data pipelines and analytics platforms. - Oversee data ingestion, transformation, and modelling across structured and graph-based systems. - Champion the use of Microsoft Fabric, Snowflake, and Neo4j to enable scalable, secure, and performant data solutions. - Collaborate with cross-functional stakeholders to translate ...

Quantitative Developer Risk Platform Infrastructure Location:- Mumbai We are looking for Quantitative Developer to architect and oversee the development of highly reliable and scalable risk infrastructure that supports front-office decision-making across asset classesincluding equities, commodities, fixed income, and FX. This role is ideal for candidates who are passionate about building robust systems that deliver accurate pricing, risk, and analytics under production constraints. What You'll Do Own the architecture, design, and delivery of the quant infrastructure powering front-office risk and analytics. Build scalable frameworks for valuation, risk, scenario analysis, and lifecycle model...

About The Role Project Role : Enterprise Technology Architect Project Role Description : Architect complex end-to-end IT solutions across the enterprise. Apply the latest technology and industry expertise to create better products and experiences. Must have skills : Nvidia Omniverse Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :The Data Center Simulation Platform Lead will architect and manage an enterprise-grade multi-domain simulation ecosystem combining Cadence (electrical & thermal), ETAP (power systems), and NVIDIA (AIR, Omniverse, Modulus, Clara) platforms. This role drives convergence of physics-...

About the Role Your days are dynamic and impactful. You will spearhead GTM programs aimed at driving significant pipeline and revenue growth. Collaborating closely with the Front End, Inside Sales, and Demand Gen teams, you'll harness extensive knowledge of regional execution performance to identify trends and craft strategies. Your expertise will support the sales organization in smashing their quarterly and yearly pipeline targets, through meticulous project management and strategy execution. A Day in the Life Your days are dynamic and impactful. You will spearhead GTM programs aimed at driving significant pipeline and revenue growth. Collaborating closely with the Front End, Inside Sales,...

Job Summary: We are looking for a skilled Data Engineer with strong expertise in Python programming and hands-on experience with Azure Data Services , including Synapse , Data Lake , App Logic , and DevOps integration . The ideal candidate will have a strong understanding of data warehousing , MS SQL/PLSQL , and building scalable data pipelines and solutions on the cloud. Key Responsibilities: Develop and optimize scalable data pipelines using Python and Azure Data Services . Design and implement end-to-end data solutions using Azure Synapse Analytics , Data Lake , and Azure Logic Apps . Build and maintain efficient data models, transformations, and workflows supporting business intelligence...

Role Description Job Summary: We are looking for a skilled Data Engineer with strong expertise in Python programming and hands-on experience with Azure Data Services , including Synapse , Data Lake , App Logic , and DevOps integration . The ideal candidate will have a strong understanding of data warehousing , MS SQL/PLSQL , and building scalable data pipelines and solutions on the cloud. Key Responsibilities: Develop and optimize scalable data pipelines using Python and Azure Data Services .Design and implement end-to-end data solutions using Azure Synapse Analytics , Data Lake , and Azure Logic Apps .Build and maintain efficient data models, transformations, and workflows supporting busine...

Role Overview: As a Senior Technical Architect at our company, you will lead the design and evolution of our next-generation technology stack. Your role will involve defining system blueprints, ensuring technical excellence, and guiding development teams in translating vision into execution. You will play a crucial role in bridging business goals with architectural strategy to ensure our products remain agile, secure, and ready for scale. Key Responsibilities: - Define and govern system architecture for large-scale SaaS and AI-based platforms using microservices, APIs, and event-driven paradigms. - Evaluate emerging technologies such as AI/ML, data orchestration, cloud-native design, and LLM...

Role Overview: As a member of the AMA Data Solutions & Engineering Team, you will play a crucial role in managing the company's most valuable asset in the Digital World - Data. Your primary responsibility will be to deliver Data as a competitive advantage for AMA Business by building unified data platforms, customizing BI tools for managers, and enabling insightful business decisions through AI in Data. You will have the opportunity to work with a variety of tools and technologies, including big data platforms, machine learning frameworks, and data visualization tools to create innovative and effective solutions. If you are passionate about data possibilities and eager to make a real impact ...

TransUnion's Job Applicant Privacy Notice What We'll Bring At TransUnion, we have a welcoming and energetic environment that encourages collaboration and innovation - we're consistently exploring new technologies and tools to be agile. This environment gives our people the opportunity to hone current skills and build new capabilities, while discovering their genius. Come be a part of our team you'll work with great people, pioneering products and cutting-edge technology As a Technical Platform Product Manager Batch Fulfillment within Global Technology, Data & Analytics, you will define and drive the strategy for scalable, resilient, and efficient batch data processing capabilities. You'll be...

As a Data Architect Vice President based in Chennai, your role will involve designing, developing, and implementing solutions to solve complex business problems. You will collaborate with stakeholders to understand their needs and requirements, and design and implement solutions that meet those needs while balancing technology risks against business delivery. Your responsibilities will include: - Defining appropriate data architecture for data products - Implementing data product principles and standards - Translating business/use case requirements into logical and physical data models - Collaborating with business teams to capture requirements and optimize data models for performance - Test...

Job Summary Are you a strategic thinker with deep expertise in data architecture and analytics Join us as a Manager, Data Analytics and lead the transformation of our global data ecosystem. IFF is a global leader in flavors, fragrances, food ingredients and health & biosciences, we deliver sustainable innovations that elevate everyday products. Global Business Services: Delivering streamlined, scalable supportenhancing efficiency, compliance and service excellence across the company. This role is based in Hyderabad, India with a hybrid work model. Join a visionary, technically driven team where your leadership will shape the future of data analytics. Your expertise will help build the data f...

As a skilled Node.js Developer with a strong foundation in data engineering, you will be joining the engineering team at Affle 3i Limited in Gurgaon. Your primary responsibilities will include building scalable backend systems using modern Node.js frameworks and tools, designing and maintaining robust data pipelines and integrations, and collaborating with various teams to ship end-to-end features. Key Responsibilities: - Build and maintain performant APIs and backend services using Python and FastAPI. - Develop and manage ETL/ELT pipelines, data models, schemas, and data transformation logic for analytics and operational use. - Ensure data quality, integrity, and consistency through validat...

As a Snowflake Administrator, your role will involve managing Snowflake instances efficiently, configuring and monitoring Snowflake accounts, warehouses, databases, schemas, and roles. You will also be responsible for administering user access controls and roles to ensure appropriate access levels. Key Responsibilities: - Manage Snowflake account and ensure efficient configuration, monitoring, and maintenance of Snowflake instances. - Create and manage Snowflake warehouses, databases, schemas, and roles. - Administer user access controls and roles to ensure appropriate access levels. In terms of security and data governance, you will implement and manage data security policies, including enc...

Overview Cvent's Global Demand Center (GDC) is seeking a motivated and passionate Data Management Associate to support our Data Management efforts for B2B Marketing. This role will be pivotal in overseeing the growth and accuracy of our global marketing data, providing critical input for our audience identification and campaign segmentation strategies. Cvent's marketing database is the engine driving our powerful lead generation machine. The Data Management Associate will support the centralized global Data Management function, catering to all global marketing teams. You will ensure that both the prospect and customer data are accurate and available, fostering engagement that drives sales pi...

About the Role: 11 About the Role: We are seeking a Lead Machine Learning and MLOps Engineer focused on Generative AI to join our ML team within the Data Science Center of Excellence at S&P Global. In this role, you will lead engineering activities to build production-grade generative AI solutions and play a pivotal role in implementing machine learning engineering operations to ensure seamless deployment, monitoring, and management of our machine learning models and data pipelines. The Team: You will work closely with a world-class AI and ML team comprised of experts in AI and ML modeling, MLOps engineers, data science, and data engineering. Your contributions will be critical in engineerin...

In this role as a Data Architect, your primary focus will be on architecting and maintaining scalable data infrastructure, mentoring team members, ensuring data platform reliability, and leading data engineering initiatives. **Key Responsibilities:** - Design and manage robust, scalable, and secure data platforms and pipelines. - Architect data lake/data warehouse solutions such as Redshift, BigQuery, Snowflake, and Delta Lake. - Build real-time and batch data pipelines using tools like Apache Airflow, Kafka, Spark, and DBT. - Ensure data governance, lineage, quality, and observability across all pipelines. - Collaborate with stakeholders to define data strategy, architecture, and KPIs. - Le...