2042 Data Flow Jobs - Page 15

Skill required: Tech for Operations - Artificial Intelligence (AI) Designation: AI/ML Computational Science Sr Manager Qualifications: Any Graduation Years of Experience: 16 to 25 years What would you do? You will be part of the Technology for Operations team that acts as a trusted advisor and partner to Accenture Operations. The team provides innovative and secure technologies to help clients build an intelligent operating model, driving exceptional results. We work closely with the sales, offering and delivery teams to identify and build innovative solutions.The Tech For Operations (TFO) team provides innovative and secure technologies to help clients build an intelligent operating model, ...

Project Role : Technology Architect Project Role Description : Design and deliver technology architecture for a platform, product, or engagement. Define solutions to meet performance, capability, and scalability needs. Must have skills : SAP Quality Management (QM) Good to have skills : SAP HANA DB AdministrationMinimum 12 year(s) of experience is required Educational Qualification : Should have completed Graduation from reputed College University Summary :As a Technology Architect, you will design and deliver technology architecture for various platforms, products, or engagements. Your typical day will involve collaborating with cross-functional teams to define solutions that meet performan...

Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc. Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation Ability to analyse data for functional business requirements & front face customer Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 5 to 7 years of relevant experience working as technical analyst with Big Query on GCP platform. Skilled in multiple GCP services - GCS, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer You love colla...

We are looking for a highly skilled and experienced Cloud Data Engineer to join our team at Apple India Pvt Ltd. The ideal candidate will have a strong background in designing, developing, and implementing data engineering solutions on cloud platforms. Roles and Responsibility Design and develop scalable and efficient data pipelines using cloud-based technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data architectures on cloud platforms such as AWS or Azure. Ensure data quality and integrity by implementing data validation and testing procedures. Optimize data processing workflows to improve performance and...

Job Title: Senior Data Engineer (Kafka & AWS) Responsibilities: Develop and maintain real-time data pipelines using Apache Kafka (MSK or Confluent) and AWS services . Configure and manage Kafka connectors , ensuring seamless data flow and integration across systems. Demonstrate strong expertise in the Kafka ecosystem , including producers, consumers, brokers, topics, and schema registry. Design and implement scalable ETL/ELT workflows to efficiently process large volumes of data. Optimize data lake and data warehouse solutions using AWS services such as Lambda, S3, and Glue . Implement robust monitoring, testing, and observability practices to ensure reliability and performance of data platf...

Job Overview: We are seeking a skilled Data Consultant/ Data Architect to design and manage the enterprise data architecture, ensuring the efficient and secure handling of data across the organization. The ideal candidate will possess extensive experience in data modelling, database design, and data management practices. Responsibilities: Data Architecture Design: Drive architecture and design conversations with client Architecture Board Develop and maintain the data architecture, including data models (industry standard Telecom data model), data flow diagrams, and database schemas. Design and implement data integration frameworks, ensuring data consistency and reliability. Be familiar with ...

Description: Skills: Proficiency in SQL is a must. PL/SQL to understand integration SP part. Experience in PostgreSQL is must. Basic knowledge of Google Cloud Composer ( or Apache Airflow). Composer is managed GCP service for Apache Airflow. All pipelines are orchestrated and scheduled through Composer GCP basics-high level understanding of using GCP UI and services like Cloud SQL PostgreSQL Cloud Composer Cloud Storage Dataproc Airlfow DAGs are written in Python basic knowledge of Python code for DAGs Dataproc is Managed Spark in GCP so a bit of PySpark knowledge is also nice to have. Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be ...

Description Proven experience in working with all business areas to elicit define prioritize and document business requirements including challenging existing processes where appropriate Lead and facilitated requirements gathering and solution workshops with stakeholders suppliers and functional/technical subject matter experts. Experienced in capturing detailed analysis on System impacts of new/changed functional processes to provide a detailed definition of gap fit requirements including any requirements for integration between systems. Data flows and business/accounting requirements to clearly definedata content formatting mapping cleansing enhancement validation exceptions handling acces...

SAP CDC (Customer Data Cloud): Manage consent and profiling processes. Ensure compliance with data privacy regulations. Integrate CDC with other systems for seamless data flow. SAP CDP (Customer Data Platform): Oversee contact profile management and maintain a Single Source of Truth. Implement and manage data integration processes. Utilize built-in connectors and CPI for efficient data handling. Integration and Data Flow: Utilize built-in connectors, CPI, and as-is integrations. Ensure smooth data flow between marketing, sales, and other systems. Collaborate with IT and other departments to maintain data integrity. Additional Responsibilities: Manage marketing contacts, sales contacts, and l...

7+ years of experience in ETL supporting roles. Strong understanding of ETL & reporting processes like SSIS, Azure synapse, Azure data flow, Azure databricks, PowerBI and Control M job scheduling. Experience with incident management tools (e.g., Jira). Proficiency in troubleshooting and root cause analysis. Excellent communication skills and experience working with cross functional teams. Willing to work in rotational shifts and occasional On call support.

Job Summary: We are looking for a skilled Google Cloud Platform (GCP) Data Engineer to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate will have strong experience in data warehousing, ETL development, and cloud-based data processing . Key Responsibilities: Design, develop, and maintain ETL/ELT pipelines on GCP using Cloud Dataflow, Dataproc, Data Fusion , or Composer (Airflow) . Build and optimize data warehouses and data lakes using BigQuery, Cloud Storage , and Pub/Sub . Implement data ingestion from multiple sources (databases, APIs, streaming). Ensure data quality, integrity, and governance through automated validation and monitoring. Collabora...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Job Summary : The SAP Datasphere Specialist will be responsible for the design, development, and maintenance of data architecture within SAP Datasphere. The ideal candidate should have extensive hands-on knowledge of SAP Datasphere artifacts, including Spaces, Local Tables, Views, Data Flow, Replication Flow, Transformation Flow, DAC, Task Ch...

We are hiring - Experience - 4-8 Years Location - Bangalore, Hyderabad, Pune, Coimbatore, Kerala, Chennai Interested candidate can apply on below link for the next process - https://careers.ey.com/job-invite/1647314/ Role & responsibilities Were looking for candidates with strong technology and data understanding in GCP engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team. Preferred candidate profile Working knowledge of Google Cloud Platform Worked with a combination of cloud based big data technologies (Google Big Query, Cloud Data Flow, Cloud Composer, Cloud Functions, Clou...

Salary: 8 to 12 LPA Exp: 2 to 5 years Location: Gurgaon /Pune/Bangalore Notice: Immediate to 30 days..!! Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data pipelines using GCP services such as BigQuery, Data Flow, PubSub, Dataproc, and Cloud Storage. Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs. Develop complex SQL queries to extract insights from large datasets stored in Google Cloud SQL databases. Troubleshoot issues related to data processing workflows and provide timely resolutions. Desired Candidate Profile 2-4 years of experience in Data Engineering with expertise GCP & Biq quer...

Salary: 35 to 50 LPA Exp: 7 to 12 years Location: Gurgaon/Pune/Bengalore Notice: Immediate to 30 days..!! Job Profile: Experienced Data Engineer with a strong foundation in designing, building, and maintaining scalable data pipelines and architectures. Skilled in transforming raw data into clean, structured formats for analytics and business intelligence. Proficient in modern data tools and technologies such as SQL, T-SQL, Python, Databricks, and cloud platforms (Azure). Adept at data wrangling, modeling, ETL/ELT development, and ensuring data quality, integrity, and security. Collaborative team player with a track record of enabling data-driven decision-making across business units. As a Da...

Job role: Data Engineer Location: Hyderabad/Chennai (Hybrid) Employment Type: Full-time Team: Data Engineering No-of Positions: 4 JD: Hands-on expertise in GCP data stack: BigQuery, Dataflow (Apache Beam), Dataproc, Cloud Storage, Pub/Sub, Cloud Composer (Airflow) . Strong Spark (PySpark or Scala) for batch processing on Dataproc. Solid Airflow DAG design (idempotent tasks, backfills, retries, SLAs). Advanced SQL and data modeling (star/snowflake, slowly changing dimensions, partition strategies). Proficiency in Python (preferred) or Scala/Java for data engineering. Experience with Git and CI/CD (Cloud Build/GitHub Actions/GitLab CI). Familiarity with security & governance on GCP (IAM, servi...

Job Purpose As a People & Culture Team, we are responsible for fostering a workplace and culture that empowers everyone to do their best work. This role is responsible for managing full product execution for specific product(s) within our HR technology landscape that are aligned to a specific focus area, such as Talent, Compensation & Benefits, CoreHR, Learning, and Recruiting, based on business needs. This role manages multiple project teams and coordinates with multiple stakeholders providing thought leadership and expertise within the HR technology landscape domain We are seeking an experienced and strategic Product Owner to lead our Global Time & Attendance solutions, with strong knowled...

Warm welcome from SP Staffing Services! Reaching out to you regarding permanent opportunity for MNC!! Skill: GCP Data Engineer/Data Architect Job Location: PAN India Experience: 5-15yrs Required Skills: GCP, Big Query, Dataflow, Data Proc, Cloud SQL, Cloud Spanner, Pub/Sub, ETL, Apache airflow, Python, Pandas and Numphy Interested can share your resume to sangeetha.spstaffing@gmail.com with the below inline details. Full Name as per PAN: Mobile No: Alt No/ Whatsapp No: Total Exp: Relevant Exp in Big Query: Rel Exp in GCP: Rel Exp in Data Proc/Pubsub: Rel Ex in Python: Current CTC: Expected CTC: Notice Period (Official): Notice Period (Negotiable)/Reason: Reason for Job Change: Offer in Pipel...

Job Description 1. Production : Ensure to Achieve Production as per business Plan Target. Minimize the cost for Production Process. Ensure to achieve desired yield as per Business Plan 2. Plan and Perform activity : Preparing weekly, daily production plan based other schedules released by PPC department. Preparing List of resource requirement. Collation of relevant information to be shared with the HOD. Ensuring adherence of production inline with specifications. Maintaining all records as required as per documentation as per organizational defined process and SOP. Recommend changes to be carried out to improve production. Carrying out routine health checkup of equipment's, to ensure continu...

Work Location: Bangalore/Chennai Experience: 5-12yrs Required Skills: Proven experience as a Data Engineer with expertise in GCP. Strong understanding of data warehousing concepts and ETL processes. Experience with BigQuery, Dataflow, and other GCP data services Design, develop, and maintain data pipelines on GCP. Implement data storage solutions and optimize data processing workflows. Ensure data quality and integrity throughout the data lifecycle. Collaborate with data scientists and analysts to understand data requirements. Monitor and maintain the health of the data infrastructure. Troubleshoot and resolve data-related issues. Thanks & Regards Suganya R Suganya@spstaffing.in

Role & responsibilities Position Description: Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately Key Responsibilities: 1) Collaborate with business and technology stakeholders to understand current and future data requirements 2) Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis 3) Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Snowflake Data Warehouse, Core Banking Good to have skills : AWS BigDataMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : EPIC Systems Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with different teams, analyzing system performance, and ensuring that...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : SAP BTP Integration Suite, Infogix Good to have skills : NAMinimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. Your typical day will involve collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will ...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : EPIC Systems Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with different teams, analyzing system performance, and ensuring that...