2044 Data Flow Jobs - Page 18

Primary skillset is Java and secondary is API with GCP services like GKE, Bigquery, Spanner, strong in writing complex SQL's. Self stater, quick learner and problem solving skills are mandatory Secondary:C# .NET / Python, OpenShift SPSF objectives are to reduce misload through the use of RFID enabled scanners and handheld wands. It increases Package Loader productivity as manual scanning is eliminated and efficiency of Sort and Load process is increased. Customer satisfaction is improved as packages are delivered on time with the elimination of misload packages. UPS also benefits from SPSF as it helps mitigate fraud by uniquely identifying each Package Label. Mandatory Skills:Mandatory Skill...

Description: Proven experience in working with all business areas to elicit define prioritize and document business requirements including challenging existing processes where appropriate Lead and facilitated requirements gathering and solution workshops with stakeholders suppliers and functional/technical subject matter experts. Experienced in capturing detailed analysis on: System impacts of new/changed functional processes to provide a detailed definition of gap fit requirements including any requirements for integration between systems. Data flows and business/accounting requirements to clearly define:data content formatting mapping cleansing enhancement validation exceptions handling ac...

Description Adobe Commerce Developer with 4-7 years of experience Key Responsibilities and Requirements Hands-on experience with Adobe Commerce (Magento 2.x), with proven proficiency in both backend and frontend development. Deep understanding of Adobe Commerce architecture, design patterns, and best practices, including performance optimization techniques and security best practices. Experience in designing scalable solutions using modern Adobe tools (API Mesh, App Builder). Advanced knowledge of Magento, JavaScript, HTML, PHP, CSS, and MySQL. Expert with RESTful APIs, GraphQL, and web services to seamlessly integrate Magento with third-party platforms and systems. In-depth understanding of...

Description Adobe Commerce Developer with 4-7 years of experience Key Responsibilities and Requirements Hands-on experience with Adobe Commerce (Magento 2.x), with proven proficiency in both backend and frontend development. Deep understanding of Adobe Commerce architecture, design patterns, and best practices, including performance optimization techniques and security best practices. Experience in designing scalable solutions using modern Adobe tools (API Mesh, App Builder). Advanced knowledge of Magento, JavaScript, HTML, PHP, CSS, and MySQL. Expert with RESTful APIs, GraphQL, and web services to seamlessly integrate Magento with third-party platforms and systems. In-depth understanding of...

Description Skills: Proficiency in SQL is a must. PL/SQL to understand integration SP part. Experience in PostgreSQL is must. Basic knowledge of Google Cloud Composer ( or Apache Airflow). Composer is managed GCP service for Apache Airflow. All pipelines are orchestrated and scheduled through Composer GCP basics-high level understanding of using GCP UI and services like Cloud SQL PostgreSQL Cloud Composer Cloud Storage Dataproc Airlfow DAGs are written in Python basic knowledge of Python code for DAGs Dataproc is Managed Spark in GCP so a bit of PySpark knowledge is also nice to have. Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade C Level To Be Def...

Job Title: GCP Data Engineer Location: Pune, India Experience: 3 to 7 Years Job Type: Full-Time Job Summary: We are looking for a highly skilled GCP Data Engineer with 3 to 7 years of experience to join our data engineering team in Pune . The ideal candidate should have strong experience working with Google Cloud Platform (GCP) , including Dataproc , Cloud Composer (Apache Airflow) , and must be proficient in Python , SQL , and Apache Spark . The role involves designing, building, and optimizing data pipelines and workflows to support enterprise-grade analytics and data science initiatives. Key Responsibilities: Design and implement scalable and efficient data pipelines on GCP , leveraging D...

Responsibilities: * Design, implement & optimize data solutions using BigQuery, Data Build Tool & Python. * Collaborate with cross-functional teams on ETL projects with focus on robustness & data governance. Provident fund

Role- Data Architect Location- Pan India Year of Experience - 10 to 15 years Skills Required - Databricks, AWS/Azure/GCP Cloud, Data Architecture Job Description: 10-15 years of total experience and at least 3+ years of expertise in Cloud data warehouse technologies Azure data platform covering ADF, ADLS, Synapse, Microsoft Fabric, databricks etc. AWS data platform covering Glue, EMR, RedShift, databricks etc. At least one End-to-end AWS data platform implementation is a must covering all aspects including architecture, design, data engineering, data visualization and data governance (specifically data quality and lineage). GCP data platform covering Cloud Storage, Data Flow, Data Proc, BigQ...

Job description Hiring forGoogle Cloud Data Engineer Mandatory Skills: GCP , BigQuery Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed func...

Job description Hiring forGoogle Cloud Data Engineer Mandatory Skills: GCP , BigQuery Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed func...

Job description Hiring forGoogle Cloud Data Engineer Mandatory Skills: GCP , BigQuery Responsibilities A day in the life of an Infoscion As part of the Infosys consulting team, your primary role would be to actively aid the consulting team in different phases of the project including problem definition, effort estimation, diagnosis, solution generation and design and deployment You will explore the alternatives to the recommended solutions based on research that includes literature surveys, information available in public domains, vendor evaluation information, etc. and build POCs You will create requirement specifications from the business needs, define the to-be-processes and detailed func...

As a company deeply committed to bringing passion and customer focus to the business, Fractal is a prominent player in the Artificial Intelligence space with a mission to power every human decision in the enterprise. Fractal brings AI, engineering, and design expertise to help the world's most admired Fortune 500 companies. Rated as one of India's best companies to work for by The Great Place to Work Institute, we are at the forefront of innovation in Cloud, Data, and AI technologies, driving digital transformation across enterprises at an unprecedented pace. **Responsibilities:** - Evaluate the current technology landscape and recommend a forward-looking, short, and long-term technology str...

As Senior Scientific Officer -Ensure execution of Formulation, Filling activity of Line-1 and Line -2 and Lyophilizer activity in Line-I in different shifts. 2. To review SOPs, validation protocols, Preventive maintenance schedule, log books, calibration schedules and regulatory guidelines. 3. Ensure: Timely availability of resources and infrastructure. Equipment and facility are to be maintained in optimal operational conditions. On Time in Full (OTIF). Regulatory Compliance Successful adherence to GMP, GDP of the Plant compliance. Provide a culture of continuous improvement in Production. o Create cohesive and peak performance for Production team o Consolidates inputs from all subordinates...

You will be responsible for performing various testing procedures, such as substantive and controls testing, vouching, and verification. Additionally, you will provide support to the team manager on assurance engagement formalities and handle allocated work areas including testing and relevant assurance procedures. Your key responsibilities will include: - Preparing assurance work papers and ensuring compliance with firm policies, procedures, and regulatory requirements. - Managing and supervising junior team members, including article staff. - Acting as a Single Point of Contact (SPOC) for the team with the client, facilitating data flow, communication, coordination, and discussions. - Coor...

As a Smart Factory Architect Connectivity Engineer at our company, your role will involve leading the data modeling to ensure seamless data flow enabling real-time visualization, simulation, and optimization of manufacturing processes. **Key Responsibilities:** - Architect and deploy batch real-time data pipelines - Design secure, scalable serverless data platforms for structured and unstructured data - Develop Infrastructure-as-Code - Manage GCP environments, IAM policies, VPC networking, cost controls, and hybrid connectivity - Build AI/ML workflows - Integrate semantic search frameworks with vector databases - Implement RAG pipelines to enhance LLM outputs - Lead enterprise initiatives an...

Role - GCP Data Architect Year of Experience- 10 to 15 years Location - Pan India Job Description: Required Skills: 10-15 years of total experience and at least 3+ years of expertise in Cloud data warehouse technologies on GCP data platform covering Cloud Storage, Data Flow, Data Proc, BigQuery, etc. At least one End-to-end GCP data platform implementation is a must covering all aspects including architecture, design, data engineering, data visualization and data governance (specifically data quality and lineage). Significant experience with data migrations and development of Operational Data Stores, Enterprise Data Warehouses, Data Lake and Data Marts. Good hands-on knowledge on SQL and Dat...

Job Title: GCP Data Engineer/BigQuery Developer Relevant Experience (in Yrs.) 5-8 years Location: Hyderabad, Pune Technical/Functional Skills 1) Expertise on GCP services Airflow/Cloud Composer/Google Cloud storage/ BigQuery, 2) Experience in developing. maintaining and supporting Airflow/Composer DAG's 3) Good hands-on experience in Python programming, working with GCP API's 4) Experience with Data Engineering services in GCP- Big Query, Data flow, DataProc Pub-Sub, Cloud Function, Composer, Storage etc. 5) Experience with writing complex queries, stored procedures in BigQuery 6) Experience in cost/process/run time optimization of Airflow/Composer DAG's and/or stored procedure/queries in Bi...

Design, Develop, and Maintain ETL Processes: o Build and maintain scalable ETL pipelines inPython to extract, transform, and load data into Snowflake master tables.Automate data mastering, manage incremental updates, and ensure consistencybetween landing and master tables. Data Modeling: o Create and optimize logical and physical datamodels in Snowflake for efficient querying and reporting. Translate businessneeds into well-structured data models, defining tables, keys, relationships,and constraints. Analytical Thinking and Problem Solving: o Analyze complex datasets, identify trends, andwork with analysts and stakeholders to resolve data challenges. Investigatedata quality issues and design...

Overall responsible for service revenues from the Infra Service area. Including setting their annual business targets and periodical reviews to achieve the results. Drive excellence in field operations through employees. Ensure that Lifts / Escalators are maintained at job sites in various locations as per the SLA with customers. Enhance field productivity. Sub Con Management and Development to support field operations. Maintain cordial relations with Customers. Coach and develop internal talents for taking up higher responsibilities in the organization. Drive service transformation initiatives in the area Drive weekly and monthly reviews on forecast vs actuals with the team on Commercial pa...

Design, develop, and maintain scalable ETL/ELT data pipelines on GCP (BigQuery, Dataflow, Cloud Composer, Pub/Sub, etc) Build and optimize data models and data marts in BigQuery for analytical and reporting use cases Ensure data quality, integrity, and security across the data lifecycle Implement data transformation logic using SQL, Python, and Cloud Dataflow/Dataproc Collaborate with business and analytics teams to understand data requirements and deliver efficient solutions Automate workflows and orchestrate pipelines using Cloud Composer (Airflow) Monitor and optimize BigQuery performance and manage cost efficiency Support CI/CD deployment processes and maintain version control using Git ...

Your role and responsibilities Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc. Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation Ability to analyse data for functional business requirements & front face customer Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 5 to 7 years of relevant experience working as technical analyst with Big Query on GCP platform. Skilled in multiple GCP services - GCS, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporti...

Your role and responsibilities As a Software Developer you'll participate in many aspects of the software development lifecycle, such as design, code implementation, testing, and support. You will create software that enables your clients' hybrid-cloud and AI journeys Your primary responsibilities include: Lead the project team to deliver solutions to the client Apply techniques for planning, tracking, change control, and risk management to ensure project success. Establish and maintain an effective communication plan with both the application team and the client Provide day-to-day direction to the application team, ensuring efficient task execution and prioritization. Provide regular status...

About The Role Project Role : Application Support Engineer Project Role Description : Act as software detectives, provide a dynamic service identifying and solving issues within multiple components of critical business systems. Must have skills : EPIC Systems Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Support Engineer, you will act as software detectives, providing a dynamic service that identifies and resolves issues within various components of critical business systems. Your typical day will involve collaborating with different teams, analyzing system performance, and ensuring tha...

About The Role Project Role : Business and Integration Practitioner Project Role Description : Assists in documenting the integration strategy endpoints and data flows. Is familiar with the entire project life-cycle, including requirements analysis, coding, testing, deployment, and operations to ensure successful integration. Under the guidance of the Architect, ensure the integration strategy meets business goals. Must have skills : Personal Insurance Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Business and Integration Practitioner, you will play a crucial role in assisting with the documentati...

About The Role Project Role : Business and Integration Practitioner Project Role Description : Assists in documenting the integration strategy endpoints and data flows. Is familiar with the entire project life-cycle, including requirements analysis, coding, testing, deployment, and operations to ensure successful integration. Under the guidance of the Architect, ensure the integration strategy meets business goals. Must have skills : Personal Insurance Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Business and Integration Practitioner, you will assist in documenting the integration strategy endpoint...