RFT-GW-2006-TB112 by liaoxiuli

VIEWS: 26 PAGES: 14

									Reliable File Transfer Service


         Ravi K Madduri
   Argonne National Laboratory,
       University of Chicago



                                  1
                        What is RFT ?
   WS-RF compliant Fault-tolerant, High-
    performance data transfer service
       Soft state.
       Notifications/Query
   Reliability on top of high performance provided by
    GridFTP.
       Fire and Forget.
       Integrated Automatic Failure Recovery.
            Network level failures.
            System level failures etc.
       Essentially a Data transfer scheduler with FIFO as a
        Queue Policy.



                                                               2
                              What is RFT ?
                                 RFT Client

                           SOAP                Notifications
                          Messages              (Optional)
                                 RFT Service



GridFTP Server                                                   GridFTP Server

   Master      Protocol      Data               Data        Protocol    Master
    DSI      Interpreter    Channel            Channel    Interpreter    DSI

       IPC Link                                                  IPC Link

    IPC           Slave      Data               Data           Slave      IPC
  Receiver         DSI      Channel            Channel          DSI     Receiver



                                                                                   3
                              What is RFT ?

                           SOAP                Notifications
                          Messages              (Optional)
                                 RFT Service



GridFTP Server                                                   GridFTP Server

   Master      Protocol      Data               Data        Protocol    Master
    DSI      Interpreter    Channel            Channel    Interpreter    DSI

       IPC Link                                                  IPC Link

    IPC           Slave      Data               Data           Slave      IPC
  Receiver         DSI      Channel            Channel          DSI     Receiver



                                                                                   4
                              What is RFT ?
                                 RFT Client

                           SOAP               Notifications
                          Messages             (Optional)




GridFTP Server                                                  GridFTP Server

   Master      Protocol      Data              Data        Protocol    Master
    DSI      Interpreter    Channel           Channel    Interpreter    DSI

       IPC Link                                                 IPC Link

    IPC           Slave      Data              Data           Slave      IPC
  Receiver         DSI      Channel           Channel          DSI     Receiver



                                                                                  5
                     What is RFT ?
                       RFT Client

                  SOAP               Notifications
                 Messages             (Optional)
                       RFT Service



GridFTP Server                                         GridFTP Server

                                      Data        Protocol    Master
                                     Channel    Interpreter    DSI

                                                       IPC Link

                                      Data           Slave      IPC
                                     Channel          DSI     Receiver



                                                                         6
                              What is RFT ?
                                 RFT Client

                           SOAP                Notifications
                          Messages              (Optional)
                                 RFT Service



GridFTP Server                                                 GridFTP Server

   Master      Protocol      Data
    DSI      Interpreter    Channel

       IPC Link

    IPC           Slave      Data
  Receiver         DSI      Channel



                                                                           7
                              What is RFT ?
                                 RFT Client

                           SOAP                Notifications
                          Messages              (Optional)
                                 RFT Service



GridFTP Server                                                   GridFTP Server

   Master      Protocol      Data               Data        Protocol    Master
    DSI      Interpreter    Channel            Channel    Interpreter    DSI

       IPC Link                                                  IPC Link

    IPC           Slave      Data               Data           Slave      IPC
  Receiver         DSI      Channel            Channel          DSI     Receiver



                                                                                   8
     RFT Implementation Details
   Provides following operations
       start()
       getStatus(source_url)
       getStatusSet(from,offset)
       Cancel()
   Provides following Resource Properties
       RequestStatusType with faults.
       OverallStatusType with faults.
       Other Aggregation RPs for total bytes, total files etc.
   Uses Database to store and retrieve the state.



                                                                  9
                New in GT4.1
   A C client to submit transfers to RFT
    service
   Better performance than the command-line
    java client
   Client API in java to make it easy to write
    custom clients
   Bug fixes




                                                  10
               Who is Using RFT ?
   Two types of users
     Embedded (As part of other services)
     Stand-Alone.

   GRAM
       Stage-in, Stage-out, Clean-up
   Data Replication Service
   TeraGrid
       Tgcp
   LiGO (Proposed)


                                             11
                 Future Work
   Standardization effort at GGF-DMIS
   Add new operations
     Pause()
     Resume()

     addTransfers(List of transfers)

     getStatus(StatusType)

   Merge create() and start() into one
    operation
   Add support for more data scheduler like
    functionality in RFT

                                               12
        Future Work (continued..)
   Priority based transfers
   Add support for different transfer protocols
   Add new resource properties with
    predictions for estimated time of finish of
    transfers
   Support for partial file transfers
   Better scalability and performance.




                                                   13
Q&A




      14

								
To top