; Declaration
Documents
Resources
Learning Center
Upload
Plans & pricing Sign in
Sign Out
Your Federal Quarterly Tax Payments are due April 15th Get Help Now >>

Declaration

VIEWS: 9 PAGES: 65

  • pg 1
									                                          !

                            " !
                                  #   #


                    $! % & '              (




Declaration
I declare that this document and the accompanying code have been
composed by myself, and describe my own work, unless otherwise
acknowledged in the text. It has not been accepted in any previous
application for a degree. All verbatim extracts have been distinguished by
quotation marks (unless explicitly indicated otherwise), and all sources of
information have been specifically acknowledged.
Abstract



           !


"              "
       #
Acknowledgements
"        $                %                                             &   !
                              ' ()$*)+*   **
              *       #                     ,              -    .
"       ( #                                   0
                                            /0 1           #2       *
                      2   3 3 4       5 #          &                        #
                                                                #               #
                              "                        #
                                  #

"   #         #   6
Foreword
"
    2
           #   #
               &
Contents
7    2                              7

    77   8                          7

    7/   !     98 &                 7

    71                              /

    7:   +         ;                1

    7<         2                    :

    7=   + & >                      <

    7?   $             @            <

/    4                              =

    /7                              =

    //   4@@                        A

    /1   2                 B       77

    /:   2             !           71

    /<   @         #               7<

1    !          9$             +   7=

    17   !                         7=

    1/   @#    8                   7?

    11   5                         7C

    1:                     !       /0

    1<   +                         /7

    1=                             /:

:    2                             /<

    :7   *             +           /<
    :/   B        *                  /?

    :1   5        $                  /C

    ::   !    $                      /A

    :<   +        $                  10

<    B                               11

    <7   !            #              11

    </   @        #                  1:

    <1   4                           1:

    <:   ,                           1<

    <<   "                           1<

=    *        9,                     1?

    =7   4                !   98 &   1?

    =/   @#   %                      1C

    =1   !                           1C

    =:   ,                           1A

    =<   @    #                      :0
Figures
,   17 ! 8       !       !                   7C

,   1/   $   %       5                       7A

,   11 ! B       (           !           >   /0

,   1: !,                !       !       +   //

,   1 < !;   $       !       !       2       /1

,   :7 B     D   *                   !   !   17
1 Introduction

1.1 Overview
"                                !   !       #           !            !
!   !               #
                                                                              #       "
                         #                                                "#      #


                                             #
!   !                        #                                        #                       #
                                                              #

2                                                                                         #
"                                                                 E
                    #                        #           E                 #
            8            #
            .                                            #!       #       #
                                                                          (""+
4$, D                                                2                                    #
                                 !       #
                #                        #

@           #                                #   !   !
                    ("                                                                        ("
        "                    #                               #


                                                                                  #



1.2 Aims & Objectives
"       &                                #                   #




*       7 2                                                                                        7
                                      #2
#                                                   "


                     "                #


,                            #                 #
            #                              #


"                                                                             #
                                                                    &

    •   B                    #                                          F!         G
    •   4                             FB       #G
    •   +                                                                F,       G
    •   +                                               #                F,       #G



    •               ("                                  #
    •   5
    •   !
    •   !



1.3 Motivation
                                                                #                      "
            #                                                   #
                                                   +        #


                                                            2
                F        #       #G




*       7 2                                                                                /
,
           #                                            #
                        #                                                         .           2
                                #                                                 #
               #

2                                                                         ,
                                        #
                                @
       #

"                               #
                    (           #
                                                            2
#



1.4 Potential Users
!
                                            "                                         #


;              #                                            !   !
#                       #       ("                               "            #
               #                                                      ;
               ("

2                           #                                      G
                                                                F>;2                  2
                                    #                                !$B I
                                                                     H   5                        7AAAJ
"                   #                                                 #           #       !
>;2F           #            G #                 !   !                                             #
                            #




*      7 2                                                                                            1
1.5 Legal Issues
@                                                                        #                             #           #
                            #"                                           #                         2           ;' F
                                 G       #                       #
                F       !            *                            G
                                                                 # 2
                                         5                                                 &               #               ;'
"                                                    #                       #;'                                       &
    #               @
                        K

2                       #                            $ "                 ( #               ;           #       !
@                                                        #           (
                                     # F                          G

    7   L                                            #                                         #
                            .                    #

    /   L
                                                 .

    1   L               38"                                                                            #
                                                     #

    :   2#                                                                             #               #
                            #                                                                      #
                             B;                                          &                         #


"       #                                                                                              #2
            #                #                                   #                 >
                                                             F        ;'           G           #                   !        #
    $ ( #.              #                    !           $

"                                            2
                    #                            #       #                                                             #




*       7 2                                                                                                                 :
    "
                                                                       "


1.6 Project Group
!                                         &                #       #
                    !     @                                    &                       M@
@                         $       2               @       N!       #
    #           &                                                  #           &   !       .
@
I     0
    /0 1J                                                                  #
        #


1.7 Document Structure
                    # !       !                                        "
                              #                                                *       /
    #                                                                      !   !   2 *
1                                     #
                                      *       :                                        #
*   < ,     #                             *           =




*   7 2                                                                                        <
2 Related Work
2                                                      !    !       #
     #


2.1 Web Maintenance
"                                                               @                     #


                 #!                    O                   #


                                                       "                                  "   2
                                         0 *
                                       70 P I              98 #O        7AACJ
                                                                "
                                             #                           "                             #


@                                                               $                I                  0
                                                                                                  /0 1J
@#           %    +   @#
                      I        /0 1J
                                 0                         ,    +       I              0
                                                                                     /0 1J
                      "
                                                       "
                                   #                                                               "
         #                                                      #


!                                           #
#            $                                     #
                          #

"    @"4;$B       #   ,
                      I        O           7AA?J
                                                   #
                      "    #
                                                                             2         # @"4;$B
                               #



*        / 4                                                                                           =
!                                                                                                           @"4;$B .
                        #             "      #                                                          #           #
                                                                                        #                               "
                            #                                       #           !           #
     #                                                  D                      0
                                                                        I 1* /0 1 J
          0
D@ I 1* /0 1 J          #                         (             @"4;$B


     #                                                                      @                           +       @
                                                                                                                I
      0
    /0 /J           2           "    I O /0 1J 5
                                     +     0                                    #       #
                    @"4;$B
                                                                                                                            #

  "B@ I
B@2   4               0
                    /0 1J                   #                                                   "


B                                                                                           #               !               #
  "B@
B@2
                                    O "     #


4                                                                                                   #          "B@
                                                                                                             B@2
                                      ("                            2               #
                                                        !
                                                                                # 2.


"              #    I                       0
                                          /0 1J             F               G                                           #
                            ;                     #     #                                       #
                                             "                                                                          "


                                                #                                                                       "
                    #                                                   #
                                                                #
         -     .-               .     -             .                                           ;4



*        / 4                                                                                                                ?
    E                                               2           #
                                                                        #
                                +                                                                                           #           #
"                                                                                       #=<P                                        #
                    #                                                                           2
                                        #                                                           #

!                                                                                                   "


                #   #

    #                               #               #                                                       #
            #                                               !       !
            "                                                   #
    "                                                                       #       #

"   =<P                 #                   .                                                                       (
            1<P                                 .       #           B                                                   #!
3                           +               F3 +G           #                                           #               #


                    #                                                               #                                   B   #
                                            @                                                           Q       #
                    "                                                                       #       !       !
                                                                                        #2
    #                                                                           !       !                       #
                                    (                                       !       !
                    #                   #                                               #

2                               #                                                                                           %
        HR *                    %
                                I                   9 *                       0
                                                                            /0 /J
                    " #                                                                                                         #


                                            >                                                                       #
        #                                                       ! #                                             #



*           / 4                                                                                                                         C
                                                               "
                                                                                                   "


!           #         #
                                  2           #
                                                                                                           "
                  #                                                                                        #!
                                                  #                                                             #
                                          "                                            #


"
            *     #           #                                !   !
                                                                                       (


,   #                                 #   #                                                            #H


                                              "                    #
                              #                                                #
                                                                               !   !                                #
2                #                                        ("

@       #                                                      #           ,           #
                          +                       #                                                F            #
                                              E                     G      #
                  #           #           ! !         !             #                          #
                F("       G                                                        #               ("


2.2 RSS
    5
4@@ I       #         7AA?)B              O       /0 0
                                                    0)               0
                                                                   /0 1J                   #                        #


                      "                               #                                                #



*       / 4                                                                                                         A
                    #                                                                                      4@@
                            #                                                          #                                   F       G
        "                                         #                                                    #        4@@
    #                               #                          #

+                           F                            #G                                                            4@@
                                    #        "                                                 #                       #
                        #                                                            #          #                                  ,
                            #                +(+              +(+ /0 1JH
                                                              I     0                  @       @
                                                                                               I             0
                                                                                                           /0 1 J *>2
*>2 7AAAJ
I                                           #                                                          ("

4@@                                     #                                                  "
                                                                               4@@
                @                                4             $               ,                    5
                                                                                               F4$,GI                  #       7AA?J
                #                                                                                                                      #
                                                                                   4$, @           @            5
                                                                                                               #I              $
  0J
/0 0 4              @       @            B
                                        #I        O       /0 0
                                                            0J             4   #@          @#                  I             0
                                                                                                                           /0 1J "
        #                                                                                                          #                       !
                                    4@@ #                +                                 +
                                                                                           I             0
                                                                                                       /0 /J

                                        4@@ F                          #           G
                                             #                                       #                                                 F
4@@             G2                                            #                                                            #
"                                           #                                                          !       !
        #

"                                                                  #
            )               #                                                            4@@           3                   #
                                    #
                                "                    F                                             G
                        #                                                                                   #
                    ,
            *           #                                                                                  #
                                #            )@           7<                   (



*           / 4                                                                                                                        70
                        #           4@@            #    .                                 #
                                #


2.3 Information Extraction
2 @            //                         4@@                                                                             #
                                        #          #                                                        "
           #                                        #
                                                                     "


"                                       #       !       !

"
           $                                                        )>        (                        (
                                                                                                       I              7AACJ
                                                                                      M                    N      M
                    N

+                               #                                                                 ;
                        #                                            -            .
                                                                -         .                       ;
                                                        "
                                     (
                                     I                        0J
                                                            /0 0 +
               #                                            (
                            F                           G

+                                       #                                                     !             #
           #                              #                                       #                                   #
                                               2
                                          #                          ,                                          0 S
                                                                                                                I AJ "
                                    #                                    0A               "
                                              M T/0N                     N
                                                                    M TA0 2                           UU
      UU                    #                                                                 UU      UU
               >                                                                                  #
                                                            #                     UU                   UU




*          / 4                                                                                                            77
2           #
                                "    H                          (
                                                                I               7AACJ
    #           "                                #              M


        N! H                                                                                         #
                                                                        "
                                                        !               #H
"                           F                           G                                                 #          #
"
    &

;
"                                                               #                                B    5
                                                                                                      I
  0
/0 7 J                                                                                               ("
                                    #                               D                        #
                                            ("
        ;
    #("                                          #                       I #         7AAAJ
                                                                M
                                                                                                              N@
                                                    H       (
                                                            I                          $
                                                                             7AACJ , 842 I # 7AAAJ
5
I                             0
                            /0 7 J


!                                                                       #       #                                    #
                                                                                 E                    #
                                "
#                                                                       #                    "                   #
                        #       #                                               ##                        # @#
                                                                                                      #              #
                                        ;                                                #
        #           #                       #                               ,
                                #               "                                    #



*           / 4                                                                                                    7/
                                                                 #                        2            #
                                                                                               "                                    #
                             #                                B       5
                                                                      I                              0
                                                                                                   /0 7 J
              "                                                                                                                 #
                                                                                          #

!                        #               #                                                                      "
                                                                                                                "
             #                               #                                                              #                       #
D                                                                                         #
    #                            D               #                    (
                                                                           #                  #        #        ,
        #                                                                                              ("
                                                                      #


2.4 Intelligent Agents
!                                                                         #
,8 $8* F,            8       $               #8 *                      ,8
                                                                      GI $8* 7AA1J
M
                                                                          N@          4                +    3           4
                                                                                                                        I           9
3           7AA<J                        M #
                                                                                          N!       +                I       7AA<J
            M!                                                        #                                                     #
                                                         #                                         #                    O
                                     #                   N2                   #
                                 @       ,                   !    >
                     #                   2
                                         -           !            &       +               .,
                                                                                          KI           9>               7AA=J

"                                        #                                                                 #2
                 I             0
                             /0 /J               M                                #
                                                                 #                    #       & N!                                  #
                 M                                                                                                   N
                                                                                                                    # "
    #                    #


*           / 4                                                                                                                 71
"                                                                                                                #
                                         F                       G           #           @
                #                                    #
                                                                 #               #           "
                                                                                 #
                                         #
                                         "                           #




!               #                    #                                               B                   I
9H                  7AA<J                                                                        #

    •       4            #
    •       +
    •       @        !       #

4           #                        .           #
                                                                         "
                                                                     #                               !           #
                                                                                     #
                             4                                           !   !                                        #
                                 ,                               #                       #


+                                            .           #
"                                                                                                            #
                             2                       #


                                                                             @                                        #
                    !    !           #

@               #                            .               #                               "                        #
        #                            #                                                                       !




*           / 4                                                                                                      7:
                                            F                           G2
            #                                                                                #
!   !                                                                                #
                                "               #                            #
            #                                                                            #
                                        #

"                                                           !   !            &           #
            (                                                   F                        G
                                                                            #        !
            #%                      *               %
                                                    I   9*                0
                                                                        /0 /J
        "               !   !                                                                     #
#


2.5 Summary
"   *                                                                   &
                    !   !       2
    &   #                                                                   #


                                                        !           #
                #                       #                                        #
                                    ,
#
                            !       !




*       / 4                                                                                      7<
3 Architecture & Design Process
"                                   #                                                                #
        #                   #                                  #
                        #       #

5                                                          #                                     #
                                                                   #           @        17
                        #                    #                                                                   #
                                                                                        #


3.1 Agent Language
2                                            - .                   F1 7G                     !       @       @
                                                                                                             I
  0
/0 1J       #       "
                                                                       &


8                                                                          @           77 ;              #
                                                       ("                          F                             G
                                                   "

    •   @                   ("                         #
    •   "               #           ("
    •   $

"
                                                                                                                 "


<!--agent source=”http://www.fluff.com/index.htm” cache=”c:\cache\01.htm” -->
some data
<!--/agent -->

"               #                   ("                     "                             $
                #                                ("
                                     1* ("       :0                    I 1* 7AA?J



*       1 !                 9$           +                                                                           7=
                                                                                           #
                                       "
                               2
        <!--agent . -
        -           <!--/agent .                                               #                       #
        (                                  #               #

"                                          #                   "                           #           -
                                                                                                       some data.

                                                                           #       source.
                                                                                   -                       5
                              K"

"                         #                                                #                                       "
                                                                                                       "
              F                G                                                       #
                      #                #   #"                                          #
                                                                               some data.5#
                                                                               -
    #                                                                                  #
F           G     "                                                    #


!                                      !       @                           #


                                                       #                   (
                                                                                                       &       @
                                                                                                               I
  0
/0 1J


3.2 System Overview
2                                                      !       !
                                           #                                   *           :
                                                                   @               #
                                           #                                       &                   #

,        17                                        #       "                                   &   F                   G
                                       "                                               ("
    #                                                                  #                                   *           #



*           1 !           9$       +                                                                               7?
                           ("
                          #                                      "                                  "
                          2
                                                                                   "
                                                                          ,
                                          #                                                 #
    E                                                      #F                               #
                     G!           #           #
                                                                                                #




                                                                          Ag




     Set of                               Bootstrap                       Ag            JADE
     HTML            read agent            Module
    Targets             tags
                                                      generate
                                                       agents             Ag



                                  Figure 3.1 – An Overview of ArchAgent


"                    F                G                                  !$B I
                                                                         H   5                  7AAAJ
             2
                      ("
                          #                       2    #                       #
            !$B #
            H                                     "


3.3 Bootstrap Module
"       #                                                   #                          ("
                                                           #         "
                 "                                                   +



*           1 !            9$             +                                                             7C
"
,   #
                                @         #
            ,       #                                                                  F       +        G

"                               #             #                                        #
                "                                 #        #                                                                  #


        #                                                                          *           : "
         #                                                                                              #
+                   ("                                         #                                                      ;4
"                 +                                            !    !                                                 ("
                            #                                                              "
                            #                                                                       #

"               +                                     !   !               *                     4               F
             G
            # "         *                                                                      (            @         (
                                                                                                                      I
  0
/0 1J"                                                     #H (                                                           "
                                                  #            ;4                                                             #
                                                               *         : "       4
                                              #                               #
                                                                                  #




                                Bootstrap Module

                                                                                                             Set of
    Params                               Loader                         Process*                             HTML
                  read                                    invokes                              read         Targets


                                         Filter
                                                                uses
                                                                                                   * Recurser or Crawler


                                Figure 3.2 – Detailed View of the Bootstrap Module




*       1 !                         9$        +                                                                            7A
,         1/                                                                   "
                                                                                                           "
                   F                G              4                   *       "   +
                                         #                                                 #
               "
                           ("


3.4 Maintenance Agents
"                                                                                  "            #
     !         @           @
                           I        /0 1J
                                      0            #                           #@              1:7
                   # #                                     !   .                           @         1:/

3.4.1          The Skeleton
"                                                                                  !$B " #
                                                                                   H
                                                       4           *       F
                           G                                        "                  #             ,     11


    Bootstrap Module                     Agents Module

                                                                                                     Target
       Process*                                Agent                       Updater
                                read                           invokes                     read/
                               params                                                      write

                               Figure 3.3 – An Example of How an Agent is Generated


"                                                                  #
                                                               8                       ;                       #
               #
               "       ;
                                @         17

3.4.2          Source & Cache Comparisons
!     @            @
                   I             0
                               /0 1J
                                           (                       ;


*         1 !                       9$         +                                                               /0
                                                                               "
                                                                                           !
                          #                                                                        #
            #,                                    !    .                                   @
                                                                                           I             0
                                                                                                       /0 1J


3.5 Protocol
!                                 #
                                  #

"                                                          ,       #
                      #                                                        #                                    #
    #                                     @            #                                                   .




                                                                   #

3.5.1        FIPA ACL
"       ,                     2                   +#           !       ,2     0
                                                                       I +! /0 / J
                  #                           #

8                                                 !*       !           *                       ,2     0
                                                                                               I +! /0 / J "
                                                                                                                   2
        #                                                                          #

"    +!
    ,2 !*                             #                            #                               "
                                                                               "       #               #
                  +!
                 ,2 !*                             #                       #                                   #
                                                           ,                                                   #
                      #           -                        .

2                                                                                                              "
 +!
,2                                                                                             #
             #,                           !$B
                                          H                                                 +!
                                                                                           ,2
                                      !       !



*           1 !                   9$              +                                                                /7
3.5.2       Message Content
!                +!
                ,2
                #               "                                                                +!
                                                                                                ,2
#                          #                           "
        #                           #

!   !                          D                   #                              "
            #                                                                                             "
                                                                #           "
        #                      #!                              5
                                                           4$, I        #         7AA?J
            D                                              #                              D
                                            $"$ F$             "# $                 I      0
                                                                                   G $"$ /0 1J

3.5.3       Commands
"   !       !                                                                                             4
                                        #                                                             !   !
                                                                                          !
                                                                                      #
*       :                                                           #            ,        1:

    Command Description                            Syntax                       Data/Attribute Constraints
                #                   <timer>...</timer>

                                    <state>...</state>                            V
                                    <source chunkID=”...”>
                                    ...
                                    </source>                                             ;4
                                    <cache chunkID=”...”>
                                    ...
                                    </cache>
                                    <report history=”...”/>                               # V

                        Figure 3.4 – A Formalisation of the ArchAgent Protocol


"                                                                       #                                 !
                    !     !                                                                           "
                                #              #                        !
                                                    +!
                                                   ,2 -         .                     "


*       1 !               9$        +                                                                         //
                                                          -           .-    .    -            .
                                                          #       "
                    !;                    F,       1 <G

                                                              !

      Client                                Agent             -   ."

                 request: command set


                                                              2
                 not-understood
                                                                      $"$

                 failure: reason                                  -     .   -                     .

                                        XOR
                 Inform: success
                                                              2


                                                                                #,           1:
                                                              -   .


    Figure 3.5 – AUML Diagram of ArchAgent Interactions


(                                                                                        -        .



3.5.4      Extensibility
!
                       2      #                #                                     #        !


         !                                                                                        #




*        1 !             9$        +                                                          /1
3.6 Logging
!   !                                                                                       #       B
                                                    #       "
              #                                                         #

3.6.1    Bootstrap Errors
"                                               #       2                                   4
*        &                 @           11                   #
                                        #                                   2


                           !                                                                        #
                                                        "                           #
                                                    #           B                       #
          #

3.6.2    Agent Errors
"                                                                               "




!
                               )   #        #                                                   2
                                                    !       !
                           #                                                        #
                                       >;2

3.6.3    Interactions
!                                  !    !                               !
#                                                   !               #
              #   #            .                                                #       "           #
                                                        2       #                                        #
                                            #
                                                    #



*       1 !           9$       +                                                                        /:
4 Implementation
2                                                                              !       !                    #


             #       !               #
                 &

4                    !       !                                                         SomeClass


4.1 Choice of Programming Languages
!   !                                #       H     I / /0 1J *
                                                   H     0              #                          #
                                                                              #H
        "                                                               "
                                 #       # &

4.1.1       Object-Orientation
"   8 & 8                5
                         I           9+                 7AA<J
                                                             #
                 &               #                               #      #                  "
                                                                       #
!   !        H                                     8 & 8

4.1.2       Portability
"   H   %                                #                                         H                        #
                                 #                 !     !                                         #        )
        H                                      "                                   H               #
*       #                                #                                           D
                                                                                   ;32             #   2
                                                         #

4.1.3       Documentation Support
!            #                           H          &            I
                                                                 @     0
                                                                     /0 1 J        "           H
             !+2F!               +                  2            G      H                          #   "




*       : 2                                                                                                /<
                #                                   !    !            #
                        #

4.1.4       API & Re-usability
                    H                                   !+2                                             "
                    !+2                       H
                                                                 "            #
                                                                                ,       #
        H                                                    #
                #

4.1.5       Alternatives
2                                        #
                                              $

"                                                                                           8 & 8
                                @
                            *WW I                   0
                                                  /0 1J +#       +#
                                                                 I          /0 1J
                                                                              0         @   "   @
                                                                                                I       "
  0
/0 1JH
                H                                  #                                                F
                                                                                    @       @
                                                                                            I     0
                                                                                                /0 1 J
@+I
H @           0
            /0 1 J                  #G

!                               #                            H                                  +48 8>
5
I          0
         /0 7J          H       I
                                H      0
                                     /0 1J+48 8>                                    D                       #


+                           D                $8
                                             H     H
                                                   I$8       /0 1J
                                                               0              @!D /0 1J
                                                                          @!D I     0           #
H   !               #+48 8>
!   !

H           H                                                                       )       #
  +@ * +@ 0
* 2 I 2 /0 1J H
                                #        "                                                      !   !
        H




*       : 2                                                                                                 /=
4.2 External Code
@                                      #                                                                 !       !         "
                               H   !4
                                   H                                                                                 4
                   #                                                                                             #


4.2.1         HTMLParser
4                  - .                                      #           !       @           @
                                                                                            I         0
                                                                                                    /0 1J

!                  !       !           &
                                                    2                   #
      ("                                                                                             4
("                                             ("       +       8
                                                                I                     0
                                                                                    /0 1J

"                                                                                               # #          !




4.2.2         JDOM
$8
H         H
          I$8          /0 1J
                         0             #           D                    H       "
!4
H                                          #H                       !       !       .
$8
H                      D                   #                            $8
                                                                        H
                                                                                    $"$                              :<7
                               #

4.2.3         Heaton Spider
2 @           11                                                                                         !       !         "
                                                            *           "
!     !                                                         #               (""+                                 #
#         "     *          .                                            (               @       (
                                                                                                I              0
                                                                                                             /0 1J             #


;              #                                                                                         #
          !    !                                            #           !       !
+*            ;            #       !           B                                #!


*         : 2                                                                                                              /?
                                                                            #                        2
*                                                                               #"
#                                               !               &       #                        *
                                                            #                        "               #
            *


4.3 Bootstrap Details
2



4.3.1       Bootable Interface
                        @              11       !   !
Recurser                Crawler                                         #   Loader       2
                                                     #      #               #       Loader           "
                                    Bootable            "                                    #
                #   boot()                      @
                        boot()                      Loader                      &                            "
!   !                       #

4.3.2       Bad Targets
                                         F      G            #      "
                Loader          @                                                            #
                                                "                               Loader                   #
                                Exception                           Hashtable                            -       .
            2           #

4.3.3       ID Numbers
2                       #                                                                !       !               $
                                                                                                                 2
                                                                     "
        #                   #               #                                                    @           ::7 "
                                $
                                2                                                        F                            G
        $
        2           #




*       : 2                                                                                                          /C
4.3.4        Recurser Optimisation
2       #       Recurser                                        &                              ;      #     !              .
$                 2                    @#               @       @@G
                                                              F$2 "                                  # #
    #                             #                 !X                  #                   @@
                                                                                           $2              "
                              #                                                     #

2                                                                           B                         #         4
            #                                                                         *Y             ("                2
                                                                    #
            #!     @              @
                                  I             0
                                              /0 1J                                         #



4.4 Agent Details
(                                                                                                          !       !       .



4.4.1        Agent Information Management
                      @               1/                                             ("
                                                                                                                   2


"                                         @        17                       #       TargetChunk           8 &
#                         -           .                                 $
                                                                        2
;4                    "                                                         #          #

B                                                           TargetChunk

                                                                    !                                              #
        #                                     #                             #                                  #            #
            2      # Vector                                                         !
                                                                                                   & "
                                              ;4
                                       "                                TargetChunk              $
                                                                                               # 2                 2
TargetChunk                           Vector

                  $
                  2                            TargetChunk                                                 "


*           : 2                                                                                                            /A
                           "    Vector                               Hashtable               $
                                                                                            #2
TargetChunk                 "

4.4.2         Listener & Updater
"                                                                           Listener            Updater          5
                                                                                   "   Listener              !$B
                                                                                                             H
                                                            #
               #                                                              "   Updater

H       Thread     "
                                        #

2       #        Updater                                !$B TickerBehaviour
                                                        H
                       #                        Behaviour                                                (
                                    #           !$B Behaviour
                                                H                                          action()

             !             TickerBehaviour                  action()           !$B !+2
                                                                               H
                                "                                                 #
                                            Listener            Updater                              #

4.4.3         Agent States
2                                !$B
                                 H                      F                !$B
                                                                         H                                           G
                                                                                           Updater       &           #
        "

    •       MN_HALTED                                       Updater

    •       MN_IDLE                                     Updater                                 #
    •       MN_BUSY                                     Updater                             #

"                                                                                  .                             "
                                            #                   <report/>              "     MN_

                                                    .             Minion


4.5 Protocol Details
2 *           1                                                  !   !                                       #
                                                2



*           : 2                                                                                                      10
                                        #                                #



4.5.1       Content Validation
$              "#       $               F$"$ GI 1@                 0
                                                                 /0 1J                  #             #
D              $"$                                          #                      #                      D
                                                                     ;           $"$                      #
                  #                                     D                                       D
     $"$

"                   #                       !   !
                                #                                            #          2
                                            -                    .
     D                                                  #        $"$
                        !               B

"          E                                        ,       1:                                      $"$
                                    #                                    @
         Minion             F                                                G

4.5.2       Syntax Example
"          *            1
                                                !                    @            1<1       #
                                                                         "                                #
$"$        !                B                       ,       :7

 1   <?xml version="1.0" encoding="UTF-8"?>
 2   <!DOCTYPE commandset SYSTEM "http://www.csd.abdn.ac.uk/~dnc/msg.dtd">
 3   <commandset>
 4     <command>
 5       <timer>120</timer>
 6     </command>
 7     <command>
 8       <state>start</state>
 9     </command>
10   </commandset>

                            Figure 4.1 – Example XML Content of an ArchAgent Message




*         : 2                                                                                                 17
;                              ,       1:         <command></command>

                       #                                                         /
                       #                    $"$                             (""+ 2
           D                            $"$

4.5.3      Hooks for Extensibility


,                          #


!                                                                       ,   #             .
Listener                                                                switch

"   H                              #
                   #                                        @     #                  #
                   if-else     5#                                                    #
               !                                                   $"$




*       : 2                                                                              1/
5 Evaluation
2                                                       !       !
                                                                                    #                   #
                                                                     #


5.1 Accessibility
2 *         7                                                       !       !
#

2                                                           #!          !               #
                             #                                  ("                          !               #         #
                    ("   D                                                                              ("
2
                                                                                                    #
                             F     @            / 1G

"                                                   .                                                                 #
        2                              ("
    #                                                           #                                               2
            #                                                                                       .
                     #

                !    !   .                                               #
!               #                               #           F                               !               !   5G
        #                    >;2                                                !       !       "
                                  #
                                            &

                         >;2                                                                    #
*       #                        !$B
                                 H                  #
                                                                         (                              #
                                                            #        !$B
                                                                     H




*       < B                                                                                                          11
5.2 Scalability
!                       *            7                                               !       !
                                                                                                                     2
                                             !       !                                                       #
                        #2                       #

+#                  #                                #
                             #                                               #               #
                                                             #                                                       #
!    !                       #           #               "       #
         #               #               "                               #                               #       #
               #!       !                #           #                   #
         #     !$B
               H

*                       #                                        #               #
                    #        #
                                         #       #                   2           #
                                                                             2
                        #                                                                        K

2                       !        !                           #                           !
                                                     !$B
                                                     H                   #
                                                             #                           "               #
                                                 2
                                                 #                                                           2        #
                                                     )                                                                #




5.3 Robustness
!                   #            *           1           :
                !       !                                                                            D




*        < B                                                                                                         1:
                                      "                           !       !               #
B                             #

*         #                                   F                       #                               G        #
      #
                          $                                                   #
                                                                  #
2                                                                                             #
                                                                              #


5.4 Feedback
!             !   !                               F                       G                           #
                                                          2
                                                                      #               )


*     #                   #                                                                       ,
                                                                          #                       H       @
                                                                                                          I
  0
/0 1 J @
           !                                              #
#                                                                             6

B                                                     #                                               #
                                  #                           #                               !
                                      !   !                                                               #
                      #           #               #                       #
          #


5.5 Testing
5.5.1         Bootstrap Code
2 @           :1:             #           #                           4
                                              ("                                  "




*         < B                                                                                                 1<
8
                           #                                    #                                       @
                  #                     #
    #                          !                                                   !    !
            #                  #        #                                      2            #
                       #                                                  #2
            #

5.5.2        Information Extraction
"                                                                                  #!       @       @
                                                                                                    I
  0
/0 1J !                                         #                                               F
                               G!                                                      # #
                                                "
                           ;
                               #
                      #"                    #

5.5.3        Agents
"                                                                              "
                                                                                        2.
                                    #                                              !
                              8
                           # M &                                               #            NI
  0
/0 1J "                #                                            F                           G
                                        )                                               .
                                                        .           #                       )&
                                    #

"                                                                                                       "
                                                                                       !$B
                                                                                       H
        #                      #            "               #                                                #
                  #                                                     !$B
                                                                        H
                                                    F                              G#                        #
                                            #       2           #



*           < B                                                                                             1=
6 Conclusions & Future Work

6.1 Reviewing the Aims & Objectives
"                                       #           *       7                                                       &
                                                                            4
                                                #


    •       !                               •   ,
    •       B           #                   •   ,       #


                                                                            #
                    "                                   &                                                                       #
                                        !                               #                   #                   O


                            !   !

"                               #
                                                                        8                           #   #           #
                                                        #2                      !       !                                   3
                        #                                                                                           #
2               #                                               #                   #           #

!   !
        "                                                           #       #                                   #
                                                                    #               #


"                                                                                                           #                   #
                                                        #               #                                   "
            #       #                #                                                  !           !           #
%                                                            !$B
                                                            #H                                                  "       #
                        #           "




*           = *                 9,                                                                                          1?
6.2 System Value
(                                                 K@                   #
                        @                         #                             &
                                                                                        #
                2                                                       #
                                              #                                    &            !       !
                                          @                                 #
        # #                                   #                    #                                    &
                        65            #                    #
                    F                                      G8 #                             &       !       !


6.3 Achievements
,   #                         #                                                             "


                              #                                !                    *           /       #
                                                                                    2                       &
                        #                                          &       "                                    F
                 G
                # #                                    &       $                   %                    8


        "                         #                                    &

$                             !       !
                ,                                                      !$B
                                                                       H
                                                                                        "
                                                                                       $


    #                         !       !                                             &               "           &
                                          @
                                          -            @                       $        2                   @   .!
                                                       !       !                    @
                                                                                    I             0
                                                                                                /0 1J!
L       0
    I /0 1J                                                                                         &           "
            #           #                                              #



*       = *                  9,                                                                                      1C
!       !    .        "                                               #               &



6.4 Future Work
"                                                                                             >
                              #                                                                           #2
                                                                      !   !

6.4.1        Visual Editor
8                                         #                   $               I                     0
                                                                                                  /0 1J
5
I                       0
                      /0 7 J                                                                          #         @




"                         #       #                   !   !       !
#                                     3           #



6.4.2        Web Management
$                                                                                 H                   #8
                                  H                                       "
                                                          @
                  #                   !       !
                   "                                                                              @+
                                                                                                  H         @
            #"                                                                                        #
                                                                                                  &

6.4.3        Agent Service
!       !                                                     ;
                  #                                                   F                       =:7         = : /G
                                                                                                  (""+ 2
    #                                                                         #           #
                       "                                                  #




*           = *            9,                                                                                       1A
6.4.4    Cache Consolidation
8                        #                               *       #
                #                        B
                                     2



6.5 Summary
!   !                                                            "
                                     #                       "
        #                                        #       2
            !   !
            #                                #       ,
                    #!   !

                                                             !$B
                                                             H       2
                             #   #
                &

                #




*       = *          9,                                              :0
References
          ;4                                                                                      #
                                                                  #            0
                                                                             /0 1


5
I                        0
                       /0 7 J 4 5                         @ ,            > >                  "       B                B
+               !               2                     4              C       2                    *                         !4 0
                                                                                                                           + /0 7                      <:C <=0

5
I                        0
                       /0 7 J 4 5                          @ ,           > >                  %                   2                    B
+                      /?       % #           $              *                    4           2 #                           0
                                                                                                                  77A 7/C /0 7

5
I     $                 0J
                      /0 0 > 5               $        $ 5            #4 $                             4$,@            @                     7
                                                                                                                                      #F4@@G 0
     EE                            7 E
                                E E 0
5
I          9+                   7AA<J > 5                  > +                     8 & 8                           9+              #           @
B              +            (       7AA<

5
I           0
          /0 7J 2 5                 +48 8> +                              !               2                   "           B            !                       0
                                                                                                                                                           # /0 7
5
I     #         7AA?J $ 5                #B               4@             4             $                      ,                   F4$,G
     EE         1      E4$,
5
I                    7AAAJ , 5                    ! +            > 4                  !$B ! ,2
                                                                                      H      +!
+                  +   AA
                    !! U                     !        7AAA            A? 70C

*>2 7AAAJ
I                    1* *>2 *                >            #2                      EE              1       E*>2
* +@ 0
I 2 /0 1J ! "                       5         B           @#                  EE                      E            * +@
                                                                                                                  E 2

*
I          98 #O            7AACJ ' *                     ! 8 #O             "    @O 9>                       4                   2            !"9"
     EE
B
I    O           0J
               /0 0 H B             O      4@@ 7 0 "         3       @#                ,
     EE                                  E    E           E 7
,
I          O         7AA?J          ,         O$ ,                   H'           !           #$ @                @"4;$B !                         @
@#        2+                        !*     @2 8$ 2
                                            >                                 *                                                   $        "               #7AA?
,2     0
I +! /0 / J ,                            2            +#          !                    EE
,2     0
I +! /0 / J ,                            2             +#         !               !* @                                    EE                       E      E       0 =7
                                                                                                                                                                 00

,
I         9>                7AA=J @ ,                 ! >                +                                "        2                                       !
"         !                                       @              %            7AA=
I
(         /0 1J H(
            0                       "    (        @        "             EE           &                       E

(
I                    0J
                   /0 0 H (                  4                   H;              2                        !                   "        #
*               F/    B             G+        !                      #
(
I               7AACJ > (              +,                           ' !            B3                 H        B                        @#           O       2
                     2+                             1       ,*2
                                                            2 @2                        *                          *                2                        @#
1/ :1 3         L             BBB *@ +
                         7AAC 2

H     0
I / /0 1J H              "             #@                       #                  E
                                                                                  E&
H
I       0
      /0 1J H         "       B           @#        @                H             EE    O                                 E&
H
I$8         0   $8
          /0 1J H                      EE           &
I                     0
                    /0 1J                      $                          D /0 :
                                                                              0              EE                                     E                E
I        7AA<J +              !                                 B                                 !                        !            *
!*       1C 77              C
                          70 77:
I # 7AAAJ                    #2                 B                         2                      ,             "                    *        @       #"               4
717 ;                ,            2                 2                    7AAA           EE                                                   EZ       #E                  E

I #         7AAAJ                 #4 (              [           >                5       \        !;                   ,
     4                   2                                           2                                                                                   *
            F           AAG
                      * U                     ?
                                            10 1/0
I                 0
                /0 1J                  ,        +                   EE                            E

8
I                  0
                 /0 1J $ 8                  @ 4             H'                #' '           *$               # (" +
     EE
+     0
I O /0 1J B + O                        2       "                !             8                           "                       0
                                                                                                                                /0 1 % /? +                   /           1A :7

+(+ /0 1J "
I     0                  +(+>              +(+                  EE

+
I           0
          /0 /J           +                        4@@K              EE                      E       /0 /E 7CE
                                                                                                  E E 0 7/E
+#
I           0
          /0 1J +#                     EE               #

4
I         93             7AA<J @ 4                 +3                !             2                  !                !                 B                   *        3H
+         (

@!D /0 1J !
I     0                      @!D           EE                        &
@
I                  0
                 /0 /J        @                 5                   B'                   5 +[                 4            O        ""                            @
                      +           ! 8                   !                                                 7/       !                $                *
]                !            H        #/A ,                         0
                                                                #7 /0 7
@
I           0
          /0 1J ! @                            ! !                       !                        @       2                     ;                ;            #       !
    "+B                  "             #            0
                                                & /0 1
@
I     "           0
                /0 1J @                "       +        8 & B                                +                                               EE
@
I                 0
                /0 1J 5 @                      "        *WW +                                                 EE                                      Z *WW
                                                                                                                                                     E E
@
I       0
      /0 1 J H           @         "               #@                     #               E
                                                                                         E&                        E                E

@
I       0
      /0 1 J H                "       (         +           @                #                E
                                                                                             E&                         & &
                                                                                                                       E/ E
@
I       0
      /0 1 J H                !+2 @                     #                     E
                                                                              E&                  E                E&
@
I        0
       /0 1 J H @         +         "            #@             #                    E
                                                                                    E&                  E           E&
@#
I             0
            /0 1J @#            %       +             EE                E               E 07=

%
I             9*                 0
                               /0 /J        %                  H*               !           5       !               !              @#
                          @         +                 @             B                       '            B                       0
                                                                                                                         F@B'B /0 /G H #
        0
7< 7A /0 / 2           BBB
                    2 #2
I 1* 7AA?J ("           : 0@                                        *               F 1*G               EE      1         "4E
                                                                                                                         E 7AACE4B*
     :0 7AAC0:/:

       0
I 1* /0 1 J B                                        FD    G                            *               F 1*G        EE        1        ED

       0
I 1* /0 1 J "       B            @#                        ,        #FD@ G                              *            F 1*G
     EE       1      @
                    E #ED@
I 1@           0
             /0 1J $"$ "                        EE         1                E       E

I           0
          /0 1J $          4@@ / 0          EE                              E       E
I               0
              /0 /J                     ! 2                             !           @#          H            #9 @             0
                                                                                                                            /0 /
A           User Manual
"                                                       !   !              #
                              #                                                ("       "


        #

L                             #
    !            5


A1 Preparing the Targets
"                                  !    !               #
                          #        2            #       @       17    #             "
                                            #


                      @           17

            8                 ("                    #
             )*+ 4                      #                                       #           #
        OFFLINE_ROOT                    !       5

            ,                     <body>        ("              &    <p>

            *                      ##
            <table>
              <tr>
                <td></td>
              </tr>
            </table>

                                        <td></td>

        <!--agent cache=”” source=””--><!--/agent -->

        L

            <table>
              <tr>
                <td><!--agent cache=”” source=””--><!--/agent --></td>
              </tr>
            </table>



!               ! ;                                                                         7
    3                       #

    B          ;4 http://www.csd.abdn.ac.uk/
    8                                 #               ;4


        )*+ 2                   2         B                           #
                        F         ^       G4              #               .
                                          2               B
    @                       #                                                 index.html

                #           #                                       CACHE_ROOT

    B     CACHE_ROOT/index.html

    L                                         #

    <table>
      <tr>
        <td>
           <!--agent cache=”CACHE_ROOT/index.html”
                     source=”http://www.csd.abdn.ac.uk/”-->
           <!--/agent -->
        </td>
      </tr>
    </table>

        )*+                   #                                                        #
                    "                         #       #
                                          "
                              #                               ... agent --><!--/agent ...

"                                     #               #                   *                # .
          63            #                                      #


A2 Starting the System
    8           @ $8@                 "                         #
               #        cmd                       #                  #
    @     !$B # #
          H
    java jade.Boot –gui




!        ! ;                                                                                     /
      F"         #               !$B
                                 H                      !       57              G

          )*+                #              !$B
                                            H
                     #                          L                               #
            #4               !$B
                             H

      8                  @ $8@
      $                          PROJECT_HOME\run.bat

      !          #                       PROJECT_HOME   F   !        5 # .                  G       #
            #
      java –jar bin\project.jar SYSPROPS_HOME\sysprops.txt

      !              !               5                      SYSPROPS_HOME       F
      PROJECT_HOME                               G

"    #                               #                               OFFLINE_ROOT               #2#
                                  !$B #
                                  H                                     2
                         OFFLINE_ROOT               #       #           !       !       #
                         "                                                  !       !   F       G
!                !$B F
                 H               G




    )*+ "



!          ! ;                                                                                          1
A3 Communicating with Agents
!   !                                                #
#       ;                  #
                  "                                      #       "
                  ,   1:               #
#

            #                  #               !$B 2
                                               H             @       !7   !/
                                   L           !$B
                                               H
            3                  *           7                                   #
!   !




2
                  #
    #

        *       *         7
        *             #
                      "




!           ! ;                                                                :
"       #         F   #G




    4
    @
    !         *
              # minion1
    "
    *

"                     minion1

                      #




!       ! ;                     <
    ,
    "#             D
    <?xml version="1.0" encoding="UTF-8"?>
    <!DOCTYPE commandset SYSTEM "">
    <commandset>
      <command>
        <timer>120</timer>
      </command>
    </commandset>

    !      ;4       $"$                               SYSTEM

    "                       #                $"$     #         L


    <!DOCTYPE commandset SYSTEM "http://www.fx.com/dtd/msg.dtd">

    @              #                                 #
    "




!       ! ;                                                        =
+       #                          #
              #   "

                      "
                               #                 7

                      "

                      5#
                                       #

    *
    *
L

                           *                6L
                                                         #

                           2                         #
                               #                     #

                           ,
                           !$B
                           H
                                           !$B
                                           H




!       ! ;                                                  ?
B       Maintenance Manual
"                                                                !        !       (            #
                                    F    #                            !       !       G
                                                                                                                       &

    )*+ "                                                        D+                   #            !   !                   #
                          D
                        ;32              "                                                                             D+
                    #


B1 Dependencies
@                                                                #                !       !



    •   H       4         B              FH 7 : 7
                                          4BG                      E
                                                                  E&                       &
                                                                                          E/
    •   !$B / = 7
        H                      EE                E       & E&
    •   ("          +     71 F                   !       !       G
    •   $8
        H           5    C F                 !       !       G
    •   (           @      7 /S F                !       !        G

!           # #                          !       !                            #

    •   H       @         $              ' F@$'G : 7
                                                7                         E
                                                                          E&                    &
                                                                                               E/
    •   !           !    7<         EE

            #                                            #                                #                !       !



B2 Installation Instructions
5       #                 #                                                           JADE_HOME                "


        *                                                                                      !
        $
        *                                                                                 "



!           5                                                                                                              7
        ;                            "
        2                                "           # JADE_HOME
        2                                "                             #   !$B
                                                                           H                       C:\JADE

        *                                    #

3      #                                             clarkson_duncan.tar.gz

    )*+ "                                                               JADE_HOME

                     #                   clarkson_duncan.tar.gz             JADE_HOME                    #

;                                                                                O F     EE         O        G
+       !        F      EE                                G                  D
                                                                           ;32

        !                # gunzip clarkson_duncan.tar.gz
       "                                     #                        clarkson_duncan.tar

        3       # tar -xvf clarkson_duncan.tar
       "                                                        project    "                   #     !   !
                                                     PROJECT_HOME

,      ##                        PROJECT_HOME                 "                                #
JADE_HOME                        F                        !       !                            G


B3 Distribution Roadmap
8           O        !       !                   #                    PROJECT_HOME


    Directory                                                 Contents

      bin       *                                    &        project.jar
                |-cache                                                          #       #
                |-logs
     data       |-test
                !                                                     test.xml           $"$
                                                      msg.dtd
     docs       |-api                             &       !+2
      lib       *                                  !4
                                                 F H G        #
      src       *                                                                    #




!           5                                                                                                    /
@                           PROJECT_HOME         "

build.bat               Executable to invoke the Ant build.
build.xml               Ant build file.
README                  Plaintext description of ArchAgent & brief instructions.
run.bat                 ArchAgent executable.
sysprops.txt            System initialisation file.


B4 Code Roadmap
!                                                            !    !    .
PROJECT_HOME\docs\api\index.html

,

project.bootstrap: Encompasses the primary classes used during the bootstrap process.

                        "                                          boot()
Bootable.java
                                                                       #
Crawler.java            "                                                   SSS
HTMLFilter.java         ;                                             ("
Loader.java             "                        #
Recurser.java           8


    project.daemons*: The agents module containing agent code & supporting classes.

    Logger.java     8
    Minion.java     "

S"                      #        &       (




project.parser: Classes to support the parsing process.

Chunk.java                   !                       TargetChunk

TargetChunk.java             4
TargetUpdater.java           ;       #       Minion.java         Recurser.java        #



B5 System Properties
"       #                                            !   !        "               #       H
Properties                           H   / !+2


!           5                                                                                 1
"

TRAVERSAL_METHOD       Specifies whether to use the Recurser or Crawler:
                       Values:
                          online -> Crawler
                         offline -> Recurser
                       NOTE:
                         If online is used the properties ONLINE_ROOT and
                         ONLINE_LOG_PATH must be set. However the Crawler is
                         not functional and should not be used.

OFFLINE_ROOT           Specifies where target documents reside.
                       Values:
                         any valid pathname

OFFLINE_LOG_PATH       Specifies where the Recurser log files will be stored.
                       Values:
                         Any valid pathname

MN_LOG_PATH            Specifies where the Minion log files will be stored.

L                                               #


B6 Environment
              #                                         "

PROJECT_HOME          The root of the ArchAgent installation.
SYSPROPS_HOME         The location of the system properties file sysprops.txt
JADE_HOME             The root of the JADE installation.


B7 Building from Source
"                 &

     $                PROJECT_HOME\build.bat

     !            #              PROJECT_HOME       #   #


     build

+        !                   #        &                 #


B8 Known Bugs
"                        !       !    "
#




!        5                                                                      :
    •   2                                <!--agent

                 #                                   "   #


    •   2                <!--/agent         #
                ("
    •   2                    -       .                       <source…>

        <cache…>                                                     #
        ("           "           #




!           5                                                            <
C       UK Copyright Law
"                                                               ;'
                             #;'       #

"   #                   #

    7               #                                                         #
                                           #                              F       "
                 )
                 G

    /                                                       )

    1                        )

    :
                                                            )

    <                                      #                              )

    =                              #                    #
             #                             #                         #)

    ?                        )

    C

"                       EE                     E   #E




!        * ;' * #
D     Copyright Analysis
"                       #2           "    ( #          #             #
            !   !

Date: Mon, 25 Aug 2003 11:51:26 +0100
From: Thomas Hays <t.e.hays@abdn.ac.uk>
To: dclarkso@csd.abdn.ac.uk
Subject: Re: Intellectual Property

Dear Duncan,

Yours is actually a very interesting question. Generally, speak, objective
facts are not copyright protectable. Copyright protection requires a minimal
degree of originality. Therefore, in most countries (not the Rep. of
Ireland) things like telephone directories are not copyright protectable,
because the information they contain is not original, nor is its arrangement,
having been dictated by the alphabet. However, databases are protected by
copyright. They are protected, not is the sense of the data they contain, but
it how that data is organized. When someone makes a database available to
the public, the public is entitled to access the data, but not to reuse the
database-generated results of access for commercial purposes. Your problem
comes about if your competitor’s price lists could be classified as a part of
a database (most like are a database). You could access the prices in the
data if it is otherwise available to the public, but you would not be
entitled, under the existing law, to reuse those prices for commercial
purposes. This means that you could not display to the public your
competitors prices through your own database or computer related service.
However, what you propose is not to display the competitor's prices to the
public but to use the competitors prices to generate your own prices, such
that public would only see a secondary version of the competitor's price, not
the prices themselves, nor would the public be able to directly relate the
prices you display to their source.

Here is my analysis:
1. You could use such a program for your own purposes, generating your own
prices based on a competitor's prices, for display to the public.
2. You could sell or license such a program to others for the purpose of
generating their own prices based on their competitor's published prices.
3. You could NOT offer a service based on the program to others wherein
you use competing databases to generate price lists for your customers.
4. If you were ever challenged, meaning if someone ever sued you for
copyright infringement in respect of your use of the competing database to
generate prices, you could argue that it is not, under EU law, a part of
the specific subject matter of copyright to impede price comparisons, such
as facilitate competition and the free movement of goods and services.

Please keep in touch with this and let me know how you are getting along
with it.

Tom Hays




!          $ * #    !   #
E     DTD for Agent Message Validation
<?xml version="1.0" encoding="UTF-8"?>
<!ELEMENT commandset (command+)>
<!ELEMENT command (report|state|timer|source+|cache+)>
<!ELEMENT report EMPTY>
<!ATTLIST report history (yes|no) "no">
<!ELEMENT state (#PCDATA)>
<!ELEMENT timer (#PCDATA)>
<!ELEMENT source (#PCDATA)>
<!ATTLIST source chunkID CDATA #REQUIRED>
<!ELEMENT cache (#PCDATA)>
<!ATTLIST cache chunkID CDATA #REQUIRED>




!       B $"$     !           %

								
To top