Docstoc

2 Solution Proposal

Document Sample
2 Solution Proposal Powered By Docstoc
					      Solution Proposal




Auscope Virtual Core Library




                 Greg Tom



               Version:<0.1>

             I2 December 2008

   TRIM Container Reference – <###/#####>
                                      Solution DesignProposal
                                     Auscope Virtual Core Library


Change History
Draft = 0.# (Draft documents under review)            Final = 1.# (Project Board approved deliverable)

 Version            Author(s)                                 Comments                           Date

0.1

0.2

0.3

1.0        Greg Tom                                                                           3/12/08




Document Owner
       Name               Organisation                Phone                       Email

Greg Tom              Data Mgt ICT             02 6391 3416        greg.tom@dpi.nsw.gov.au




Version:<0.1>                                                                     Print Date: 12/02/2013
File Name: 7672b1d5-C931-4376-A7aa-C2ebbc5d3e67.Doc                                              Page 2
                                                       Solution DesignProposal
                                                      Auscope Virtual Core Library




Table of Contents
1         Introduction ....................................................................................................................... 4
          1.1        Purpose of this document ......................................................................................... 4
          1.2        Background / Overview ............................................................................................ 4
          1.3        Broad ICT Requirements.......................................................................................... 4
                     Data backup ............................................................................................................................. 4
                     Data Access for Analysis ....................................................................................................... 5
                     Equipment Requirements ...................................................................................................... 5

2         Solution Proposal .............................................................................................................. 6
                     1. Setup Facility to Backup level 0 Log Files ....................................................................... 6
                     2. Setup of Facility to Backup level 1 Compressed Log Files ............................................ 7
                     3. Setup facility to Load Level 1 Log Files to an Oracle Management Database ............. 8
                     4. Setup Facility to Enable Analysis of Drill Core Information from Oracle Database .... 9

3 Next Steps ................................................................................................................................ 10




 Version:<0.1>                                                                                                                 Print Date: 12/02/2013
 File Name: 7672b1d5-C931-4376-A7aa-C2ebbc5d3e67.Doc                                                                                                Page 3
                                    Solution DesignProposal
                                   Auscope Virtual Core Library



1       Introduction

1.1     Purpose of this document
        The purpose of this document is to propose an ICT architecture that will support the
        Auscope Virtual Core Library, the details of which are recorded on Service Request
        16096, recorded in Trim File INT08/66400.


1.2     Background / Overview
        In June 2008 NSW DPI signed a collaborative agreement with Commonwealth, State and
        Territory Governments and Auscope Ltd to participate in a National Virtual Core Library
        project. The project aims to create, over a 3 years period, a national library of all
        significant drill cores by spectrally analysing drill cores across Australia and storing the
        results in database systems maintained by each jurisdiction. Information from the
        database systems would then be available to both internal and external parties. It is
        hoped that the information will foster greater mineral exploration and resulting increased
        revenues for Government.
        A spectral scanning Hylogger system for the scanning of drill cores will initially be installed
        at Londonderry in a specially designed movable building. The building may be moved to
        Broken Hill in the future if needed.
        Full time staff will be engaged to run the Hylogger. It is planned to scan drill cores on
        Mondays to Wednesdays with analysis work taking place on Thursdays and Fridays.
        Graham Butt, Manager Geoscience Information from Minerals Geological Survey Branch
        has requested ICT assistance in implementing appropriate data management solutions for
        the data collected as part of this project.




1.3     Broad ICT Requirements
Data Backup
        The Hylogger, when fully operational can produce up to 10.5gb of log files a day, or
        31.5gb of log files over a 3 day operational week. As these log files (known as level 0) are
        the basic data from which all analysis takes place it is essential that they be backed up.
        The CSIRO has suggested that these log files be kept permanently as they may be
        required in the future if more advanced software to analyse their contents is developed.
        The plan is to move the level 0 log files off the Hylogger machine every Thursday and load
        them to the Londonderry file server. Specialist software (TSG), running on a local PC, will
        then compress the files to around 4.5gb (known as level 1). Given the specialist nature of
        the Hylogger machine and the software it runs the preference is not to have the machine
        linked to the DPI network. Therefore it has been decided to move level 0 log files off the
        Hylogger and load them to the Londonderry file server using portable hard drives.



Version:<0.1>                                                                     Print Date: 12/02/2013
File Name: 7672b1d5-C931-4376-A7aa-C2ebbc5d3e67.Doc                                              Page 4
                                    Solution DesignProposal
                                   Auscope Virtual Core Library

        Level 1 log files, which will be used for analysis purposes, will then be moved to an Oracle
        database at Maitland via an overnight process for which there should be adequate
        network bandwidth.
        Currently Robocopy is used to move files requiring backup from Londonderry to Maitland
        overnight via the current 2mb link. Given the size of the log files it is not possible to move
        such large files with this method on a 2mb link. Enquiries have revealed that it would cost
        $25,000 to setup a 10mb link between Londonderry and Maitland and an additional
        $25,000 per annum in line charges. This cost is seen as excessive. Therefore a solution
        utilising a single tape drive, attached to the Londonderry file server is proposed. David
        Truong has advised that such a unit can be purchased for under $4,000. David’s team
        could setup the backup system, train user in backup operations, write backup scripts,
        including file server data clean up processes, and setup appropriate offsite secure long
        term tape storage.

Data Access for Analysis
        The CSIRO had proposed loading a software product called TSG on the desktop
        computers of staff who would be analysing drill core data. The user would then select a
        core to analyse from the Oracle database in Maitland, the data would be retrieved,
        converted to the level 1 log file format and then analysed. The problem with the CSIRO
        approach is that the average drill core data is about 1.5gb and too large to be transmitted
        across the DPI network during normal business hours. After much discussion it has been
        agreed by all parties that we should consider loading the TSG software onto the Maitland
        Citrix infrastructure and undertake all core analysis using Citrix. Agreement has been
        reached to test the performance of the TSG software over Citrix, and if acceptable a multi
        user licencing agreement for the use of the TSG software over Citrix will be developed by
        the CSIRO.



Equipment Requirements


        The following equipment may need to be purchased as part of the project. It is assumed
        that the cost of this equipment will be met by the Project.


        Tape Drive:                                   $4,000
        Tapes                                         $1,000 (20 tapes @ 500gb est.)
        Standalone Citrix Server (if required)        $6,000
        Oracle Database Disk Storage (500Tb)          $5,000




Version:<0.1>                                                                     Print Date: 12/02/2013
File Name: 7672b1d5-C931-4376-A7aa-C2ebbc5d3e67.Doc                                              Page 5
                                                 Solution DesignProposal
                                                Auscope Virtual Core Library



2        Solution Proposal
The proposed solution has 4 key elements that should meet the needs of data backup and
recovery and data access for analysis:


         Setup facility to backup level 0 log files
         Setup facility to backup Level 1 compressed log files
         Setup facility to load level 1 compressed log files to an Oracle management database
         Setup facility to enable analysis of drill core information stored in the Oracle database
         A summary of each element is detailed below, along with details of key tasks and any
         assumptions made. More detailed analysis may be required when the actual solution is
         implemented.


    1. Setup Facility to Backup level 0 Log Files


                                                                                  Key Tasks
        Hylogger               Hylogger Workstation
                                                                                  1. Purchase External USB drive
                                                                                     (Geological Survey)
                                                                                  2. Setup file server storage for level 0 log files
                                                                                     (ICT)
                                                      `                           3. Train staff in process for loading log files to file
                                                                                     server
                                                                                     (ICT)
                                                                                  4. Fund purchase of Tape Drive
                                                                                     (Geological Survey)
                                                                                  5. Install and configure tape drive and setup
                                                                                     backup schedule
                                                  External       Periodic Data
                                                 USB Drive       Transfer Level      (ICT)
       Demountable Transportable                   250gb         0 log files      6. Train staff on tape backup processes
       Building – Londonderry Site                                                   (including labelling, storage, tape recovery and
                                                                                     tape recycling) and workflows to support the
                                                                                     process
                                                                                     (ICT)
           Local File Server
                                                                                  Assumptions
                     Files stored on network Drive
                                                                                  1. 100gb space available on Londonderry file
                                                             `                       server for storage of log files
                                                                                  2. Geological Survey will develop appropriate
                                                                                     SOP’s for Hylogger operations
                  Scheduled                  Operator Workstation
                  backup to
                    Tape                                                          Timings

                                                                                  This work could not commence till after the
                                                                                  Hylogger has been installed. At this stage the
                                                                                  installation date is some time in February 2009.
        Single Tape Drive            Londonderry DPI Office



 Version:<0.1>                                                                                                 Print Date: 12/02/2013
 File Name: 7672b1d5-C931-4376-A7aa-C2ebbc5d3e67.Doc                                                                             Page 6
                                           Solution DesignProposal
                                          Auscope Virtual Core Library




2. Setup of Facility to Backup level 1 Compressed Log Files



                                                                   Key Tasks
                                          TSG Analysis
                                            Software               1. Arrange licencing for TSG software
                                            (creates
                     `                    compressed                  (Geological Survey)
                                           Level 1 Log             2. Install and configure TSG software on operator
                                              files                   workstation and setup application connections
                                                                      to network file server.
       Operator Workstation
                                                                      (ICT)
                                   Files stored on network Drive   3. Test TSG software to ensure acceptable
                                         (4.5Gb per week)
                                                                      performance with data on file server
                                                                      (ICT)
                                                                   4. Setup Level 1 log file backup and file system
                                                                      cleanup schedule
                                                                      (ICT)
                              Scheduled
                              backup to                            Assumptions
        Single Tape Drive
                                Tape
                                          Local File Server        1. TSG application can run effectively with data
      Londonderry DPI Office                                          files on a network file server
                                                                   2. There is sufficient internal office bandwidth to
                                                                       enable the TSG software to operate
                                                                       effectively


                                                                   Timings

                                                                   This work could not commence till after the
                                                                   Hylogger has been installed. At this stage the
                                                                   installation date is some time in February 2009.




 Version:<0.1>                                                                                 Print Date: 12/02/2013
 File Name: 7672b1d5-C931-4376-A7aa-C2ebbc5d3e67.Doc                                                           Page 7
                                                 Solution DesignProposal
                                                Auscope Virtual Core Library




3. Setup facility to Load Level 1 Log Files to an Oracle Management Database

                                                                        Key Tasks
                                     TSG Analysis
                                         Software
                                                                        1. Install and configure Oracle Core Library
                                          (moves
                   `                compressed log                         database
                                     files to Oracle                       (CSIRO, ICT)
                                       database at                      2. Configure TSG software to run the database
                                         Maitland
                                                                           upload processes out of normal business
    Operator Workstation
                                                                           hours at a time that does not interfere with
                                                                           normal system backup processes
                                                                           (ICT)
                                                                        2. Setup scheduled nightly backup of Oracle
                         Files stored on network Drive
                                                                           database
                                                                           (ICT)

     Local File Server
                                                    ETL process to      Assumptions
                                                  transform log files
                                                 to database format     1. TSG application can push up to 1.5gb of data
                                                  (4.5Gb per week)
   Londonderry DPI Office                                                  to Maitland across the 2mb link outside normal
                                                                           office hours


                                                                        Timings

                                                                        This work could not commence till after the
                                                                        Hylogger has been installed and the log backup
                                      Oracle Core
                                        Library
                                                                        processes implemented.
      SAN Storage                      Database
    (400Gb required)


                               Scheduled
                               backup to
                                 Tape



    Maitland Office




Version:<0.1>                                                                                      Print Date: 12/02/2013
File Name: 7672b1d5-C931-4376-A7aa-C2ebbc5d3e67.Doc                                                               Page 8
                                             Solution DesignProposal
                                            Auscope Virtual Core Library




4. Setup Facility to Enable Analysis of Drill Core Information from Oracle Database

                                                          Key Tasks

                      Oracle Core                         1. Ensure multi user licence agreements for the
                        Library                              use of the TSG software are in place
                       Database
                                                             (Geological Survey)
                                                          2. Install and configure TSG detailed and simple
                                                             analysis software on Maitland Citrix servers
                                                             (ICT)
                                                          3. Setup connections from TSG to the Oracle
                                                             database
                                                             (ICT)
                                                          4. Install Citrix client on relevant user PCs
                                                             database
      TSG Software for           TSG Software for            (ICT)
       Simple Analysis           Detailed Analysis        5. Test TSG application performance on current
                                                              Maitland Citrix environment
                                                             (ICT, Geological Survey)
                                                          6. Setup relevant Citrix user groups
   Citrix Server                                             (ICT)

                                                          Assumptions
   Maitland Office
                                                          1. Current Maitland Citrix infrastructure can run
                                                             the TSG Software. (If not a dedicated Citrix
                                                             server may be needed @ $6,000)
                                                          2. Full application disaster failover to Orange is
                                                             not required if we lose a Maitland Citrix server
                                                             or Oracle database for any period.

                                    `                     Timings

                                                          This work could not commence till after the
                     User Workstation                     Hylogger has been installed and the log backup
                   (potentially anywhere)                 processes implemented and some data in the
                                                          TSG database system.




 Version:<0.1>                                                                              Print Date: 12/02/2013
 File Name: 7672b1d5-C931-4376-A7aa-C2ebbc5d3e67.Doc                                                       Page 9
                                    Solution DesignProposal
                                   Auscope Virtual Core Library



3 Next Steps
        From analysis to date on the size of the task the creation of an ICT project is not
        warranted. However as the work does require interaction between a number of ICT
        Sections it does warrant the creation of a work package, with an appropriate schedule run
        through the normal RFC process appears warranted.
        Given that the major tasks, of establishing a backup process and a Citrix infrastructure,
        would be the responsibility of the LAN technology Section it is recommended that the LAN
        Technology Manager, David Truong, be appointed to manage this package of work.
        The work will require:

               the establishment of the required infrastructure

               engagement of other Section staff, where required, to assist in system testing

               relevant documentation, including configuration information

               development of any required Customer Service procedures and the end to end
                testing.




Version:<0.1>                                                                  Print Date: 12/02/2013
File Name: 7672b1d5-C931-4376-A7aa-C2ebbc5d3e67.Doc                                         Page 10
                                    Solution DesignProposal
                                   Auscope Virtual Core Library




Version:<0.1>                                                     Print Date: 12/02/2013
File Name: 7672b1d5-C931-4376-A7aa-C2ebbc5d3e67.Doc                            Page 11

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:2
posted:2/12/2013
language:English
pages:11