emetrics module 1 importance011402 arlmode

Shared by: HC12031016119
Categories
Tags
-
Stats
views:
0
posted:
3/10/2012
language:
pages:
26
Document Sample
scope of work template
							         ARL New Measures Initiative
           The E-Metrics Project



         The Importance of Network
          Measures and Statistics




                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              1
  The ARL New Measures Initiative

1. Service Effectiveness Measures (LibQUAL+)
2. Higher Education Outcomes Research Review
3. Investigation of Cost Drivers (i.e. Technical
   Services)
4. Self-study Program Based on ILL/DD Study
5. E-Metrics (Measures for Electronic Resources)

                    ARL New Measures Initiative
            http://www.arl.org/stats/newmeas/newmeas.html



                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              2
   Working Definition of Networked
             Services

  Those electronic information resources and/or
  services that users access electronically via a
  computer network:
       1. From on-site in the library
       2. Remote to the library – but from a
          campus facility
       3. Remote from the library & campus




                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              3
     Networked Information Resources


      Locally Licensed Databases
      Regional or Statewide Consortia
       Licensed Databases
      Aggregated Databases
      Publishers Databases
      Publicly Available (Web) Resources



                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              4
       Networked Information Services


   Access to text & numerical databases,
    electronic journals, electronic books, listservs,
    e-mail
   Instruction, Training & Workshops
   Reference & Information Services
   Virtual Reference
   Interlibrary Loans, Document Delivery
   IT Infrastructure
   Institutional & Personal Portals


                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              5
    The Changed Library
    Information Environment

                                       information             
                                                               
information
                                     
                                                                  users


              Traditional                       Networked
               Library                           Library
                                                Library
               
               
               
                                                
                                                  



                   users                                    users
                                       information


                      ASSOCIATION
 Association of Research Libraries OF RESEARCH LIBRARIES
                                                 www.arl.org

                                                                            6
           Percentages of Acquisitions Dollars
            Devoted to Electronic Resources
  14.0%                                                                                      13.2%


  12.0%
                                                                                  10.7%

  10.0%                                                                9.1%
                                                           7.9%
  8.0%                                          7.0%
                                   6.4%

  6.0%                  4.7%
            3.6%
  4.0%


  2.0%


  0.0%
          1992-93    1993-94     1994-95     1995-96     1996-97    1997-98     1998-99   1999-2000

                                                Fiscal Year
          1999-2000 several libraries reported over 20% spent for electronic resources.
          Source: ARL Statistics and Supplementary Statistics.

                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                                                                      7
  Comparison of Annual Increases in Electronic Resources &
                Total Materials Expenditures
          ARL Libraries Comparison of Yearly Increases in Electronic Resources and Total Materials
                                      Expenditures Average Counts

    50.0%                         47.5%

    45.0%

    40.0%              37.3%

    35.0%

    30.0%                                                                                   27.1%
                                                          23.2%                   24.8%
    25.0%                                                            22.5%

    20.0%
                                               12.9%
    15.0%
                                       8.5%                   9.2%
    10.0%                                                                 5.5%       6.4%
                           4.3%                    4.2%                                         3.4%
     5.0%

     0.0%
             1992-93   1993-94    1994-95     1995-96     1996-97    1997-98     1998-99    1999-
                                                                                            2000
                          Average Increase in Electronic Resources Expenditures
                          Average Increase in Library Material Expenditures
       446.9% increase in dollars spent for Electronic Resources between 1992 and 2000
       49.4% increase in dollars spent for Total Library Materials between 1992 and 2000
      Source: ARL Statistics and Supplementary Statistics


                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                                                                       8
      Why You Need Networked Data &
                Statistics
                          Funding

   Financial Support
       To justify - make a case for continued
        current support for digital collections
       To make a case for additional support for
        technology & infrastructure




                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              9
      Why You Need Networked Data &
                Statistics
                  Infrastructure
 Better Internal Processes
  To measure & track changes in
    internal processes
  To enable better decision-making in
    allocating & prioritizing resources &
    needs
  To enable assessment of service
    quality in a networked environment

                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              10
      Why You Need Networked Data &
                Statistics

                 For Comparisons

    Institutional Comparisons
        For benchmarking digital services
        To enable competition for resources
         with other departments on campus



                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              11
   Why do You Need Networked Data &
               Statistics
                Vendor Negotiation
      Need for accurate reporting of network
       use
      Need for accurate estimates of per client
       use
      Ability to compare overlapping coverage
      Need the ability to pressure vendors to
       price according to the library’s real need



                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              12
  Does this Describe your Library?


   “We do not currently have this data.”
   “We are seeking ways to find
    measures.”
   “We are looking for formal mechanisms
    for dissemination and evaluation.”
   “We are discussing how to support
    analysis of the data.”
    Source: February 2000 Scottsdale E-Metrics Planning Workshop




                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                                   13
        Changes Needed to Implement the
         E-metrics in Research Libraries


   Need an Organizational Culture Change
      With Focus on Customers
      With Focus on Networked Services
        • Local, State, Consortia, etc.


   Need to Create a Culture of Assessment




                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              14
           Culture of Assessment -
                  definition
   Basic Value - customer & learning focus
   A Culture of Assessment is an organizational
    environment in which
      decisions are based on facts, research and analysis,
       and where
      services are planned and delivered in ways that
      maximize positive outcomes and impacts for library
       clients.
   A Culture of Assessment exists in organizations where
      staff care to know what results they produce and
      how those results relate to customer expectations.
   Organizational mission, values, structures, and systems
    support behavior that is performance and learning
    focused.

                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              15
                 Culture of Assessment
                          We have a GAP




                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              16
                 Bridging the Gap


   Think Systemically (SIPOC)
   Anticipate the Future
   Take Risks – innovate & experiment
   Focus on Customers
   Create & Sustain a Culture of
    Assessment


                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              17
                 Bridging the Gap

   Build Organizational Structures that
    Support Work based on Data & Analysis
    - MIS Resource
   Invest in Staff Resources & Learning
   Invest in IT Infrastructure, Services &
    Support
   Build Collaborative Environments with
    Vendors & Other Libraries

                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              18
          Additional Approaches to
                 Evaluation
   Balanced Scorecard            - http://www.bscol.com/

   LibQual Project -        http://www.arl.org/libqual

   Activity Based Costing -
     http://www.mamag.com/winter01/w01tati.htm
   Learning Outcomes Assessment -
     http://www.arl.org/stats/newmeas/outcomes/heo.html
   Measuring Library Service Quality – ARL Online
    Lyceum - http://www.arl.org/training/quality%5Fold.html
   Measuring Performance of ILL/DD -
     http://www.arl.org/stats/newmeas/ill-dd.html


                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              19
          Projects Related to
               E-Metrics

     EQUINOX Project (EU-UK)
     Publishing and Library Solutions
      Committee (PALS) - (UK)
     International Coalition of Library
      Consortia (ICOLC)
     National Commission of Libraries and
      Information Science (NCLIS)


                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              20
         Projects Related to
              E-Metrics
     Institute of Museum and Library
      Services (IMLS)
     Council on Library and Information
      Resources (CLIR)
     NISO Standard on Library Statistics.
     Round-up of Other E-metrics
      Developments – ARL


                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              21
                   Keep in Mind…

   The Evolving Nature of the IT Environment
   The Evolving Nature of Digital Offerings – New
    Vendor Configurations
   New Partnership Arrangements
   New Collaborative Service Options - influence
    on e-metrics
   New Usage & Payment Models



                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              22
    Forces that Shape the Network Services
      Environment in Research Libraries

                            Internal
      Increasing Demand for Digital Content
      IT Infrastructure – Networked
      Competencies – Expert Staff (HR)
      Accountability – Assessment
      Organizational Structure
      Institutional Mission


                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              23
    Forces that Shape the Network Services
      Environment in Research Libraries

                              External
      Increasing Offering of Digital Content
      Inter-institutional Competition
      Increasing Ability for Library Users to
       Bypass the Library for Scholarly
       Information
      Ever-changing Information
       Technology Environment


                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              24
             Take Action…Now!!!

   PLAN & PRIORITIZE
   You Don’t Have to Collect ALL the
    Measures
   Collect the MOST IMPORTANT Measures
    for Your Library
   EXPERIMENTATION is OK!
   Take ACTION on What You Measure!!!



                     ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
                                                www.arl.org

                                                              25
Developing measures and evaluation techniques
for networked services will take time, effort, and
on-going learning on everyone’s part – but we
must begin now.
                                           (Carla Stoffle,
                                           University of Arizona)

We not only need to measure things in new ways
but we also need to measure new things.
                                        (Sherrie Schmidt, Arizona
                                        State University)




                      ASSOCIATION
 Association of Research Libraries OF RESEARCH LIBRARIES
                                                 www.arl.org

                                                                    26

						
Related docs
Other docs by HC12031016119