emetrics module 1 importance011402 arlmode
Shared by: HC12031016119
-
Stats
- views:
- 0
- posted:
- 3/10/2012
- language:
- pages:
- 26
Document Sample


ARL New Measures Initiative
The E-Metrics Project
The Importance of Network
Measures and Statistics
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
1
The ARL New Measures Initiative
1. Service Effectiveness Measures (LibQUAL+)
2. Higher Education Outcomes Research Review
3. Investigation of Cost Drivers (i.e. Technical
Services)
4. Self-study Program Based on ILL/DD Study
5. E-Metrics (Measures for Electronic Resources)
ARL New Measures Initiative
http://www.arl.org/stats/newmeas/newmeas.html
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
2
Working Definition of Networked
Services
Those electronic information resources and/or
services that users access electronically via a
computer network:
1. From on-site in the library
2. Remote to the library – but from a
campus facility
3. Remote from the library & campus
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
3
Networked Information Resources
Locally Licensed Databases
Regional or Statewide Consortia
Licensed Databases
Aggregated Databases
Publishers Databases
Publicly Available (Web) Resources
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
4
Networked Information Services
Access to text & numerical databases,
electronic journals, electronic books, listservs,
e-mail
Instruction, Training & Workshops
Reference & Information Services
Virtual Reference
Interlibrary Loans, Document Delivery
IT Infrastructure
Institutional & Personal Portals
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
5
The Changed Library
Information Environment
information
information
users
Traditional Networked
Library Library
Library
users users
information
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
6
Percentages of Acquisitions Dollars
Devoted to Electronic Resources
14.0% 13.2%
12.0%
10.7%
10.0% 9.1%
7.9%
8.0% 7.0%
6.4%
6.0% 4.7%
3.6%
4.0%
2.0%
0.0%
1992-93 1993-94 1994-95 1995-96 1996-97 1997-98 1998-99 1999-2000
Fiscal Year
1999-2000 several libraries reported over 20% spent for electronic resources.
Source: ARL Statistics and Supplementary Statistics.
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
7
Comparison of Annual Increases in Electronic Resources &
Total Materials Expenditures
ARL Libraries Comparison of Yearly Increases in Electronic Resources and Total Materials
Expenditures Average Counts
50.0% 47.5%
45.0%
40.0% 37.3%
35.0%
30.0% 27.1%
23.2% 24.8%
25.0% 22.5%
20.0%
12.9%
15.0%
8.5% 9.2%
10.0% 5.5% 6.4%
4.3% 4.2% 3.4%
5.0%
0.0%
1992-93 1993-94 1994-95 1995-96 1996-97 1997-98 1998-99 1999-
2000
Average Increase in Electronic Resources Expenditures
Average Increase in Library Material Expenditures
446.9% increase in dollars spent for Electronic Resources between 1992 and 2000
49.4% increase in dollars spent for Total Library Materials between 1992 and 2000
Source: ARL Statistics and Supplementary Statistics
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
8
Why You Need Networked Data &
Statistics
Funding
Financial Support
To justify - make a case for continued
current support for digital collections
To make a case for additional support for
technology & infrastructure
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
9
Why You Need Networked Data &
Statistics
Infrastructure
Better Internal Processes
To measure & track changes in
internal processes
To enable better decision-making in
allocating & prioritizing resources &
needs
To enable assessment of service
quality in a networked environment
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
10
Why You Need Networked Data &
Statistics
For Comparisons
Institutional Comparisons
For benchmarking digital services
To enable competition for resources
with other departments on campus
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
11
Why do You Need Networked Data &
Statistics
Vendor Negotiation
Need for accurate reporting of network
use
Need for accurate estimates of per client
use
Ability to compare overlapping coverage
Need the ability to pressure vendors to
price according to the library’s real need
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
12
Does this Describe your Library?
“We do not currently have this data.”
“We are seeking ways to find
measures.”
“We are looking for formal mechanisms
for dissemination and evaluation.”
“We are discussing how to support
analysis of the data.”
Source: February 2000 Scottsdale E-Metrics Planning Workshop
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
13
Changes Needed to Implement the
E-metrics in Research Libraries
Need an Organizational Culture Change
With Focus on Customers
With Focus on Networked Services
• Local, State, Consortia, etc.
Need to Create a Culture of Assessment
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
14
Culture of Assessment -
definition
Basic Value - customer & learning focus
A Culture of Assessment is an organizational
environment in which
decisions are based on facts, research and analysis,
and where
services are planned and delivered in ways that
maximize positive outcomes and impacts for library
clients.
A Culture of Assessment exists in organizations where
staff care to know what results they produce and
how those results relate to customer expectations.
Organizational mission, values, structures, and systems
support behavior that is performance and learning
focused.
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
15
Culture of Assessment
We have a GAP
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
16
Bridging the Gap
Think Systemically (SIPOC)
Anticipate the Future
Take Risks – innovate & experiment
Focus on Customers
Create & Sustain a Culture of
Assessment
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
17
Bridging the Gap
Build Organizational Structures that
Support Work based on Data & Analysis
- MIS Resource
Invest in Staff Resources & Learning
Invest in IT Infrastructure, Services &
Support
Build Collaborative Environments with
Vendors & Other Libraries
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
18
Additional Approaches to
Evaluation
Balanced Scorecard - http://www.bscol.com/
LibQual Project - http://www.arl.org/libqual
Activity Based Costing -
http://www.mamag.com/winter01/w01tati.htm
Learning Outcomes Assessment -
http://www.arl.org/stats/newmeas/outcomes/heo.html
Measuring Library Service Quality – ARL Online
Lyceum - http://www.arl.org/training/quality%5Fold.html
Measuring Performance of ILL/DD -
http://www.arl.org/stats/newmeas/ill-dd.html
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
19
Projects Related to
E-Metrics
EQUINOX Project (EU-UK)
Publishing and Library Solutions
Committee (PALS) - (UK)
International Coalition of Library
Consortia (ICOLC)
National Commission of Libraries and
Information Science (NCLIS)
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
20
Projects Related to
E-Metrics
Institute of Museum and Library
Services (IMLS)
Council on Library and Information
Resources (CLIR)
NISO Standard on Library Statistics.
Round-up of Other E-metrics
Developments – ARL
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
21
Keep in Mind…
The Evolving Nature of the IT Environment
The Evolving Nature of Digital Offerings – New
Vendor Configurations
New Partnership Arrangements
New Collaborative Service Options - influence
on e-metrics
New Usage & Payment Models
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
22
Forces that Shape the Network Services
Environment in Research Libraries
Internal
Increasing Demand for Digital Content
IT Infrastructure – Networked
Competencies – Expert Staff (HR)
Accountability – Assessment
Organizational Structure
Institutional Mission
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
23
Forces that Shape the Network Services
Environment in Research Libraries
External
Increasing Offering of Digital Content
Inter-institutional Competition
Increasing Ability for Library Users to
Bypass the Library for Scholarly
Information
Ever-changing Information
Technology Environment
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
24
Take Action…Now!!!
PLAN & PRIORITIZE
You Don’t Have to Collect ALL the
Measures
Collect the MOST IMPORTANT Measures
for Your Library
EXPERIMENTATION is OK!
Take ACTION on What You Measure!!!
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
25
Developing measures and evaluation techniques
for networked services will take time, effort, and
on-going learning on everyone’s part – but we
must begin now.
(Carla Stoffle,
University of Arizona)
We not only need to measure things in new ways
but we also need to measure new things.
(Sherrie Schmidt, Arizona
State University)
ASSOCIATION
Association of Research Libraries OF RESEARCH LIBRARIES
www.arl.org
26
Related docs
Other docs by HC12031016119
Barnet skal have s� meget tryghed som muligt ogs� hvis det i en periode har brug for
Views: 18 | Downloads: 0
Get documents about "