E-Metrics: What you need to know
to get started
Denise M. Davis
Director, Statistics & Surveys
National Commission on Libraries and Information Science (NCLIS)
202-606-9200 ddavis@nclis.gov
Library Assessment and Benchmarking Institute (LAB 2002). September 16, 2002. Monterey, CA
Expectation modification
theory
It is not enough to ask “let’s capture database use information”.
The measures need to be meaningful in order to understanding
how libraries meet the information needs of their users.
Technology is driving what we can and cannot collect.
User demand is driving what we need to collect.
Funders are driving what we must collect.
Library Assessment and Benchmarking Institute (LAB 2002). September 16, 2002. Monterey, CA
Same issues, different formats,
more opportunity for use reporting
The questions library’s need to answer are the same;
what vendors are able to provide has improved
dramatically
– Greater literacy of what data are collectable and what data are
valuable to libraries
– Uniformity in statistics reporting remains a key issue
– National library surveys are beginning to adopt measures and
require reporting
– National and international standards organizations are adopting
electronic measures (ISO and NISO)
Library Assessment and Benchmarking Institute (LAB 2002). September 16, 2002. Monterey, CA
Metrics in Use or Field Testing
ICOLC
NCES State Library Agency Survey,
Federal State Cooperative Survey
(FSCS), Academic Library Survey
ARL
IMLS granted supported network
statistics research (Bertot/McClure)
NISO Z39.7:2002
Library Assessment and Benchmarking Institute (LAB 2002). September 16, 2002. Monterey, CA
Network Statistic and
Location of Collection
NISO Z39.7: 2002
Appendix C - Measuring public library networked services: Preparing your library to collect
network statistics. Table 2. Network Statistics and Collection Issues.
# Public access workstations Branch level
# Public access workstation users Branch level
Maximum speed of public access Internet workstations Branch level
# Full text titles available by subscription System level/vendor
# E-book titles available by subscription System level/vendor
Library Assessment and Benchmarking Institute (LAB 2002). September 16, 2002. Monterey, CA
New Network Statistic and
Location of Collection
# Commercial services sessions (formerly database
sessions) System level/vendor
# OPAC sessions System level/vendor
Menu selections System level
Rejected sessions (turnaways) System level/vendor
OPAC searches System level/vendor
Library collection searches (queries) System level
Commercial services searches (queries) System level/vendor
(formerly database queries)
Library Assessment and Benchmarking Institute (LAB 2002). September 16, 2002. Monterey, CA
New Network Statistic and
Location of Collection
OPAC descriptive records examined System
level/vendor
Library collection descriptive records examined
System level
Commercial services descriptive records examined
(formerly items examined using subscription
services) System level/vendor
Units/records examined System level/vendor
Library collection full-content units examined System
level
Commercial services full-content units examined
System level/vendor
Library Assessment and Benchmarking Institute (LAB 2002). September 16, 2002. Monterey, CA
Additional Network Statistic and
Location of Collection
# Virtual reference transactions Branch or system level
Public service time spent servicing information
technology Branch level
# Virtual visits to networked library resources
System level
Formal user information technology instruction
Branch level
Point-of-Use information technology instruction
Branch level
Library Assessment and Benchmarking Institute (LAB 2002). September 16, 2002. Monterey, CA
National Comprehensive Projects
Developing National Data Collection Models for Library Network
Statistics and Performance Measures. (2000)
Sponsored by the Institute of Museum and Library Services (IMLS).
http://www.ii.fsu.edu/Projects/IMLS/index.html
Statistics and Performance Measures for Public Library
Networked Services (Bertot, McClure, & Ryan, 2001)
Developing a National Data Collection Model for Public Library Network
Statistics and Performance Measures
Broad focus on measuring use, usage, and uses of network-based
resources
Database usage a key component, but focus in areas of Public Access,
Virtual Visits, Electronic Services, and Instruction
Library Assessment and Benchmarking Institute (LAB 2002). September 16, 2002. Monterey, CA
E-Metrics Initiatives 2000
to the Present
Network Performance Measures Focus Group #4, Summary of discussion
and handouts from participants (2002)
http://www.nclis.gov/statsurv/FocusGroup4/FocusGroup4.html
Network Performance Measures Focus Group: Group Discussion #3,
Summary Notes. (2000-2001)
http://www.nclis.gov/statsurv/FINALRPT.NCLIS.vendor.FG.1.11.01.doc
Guidelines For Statistical Measures of Usage of Web-Based Indexed,
Abstracted, and Full Text Resources. (November 1998). International
Coalition Of Library Consortia (ICOLC).
http://www.library.yale.edu/consortia/2001webstats.htm
ARL New Measures Initiative. (2001) Association of Research Libraries
(ARL). http://www.arl.org/stats/newmeas/newmeas.html
Library Assessment and Benchmarking Institute (LAB 2002). September 16, 2002. Monterey, CA
Where to find additional information
NISO Z39.7 Library Statistics Draft Standard for Trial Use
http://www.niso.org/emetrics/
CLIR report on vendor statistics (prepared by Judy Luther). The
white paper is available from
http://www.clir.org/pubs/reports/reports.html
Library Statistics & Measures, compiled by Joe Ryan
http://web.syr.edu/~jryan/infopro/stats.html
State Library Agency Survey Steering Committee adopts core
network performance measures for FY2002 national reporting.
(2001)
http://www.nclis.gov/libraries/lsp/StLArevised2001.html
ISO Standard 2789, Library Statistics
http://www.iso.org/iso/en/ISOOnline.frontpage
Library Assessment and Benchmarking Institute (LAB 2002). September 16, 2002. Monterey, CA
Summary
Library Assessment and Benchmarking Institute (LAB 2002). September 16, 2002. Monterey, CA