Re: Program Review and Assessment

From: Charles Dyer (charlesrdyer@clearwire.net)
Date: Mon Jun 25 2007 - 16:03:25 PDT


Hi, Steve:

Among public law libraries, I know of two different activities that have
given some recognition to learning outcomes. A couple of county law
libraries in California have been listening in while the public
libraries they associate with through regional networks have looked at
the management technique called Balanced Scorecard, of which one
component is measuring "outcomes" (Did the reader get the information he
desired?) rather than "outputs" (How have circulation statistics
changed?). I believe the Balanced Scorecard technique could be somewhat
helpful to your situation.

The other activity is really in its nascent stage. The Self Represented
Litigation Network's Research Group is looking into trying to measure
empirical data that would truly be useful in judging how to improve
service to self represented litigants. The group is currently focusing
on compliance, formulating such possible hypotheses as "Does using a law
library during trial prep improve a litigant's compliance with court
orders?" The Research Group chose compliance over other outcomes, such
as litigant satisfaction with the process, in hopes of achieving a
statistically more reliable measure. (So far, litigant satisfaction
seems to be more dependent on whether the judge acted respectfully
toward the litigant than on any rational basis, e.g., got a truly fair
trial.) But even so, using compliance, the numbers of other variables
that have to be reduced out, such as the effect of low income level on
child support, are making the research methodology very complicated.
Added to that are the variables presented by litigants, e.g., for a
variety of personal reasons, the wife failing to notify the court of the
ex-husband's failure to pay, so the compliance stats themselves are suspect.

The second example raises that most problematic matter of empirically
determining larger, more meaningful outcomes. Does a better bar passage
rate or higher starting salary average mean that a law school is
producing "better" lawyers? What are "better" lawyers?

Good luck,

Charles Dyer

Steve Feller wrote:

> Hi,
>
> I have been asked to participate in our University’s efforts to comply
> with the latest regional accreditation standards. As you probably
> know, the trend is away from measuring inputs, moving instead toward
> measuring learning outcomes. The question of educational effectiveness
> is awkward for my library, since our involvement is limited to
> supporting education efforts, rather than providing actual
> instruction. But I know that we provide a significant contribution
> through faculty and student support. I was wondering if anyone out
> there can help me find resources specifically tailored for law
> libraries to demonstrate that contribution, in order to participate
> fully in any educational effectiveness review. I would like to see how
> other law libraries position themselves in terms of program learning
> outcomes, as well as overall law program review.
>
> Thank you,
>
> Steven R. Feller
>
> Law Library Director
>
> J.F.K.U. School of Law
>
> 100 Ellinwood Way
>
> Pleasant Hill, CA 94523
>
> Phone:925-969-3127
>
> Fax:925-969-3121
>
> sfeller@jfku.edu
>

-- 
Charles R. Dyer
Charles R. Dyer Consulting
808 East Maple Street
Bellingham, WA 98225-5225
360-738-6439
fax 360-738-6439 (call first)
mobile 360-483-9446
charlesrdyer@clearwire.net
www.charlesrdyer.com 




This archive was generated by hypermail 2b29 : Wed Nov 14 2007 - 20:46:56 PST