Advertisement

News, Views and Careers for All of Higher Education

Bang for Their Bucks

When state legislators and governors gather from around the country, they might be forgiven for thinking that all of those who run state higher education systems come from Lake Wobegon, where all children are above average. For in just about every state — whether generous or frugal on college spending — administrators say that they are making the absolute best possible use of available dollars.

A new system has been developed to see if they really are — and the results are sure to please college officials in some states and upset those in others. The system measures spending that goes into higher education and performance in certain areas, with the idea of seeing which states are getting the most bang for their bucks.

The analysis — developed by the National Center for Higher Education Management Systems — ranks Utah No. 1 for performance relative to funding, followed by Massachusetts, Colorado, California and North Dakota. The bottom five, starting at 50, are: Alaska, Maine, West Virginia, Hawaii and Vermont. (Summaries of the various rankings appear at the bottom of this article.)

A report accompanying the center’s analysis said that the new system might provide perspective to state lawmakers, who don’t know what to make of college leaders who complain about their level of support relative to institutions in other states. Because this analysis is independent, it may have more credibility, the report said. It also said that too much of the lobbying done by public colleges and universities focuses on spending levels compared to other institutions, not the relationship between spending and quality.

“In response to the question of ‘how much funding is needed?’ the typical answer of ‘more’ or ‘as much as our peers’ leaves out all consideration of performance and affordability to students,” the report said.

The center also did separate analyses for public research universities, bachelor’s and master’s institutions, and community colleges — with Colorado, Washington and South Dakota leading the three categories, respectively. The rankings could bolster the assertions of educators in states that did well that they are indeed spending taxpayer funds effectively. But doing well could be a double-edged sword — some of the states with high scores are a bit parsimonious in supporting their colleges, and might be inclined to go right on doing so, knowing that they are getting good results. Of course some of those scoring poorly are also not known for overflowing coffers.

For the overall state rankings, state support covered both appropriations and tuition revenue. Federal research support was excluded based on the view that such funds must be spent on certain areas. Quality measures included such factors as undergraduate enrollment relative to population, undergraduate degrees relative to enrollment, timely graduation rates of traditional age undergraduates, competitive research funds awarded per capita and percentage of total degrees awarded that are doctoral degrees.

An adjustment was also made for cost-of-living differences. Since states that are more expensive to live in require higher faculty salaries, and since faculty salaries are a major component of state budgets, NCHEMS officials said it would have been unfair to do a straight dollar comparison among the states. Separate calculations were made for the sector rankings, but all focused on various graduation rates.

Patrick J. Kelly, a senior associate at NCHEMS and one of the report’s authors, stressed that the project was not designed to say “this system is underfunded or this system is overfunded.” Rather, he said the idea was to make comparative data available so that educators and state officials could examine the details. He said that there are many “red flags” that should be visible in different states, but that every red flag did not indicate a problem.

What is clear, he said, is that “funding alone is not correlated with performance” and that some states are doing much better with limited funds than are other states. Kelly said he was “a little concerned” that parts of the report might be used to justify tight budget for colleges. But he said that he believed many states could use the data to show that they make excellent use of their funds, and deserve more. NCHEMS plans to start publicizing the analysis today.

He also said that the data in the report might be helpful in debates over tuition policy. People who assume a direct correlation between funding and performance would respond to a cut of $1 in state support by adding $1 in tuition revenue, he said. Kelly said that is a “knee jerk” reaction that shouldn’t happen, and he hoped that the report may prompt some people to reconsider how they set tuition.

Kelly acknowledged that there are important measures of institutional quality that could not be measured, and he said this was especially the case at the baccalaureate and community college levels. NCHEMS could not find good measures of support to local communities, he said, so that mission — extremely important to community colleges and regional state colleges — isn’t calculated.

Below are overall rankings and rankings for the three sectors NCHEMS analyzed. Data that were used for the rankings generally come from 2002-3.

Performance of Public Higher Education Relative to Spending

State

Overall

Research Institutions

Bachelor’s and Master’s*

Community Colleges

Alabama

28

38

22

13

Alaska

50

48

47

50

Arizona

9

17

*

17

Arkansas

44

42

27

18

California

4

3

16

3

Colorado

3

1

6

19

Connecticut

22

34

26

46

Delaware

19

18

45

48

Florida

16

12

34

6

Georgia

30

5

33

8

Hawaii

47

49

46

40

Idaho

34

44

41

42

Illinois

14

13

14

9

Indiana

33

33

43

39

Iowa

8

15

2

5

Kansas

18

11

13

10

Kentucky

45

41

36

22

Louisiana

42

25

35

27

Maine

49

45

32

32

Maryland

6

28

21

45

Massachusetts

2

31

10

36

Michigan

29

16

28

30

Minnesota

20

20

9

15

Mississippi

37

30

39

2

Missouri

11

39

18

23

Montana

32

21

40

20

Nebraska

15

10

17

16

Nevada

39

37

*

49

New Hampshire

12

2

7

28

New Jersey

40

6

3

31

New Mexico

35

36

44

43

New York

24

24

8

26

North Carolina

23

40

31

29

North Dakota

5

32

30

14

Ohio

27

22

42

35

Oklahoma

36

19

19

11

Oregon

31

27

37

41

Pennsylvania

26

26

11

47

Rhode Island

7

14

23

44

South Carolina

43

29

12

25

South Dakota

17

35

20

1

Tennessee

38

46

29

38

Texas

25

7

24

21

Utah

1

23

15

7

Vermont

46

50

38

33

Virginia

10

9

4

12

Washington

13

8

1

4

West Virginia

48

43

25

24

Wisconsin

21

4

5

37

Wyoming

41

47

*

34

*Not all states have institutions in this category, although one state — Nevada — that is not evaluated here recently created an institution for this classification.

Scott Jaschik

Got something to say?


Want it on paper? Print this page.
Know someone who’d be interested? Forward this story.
Want to stay informed? Sign up for free daily news e-mail.

Advertisement

Comments

Red Flags?

Scott,Thank you for bringing this study to our attention in a concise manner. It appears that this study is intended to be simultaneously formative and summative, but likely the latter will prevail. It also appears that Kelly might be a bit naive about the the notion that some “red flags” don’t indicate a problem. If it’s a reputable national survey and Trustees or Senators see red flags, at the least it’s an issue. Also, the qualification that some important quality issues could not be measured seems rather problematic—but also prompts us to want to study this in more detail to know what can be learned from these studies. Also, the issue of graduate rates may seem a safe measure, but is rather complex—with contributing factors ranging from the state’s k-12 programs to general family patterns outside the control of the university. However, this data seems to bring another helpful perspective in understanding the “Departure Puzzle” as well as quality. I’d recommend John Braxton’s (at Vandy) book as background for this (Understanding the Student Departure Puzzle). Thanks for the article. JP

Jerry Pattengale, Ass’t VP for Scholarship and Grants at Indiana Wesleyan University, at 7:22 am EST on January 17, 2006

Data presentation problem

These data are so disparate that I question whether they should even be placed in the same table. It’s difficult to explain, e.g., how Maryland scores 6th overall but only 28th/ 21st/45th in the specific rankings:

Maryland 6 (overall) 28 21 45

While the rankings are obviously not simple averages, it seems odd to have a state rank in the top 10 overall but not even make it into the top twenty in any specific program. Somehow, despite no particularly strong areas, Maryland seems to have mastered the Lake Woebegon Effect and managed to have all its schools be above average.

JMG, at 2:28 pm EST on January 17, 2006

parsimonious state legislators and governor

One of the reasons Illinois is ranked in the top 15 is that university faculty have helped subsidize higher education for several years now. No joke. Because of state slashing of higher education funds, my university gave no raises for two of the last four years. The state legislature helped “balance their books” by deciding not to contribute to the state university retirement system for two full years, thus adding to an already multi-billion dollar shortfall in the SURS retirement fund. Whoever labeled this “bang for the buck” didn’t really seem to consider whose buck got banged!! The simple answer: the faculty and then, ultimately, the students.

John V. Knapp, Professor of English at Northern Illinois University, at 10:57 am EST on January 18, 2006

Yes, explanation please

I agree with the comments about the strange, even bizarre nature of these results, especially Utah’s and Washington’s. Rank statistics are of course inherently non-linear and subject to strange twists, but these defy comprehension.

A state which comes out well above average in all three measures, as Washington does, should end up with an especially high overall rank — but instead its overall rank is lower than any of its component ranks.

I am also leery of the underlying rationale, that low costs per unit of “output” are the way to measure performance. If the cost cutting is done at the expense of long-term faculty morale and quality, and herding students into large impersonal classrooms, then the low costs may not turn out to be a bargain in the long run, if educational quality deteriorates.

I would prefer to see a 2-dimensional display, with costs or costs per unit of quality (however they measured it) on one axis, and quality/performance/output on the other. Although states may wish to be in general on the low cost/high quality side of the overall regression line, they should also be making strategic choices about where on that line they ought to be.

mkt, at 10:57 am EST on January 18, 2006

Readers who are confused by the “overall” versus “sector” rankings may be missing a key detail: The “overall” rankings include PRIVATE colleges and universities; the “sector” rankings are only PUBLIC schools. Thus, Massachusetts has an overall #2 (Harvard, MIT, Williams, Amherst etc?) and much lower “sector” scores. From the report: “Private institutions are included in the state-level analyses because in many states they play an important role in meeting the education needs of state residents and they are sometimes thebeneficiaries of state scholarship programs. However, they are excluded from the sector-level.”

Rich L, at 11:32 am EST on January 18, 2006

Interesting study, but as usual the devil’s in the details (check out the full report). On quick review, just a few concerns:

1) If private sector is going to be considered part of a state “system", their results should at least be broken down separately along with the public sector results. 2) The R&D outcome(?) measure seems to carry a huge chunk of the variance in the average index scores. 3) I understand adjusting for cost-of-living, but why also faculty salaries? 3/4 of our operating expenses are sal + benefits. Seems to be that this negates 1 of the basic ways states can effect funding.

I would be very hesitant to draw any conclusions w/o downloading & closely reading the full study.

Steve Cunningham, Instiutional Researcher, at 4:49 pm EST on January 18, 2006

Just a caution about Mr. Kelly’s statement that “funding alone is not correlated with performance”. I think it rash for researchers to make global statements out of hand. I believe Mr. Kelly should have qualified his statement thus: “funding alone is not correlated with OUR MEASURE of performance” The funding to which he refers is part of objective reality (except in KY?), whereas the performance measure is a limited construction that of its nature leaves out many facets of performance, maybe even critical nonmeasureable factors. How about a little humility and tact?

J Pace, Professor at Essex County College, at 9:45 am EST on February 2, 2006

Advertisement

 Jobs Related to Bang for Their Bucks

or search for jobs directly.

Large Animal Surgery Resident
University of Minnesota, Twin Cities

The University of Minnesota is a premier employer and a talent magnet attracting leading faculty and staff from around the ... see job

Assistant, Associate, or Full Professor of Accounting
Georgia Gwinnett College

Georgia Gwinnett College, the 35th member of the University System of Georgia, is a premier 21st century four-year liberal ... see job

Coordinator for Peer Tutoring and Academic Success
Ithaca College

Job Description: The Office of Academic Enrichment Services (AES) is accepting applications for a temporary ... see job

Research Professional I
University of Georgia

Job Summary This individual will work independently and possess demonstrated expertise in these areas. ... see job

Gift Coordinator
College of Notre Dame of Maryland

College of Notre Dame of Maryland is currently seeking a Gift Coordinator to join our advancement services team. The Gift ... see job

Lecturer in Construction Management, One-Year
University of Denver

The Franklin L. Burns School of Real Estate and Construction Management, established in 1938, is one of the oldest programs ... see job

Assistant Professor of Spanish — Modern and Contemporary Spanish Literature and Culture
University of Minnesota, Twin Cities

The University of Minnesota is a premier employer and a talent magnet attracting leading faculty and staff from around the ... see job

Admissions Recruiter, School of Pharmacy
College of Notre Dame of Maryland

College of Notre Dame of Maryland seeks an Admissions Recruiter for the School of Pharmacy. Under the general direction of ... see job

Assistant Professor of Theatre
Valdosta State University

Valdosta State University where tradition and tomorrow come together. see job

Adjunct Faculty, Dept. of Aviation Science (Part-Time)
Bridgewater State College, MA

BSC is one of the largest and most exciting centers for higher education in the commonwealth. Here in our idyllic setting, ... see job