Advertisement

Advertisement

News, Views and Careers for All of Higher Education

Mixed Grades for Grads and Assessment

In discussions of education policy, and especially of educational failings, it’s common to hear references to “what the business community thinks” or “what employers want.”

It turns out that employers aren’t as frustrated with the skills of new graduates as some politicians and policy makers suggest. In a number of areas, employers appear to think graduates are coming out well positioned. And while employers would love to see better assessment tools used in college (as you may have heard from some critics of higher education), employers seem dubious of multiple choice exams and how colleges compare to one another and much more concerned with being able to get individual analyses of potential employees’ skills.

Those conclusions come from a national survey of employers with at least 25 employees and significant hiring of recent college graduates, released Tuesday by the Association of American Colleges and Universities. Over all, 65 percent of those surveyed believe that new graduates of four-year colleges have most or all of the skills to succeed in entry-level positions, but only 40 percent believe that they have the skills to advance.

In terms of specific skills, the employers didn’t give many A’s or fail many either. The employers were asked to rank new graduates on 12 key areas, and the grads did best in teamwork, ethical judgments and intercultural work, and worst in global knowledge, self-direction and writing.

Employers Ratings of College Graduates Preparedness on 1-10 Scale

Category

Mean Rating

% giving high (8-10) rating

% giving low (1-5) rating

Teamwork

7.0

39%

17%

Ethical judgment

6.9

38%

19%

Intercultural skills

6.9

38%

19%

Social responsibility

6.7

35%

21%

Quantitative reasoning

6.7

32%

23%

Oral communication

6.6

30%

23%

Self-knowledge

6.5

28%

26%

Adaptability

6.3

24%

30%

Critical thinking

6.3

22%

31%

Writing

6.1

26%

37%

Self-direction

5.9

23%

42%

Global knowledge

5.7

18%

46%

To the extent that employers give graduates mixed grades, that raises the question of how they determine who is really prepared. Many of the existing tools appear to be insufficient, the poll found.

Only 13 percent said transcripts were very useful with another 16 percent saying fairly useful, compared to 33 percent who said “not useful.”

What the employers appear to want are intensive, personally evaluated projects, not more testing. Only 7 percent said it would be “very effective” to have the results of multiple choice tests of general knowledge, and there was little interest in tools that would compare on colleges’ graduates to another on critical thinking tests.

In contrast, 46 percent said it would be very effective and 70 percent said it would be very or fairly effective to have students complete an advanced project as seniors, demonstrating knowledge in the major and in problem-solving, writing, and analytic skills. And 69 percent said it would be very effective and 83 percent said it would be very or fairly effective to see an evaluation of a supervised internship where students apply college learning in a “real-world setting.”

The results appear to contradict statements from Education Secretary Margaret Spellings and many politicians that the business community is demanding tools that allow for comparisons of colleges on how they perform in certain areas.

Carol Geary Schneider, president of the AAC&U, said in a press briefing on the data that “there was truth and misunderstanding” in discussions over the last year of what business leaders want. “They do want more transparent forms of assessment,” she said, “but there was an assumption that people want more of the kinds of assessments of the sort that the testing industry provides.”

In fact, what business leaders appear to want is much more individual and less focused on comparing colleges, according to the new poll. Focusing on new multiple choice measures to assess, she said, “is not a good investment.”

Scott Jaschik

Got something to say?


Want it on paper? Print this page.
Know someone who’d be interested? Forward this story.
Want to stay informed? Sign up for free daily news e-mail.

Advertisement

Comments

The basics

Excuse me — nearly 25% were given low scores on “quantitative reasoning.” Given the current U.S. financial SNAFU — could the two be related? As noted in “The Wall Street Journal?”

As for the 37% with low scores in writing — hardly a “mixed” assessment, IMHO. Low is low.

L.L., at 6:25 am EST on January 23, 2008

Politicians and the cabinet secretary want even more multiple choice questions—this after having ruined many elementary schools’ programs with the No Child Left Behind strategy so the schools now are just teaching to the test, like the NY state HS regents. Apparently the politicians want to compare colleges. (Then they could give many dollars to colleges that do well, presumably, and withhold from the losers—imagine the scenario.) This report indicates that businesses prefer to compare individual job candidates, which makes sense, since they are hiring one at a time, not a groups of grads. I am happy that they found a voice to speak for themselves. They may have to shout louder, and many times, to be hear—because people in DC seem to think they know what everyone wants everywhere.

bystander, at 6:45 am EST on January 23, 2008

Projects vs. Testing

Surveys like this can’t tell you much about how students are doing, or compare them to the past at all. Obviously, any employer can set a very high standard and deem graduates inadequate. It all depends on expectations.

The important results of this study are the fact that employers aren’t interested in standardized exit exams or similar simplistic assessment information being pushed now by ACTA. Instead, what employers would like is the work product of students on major products. So why don’t colleges give it to them? I’d love to see colleges strongly encourage seniors to complete a major project as a capstone, and then post the project on the web to allow employers easier access to what students can do.

John K. Wilson, collegefreedom.org, at 8:45 am EST on January 23, 2008

What employers want

Graduates who can read, write and do math accurately. That is what employers want.

Not self-serving polls by special interests with a stake in continued taxpayer funding. Polls conducted by pollsters known by their work for one of two major political parties. As in, “lies, damn lies, and statistics.”

The poll pointedly notes that employers have very little faith in college transcripts.

In other words — real-world unhappiness with employer-verified skill levels of “college graduates” and the veracity of college grades. ENRON never had it so good?

As an employer who deals with academics frequently, I’d like to speak to an applicant’s professors.

One, to verify the information. Two, because faculty are often more frank about students, if there is no “paper trail.”

Also — how an applicant can supposedly have good grades, yet do so poorly in real-world applications (e.g., math, writing).

Buzz, at 9:40 am EST on January 23, 2008

Gee, I wonder if higher ed’s insistence on relegating intro freshman comp courses to low paid, part time adjuncts and teaching assistants may be a reason writing skills are so poor? This demonstrates higher ed’s real commitment to teaching writing.No excuse, no reason, can justify this behavior. It speaks for itself.

Laura, at 9:50 am EST on January 23, 2008

The sub-heading in my email annoucing this story begins, “Survey of employers finds they think new degree holders have basic skills.” That’s a darn rosy interpretation of the “writing” score here. The actual report says, “employers are less convinced of their preparedness in terms of global knowledge, self-direction, and writing.” What skill is more important in many workplaces today than writing?

It is interesting, too, that outcomes broadcast so loudly as aims in higher education—critical thinking, global knowledge, and, again, writing—come out at the bottom.

Mark Bauerlein, at 11:30 am EST on January 23, 2008

There seems to be a real problem with each new class of students concerning writing and critical thinking skills. The have been trained to take multiple choice exams and tothink in a highly structured manner.

gloria schubert, Instructor, at 12:10 pm EST on January 23, 2008

What employers want

Buzz, did you even look at the survey? Employers did not say they wanted grads who can read, write and do math. What they wanted was those with “global knowledge,” “critical thinking,” etc. Finding Pakistan on the map is not “global knowledge.” What they need to understand integrates many of these “skills” such as, what is there about the differences between Shiites and Sunnis that has fostered such division in many Arab countries, and what does this have to do with the political climate in Pakistan? How do you “test” this on a multiple choice test? You need to encourage faculty to focus on issues not “skills.”

In my field, math, I can show you that randomly testing for drug usage can produce up to 30-50% “false positives,” depending on the reliability of the testing and the actual percentage of the population that uses the drugs. (If anyone wants to know how to do the math, I would gladly explain. Just email me.) On the other hand, the more important question is what is the impact of such an analysis. Somehow people still have faith that this procedure would “get the bad guys.”

As long as we “teach to a skills test” we will never succeed in preparing students for the type of thinking that they need to actually improve the quality of life on this planet. We, of course, cannot do stem cell research unless we know how the system works, and those researchers who investigate will most likely understand, but isn’t the more important question for those of us with very limited knowledge of the process still need to recognize the impact of research on our lives and to help make intelligent decisions regarding the pros and cons of such research?

My wife recently died of breast cancer. I support lots of research into finding a “cure” for this miserable disease, but I believe (call it a hunch) that the cure will come at the celluar level. Some brilliant scientist is going to find the “gene” that caused the disease, and he (or someone else equally brilliant) will find a way of sliping in a new gene from some stem cell that will resolve the problem. Does anything I said make sense? Probably not, but what I don’t want is someone who, for some God forsaken reason blocks this research. What I want in classroom across this country is open/clear headed discussions of whether to support such reseach or not. I could care less if the discussants know the difference between miosis and mitosis—although I am not opposed to including such knowledge in the discussions. In other words, I am much more concerned with “how we teach” than “how we test.”

Fred Flener, Retired, at 12:45 pm EST on January 23, 2008

Writing

What no one, in or out of higher ed, ever seems to question is why we expect college to be the place where students learn writing. I agree that college graduates should write well, but why shouldn’t we expect good writing from high school grads? In order to meet the needs of struggling freshmen writers, universities have turned their general education curricula into, as one of my students put it, “12th grade.” If a student knows that what they’re learning in 12th grade (or 8th grade, for that matter) will be repeated in college, why would he or she be motivated to take away anything more than what is needed to pass the course and get into college? Before everyone starts blaming college writing instructors, they should examine how the K-12 system has been extented into colleges. That system’s approach to assessment, I believe, has a tendency to reinforce an “is this going to be on the test” attitude in students, and discourages the necessary practice, process and follow-through needed for students to become good writers.

English prof, at 1:00 pm EST on January 23, 2008

What Employers Really Want

US employers neither recognize nor hire for writing skills. Neither do they hire for quantitative skills, business skills, global awareness, language skills or technical skills. Almost all US business commentary on American students’ command of these skill sets is simply meant to denigrate US students regardless of actual individual performance.

US employers typically do not recognize grades as valid indicators of performance except as means of excluding candidates. Straight As will not exclude a candidate, but neither will high grades guarantee actual consideration. US employers usually do not recognize more than a small handful of colleges and universities (and disturbingly, only about half of the 20 or so most competitive ones). They typically don’t know what standardized test scores mean, and frankly could care less.

Employers usually hire for meaningful experience or cost-effectiveness. Internships and small-business experience typically do not qualify. Increasingly over the past three decades mid-size to large US employers have shied away from training new employees, preferring instead to poach employees from brand-name competitors or outsourcing firms. Small businesses typically lack the resources to train new employees. In addition, what formerly constituted most “new hire” positions in corporate America are those most likely to be offshore-outsourced.

Students’ best bet at this time is to pursue opportunities related to self-employment. Self-employment currently presents the best opportunities to retain learned skills and to benefit from prior investment in those skills. This being the case, there’s really no need to consider what “the business community” thinks of American students’ skills except as barometers of the fortunes of the pro-globalization, pro-immigration, and anti-labor lobbies.

Scrawed, at 1:00 pm EST on January 23, 2008

What AACU trying to say?

First of, I like to thank Scott to bring this report forward.

I suspected that this report is a response to Spellings’ committee. In a way, it did — employers don’t trust standardized test. But it does not respond to the accountability question.

The report showed that employers do want to evaluate the graduates and this is what is important. In what form is really a secondary question.

Of cause, employers can careless about school rankings if they can evaluate graduates. But the measuring of school is actually a call for accountability. This goal can be achieved regardless of the type of evaluation is used. As long as the result is published, students and parents will have the information to pick a school with desired quality(employability) with reasonable price.

There are opportunities for vendors to work with employers to create good evaluation tools. But I do hope US employers aren’t like those described by Scrawed.

Duncan, at 2:10 pm EST on January 23, 2008

As a person who is an organization planner and has written many job descriptions the problem is really quite different. College rewards linear thinking where a good student narrowly concentrates on a single subject to the satisfaction of the professor. Most jobs require multitasking where the employee balances several diverse items at the same time and needs to do a good job on all of them rather than a superb job on one. It’s likely to be impossible to change since the process of becoming a professor requires superb linear thinking and naturally, the professors will be inclined to reward linear thinking. It’s clear to me that the employer will always have to deal with the transition from the linear process to the multitasking one and they need to do it and stop complaining. Colleges will supply smart graduates with the needed skills industry will have to help them adapt to a different environment.

steve, at 2:10 pm EST on January 23, 2008

Employers & Students

We’ve done (NASPAA)several employer survey’s and continually see interest that students be better able to communicate (both oral and written), work with others (teamwork) and take initiative (lead) on the job.

These ’soft skills’ are not yet as prevalent in the classroom. They are also not as easy to teach compared to math, history, science, quantitative, hard skills etc.

Employers create allot of direct and residual demand for educated students so listening to them make good sense.

scott talan, nat. assoc. schools public affairs & administration, at 2:40 pm EST on January 23, 2008

Attention to Detail

Great Article... Besides the knowledge, problem solving skills and team work that most employers look for, I have come to find that the number one common denominator is attention to detail. Having an employee with little to no mistakes from an entry level receptionist to an entry level engineer is key to succeed! Visit Jobosity — The Job Blog — www.jobosity.com-Coach Phil

Coach Phil, at 11:35 am EST on January 30, 2008

Advertisement

 Jobs Related to Mixed Grades for Grads and Assessment

or search for jobs directly.

Department Chairperson, Arts and Philosophy — 349001
Miami Dade College

Job Description: The Department Chairperson provides academic leadership to the Arts and Philosophy Department and serves as ... see job

Associate Dean for Planning
University of Minnesota, Twin Cities

The University of Minnesota is a premier employer and a talent magnet attracting leading faculty and staff from around the ... see job

Chair and Senior Faculty Member
Temple University

Chair and Senior Faculty Member Department of Strategic and Organizational Communication Temple University The School of ... see job

Transfer Advisor
University of Minnesota, Twin Cities

The University of Minnesota is a premier employer and a talent magnet attracting leading faculty and staff from around the ... see job

Director, Center for Sustainable Processes and Practices
Portland State University

Vibrant. Forward-thinking. Sustainable. We’re Portland State University, and we’re hiring. see job

Systemwide Director of Training
Alliant International University

Alliant International University is looking for an Assoc. Provost for Pedagogy/Quality Assurance who will develop & maintain ... see job

Director of Employer Relations
Claremont McKenna College

Director of Employer Relations (M841) Robert Day School of Economics and Finance The Director will be responsible for the ... see job

Faculty, Speech Communication — 020701
Miami Dade College

Job Description: This faculty member teaches Speech courses including Fundamentals of Communication, Public Speaking, and ... see job

E-Learning Platform Administrative Analyst
DeVry Inc.

DeVry Inc. (NYSE: DV) is the parent organization of DeVry University, Advanced Academics, Ross University, Chamberlain ... see job

Dean of Academic Affairs
Hillsborough Community College

Hillsborough Community College is a public, comprehensive multi-campus, state-supported community college located in the ... see job