Jefferson Policy Journal

The General Assembly enacted the 2005 Restructuring Act with the idea of holding public universities accountable to a set of performance metrics. Many measures have fallen by the wayside.
This is the third of four articles exploring higher-education accountability in Virginia since enactment of the 2005 “Restructuring Higher Education Financial and Administrative Services Act.”
Upon becoming governor in 2002, Mark Warner made higher education a top priority. An entrepreneur who had made his fortune in cell phones, he saw Virginia’s colleges and universities as vital institutions for preparing a technology-ready workforce and for creating R&D-based innovation centers. He arranged a $900 million state-backed bond initiative to pay for a college building program, and he pushed through a tax increase to offset the spending cuts he’d enacted previously to balance a recession-hammered budget.
Warner paid keen attention to higher ed issues. In 2003 Virginia became one of five states to join the National Collaborative for Postsecondary Education Policy. The ensuing discussions brought another priority to the fore — the gap in access to higher education experienced by different races and ethnic groups. African-Americans and Hispanics lagged the population in college attendance, and given the increasing proportion of minorities in the college-bound population, lawmakers worried that the disparity in access could get even worse.
At the same time, Virginia’s public universities had their own agendas, which entailed winning more freedom from regulation and less state meddling with tuition. In 2005, Warner and the higher-ed establishment struck a grand bargain enshrined in the “2005 Restructuring Act” — universities would get more autonomy, and Warner would get more accountability.
“Restructuring was a historic effort by the Commonwealth to establish a new relationship that would both help to ensure the viability and the effectiveness of public higher education for the citizens of the Commonwealth,” says Peter Blake, director of the State Council of Higher Education for Virginia (SCHEV).
The legislation enshrined eleven goals, to which a twelfth was added after the 2007 Virginia Tech massacre. Public institutions would:

1. Ensure access to higher education, including meeting enrollment demand.
2. Ensure affordability, regardless of income.
3. Provide a broad range of academic programs.
4. Maintain high academic standards.
5. Improve student retention and progress toward timely graduation.
6. Develop uniform articulation agreements with community colleges.
7. Stimulate economic development.
8. Increase externally funded research and improve technology transfer.
9. Work actively with K-12 to improve student achievement.
10. Prepare a six-year financial plan.
11. Meet financial and administrative management standards.
12. Ensure the safety and security of students on college campuses.

The 2005 Restructuring Act put the Governor and Secretary of Finance in charge of developing financial and administrative measures, and tasked SCHEV with devising and tracking metrics for the other goals. SCHEV would publish an “Assessment of Institutional Performance” every year that ascertained whether or not institutions met the goals. Falling short would jeopardize a college’s access to revenue sources estimated in 2008 to be worth about $60 million across Virginia’s higher-ed system. (The incentives have declined to less than $20 million in recent years.)
After the law passed, the state began diligently devising metrics and compiling data, some of which SCHEV had been collecting already, and Virginia’s public colleges and universities incorporated the state goals into their own planning processes. Several years later, the 2011 “Preparing for the Top Jobs of the 21 Century” act, modified the goals, establishing an objective of increasing the number of degrees awarded by 100,000 over 15 years. Top Jobs put an emphasis on STEM (Science, Technology, Engineering and Math) and health disciplines.
We saw in Part II of this series that the 2005 Restructuring Act has brought some tangible financial benefits to Virginia’s colleges and universities. In exchange, the state expected to hold them accountable for achieving the 12 state goals. How did those goals translate into metrics? How carefully did the state keep track of those metrics? And what happened if and when institutions fell short?
While outside observers hoped that the new covenant between the Commonwealth and its higher-ed system might provide a new model for the nation, administering the 2005 Restructuring Act proved more difficult than anyone anticipated. The accountability-by-metrics piece bogged down in a legislative-bureaucratic morass.
SCHEV and the Secretariat of Finance still monitor student enrollment and degrees granted, and they track an array of financial and administrative measures for the institutions that have signed Level II and Level III autonomy agreements. SCHEV compiles these limited metrics in biennial performance reviews for each institution. Further, SCHEV maintains a rich database of higher-education statistics, much of which is relevant to the 12 state goals, and it publishes metrics for a strategic plan, the Virginia Plan for Higher Education.
But changes implemented over the years have undercut accountability. Hewing to directives from governors and the General Assembly, SCHEV no longer sets benchmarks or monitors metrics for all 12 state goals at each college and university. If institutions fall short of metrics that SCHEV does track, they suffer no public rebuke. Most significantly, while Virginia’s higher-ed system continues to meet some state goals, the apparatus put into place by the 2005 Restructuring Act has proven unable to rein in tuition cost increases or prevent a crisis of middle-class affordability.
The JLARC report. Since enactment of the Restructuring Act  in 2005, the Joint Legislative Audit and Review Commission (JLARC) is the only state entity to have taken a comprehensive look at the accountability question. In 2008 the law was still fresh in the minds of lawmakers and administrators, stakeholders were taking it seriously, and progress was being made in implementing it. The 2008 review of Level III institutions (those with the most autonomy) found that SCHEV had devised “fully developed performance measures” for seven of its goals but not for the others.
The most detailed accounting came from the secretariats of Finance and Administration, which devised 17 metrics showing compliance with state financial and administrative standards. Some metrics were simple. Did an institution have an unqualified opinion from the auditor? Did it have a AA- bond rating? Did it comply with Small Women and Minority (SWAM) procurement guidelines?
Other metrics required data collection and analysis. Was voluntary employee turnover comparable to that of state employees? Was an institution using the state’s Internet-based procurement system for at least 80% of its purchases? Did an institution pay competitive rates for leased office space? Did it limit project change orders to 2% of the guaranteed price?
While the JLARC was generally positive about the progress made in implementing the 2005 Restructuring Act, the report acknowledged that considerable work remained to be done. One of JLARC’s recommendations would prove prophetic:

The oversight process needs improvement to address concerns quickly and ensure the transfer of institutional memory between gubernatorial administrations. A restructuring advisory committee or an expanded leadership role for [SCHEV] could improve the oversight process.

That recommendation was never acted upon. No advisory committee was formed. The General Assembly never gave SCHEV more resources. But administrations did change.
Complications and delays. When SCHEV embarked upon the task of developing metrics and benchmarks for the state goals, complications quickly arose. Initially, staff thought to set up standardized goals that applied to everyone, recalls Jim Alessio, who worked eight years as SCHEV’s in-house “Restructuring Act” expert. But it quickly became apparent that setting identical goals would be unfair to certain institutions.
For example, says Alessio, the University of Virginia had a six-year graduation rate exceeding 90%. Norfolk State University’s graduation rate hovered around 30%. The two universities had radically different student bodies and widely disparate resources. UVa’s graduation rate was so high, it was almost impossible to improve; if it fell a percentage point, it was still a stellar performer. By contrast, NSU needed dramatic gains in student retention. Accordingly, SCHEV began negotiating goals with each institution.
Other problems arose from the built-in time lags involved with selecting metrics, establishing benchmarks, and then measuring against the benchmarks. The Restructuring Act went into effect in July 2005. It took a year for SCHEV to develop and approve base-line metrics. But because the 2006-2007 academic year had already begun by then, it it did not seem appropriate to develop challenging targets that year.
By then, Tim Kaine was governor, says Alessio. The new team knew little about the Restructuring Act. A key provision of the law needed to be ironed out to allow universities to apply for Level II status and gain more autonomy for IT, capital projects and procurement. Amid the administration’s other priorities, that task fell between the cracks for two years, says Alessio. Consequently, institutions could not apply for Level II status those two years, as the legislation had allowed.
Meanwhile, SCHEV was trying to apply the metrics that people could agree upon. The first year, the Council set easy goals on the grounds that everyone was still getting familiar with the process. “The first year was more of a run-through,” says Alessio. Every institution passed.
In 2008, SCHEV tightened the standards. Four institutions — Longwood University, Virginia Commonwealth University, Virginia State University, and the University of Virginia at Wise — failed one or more of the measures. Alessio took the data to the Council, and heated discussions ensued. Some members were reluctant to sanction the colleges: Withdrawing resources would only make their job harder.
Institutions began arguing that they couldn’t meet the goal because of factors beyond their control. When the Council gave special dispensation to one college, that made it harder to refuse to cutting another institution slack. For instance, says Alessio, one university missed its enrollment target because a key manager had suffered a series of personal crises. The institution’s local delegate successfully pleaded its case to SCHEV. The other legislators began standing up for their institutions as a constituent service.
Instead of taking a hard-line approach, SCHEV began requiring institutions to submit improvement plans for measures in which they had fallen short. SCHEV contends that the approach has worked out well.
Top Jobs. By 2011 the business community had developed a consensus that the state needed to make a sustained investment in the higher-ed system. Governor Bob McDonnell established a Governor’s Commission on Higher Education Reform, Innovation and Investment and loaded it with prominent business leaders, educators and elected officials.
The commission’s report, “Preparing Virginia for the Top Jobs of the 21st Century,” enumerated new higher-ed goals that would be incorporated into the so-called “Top Jobs Act” of 2011. The new law set a goal of having Virginia’s public colleges and universities confer an additional 100,000 degrees over the next fifteen years. Special attention would be given to high-demand, high-earning disciplines such as STEM (science, technology, engineering and mathematics) and healthcare.
While signing on to the STEM priority, the McDonnell administration had very different ideas about how to hold state colleges accountable — and they did not involve SCHEV.
G. Gilmer Minor III, the soon-to-retire SCHEV chair, was appointed to the council in 2009, just before Governor Bob McDonnell took office. The Council’s survival was precarious. “Literally, the Secretary of the Commonwealth said, ‘We’re appointing you to SCHEV but we can’t promise it’s going to survive,” Minor recalls.
Having served as chair of the Virginia Military Institute board, Minor knew first-hand the low regard SCHEV was held in at that time. A series of executive directors had served short terms, he says, and the Council was perceived as adversarial. It had lost the confidence of the universities and policy makers. “At VMI,” he says, “SCHEV was not the partner, it was almost the enemy.”
There was a strong sentiment in Republican circles for shrinking state government, and the unpopular SCHEV looked expendable. But the state couldn’t just cut the colleges loose. The only alternative was centralizing authority with a board of regents, and that wasn’t palatable either. At the end of the day, says Minor, “McDonnell said, ‘let’s make a more effective SCHEV.’”
In time, SCHEV’s status as a state agency did stabilize, and the agency regained credibility with lawmakers. While the administration was thinking through SCHEV’s future and establishing its own educational priorities, however, it put the original 2005 Restructuring Act metrics “on hold” for two years, says Alessio. Legislators retained the 12 higher-ed goals articulated back in the Warner administration, but they pared the number of academic-related measures in half.
For purposes of compiling the Assessments of Institutional Performance, SCHEV then began tracking performance against only six goals for each college and university, the first five of which applied to in-state students:

• Undergraduate enrollment
• Associate and bachelor degrees awarded
• STEM-H degrees awarded
• Upper-level, program-placed FTE students
• Two-year transfers to four-year institutions
• Degrees awarded to under-represented populations

SCHEV had to establish new base-lines, and then wait another year to gather data to compare. Alessio departed SCHEV in 2013 just as the organization was beginning to evaluate the data. In 2014, nine years after the enactment of the 2005 Restructuring Act, SCHEV finally published its first Biennial Assessment of Institutional Performance. The Council published its second assessment in 2016.
The missing metric. The second goal listed in the legislation was to “ensure affordability, regardless of income.” Early on, the focus was on achieving affordability for lower-income students, which several public institutions have addressed by raising funds available for financial aid. But as colleges aggressively raised tuition — in part to pay for the financial aid — legislators have become agitated about affordability for the middle class.
You’d think “affordability” would be a simple term to define — how much do you charge, says Tony Maggio, a fiscal analyst for the House Appropriations Committee who is sympathetic to the concern about higher tuition.
But how much do you charge for what? A four-year degree? If so, he asks, how do you account for a 2+2 program covering two years in community college and two more in a four-year institution? (In the 2014-15 school year, nearly 12,000 community college students transferred to four-year institutions.) What about dual high school/college enrollments? It gets complicated, he says.
Another complication is measuring the cost of attendance before and after financial aid. In 2015 Virginia colleges and universities doled out $188 million in financial aid (not including grants, loans and scholarships from private and government sources). That need-based assistance went mostly to lower-income students. So, the question becomes, affordability for whom?
Adding complexity to any calculation is the reality that not all four-year degrees are created equal. Does the University of Virginia offer the same educational value-added as, say, Virginia Military Institute or Norfolk State University? “Each one has their own value proposition,” says Minor. “How much is that worth? What am I getting for the cost? Nobody talks about that. “
These dilemmas stymied SCHEV and legislators alike. SCHEV did develop an affordability measure, which it applied for the the first and last time in 2011. The Top Jobs Act put the metric on hold, and it never resurfaced as part of the performance evaluations.
And SCHEV does publish an annual Tuition & Fee Report (see the 2016-2017 report), which shows system-wide trends. The chart below, taken from that report, shows that average undergraduate charges have consumed an increasing share of Virginians’ per capita disposable income since 2000, reaching 47.6% last year.

 
The same report lists tuition, fees, room and board for individual colleges and universities , and the Virginia Plan for Higher Education also describes metrics for “affordability” and “price” for the state system as a whole.
SCHEV Director Blake insists that the system does hold institutions accountable for tuition increases. It is true “in a very linear sense” that there are no formal accountability measures for individual institutions, he says. But policy makers can access extensive sources of data on affordability and cost. These data surface in behind-the-scenes discussions between governors, legislators and university presidents that the public never hears about.
But SCHEV does not hold individual institutions accountable to affordability benchmarks. The Council undertakes no formal review, passes no judgment and enacts no sanctions. State code states clearly that setting tuition is the sole prerogative of the Boards of Visitors of colleges and universities themselves.
“No one is tackling affordability because no one wants to touch the third rail, tuition,” says Maggio, the House fiscal analyst. “No one is willing to say, what are you charging, and are you charging too much?”
Shifting, toothless goals. Jim Alessio administered the 2005 Restructuring Act for eight years as a one-man show with assistance from other SCHEV staff members. He started with great enthusiasm but became disillusioned as he encountered endless delays and setbacks. New governors brought new priorities and staffed their administrations with new people who had little institutional knowledge.
Priorities change. The goals that animated Warner in 2005 were of little interest to McDonnell in 2011. And who is going to remember McDonnell’s priorities in 2025, asks Alessio. “Some new governor will come along and look at this differently. Will anyone care if the 100,000 additional degree goal is met?”
Also, he asks rhetorically, “Is anybody watching? Is anyone going to the institutions and saying they aren’t moving fast enough?”
No, they aren’t, he answers. The law has no teeth. “There’s nothing in there to say what happens if we don’t make the goal.”
In the fourth part of this series we will explore what the data tell us about enrollment, affordability, access, retention, research and other key goals.
(This first ran in Bacon’s Rebellion on July 12, 2017)
Email this author