Count All Students! Outcome Measures for Community Colleges

Should we count all students when analyzing higher education, or only some of them? We think all students should be included….and community colleges are often misrepresented by not doing so. This third post in a series of posts on the IPEDS Outcome Measures data (released by the U.S. Department of Education late in 2017), we turn our attention to community colleges.

The Outcome Measures is a new, more comprehensive view of what happened to students who attend an institution. This new Measure improves on the traditional Graduation Rate, which only included first-time, full-time students and left out new part-time or transfer-in students. There are many of those students at two-year institutions.

The first post in our series introduced the issue generally and the second examined the Outcome Measures results for institutions that serve a large number of students who take all of their courses at a distance. This post samples the results for the community colleges in one state.

Some overall observations:

• Our friends from the WICHE Policy and Research unit found that 60% of all higher education students and 71% of community college students were not included in the Department’s Graduation Rate statistic that has been used for many years.
• The Graduation Rate likely did not count 68.8% of community college students in Colorado. That’s almost 15,000 students. They are included in the new Outcome Measures.
• The Graduation Rate likely counted only 26.8% of community college students in Colorado, as it focused only on those who received a degree or certificate. Adding the Outcome Measures “transfer-out” and “still-enrolled” categories accounts for another 35.6% (7,215) students who entered in 2008.

This is the first year for the data to be released. As with any new statistic, some institutions were more successful than others in gathering and reporting the data. This should improve in the coming years.

We will also provide you with our spreadsheet of data so that you can analyze the data and perform similar analyses for your institution.

The bottom line: Institutions should insist on broader use of the Outcome Measures data when reporting to legislators, state system offices, the press, and those pesky ratings services.

What Are the Outcome Measures?

---

The Outcomes Measures accounted for the final disposition of an additional 35.6% of community college students after eight years!

---

For the old Graduation Rate measure, institutions were asked to identify a “cohort” of students who entered as first-time (they’ve not attended college before) and full-time (they are taking a full load of courses) in the fall of a given academic year. Institutions track and report what happened to those students after a set number of years.

The new Outcome Measures asks institutions to expand this tracking by adding three additional cohort categories of students:

• First-time, full-time (similar to the Graduation Rate).
• First-time, part-time.
• Non-first-time (transfer-in), full-time.
• Non-first-time (transfer-in), part-time.

The first cohorts were compiled for the Fall 2008 academic term and the first dataset containing results was released last October. It is important to note that these data are for all students in a given cohort, not just distance education students.

Our Sample of Public Institutions: The Community Colleges of Colorado

WICHE’s Policy and Research Brief provided statewide and regional results for each of the western states. We wanted to see the impact on an institutional basis and gauge some variations among institutions in a similar setting.

Given that community college leaders long complained about Department of Education’s Graduation Rate not providing an accurate profile of their students, we thought that we should look at that sector. We chose community college in Colorado for several reasons:

• We both live in Colorado and are more familiar with the geography, if not the intricacies of their operations, for institutions in our home state.
• Colorado includes a mix of geographic settings: urban, suburban, rural, and remote.
• With fourteen community colleges, the sample was not so large as to be unwieldy.

Most Community College Students Are Not Included in the Graduation Rate

First, let’s look at the input into the Outcome Measures statistic. Which students are included?

Community colleges may be the group best served by the expanding view of the Outcome Measures statistic. The Graduation Rate (previously the only measure of what happened to those admitted to an institution) includes only students who were first-time (they are new to higher education) and full-time (they enrolled in a full load of courses). Especially for urban institutions with a focus on working adults and those returning to college, this leaves out the bulk of the students they serve.

This fact is starkly highlighted in the WICHE brief on the western states in which they found that only 29% of all community college students in the western states were first-time, full-time students. That means that 71% of community college students in the west were likely not included in the Graduation Rate counts. In our opinions, that is a serious undercount.

For Colorado’s community colleges, the percentage of students who were first-time, full-time students  is similar to the other western states at 31.2% of enrollments. Therefore, 68.8% of community colleges students in Colorado (almost 15,000) were likely not included in the Graduation Rate counts.

Looking at the numbers more closely, in Colorado there is a huge rural/urban divide in serving first-time, full-time students:

• Rural – 57.7% were first-time, full-time.
• Urban – 27.8% were first-time, full-time.

This is not surprising, as rural community colleges may tend to serve students in their immediate area. Their enrollments may reflect the desire of traditional age students to begin their college experience locally. It also could be a tribute to those colleges offering programs that are designed to lead to employment locally. On the other hand, urban institutions, due to the make-up of their local population, may recruit and serve more adult and returning students.

Why does this matter? If only the old Graduation Rate were used, the comparisons were not equal. The Graduation Rate includes a much smaller percentage of students for urban institutions and is a poor representation of the institution’s overall population and activities.

Community Colleges Benefit from Including More Outcomes

In addition to granting degrees and certificates, the mission of many community colleges includes preparing students to transfer to other institutions. The Outcome Measure now accounts for one of the basic goals of these institutions. The low completion rates of community colleges have been cited as evidence of their ineffectiveness. Admittedly, some colleges deserve the criticism. By including counts for the students who transferred and those still enrolled, a more complete picture of what happened to the students who entered is obtained.

Below is a table of the results of the Outcome Measures data for students who entered each institution in 2008. The columns included are:

• Urban or Rural – This is our own (Colorado-based and probably unscientific) view of the communities in which the institutions reside. Those labeled “rural” are in smaller towns in more remote settings. Admittedly, to someone from the east or west coast, Pueblo or Greeley may seem “rural,” but they are larger towns that also include a university.
• FTFT Over 50% – A “yes” appears if “first-time, full-time” students represent more than 50% of the institution’s incoming freshman class cohort for the Outcome Measure. We found it interesting to note that four of the six rural community colleges served more traditional students. Additionally, a fifth institution was barely below the 50% mark. Urban institutions tend to have a much smaller percentage of “first-time, full-time” incoming students.
• Completers – These students received a degree or certificate within eight years of entering the institution. This serves as a proxy (though might not be an exact match) for the students included in the Graduation Rate measure.
• Completers + Transfer-Out + Still-Enrolled (CTS) – The percentages of those who transferred to another institution and those who are still enrolled at the institution after eight years are added to the “completers” percentage. As you may have guessed, there are precious few “still enrolled” students after eight years at community colleges. Some community college professionals have called similar statistics the “success” rate, but we avoided that value-laden term.
• Difference – Subtract the “completers” column from the next column to obtain the Difference. The reason for showing the difference is to highlight the percentage of students who would likely not have been counted in the Graduation Rate.

Our main observations from this table are:

• The “completers” designation (which mimics the Graduation Rate) accounted for the ultimate fate for only 26.8% of Colorado’s community college enrollments. Adding the “transfer-out” and “still-enrolled” students account for another 35.6% (7,215) of the students who entered in 2008. Community colleges should get recognition for these students.
• There are differences in the end results between rural and urban institutions. Rural institutions tend to have higher percentages of “completers.” That result may be partially due to the composition of their incoming student bodies having more “first-time, full-time” students.
• There are still a large number of students in the “unknown” category. Some of this may be due to inadequate record keeping because this is a new statistic. Some of it may be due to the college’s inability to track some transfers. It is likely that many of the students dropped out. If (in a worse case scenario) nearly 40% of students who entered community college in Colorado in 2008 have left higher education, that is a number that may give policymakers pause.
• The “difference” column is more than 20% for every college except Pueblo Community College, which leads us to wonder if they had difficulty with identifying transfers or experienced other problems with implementing the reporting requirements in the first year of Outcome Measures data collection.

The Incoming Students: Composition of Fall 2008 Cohort

One of the benefits of Outcome Measures (OM) is to better understand the composition of the student cohorts at our institutions. While the IPEDS Graduation Rate includes only “first-time, full-time” students, Outcome Measures includes the four cohorts listed above. Let’s look at results for those institutions for each of the four cohorts…

First-time, Full-time Cohort

Northeastern Junior College has the largest “first-time, full-time” entering cohort of students. The College is located in Sterling, CO, which has historically been a farming community. Located along the Interstate about 130 miles from Denver, it is closer to Wyoming and Nebraska than the Capitol city.

First-time, Part-time Cohort

Morgan Community College has the largest “first-time, full-time” entering cohort of students. Located in Fort Morgan, Colorado, it is about 40 miles closer to Denver on the same interstate as Northeastern Junior College. It is interesting to note the differences in the entering student composition of these two rural institutions that are less than an hour from each other.

Non-First Time, Full-time Cohort

Arapahoe Community College has the largest “non-first-time, full-time” cohort of entering students. It is located in the southern suburbs of Denver. At 17.5%, the College has the highest percentage in this category, but the others are not far behind with most colleges enrolling between 8-16% o their students in this cohort.

Non-First Time, Part-time Cohort

It is not surprising that the Community College of Denver, in the state’s largest city, leads with the most returning students who are studying only part-time.

Student Outcomes: What Happened to the Students?

In addition to providing observations about the 2008 student cohort make up, the IPEDS Outcome Measures data also provides insights regarding the disposition of the students over time. Institutions report student outcomes in one of four categories:

• Completion (Received an Award).
• Transfer Out.
• Still Enrolled.
• Unknown.

The data reported here are at eight years since matriculation (as of Fall, 2016). In addition to eight-year data, IPEDS also collects and reports outcomes at six years. We compared the six and eight-year data and found little difference. For simplicity and consistency, we decided to use only the eight-year outcomes in this analysis. It is also noteworthy that 8 years beyond the matriculation date is four times the typical completion for an Associate degree.

The Outcome Measures data for Colorado’s community colleges are reported below:

Colorado Two-Year Public Institutions

 Completion

Continuing the tour of the state to the rural southeast, Otero Junior College is located in La Junta and has the highest completion rate. Three other institutions broke the 40% completions mark: Morgan Community College (43.4%), Trinidad State Junior College (40.8%), and Lamar Community College (40.3%). All of them are located in rural settings.

Completers rates vary greatly and often need local context. For example, Red Rocks Community College (in a middle-class to upscale suburb west of Denver) has the lowest “completers” rate at 16.6%. Its “transfer-out” rate is 39.0%, reflected a possible suburban trend to start locally and transfer.

 Transfer Out

Colorado Northwestern Community College tops the list for “transfer out” colleges. It is located in remote Rangely, CO near the border with Wyoming. It is about 200 miles northwest of Denver on the other side of the mountains. On a good day, it is a four-hour drive. The lure to start locally and transfer may be based on geography. Other two-year institutions with high transfer rates include Community College of Denver 45.9% (an urban college) and Lamar Community College 43.1% (a rural college).

Still Enrolled

Although the percentages are small across the board, Front Range Community College has the highest rate of students still enrolled at the institution without having completed a degree or certificate after eight years. Front Range serves Boulder, Fort Collins, and the northern suburbs of Denver. Other community colleges with significant transfer rates reported include other suburban institutions: The Community College of Aurora (2.3%), and Red Rocks Community College (2.2%).

Unknown

Pueblo Community College has the highest rate of “unknown” responses, which we suspect may be due to problems with gathering data for this statistic in its first year of existence. We suspect that because of the suspiciously low “transfer out” rate that they report, especially since Colorado State University-Pueblo nearby is only six miles away. Northeastern Junior College (16%) and Lamar Community College (15.9%) reported the lowest “unknown” rates.

Next Steps

We are still absorbing what this all means.

We definitely urge you to examine your institution’s Outcome Measures rates. Use our spreadsheet as a starting place. We should all demand that colleges, policymakers, the press, and online listing/ranking services use these data to better represent what might happen to a student who enrolls at your institution.

If we write more or have calls for action, we will let you know.

Meanwhile, what do you think? Let us know.

 

Russell Poulin
Director, Policy & Analysis
WCET – The WICHE Cooperative for Educational Technologies
rpoulin@wiche.edu | @russpoulin

 

 

 

Terri Taylor-Straut
Director of Actualization
ActionLeadershipGroup.com

 

 

---