Program Review and Assessment Committee (PRAC)

MINUTES - November 13, 2008
9:35a-10:50a

Present: M. Cameron (SW), C. Coron (ESC, Co-Chair), O. Gulacar (CHE),
M. Hartog (MAT), T. Lin (WMS), L. Rebeschi (NUR, Co-Chair), P. Kahlbaugh (PSY), M. Fede (EXS), S. Felsenfeld (CMD), T. Radice, E. West (GEO)
Absent: R. Narumanchi (ACC), I. Antonios (CSC), R. Narumanchi (ACC), D. Pettigrew (PHI)
Guests: D. Newman (Communication Disorders Assessment Coordinator)

1. L. Rebeschi announced that D. Pettigrew has also joined PRAC. An updated PRAC membership list was distributed. In addition, copies of the program review schedule and Undergraduate Program Review Form (checklist) were provided.
2. Two booklets provided by the Office of Assessment and Planning were distributed to PRAC members for future reference (Program Based Review and Assessment and Course Based Review and Assessment, both published by Univ of Mass office of Academic Planning & Assessment).
3. As previously discussed and planned, an orientation workshop will be provided for departments scheduled for undergraduate program review during AY 2009-2010. Because of the remaining work necessary during scheduled PRAC meetings, a separate meeting time is necessary. The workshop will be scheduled for Thursday December 11th immediately following the UCF meeting (11a-12n in ASC room 301). L. Rebeschi will arrange room reservation. An invitation letter will be sent by PRAC co-chairs inviting departments to this workshop.
4. Final revisions made to the PRAC report for the Department of Journalism. L. Rebeschi will complete final edits. Report to be presented at UCF Steering Committee next Tuesday and included on the agenda for vote at Thursday's UCF meeting.
5. Discussion regarding whether a PRAC member whose department is being reviewed should be present during PRAC discussion and deliberations about their home department. After much discussion, the following motion was made: PRAC members who are members of the department being reviewed should recuse themselves from the meeting during such discussions (7 in favor, 1 opposed, 3 abstentions)
6. Discussion by PRAC members regarding the CMD report - S. Felsenfeld recused herself from this portion of the PRAC meeting. C. Coron raised general concerns regarding department's program reviews (not just specifically CMD). First, there is an orientation towards seniors and graduates rather than incremental program review. Additionally, program viewed as successful if students obtain jobs. In relation to the CMD report, M. Cameron suggested that Standard 2 be revised. As presented, it is not clear what the program's goals are. Rather, the CMD report reflects what students will do in this Standard, rather than the program goals. Suggestion from M. Hartog that Standard #3 be re-examined in order to better describe what defines successful student performance of these outcomes.
7. Diana Newman, Assessment Coordinator from the Department of Communication disorders joined PRAC at 10:30a to discuss the previously submitted self study report of CMD. M. Cameron commended Diana and the department for the work that they have already done in preparing this report. PRAC members provided suggestions for revisions to be made in order to better satisfy Standards 2 and 3. In order to provide assistance and answer questions, PRAC member P. Kahlbaugh will be available to Diana as she prepares suggested revisions. The revised CMD report is to be submitted by 11/19.
8. Meeting adjourned at 10:50a

Respectfully submitted by,
L. Rebeschi (PRAC co-chair)

Program Review and Assessment Committee (PRAC)
University Curriculum Forum

Undergraduate Program Review Report: Department of Journalism

The Department of Journalism presented their self-study report to UCF on
October 22, 2008. Professor Frank Harris, Chairperson, met with PRAC on
October 30, 2008. At that time, Professor Harris discussed the department's mission, program goals, student-learning outcomes, and methods for measurement of student-learning outcomes.

The Program Review and Assessment Committee (PRAC) reviewed the documentation for the Undergraduate Program in Journalism and offers the following appraisal.

Standard 1 - The department/program's mission supports the university's mission.
 Met 

The mission of the Department of Journalism is in alignment with the University's mission. According to the self-study, student-learning outcomes were derived primarily from the Accrediting Council of Education in Journalism and Mass Communications (ACEJMC). The Department has established a goal to seek accreditation but a specific timeline was not provided.

It is suggested that the Department elaborate upon this standard further. For example, the department provides a foundation of academic excellence in journalism theory and practice. How exactly is this accomplished? 

Standard 2 - The department/program has clearly stated program goals and objectives
 Met 

The Department of Journalism produces graduates who work as professional journalists. In addition, graduates are also prepared to work in a range of other fields such as law, business, education, government, public relations, and the arts.

Standard 3 - The department/program has clearly stated program-level expected student outcomes and methods for measurement
 Met (with conditions that need to be addressed during the next review cycle)

The department's self-study includes 12 expected student outcomes for journalism majors. It is suggested that the Department of Journalism identify priority outcomes that are measurable. These outcomes can be narrowed to 3 to 4 priority outcomes.

Currently, the Department of Journalism is measuring student-learning outcomes solely based upon student internship performance. The Department has developed surveys that are completed by the internship supervisor as well as the student. As stated by the Department, not all Journalism students complete an internship (ie. BA students are not required to complete an internship). Additionally, the internship is intended to take place during the junior or senior year of study, but this is not a requirement. In other words, it is possible for second year journalism students to complete an internship. Because of these issues, using internship performance as the sole measure of program outcomes needs to be reexamined. Additionally, this method provides a narrow perspective for assessing program outcomes.

PRAC recommends further development in this area. The current surveys need to better reflect other aspects of the program goals. For example, one of the stated student outcomes is "understanding of First Amendment principles, law, ethics and their application to professional journalistic practice". Yet, assessment of this outcome is not reflected in the current survey. Therefore, the Department may want to consider the following enhancements:
• Utilization of both direct and indirect assessment measures
o Performance based assessments - course-embedded tests, projects, learning portfolios
• Current internship surveys to be revised to better include stated student learning outcomes
• Alumni surveys
• Multiple sources to triangulate data collection

Summary
The Program Review and Assessment Committee thanks the Department of Journalism and Professor Frank Harris for the effort put forth in the preparation and presentation of the self-study report. PRAC recommends that the department continue to develop a comprehensive program evaluation plan with integration of the provided suggestions for enhancement in this report.  PRAC recommends to the University Curriculum Form that APPROVAL with conditions be granted to the Undergraduate Program in Journalism.

Report submitted by the following PRAC members: I. Antonios, M. Cameron,
C. Coron (PRAC co-chair), M. Fede, S. Felsenfeld, O. Gulacar, M. Hartog, P. Kahlbaugh, T. Lin, T. Radice, L. Rebeschi (PRAC co-chair), & E. West

November 13, 2008