Florida State University
Computer Science Undergraduate Curriculum Committee
Instructor Course Reporting Instructions

This file describes what program assessment information each faculty member is required to submit, each term, for each course taught, to the ABET/SMALCs assessment coordinator (currently transitioning from Ted Baker to Robert van Engelen).

Eventually, we would like all of this information submitted via the website http://www.cs.fsu.edu/abet/, but as that site is still not complete, until you receive further notice, please submit materials by direct e-mail to baker@cs.fsu.edu. Please send either pdf file attachments or links to where we can find the files on your website.

Syllabus and Basic Course Report (for all courses)

At the beginning of each term, for every undergraduate course, you should submit your syllabus.

At the end of each term, in every undergraduate course, you should submit a report containing your comments on how the course went this term. This end-of-term report is advice to the next instructor of the course (possibly yourself), and to the Undergraduate Curriculum Committee. It should give a general overview of the course including how well the curriculum worked, what didn't work, how well it served the students, and any additional comments, including suggestions on curriculum adjustments and ways to improve the overall program. You are free to use your own format for the report, and to keep it short if you do not have much to say.

Examples of questions you might address in your report include the following:

  1. Did you try anything new this term? If so, did it work well, or not? Would you recommend doing it the same way next term?
  2. Were the students entering the course adequately prepared? If not, what do you recommend to the instructors of the prerequisite course(s)?
  3. Were you able to adequately cover all the course objectives? All the topics? If not, what do you feel you slighted? Can this be corrected next term, or do you think we need to revise the objectives and topics?
  4. Did you cover any additional topics? How did students respond? Would you recommend making them a regular part of the course?
  5. Did you encounter any other problems this term? If so, what you you recommend doing differently next time?
  6. Even if things worked very well, do you have any ideas on how to do even better the next time?

The above two items are required for every undergraduate course. In addition, if your course is one of those in which ABET/SMALCs "outcomes" are assessed, you must submit additional information (listed further below) for each of those outcomes. Similarly, if your course is one for which Computer Competency or Oral Competency is assessed, you must submit additional information for each of those outcomes.

ABET/SMALC Outcome Assessments (for designated courses)

Additional information is required from the faculty members teaching the courses we have designated for assessment of program outcomes to satisfy requirements of our accreditating bodies (SACS, ABET) and the State of Florida (SMALCs).

These agencies want to see evidence that we have a formal feedback process for continuous self-improvement. (The underlying thinking is similar to Total Quality Management (TQM), the Capability Maturity Model in Software Engineering (CMM), and ISO 9000.) As such they will not be satisfied that we simplhy gather data for them, but that we gather data and make use of it internally to manage the quality of our program, and that we document this process in a way that they can review it.

These assessment requirements are based on the concept of measureable "outcomes" with respect to our students. Our department has defined several specific "student leaning outcomes" that we have promised to assess regularly, which are intended to cover some higher level "program outcomes" (referred to by letters "a" through "j") that are imposed by ABET. For a full description of our student learning outcomes, follow this link, or follow the individual links embedded in the table further below.

For each outcome associated with your course, you need to provide the following:

  1. A copy of the assignment(s) or exam questions used to perform the assessment
  2. A copy of the rubric used in the assessment
  3. A table of results of the assessment
  4. A few comments, giving your evaluation of the assessment and your recommendations for action, if any.

Each of these items is explained in more detail below.

Outcome

You need to read this, before the start of the term.

Program outcomes are statements that describe what students are expected to know and be able to do by the time of graduation. Student learning outcomes are more specific outcomes, that provide evidence of the program outcomes. For a listing and explanation of the student learning outcomes that our department as contracted to monitor/assess, how we have agreed to assess them, and their relationship to the ABET program outcomes, look under the specific year under the heading "Program Outcomes" at http://www.cs.fsu.edu/ugcc/. /p>

1. Assignment or Questions

Submit a PDF file containing the statement of the assignment, or a copy of the exam questions, on which you based your assessment of how well the students achieved the given outcome.

2. Rubric

Submit a PDF file containing the rubric that you used to assess how well the students achieved the given outcome. This rubric should be "common" (i.e., the same) among all sections of a given course, across all instructors and all campuses. The instructors of the course should agree on this. Once agreed upon, it should be passed on from one instructor to the next, until the instructors again meet to revise it.

A rubric is a scheme for assigning a grade or score to a student or a piece of student work. Its purpose is to break the evaluation process down into a series of smaller decisions, which can be made more objectively and consistently. For a very good example, see the second page of Daniel Chang's rubric for Oral Competency.

Most instructors use rubrics for grading student work. However, please keep in mind that when we are assessing our SMALC/ABET student learning outcomes, we have a different purpose. Therefore, the rubric you use for assessing the SMALC/ABET outcome should either be separate from the one you use for grading, or a subset of it, so that it only covers the SMALC/ABET outcome, and does not bring in extraneous matters.

3. Table of Results

Submit, as a text file delimited by tabs, a table of the scores of the students on the assessment, one line per student. Please do not include student names or any other identifying information. Include just students who appeared on the final grade roster (no drops). It may be a text file, or an Excel spreadsheet. If you recorded detailed scores separately for each item on your rubric, each row of the table will contain the scores on the individual rubric items, followed by the overall score. The following are two of many possible formats. The first uses letters for the scores ("I" = ineffective, "E" = effective, "H" = highly effective), and the second uses numeric scores for the items, and then converts them to the I-E-H scale for the summary.

 Rubric Item 1Rubric Item 2...Summary
1EH...E
2EE...E
3IH...E
4II...I
...............
25HH...H
How many received a course Grade of "C-" or better?24
Of those, how many achieved E or H on the assesment?23
 Rubric Item 1Rubric Item 2...Summary
17593...E
27080...E
35092...E
44959...I
...............
2590100...H
How many received a course Grade of "C-" or better?24
Of those, how many achieved E or H on the assesment?23

4. Comments (Evaluation & Recommendations)

Submit, as text or PDF, a few sentences of commentary on the results of the assessment. The purpose of these comments is to you have analyzed the results of the assessment, reflected on them, and learned something from them that we will apply to improve the quality of our program and/or the assessment process.

Your comments may be read by:

  1. Inside the department: the Department Chair, Director of Undergraduate Studies, and Undergraduate Curriculum Committee.
  2. Inside the College: the Dean and associate deans.
  3. In the University: the Provost and his staff, and students.
  4. Outside the University: auditors and accreditation reviewers from ABET, SACS, and the Florida Board of Education, as well as the general public.

You should comment separately on each SMALC/ABET outcome that you are required to assess. There is no required format. The following are examples of the kinds of things that it would be appropriate to include:P

  1. A summary of the results, and relationship to the standard established by the department for this outcome.
  2. Explanation of any deviation from the standard.
  3. Suggestions for improving student outcome, if any.
  4. Evaluation of the method you used to do the assessment (i.e., the asssignment/exam questions and the rubric). Is the assessment method working? Can it be improved? If so, what do you suggest?
  5. Evaluation of the outcome itself. Is it appropriate? Do you suggest any change in the statement of the outcome?
  6. Other insights you have gained from the assessment you did, if any.

If things are going well, you may not need to write much.

These comments/recommendations are likely to overlap in content with your basic course report. If so, you don't need to duplicate the details. Just write them down once here, and refer to this in your course report.

Computer Competency Assessments

This is a requirement imposed on us by the University and SACS, which applies to the following courses:

For background, see http://facsenate.fsu.edu/Liberal-Studies-Competency-Forms/Computer-Competency.

You must submit:

Note that the table here is not quite the same as that for the SMALC/ABET outcomes. Instead of the I/E/H scale, for this assessment you should report a letter grade on the assesssment, and the number of interest is how many achieved a grade of "C-" or better on the assessment. A student should not receive a grade of "C-" or better in the course unless she/he has achieved a grade of "C-" or better on the oral competency component.

Oral Communication Competency Assessments

This is a requirement imposed on us by the University and SACS, and applies only to CIS4250.

For background, see http://facsenate.fsu.edu/Liberal-Studies-Competency-Forms/Oral-Communication.

You must submit:

Note that the table here is not quite the same as that for the SMALC/ABET outcomes. Instead of the I/E/H scale, for this assessment you should report a letter grade on the assesssment, and the number of interest is how many achieved a grade of "C-" or better on the assessment. A student should not receive a grade of "C-" or better in the course unless she/he has achieved a grade of "C-" or better on the oral competency component.