Showing posts sorted by relevance for query "Astronomy quiz question" "Fall Semester 2008". Sort by date Show all posts
Showing posts sorted by relevance for query "Astronomy quiz question" "Fall Semester 2008". Sort by date Show all posts

20100218

Astronomy quiz question: inferior planets at midnight

Astronomy 210 Quiz 2, Spring Semester 2010
Cuesta College, San Luis Obispo, CA

Why are Mercury and Venus never visible in the San Luis Obispo, CA sky at midnight?
(A) Mercury and Venus never exhibit retrograde motion.
(B) Mercury and Venus are too small to reflect enough sunlight.
(C) The orbits of Mercury and Venus are smaller than the orbit of Earth.
(D) Mercury and Venus cannot exhibit gibbous phases.

Correct answer: (C)

Since the orbits of Mercury and Venus are smaller than the orbit of Earth (making them inferior planets), they can never appear behind Earth, with respect to the sun, and thus cannot be overhead (or anywhere in the sky) at midnight for typical temperate latitudes such as for San Luis Obispo, CA.

Student responses
Section 30674
(A) : 4 students
(B) : 5 students
(C) : 34 students
(D) : 2 students

Success level: 78% (including partial credit for multiple-choice)
Discrimination index (Aubrecht & Aubrecht, 1983): 0.71

Student responses
Section 30676
(A) : 10 students
(B) : 8 students
(C) : 45 students
(D) : 11 students

Success level: 64% (including partial credit for multiple-choice)
Discrimination index (Aubrecht & Aubrecht, 1983): 0.85

Previous posts:

20081011

Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Fall semester 2008)

During Fall semester 2008, Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA have piloted the use of partial credit for multiple-choice (PCMC) questions.

During the seventh week of instruction (after taking three 10-question quizzes), students were given the opportunity to evaluate PCMC in an online "Partial Credit for Multiple-Choice (PCMC) Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Partial Credit for Multiple-Choice Survey
Cuesta College
Astronomy 210 Fall Semester 2008 sections 70158, 70160
(N = 40)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. Recall that for this semester there is PCMC = "partial
credit for multiple choice," where you can get partial
credit even after circling a wrong answer, if you have
also eliminated an incorrect answer by marking it with
an "x."
Answer the following statements which may or may not
describe your beliefs about PCMC in this class.
Because of PCMC...

II.1 ...I read questions more carefully.
1. Strongly disagree 1 : *
2. Disagree 1 : *
3. Neutral 3 : ***
4. Agree 19 : ******************* [4.2 +/- 0.9]
5. Strongly agree 16 : ****************

II.2 ...I spend more time taking a test.
1. Strongly disagree 1 : *
2. Disagree 4 : ****
3. Neutral 9 : *********
4. Agree 16 : **************** [3.7 +/- 1.0]
5. Strongly agree 9 : *********

II.3 ...I feel more confident about circling a correct choice.
1. Strongly disagree 2 : **
2. Disagree 5 : *****
3. Neutral 9 : *********
4. Agree 19 : ******************* [3.5 +/- 1.0]
5. Strongly agree 5 : *****

II.4 ...I look for incorrect choices before circling a correct choice.
1. Strongly disagree 2 : **
2. Disagree 7 : *******
3. Neutral 6 : ******
4. Agree 11 : *********** [3.7 +/- 1.3]
5. Strongly agree 14 : **************

III. Answer the following statements which may or may not describe
your beliefs about PCMC in this class.

III.1 PCMC helped me answer test questions better.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 10 : **********
4. Agree 17 : ***************** [3.9 +/- 0.9]
5. Strongly agree 10 : **********

III.2 I would recommend using PCMC in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 0 :
4. Agree 22: ********************** [4.5 +/- 0.5]
5. Strongly agree 18 : ******************

III.3 Having PCMC a positive experience.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 1 : *
4. Agree 29 : ***************************** [4.2 +/- 0.5]
5. Strongly agree 10 : **********

III.4 Using PCMC was difficult.
1. Strongly disagree 22 : **********************
2. Disagree 15 : *************** [1.5 +/- 3.5]
3. Neutral 3 : ***
4. Agree 0 :
5. Strongly agree 0 :

III.5 I would identify incorrect choices even without PCMC.
1. Strongly disagree 0 :
2. Disagree 5 : *****
3. Neutral 14 : **************
4. Agree 16 : **************** [3.5 +/- 0.9]
5. Strongly agree 5 : *****

IV. (Optional.) Please type in any comments you may have regarding
the use of PCMC in this class.
The following are all of the student responses to this question, verbatim and unedited.
"P-Pre-ordained C-Cows M-Maul C-Children Mwaaahahaaahaa"

"I think it makes you read the questions more carefully so you can make sure that if you don't know the answer you can at least get some credit for knowing what's NOT the answer, which I think somewhat reinforces knowledge."

"I try my hardest in this class adn I still suck!....Ah"

"I think that using PCMC is another way we can earn points on out tests. Knowing the wrong answer is like know what the right answer is. I believe it is helpful and that every class should use this system."

"In my opinion, PCMC is a really great idea. I don't know how anyone could not like the ability to receive extra credit. It doesn't change the way I read or answer questions on a quiz, but I do appreciate the partial credit if I'm not sure on a question. Every point counts on these killer Astronomy quizzes, right? :)"

"As far as the top questions I'm not sure I understood the exact meaning, I wasn't trying to contradict myself if i inadvertently did..."
It helps out.

"I like using PCMC because if I get a question wrong on the test but I "X" out the wrong answer, I still get partial creadit and it still gives me a chance to do well on the test even if i don't answer correctly."

"Partial credit for multiple choice is a great way to get points even if you miss the question. Sometimes i know wrong answers but i can not make up my mind on the correct answer. In this case PCMC is a great way to reward students for at least being able to identify wrong answers."

"At least you get credit if get the wrong answer and some credit is better than none"

"I dig it."

"My tactic is to find the right answer first, when I achieve this, I cross out the one I know is incorrect. Other times, if I am unsure with a correct answer, the thought of PCMC gives me a glimpse of hope. Otherwise, PCMC is not a system I employ to answer a question correctly, but it does make me consider each answer, and this perhaps leads to better scores in the end."

"I feel like I am always sure which answer could be incorrect on quiz's and i use PCMC everytime whether i am sure on a question or not. I don't always feel like my points get counted for crossing out an answer. I think it really would be helpful to use PCMC if their were good results for it. It shows we know the answer, but the question was confusing."

"I think it is beneficial overall. I have never crossed another instructor who has done it, so I hope you inspire others. The only complaint would be it seems it would be harder to grade with precision."

"PCMC is helpful because it directs my thoughts to eliminate the incorrect answers and that helps with choosing the correct one."

"I like PCMC, because sometimes I am not sure about the answers, but I know some answers are not correct. Because of PCMC, I still have chances to get points. This is a good system."

"I don't know a lot about astronomy, so the partial credit really helps"

20120317

Education research: partial credit for multiple-choice questions (PCMC) student attitudes (spring semester 2012)

Starting fall semester 2008 and continuing through spring semester 2012, Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA have piloted the use of partial credit for multiple-choice (PCMC) questions.

During the ninth week of instruction (after taking four multiple-choice question quizzes, and a midterm with multiple-choice questions and short-answer/essay questions), students were given the opportunity to evaluate PCMC in an online "Partial Credit for Multiple-Choice (PCMC) Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Partial Credit for Multiple-Choice Survey
Cuesta College
Astronomy 210 spring semester 2012 sections 30674, 30676
(N = 46)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. Recall that for this semester there is PCMC = "partial
credit for multiple choice," where you can get partial
credit even after circling a wrong answer, if you have
also eliminated an incorrect answer by marking it with
an "x."
Answer the following statements which may or may not
describe your beliefs about PCMC in this class.
Because of PCMC...

II.1 ...I read questions more carefully.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 9 : *********
4. Agree 28 : **************************** [3.9 +/- 0.7]
5. Strongly agree 7 : *******

II.2 ...I spend more time taking a test.
1. Strongly disagree 0 :
2. Disagree 10 : **********
3. Neutral 10 : **********
4. Agree 22 : ********************** [3.4 +/- 0.9]
5. Strongly agree 4 : ****

II.3 ...I feel more confident about circling a correct choice.
1. Strongly disagree 1 : *
2. Disagree 4 : ****
3. Neutral 19 : *******************
4. Agree 19 : ******************* [3.4 +/- 0.8]
5. Strongly agree 3 : ***

II.4 ...I look for incorrect choices before circling a correct choice.
1. Strongly disagree 2 : **
2. Disagree 7 : *******
3. Neutral 5 : *****
4. Agree 25 : ************************* [3.6 +/- 1.1]
5. Strongly agree 7 : *******

III. Answer the following statements which may or may not describe
your beliefs about PCMC in this class.

III.1 PCMC helped me answer test questions better.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 13 : *************
4. Agree 23 : *********************** [3.7 +/- 0.8]
5. Strongly agree 6 : ******

III.2 I would recommend using PCMC in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 7 : *******
4. Agree 17 : ***************** [4.3 +/- 0.7]
5. Strongly agree 21 : *********************

III.3 Having PCMC a positive experience.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 7 : *******
4. Agree 24 : ************************ [4.2 +/- 0.7]
5. Strongly agree 14 : **************

III.4 Using PCMC was difficult.
1. Strongly disagree 16 : ****************
2. Disagree 20 : ******************** [2.0 +/- 2.5]
3. Neutral 5 : *****
4. Agree 3 : ***
5. Strongly agree 1 : *

III.5 I would identify incorrect choices even without PCMC.
1. Strongly disagree 0 :
2. Disagree 4 : ****
3. Neutral 12 : ************
4. Agree 23 : *********************** [3.7 +/- 0.8]
5. Strongly agree 6 : ******

IV. (Optional.) Please type in any comments you may have regarding
the use of PCMC in this class.
The following are all of the student responses to this question, verbatim and unedited. Some responses have been bolded for emphasis.
"PCMC helps me know where im at when knowing the material."

"I like it because I feel like I have two chances to get the question right."

"I enjoying using the PCMC and would strongly encourage you to continue to use it in the future...
PCMC is a great way to give partial credit, as well as narrow answers down to the correct one."

"I like being able to get partial credit even if my answer is wrong."

"Before using PCMC in this class i would initially look for the first correct answer i saw and then go over the rest of the incorrect answers ruling them out, using PCMC is very helpful for me on questions that i am unsure about cause identifying wrong answers is never a problem."

"i like it, please continue to use it"

"... I love the opportunity PCMC gives me and how it might give me some extra points but all in all the amount given is nothing that would really benefit the overall test. Plus with your tests already a lot of the multiplication problems have options that are all alike so it intimidates me to circle an answer and then go and cross out another since i feel all are correct."

"PCMC is a great way to encourage because if you know for a fact one is wrong then you know you can at least get some points!"

"I like having this because whne the questions area little difficult it does make you go through the possibiliites more thoroughly."

"I like PCMC :)"

"The PCMC really helps narrow down a correct answer if I'm having difficulty on a question."

"You should make the correct incorrect choice worth more than 0.5 points. Maybe one point?"

"no comments"

"I think it's a great idea. Usually when we are presented with multiple choice its all or nothing. This way at least gets you somewhat closer to the answer by eliminating a wrong choice, even if you don't quite know the correct choice"

"you're the man p-dog!"

"it works"

"I like it because I can fall back on them incase I am not quite sure of an answer, but I always end up finishing the quiz or test then going back and figuring our definite wrong ones."

"PCMC was great--even if I answered incorrectly, I still could receive credit on a question without taking a 0 outright. Keep it, P-Dog!"

"I find that PCMC really helps me in determining the answer to a question that I am unsure about."

"No comment"

"It takes a little bit of the stress off of a test."

"I feel PCMC is really valuable for other students more than it is for me. I am the type of person who really studies for tests and quizzes and I dot really want to use PCMC because I want to really earn my grade from putting in the effort and studying. I also, while in the moment of taking a quiz or exam forget that I can make an x mark next to a question I am not 100 percent sure about. I think PCMC will only come in handy for me in the explanation essay portion of the exam, just in case I can't explain something in as much detail as I want."

"I think PCMC is helpful because it's extremely difficult for me to get good grades on these tests. I feel like I study for such a long time, and the material is still eluding me. PCMC makes me a little more confident that I'll hopefully at least pass the class because of the partial credit I receive. (also, I think it might be good if the tests were longer and the questions were worth more points... like 20 questions worth 2 points each- that way, grades aren't devastated if you get a couple wrong!)"

"Do we have multiple choice on the midterm too and does it use PCMC. Or is the midterm only short answer"

"i really like it because all my life i was taught by teachers that if you dont know an answer, eliminate what you know is wrong first to narrow it down. Often i can do this but still struggle with the right answer. So its nice to get partial credit for the fact that i at least somewhat get it."

"i think it is a cool concept but i feel the partial credit that you give for a x-ed out answer doesn't make a very big difference with your score."

"PCMC is a grade helper, and I super appreciate that... especially when one question is worth 4 points."

"I enjoy pcmc to help eliminate wrong answers."

"i think it is smrt but it personaly makes me second guess myself"

"i think we should get even more points for crossing an answer out"


Previous posts:

20101013

Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Fall semester 2010)

Starting Fall semester 2008 and continuing through Fall semester 2010, Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA have piloted the use of partial credit for multiple-choice (PCMC) questions.

During the ninth week of instruction (after taking four multiple-choice question quizzes, and a midterm with multiple-choice questions and short-answer/essay questions), students were given the opportunity to evaluate PCMC in an online "Partial Credit for Multiple-Choice (PCMC) Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Partial Credit for Multiple-Choice Survey
Cuesta College
Astronomy 210 Fall Semester 2010 sections 70158, 70160
(N = 45)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. Recall that for this semester there is PCMC = "partial
credit for multiple choice," where you can get partial
credit even after circling a wrong answer, if you have
also eliminated an incorrect answer by marking it with
an "x."
Answer the following statements which may or may not
describe your beliefs about PCMC in this class.
Because of PCMC...

II.1 ...I read questions more carefully.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 11 : ***********
4. Agree 24 : ************************ [4.0 +/- 0.7]
5. Strongly agree 10 : **********

II.2 ...I spend more time taking a test.
1. Strongly disagree 2 : **
2. Disagree 14 : **************
3. Neutral 10 : ********** [3.1 +/- 1.1]
4. Agree 15 : ***************
5. Strongly agree 4 : ****

II.3 ...I feel more confident about circling a correct choice.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 13 : *************
4. Agree 24 : ************************ [3.8 +/- 0.7]
5. Strongly agree 7 : *******

II.4 ...I look for incorrect choices before circling a correct choice.
1. Strongly disagree 1 : *
2. Disagree 6 : ******
3. Neutral 10 : **********
4. Agree 21 : ********************* [3.6 +/- 1.0]
5. Strongly agree 7 : *******

III. Answer the following statements which may or may not describe
your beliefs about PCMC in this class.

III.1 PCMC helped me answer test questions better.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 17 : *****************
4. Agree 21 : ********************* [3.7 +/- 0.7]
5. Strongly agree 6 : ******

III.2 I would recommend using PCMC in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 1 : *
4. Agree 27 : *************************** [4.4 +/- 0.5]
5. Strongly agree 17 : *****************

III.3 Having PCMC a positive experience.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 4 : ****
4. Agree 32 : ******************************** [4.1 +/- 0.5]
5. Strongly agree 9 : *********

III.4 Using PCMC was difficult.
1. Strongly disagree 19 : ******************* [1.7 +/- 2.8]
2. Disagree 22 : **********************
3. Neutral 3 : ***
4. Agree 1 : *
5. Strongly agree 0 :

III.5 I would identify incorrect choices even without PCMC.
1. Strongly disagree 1 : *
2. Disagree 5 : *****
3. Neutral 17 : *****************
4. Agree 17 : ***************** [3.4 +/- 0.9]
5. Strongly agree 5 : *****

IV. (Optional.) Please type in any comments you may have regarding
the use of PCMC in this class.
The following are all of the student responses to this question, verbatim and unedited.
"I think it's a nice way to get at least some credit, even if you don't know the answer for sure."

"I don't think using PCMC necessarily helped me answer any questions better or improved my test taking skills, but it is really nice to get that partial credit which I think is the most positive outcome of using it. Its really hard sometimes on the quizzes because each question is worth so many points so if you get even one wrong, it drops your grade a lot. So having the option and opportunity for extra points helps a lot."

"It can cause confusion."

"I like the idea of still being able to get some credit for knowing which answers aren't correct, even if you might not get the right answer."

"I like knowing that even if I answer a question wrong I have a chance of recieving credit for the amount of inforation that I 'do' know."

"I think it is useful because even if you don't get the answer right you can cross out one's you know that are wrong."

"I think it is helpful to look out for wrong answers which can move you towards the right answer if you are unsure of the right answer."

"I think PCMC is a very fair way of grading tests. You are a least rewarded for identifying the wrong answer"

"none"

"I like it....a lot."

"like it :)"

"Great Job P-DAWGGGG!!!!!"

"I think its nice because its makes you feel better. 0 points for a question just sucks!"

"PCMC makes you feel more confident after taking a test knowing you get at least some credit for knowing a wrong answer"

"What made you choose PCMC?"

"Its a good way to receive partial credit even if you dont know the correct answer"

"I like this idea, it reinforces the fact that even though you do not know the correct answer, you still have an idea about what it could (or could not) be."

"I think it is a good idea because even if a student gets the wrong answer they can prove that know a little about subject by crossing out an answer they know is FOR SURE not correct (and the fact that partial credit is offered proves that underneath all that thuggish roughness P-dawg has a kind heart)"

"It helps, but it makes you think a little harder than you would normally."

"I like the PCMC because it helps acknowledge that i do know enough about the question to eliminate answers that are wrong and i can get a little credit for that."

"I just had trouble with figuring out how it works in the beginning--that we have to pick the correct answer AND cross out one incorrect answer---I thought at first that if you dont know the answer, you can cross out the one that is definitely incorrect..."

"Even though credit is minimal for PCMC it's still satisfying to earn that extra half point! haha"

"I really liked PCMC. They really help."

"I love PCMC!!"

"Good system, adds a little bit of wiggle-room and forgiveness on tests and quizes."

"i love it"

"I appreciate the partial credit for multiple choice because it helps improve my grade on quizzes/exams."

"From my experience with PCMC, it works fine because its partial credit that you can earn even if you get a question wrong. "

"With that you have a better chance of earning partial credit along with the points for the correct answer if one answers the correct answer"

"PCMC is good for partial credit on multiple choice questions, but it hasn't really helped me answer questions any easier. Usually its really easy to eliminate one choice anyway."

"Receiving partial credit for eliminating an obviously wrong answer is a great idea, and should be implemented more often. It's almost a form of reverse learning, in which we can identify what is at least closer to correct when throwing out one answer, and I like that. PCMC gives a student the opportunity to reinforce their own mental process of elimination, and answer things more confidently."

"in the beginning it sometimes throws you off."

"its a really good idea i wish more classes used this"

"i think the PCMC almost makes the tests too easy, because even when i get an answer wrong i get points which allows me to get a much higher grade than i normally would have."

"It's a nice safety net of sorts if you miss something while studying for a test/quiz"

"It's a great way for students to learn better by identifying and using process of elimination to get closer to the answers."

"I like having the opportunity to be able to get partial credit for a wrong answer."

"I think we should get at least a full point for pcmc instead of only half a point."


Previous posts:

20090308

Astronomy quiz question: adaptive optics

Astronomy 210 Quiz 3, Spring Semester 2009
Cuesta College, San Luis Obispo, CA

Adaptive optics is used in modern optical telescopes to improve:
(A) light-gathering power.
(B) resolving power.
(C) magnifying power.
(D) the amount of radiation transmitted through the atmosphere.

Correct answer: (B)

The secondary mirror of an optical telescope can be "warped" in real-time in order to compensating for the poor seeing caused by atmospheric turbulence, thus increasing the effective resolving power.

Section 30676
(A) : 12 students
(B) : 32 students
(C) : 13 students
(D) : 5 students

"Success level": 56% (including partial credit for multiple-choice)
Discrimination index (Aubrecht & Aubrecht, 1983): 0.51

Previous post:

20090115

Education research: end-of-semester feedback on clickers (Astronomy 210, Cuesta College, Fall Semester 2008)

Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA used clickers (Classroom Performance System, einstruction.com) to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture.

During the last week of instruction, students were given the opportunity to evaluate the instructional components of the course, and the use of clickers in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Astronomy 210 Fall Semester 2008 sections 70158, 70160
(N = 65)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture by instructor.
1. Strongly disagree 0 :
2. Disagree 4 : ****
3. Neutral 9 : *********
4. Agree 31 : ******************************* [4.0 +/- 0.8]
5. Strongly agree 20 : ********************

II.2 Working in groups on in-class activities.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 11 : ***********
4. Agree 30 : ************************* [4.2 +/- 0.7]
5. Strongly agree 24 : ************************

II.3 Using clickers to participate in class.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 2 : **
4. Agree 31 : ******************************* [4.4 +/- 0.7]
5. Strongly agree 29 : *****************************

II.4 Reading the textbook.
1. Strongly disagree 2 : **
2. Disagree 8 : ********
3. Neutral 27 : *************************** [3.4 +/- 1.0]
4. Agree 21 : *********************
5. Strongly agree 7 : *******

II.5 Demonstrations/videos in class.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 9 : *********
4. Agree 36 : ************************************ [4.1 +/- 0.7]
5. Strongly agree 19 : *******************

II.6 Interacting with other students during class.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 10 : **********
4. Agree 33 : ********************************* [4.1 +/- 0.7]
5. Strongly agree 21 : ***********

II.7 Interacting with other students outside of class.
1. Strongly disagree 1 : *
2. Disagree 19 : *******************
3. Neutral 26 : ************************** [3.1 +/- 1.0]
4. Agree 13 : *************
5. Strongly agree 6 : ******

III. Answer the following statements which may or may not describe
your beliefs about the use of clickers in this class.

III.1 I like using clickers.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 4 : ****
4. Agree 31 : ******************************* [4.4 +/- 0.6]
5. Strongly agree 20 : ******************************

III.2 Clickers helped me understand lectures better.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 9 : *********
4. Agree 37 : ************************************* [4.1 +/- 0.7]
5. Strongly agree 17 : *****************

III.3 I would recommend using clickers in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 6 : ******
4. Agree 30 : ****************************** [4.4 +/- 0.6]
5. Strongly agree 29 : *****************************

III.4 I will avoid other classes using clickers in future semesters.
1. Strongly disagree 33 : *********************************
2. Disagree 26 : ************************** [1.6 +/- 4.1]
3. Neutral 4 : ****
4. Agree 2 : **
5. Strongly agree 0 :

III.5 Clickers were a positive experience.
1. Strongly disagree 1 : *
2. Disagree 0 :
3. Neutral 7 : *******
4. Agree 35 : *********************************** [4.2 +/- 0.7]
5. Strongly agree 22 : **********************

III.6 Too much time in class was spent using clickers.
1. Strongly disagree 17 : *****************
2. Disagree 33 : ********************************* [2.0 +/- 2.2]
3. Neutral 12 : *******
4. Agree 3 : ***
5. Strongly agree 0 :

III.7 Too many clicker questions were asked.
1. Strongly disagree 18 : ******************
2. Disagree 39 : *************************************** [1.9 +/- 2.3]
3. Neutral 5 : *****
4. Agree 3 : ***
5. Strongly agree 0 :

III.8 Using clickers was difficult.
1. Strongly disagree 44 : ******************************************** [1.4 +/- 5.4]
2. Disagree 16 : ****************
3. Neutral 5 : *****
4. Agree 0 :
5. Strongly agree 0 :

IV. (Optional.) Please type in any comments you may have regarding
the use of clickers in Astronomy 210.
The following are all of the student responses to this question, verbatim and unedited (with a few editorial context clarifications in [brackets]).
"P-Dog is a funny yet helpful teacher and makes the class more enjoyable."

"Clickers are cool!"

"The clickers were chillin but too often I forgot my clicker and then I would not get credit! Which sucked cause I was baking on those clicker points. I never missed a class but sometimes missed a click. But that is my own fault so I think that they are good for the most part."

"I thought the clicker questions were a great way to stimulate involvement with the entire class, but when the class didn't know the answer I think it would have been better for P-Dog to explain it to us rather than have us ask our neighbors."

"I liked the clickers"

"Clicker questions provided opportunities to discuss difficult concepts. I think more of them for more difficult concepts would have been helpful. In-class activities were great but too many times not all of my assigned [groupmates] showed up or did not really contribute to answering the questions. Maybe the in-class activities could be homework and more clicker questions during class."

"PDawg is awesome"

"i liked the clicker questions it gave me a chance to understand more of what you were talking about in the lectures because of the examples and explanations"

"thanks for an Astronomical semester P-Dog!"

"I really think that the clickers are a good learning experience but it was hard and got confusing when we talked it out if the results varied because I couldn't always make the connection between the actual answer and the answer that the people around me thought it was. But i also really like the videos [PowerPoint presentations] during lecture it helps me to visually understand what you are explaining."

"Clickers were okay. I don't feel like I benifited anything from them though. I also thought that 'talking it out' irrelevant because when the class' answers are all across the board, obviously nobody knows the answer so I found that no one really new what to talk out. But I didn't think using clickers was a bad experience though!"

"The clickers were extremely helpful in not only understanding some of the information covered on the exams, but also in helping me to truly 'own' the information I spit back out."

"I thought the clicker questions were very helpful..even more so because I could go back online and download them to study."

"they were tight"

"I like using clickers becuase I have time to think about the questions, and can receive credit from that."

"good class"

"Clickers were fun! I enjoyed using them for in class quiz type things!"

"Clickers help organize student responses."

"I thought that using the clickers in class helped keep everyone on task and to focus on the material that we were learning about"

"Clickers were a postive learning experience for me :)"

"Clickers are awesome! They are a great way to make sure that students are participating in and attending class. Clickers are easy to use, and you don't even have to get the questions right to get full credit.... it's basically free points for being involved in the class."

"Pat Len is an awesome teacher. It's great the way the class has everyone collaborate their information with the group activities, and the clicker questions helped especially when your confused. You get to see where everyone else is and then go back over a question by collaborating with other. Clickers, awesome. Group activities, great. Dr. len, the bomb."

"Clickers are blue and have buttons. My favorite button was the 'F' button, but I also enjoyed 'C' and 'H' as well."

"They cost too much, and you had to pay more and have a credit card to register them."

"Clickers are a good way of learning!"
Previous post:
Education research: preliminary feedback on clickers (Astronomy 210, Cuesta College, Fall Semester 2008)
Discussion of preliminary Astronomy 210 student opinions from this semester.

20100429

Astronomy quiz question: metal rich vs. metal poor stars

Astronomy 210 Quiz 6, Spring Semester 2010
Cuesta College, San Luis Obispo, CA

Older stars are metal poor, while newer stars are metal rich because:
(A) metals produced by older stars were released by supernova explosions, and became part of newer stars.
(B) dark matter gradually converts metal rich stars into metal poor stars.
(C) older stars concentrate more of their metals into their cores, leaving their outer layers metal poor.
(D) older stars have had more time to break down heavy elements into lighter elements.

Section 30674
(A) : 30 students
(B) : 1 student
(C) : 6 students
(D) : 5 students

Correct answer: (A)

Stars produce metals (elements heavier than hydrogen and helium) in their cores during their giant/supergiant phases, up through type Ia/II supernovae explosions. Along with their unused hydrogen, these metals are then scattered into the interstellar medium, which are then incorporated into later generations of stars. An old, early generation star will have metals only in its core, while a young, later generation star will have metals sprinkled in its outer layers.

This was asked in Fall semester 2008 as a quiz question, and a final exam question.

"Difficulty level": 74% (including partial credit for multiple-choice)
Discrimination index (Aubrecht & Aubrecht, 1983): 0.03

20110321

Education research: partial credit for multiple-choice questions (PCMC) student attitudes (Spring semester 2011)

Starting Fall semester 2008 and continuing through Spring semester 2011, Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA have piloted the use of partial credit for multiple-choice (PCMC) questions.

During the ninth week of instruction (after taking four multiple-choice question quizzes, and a midterm with multiple-choice questions and short-answer/essay questions), students were given the opportunity to evaluate PCMC in an online "Partial Credit for Multiple-Choice (PCMC) Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Partial Credit for Multiple-Choice Survey
Cuesta College
Astronomy 210 Spring Semester 2011 sections 30674, 30676
(N = 45)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. Recall that for this semester there is PCMC = "partial
credit for multiple choice," where you can get partial
credit even after circling a wrong answer, if you have
also eliminated an incorrect answer by marking it with
an "x."
Answer the following statements which may or may not
describe your beliefs about PCMC in this class.
Because of PCMC...

II.1 ...I read questions more carefully.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 6 : ******
4. Agree 29 : ***************************** [4.2 +/- 0.8]
5. Strongly agree 20 : ********************

II.2 ...I spend more time taking a test.
1. Strongly disagree 4 : ****
2. Disagree 6 : ******
3. Neutral 14 : **************
4. Agree 21 : ********************* [3.5 +/- 1.1]
5. Strongly agree 11 : ***********

II.3 ...I feel more confident about circling a correct choice.
1. Strongly disagree 1 : *
2. Disagree 4 : ****
3. Neutral 11 : ***********
4. Agree 24 : ************************ [3.9 +/- 1.0]
5. Strongly agree 16 : ****************

II.4 ...I look for incorrect choices before circling a correct choice.
1. Strongly disagree 1 : *
2. Disagree 9 : *********
3. Neutral 9 : *********
4. Agree 17 : *****************
5. Strongly agree 20 : ******************** [3.8 +/- 1.1]

III. Answer the following statements which may or may not describe
your beliefs about PCMC in this class.

III.1 PCMC helped me answer test questions better.
1. Strongly disagree 1 : *
2. Disagree 2 : **
3. Neutral 10 : **********
4. Agree 23 : *********************** [4.1 +/- 0.9]
5. Strongly agree 20 : ********************

III.2 I would recommend using PCMC in future semesters of this class.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 5 : *****
4. Agree 17 : *****************
5. Strongly agree 34 : ********************************** [4.5 +/- 0.7]

III.3 Having PCMC a positive experience.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 7 : *******
4. Agree 22 : **********************
5. Strongly agree 27 : *************************** [4.3 +/- 0.8]

III.4 Using PCMC was difficult.
1. Strongly disagree 22 : ********************** [2.0 +/- 3.0]
2. Disagree 19 : *******************
3. Neutral 10 : **********
4. Agree 4 : ****
5. Strongly agree 1 : *

III.5 I would identify incorrect choices even without PCMC.
1. Strongly disagree 2 : **
2. Disagree 7 : *******
3. Neutral 20 : ********************
4. Agree 22 : ********************** [3.4 +/- 1.0]
5. Strongly agree 5 : *****

IV. (Optional.) Please type in any comments you may have regarding
the use of PCMC in this class.
The following are all of the student responses to this question, verbatim and unedited.
"I liked PCMC because it allows you to get points back. It helps your grade if you need it. =)"

"i like it except for when i go to look at my score i have a hard time understanding it ."

"I think that the PCMC is really great and think it is very effective in the class on tests and quizzes. The PCMC makes me more confident that I will not fail and at least get some points when I am going between two answers. I normally have really bad test anxiety and PCMC has really helped me not freak out as much as I normally would. I really like the use of PCMC in this class and really wish that more teachers would use this method."

":)"

"i was lost but being in a group with people that know it and got it helps"

"good"

"I think it is very helpful. I also think that it is great to have an extra opportunity to receive points when it could be just written off as wrong."

"Its useful but is doing things partially and getting partial credit really good if the student as clearly demonstrated they do not know the material? I suppose though that even those student will not be helped much by PCMC. I do believe it is excellent for those who can recall some details about the materials which does in fact demonstrate that they have learned some of the material, which i think should be rewarded with some credit, especially if some of the concepts are difficult to grasp."

":)"

"I like it."

"I really appreciate the opportunity to use the PCMC method on our tests. It encourages me to think about the question on a different level and provides me with the confidence to know that even if i didnt get an answer correct, I know my thought process will be recognized and appreciated."

"I think it is a great fall back for a student struggling with the test."

":)"

"I love that we can get partial credit for indentifying wrong answers, it makes me feel a little bit better if I didn't know the correct answer in the first place."

"It helps because I'm doing so poorly"

"I love it."

"it's good :)"

"It gives you hope on a question that you really have no idea how to answer."

"PCMC WOO!"

"I really like PCMC as a system for getting some partial credit on quizzes and tests. It makes it less stressful because even if I don't have certainty about my answer, I can be certain about at least one wrong answer."

"I think that instead of .5 points it should be anywhere between 1-1.5 points because if there is a 4 choice question, eliminating one question removes 25% of the choices so we should get at least 25% of the points because we knew what answer was wrong out of the 4 showing that we know what's going on.Kinda."

"It definitely helps :)"

"If we don't 'x' out an answer we know is wrong, will we not get as much credit?"

"I often confuse myself trying to figure out which wrong answer I should choose."

"It's a good method"

"i like the PCMC"

"I like it. Its just awesome"

"I feel like sometimes if i 'x' out a wrong answer then the question becomes incorrect and i am only graded solely on the partial credit wrong answer i 'x'ed out."

"I think PCMC is a great idea- however, I think it would help to have more review. I know time is a constraint, but it's hard to have a quiz or test almost every week and not go over "problem spots" or maybe have just 10 minutes the class after the quiz/test to go over common wrong answers. Even though it's nice to get some points made up with the PCMC, I think it would be better yet to know more of the correct answers. I say keep the PCMC and maybe add a 10 minute quiz or test review, or have a question on our Online Reading Assignments that allows us to ask for a review of certain topics."

"PCMC is a good help to figuring out the right answer easily"

"Gives a different perspective on the test. anybody would like to have that possibility to get a little credit when not being 100% that the selected answer was best while especially while mind dueling between two"

"I love it :)"

"I think it is really helpful. It helps you to narrow down your choices and get some extra points at the same time! I just wish they were worth a little more. Maybe a full point? .5 out of 4 isn't a whole lot, but every bit helps!"

"I think it's rad."

"Great tool. Helps you cancel out the wrong answer ."

"I like PCMC because sometimes you are torn between two answers... so if you cross off the ones you know are definitely incorrect, you already have a better score than if you took a chance and had to guess."

"Golden"

"helps"

"I think that this method is very effective for nervous multiple-choice test takers! I am definitely a fan."

"I really love all the oppurtunities we get in order to get more points inside class... PCMC really confuses me. Can you explain it more in detail?"

"PCMC has me going into stressfully test situations with more optimism and relaxation which leads to better scores"

":P"

"I think that there should be partial credit for x-ing out any of the incorrect answers not just the most incorrect because then I worry about that as well as circling the right answer. Then partial credit would be more effective and give students a few extra points if they are struggling with a few questions"

"LOVE PCMC!!!!!!!!!!!!!!!!"

"I like the PCMC because I don't feel doomed by an incorrect answer. My grade benefits as I am often able to use the knowledge I have obtained to eliminate an answer I know is wrong."


Previous posts:

20081010

Education research: partial credit for multiple-choice questions (PCMC) bibliography

Fall semester 2008 has partial credit for multiple-choice questions (PCMC) being piloted for Astronomy 210 (introductory one-semester astronomy) at Cuesta College (San Luis Obispo, CA). The intent is to get students to spend more time critically selecting their answers, especially with regards to eliminating incorrect answers. Observations of students in previous semesters is that students spend approximately one minute per question before turning in their completed quizzes, which could be considered much too little time, given that there are two minutes per question allotted.

Quizzes have 10 multiple-choice questions, each with four (A)-(D) choices.

Sample quiz questions from Fall semester 2008:
http://tinyurl.com/3tbhnz

From the course policy:
"Partial credit (0.5 points) will be given for an incorrectly circled answer to a multiple-choice question if a single "x" is also made on one incorrect response to that question. No other circumstance other than that previously described will result in partial credit."
A briefer statement on the quiz itself:
"Closed book, closed notes. Clearly circle ("O") the one choice that you think is most definitely correct. Cross out ("×") only one choice that you think is definitely incorrect."
A correct circled answer is 4.0 points, and 0.5 points is awarded for a successfully identified incorrect answer only if the circled answer is incorrect. Thus the partial-credit option is 1/8th of the full-credit possible.

Brief bibliography, with abstracts/excerpts:

"Humanizing the multiple-choice test with partial credit"
Barry M. Cherkas, Joseph Roitberg, International Journal of Mathematical Education in Science and Technology, Volume 24, Issue 6 November 1993, pages 799-812.
"We describe an innovative method for machine-grading precalculus students: the partial-credit, multiple-choice test (PCMCT). Our scheme is to assign partial credit to any wrong multiple-choice answer for which we can ascribe partially correct reasoning. This permits us to accumulate additional information about the extent of a student's incomplete understanding. We add the assigned partial credit to arrive at our final measure of a student's total knowledge—the student's grade. In comparison with the standard multiple-choice test (MCT), the PCMCT judiciously avoids the necessity to scale scores—an educationally unsound but common practice with MCTs. In addition, the PCMCT turns out to be better at distinguishing uneducated guessing than the MCT. We conducted student surveys in our pre-calculus classes and found that most students believed the PCMCT is a more accurate measure of their knowledge than the MCT. We also uncovered the remarkable result that most students are less math-anxious when taking the PCMCT than when taking either the MCT or a standard essay test."
"Comparative Review: Partial-Credit Scoring Methods for Multiple-Choice Tests"
Robert B. Frary, Applied Measurement in Education, Volume 2, Issue 1 January 1989, pages 79-96.
"This review covers multiple-choice response and scoring methods that attempt to capture information about an examinee's degree or level of knowledge with respect to each item and use this information to produce a total test score. The period covered is mainly from the early 1970s onward; earlier reviews are summarized. It is concluded that there is little to be gained from the complex responding and scoring schemes that have been investigated. Although some of them have confirmed potential to increase internal-consistency reliability, this outcome is often obtained only at the expense of validity. Also, the extra responding time required by some methods would permit lengthening a conventional multiple-choice test sufficiently to obtain the same reliability improvement. Partial-credit response and scoring methods that continue to be used will probably earn this status due to secondary characteristics such as providing feedback to enhance learning."
"A Multiple Choice Test that Rewards Partial Knowledge"
M. Bush, Journal of Further and Higher Education, Volume 25, Number 2, 1 June 2001, pp. 157-163(7).
"A new multiple choice test format is presented that allows examinees to select more than one answer to a question if they are uncertain of the correct one. Negative marking is used to penalise incorrect selections. The aim is to explicitly reward examinees who possess partial knowledge as compared with those who are simply guessing. The result is a test method that forces examinees to think more carefully about their answers, and that yields results of a higher resolution than standard multiple choice tests. After describing the new format, the paper presents and critiques several existing methods which have the same or similar aims. The paper ends with a discussion of the feedback and experience gained to date in using the new format."
"A singular choice for multiple choice"
Gudmund S. Frandsen, Michael I. Schwartzbach, ACM SIGCSE Bulletin Volume 38, Issue 4 (December 2006), p. 34-38.
"How should multiple choice tests be scored and graded, in particular when students are allowed to check several boxes to convey partial knowledge? Many strategies may seem reasonable, but we demonstrate that five self-evident axioms are sufficient to determine completely the correct strategy. We also discuss how to measure robustness of the obtained grades. Our results have practical advantages and also suggest criteria for designing multiple choice questions."

20080819

First day of clickers: introducing think-(pair)-share

Some background from education research, and then a first-day presentation to motivate students on the use of peer instruction in the classroom.

Paul J. Green at Harvard University (2003) explains the importance of clearly outlining the motivation for, and the means of using clickers in the classroom:
"For Peer Instruction, Day One is particularly important. This is when you can set the tone for a relaxed classroom environment where inquiry and participation are encouraged. It is also the best time to make clear that Peer Instruction is not a free-for-all. During the first several classes, lay out clearly what you expect from the students, and how they will be evaluated..."
Amy Forestell at the University of Texas (2008) outlines an exemplary think-(pair)-share procedure:
"Present question to students. Ask students to 'think' individually about the question for "x" seconds or minutes. Say, 'Here's a question that we will vote on' or simply, 'Question.' Don't go into a lengthy introduction or description. Don’t read the question aloud. Read it to yourself slowly as if you were a student reading it for the first time and had to answer it... When you are finished you should have a sense that most students are done and getting their cards ready to vote. Say, 'How many people need more time?' Don't say something like 'Everyone done?' because you don't get good feedback from that. If many students actually need more time they will let you know.
      "Have students anonymously provide their answer to the question simultaneously as a class. When most students are ready say, 'Vote on the count of three. One, two, three, vote...'
      "Decide if students should 'share' their answers with each other. This is the case when about 50% of the students are correct. If more than [about] 80% of students are correct, there is no need to discuss the question further. If fewer than 50% of students are incorrect, there isn't a critical mass for fruitful discussion... If between 50% and 80% of the students got it right...tell the students, 'Find a person who has a different answer than yours and convince them that you are right. You have [time limit] minutes.' You may remind them that this might require getting up and moving around the room. After they have had enough time (not necessarily the time you said) tell them to stop. To get their attention you may have a happy place in the room you return to, flash the lights, or ring a bell. Say it is time to vote again. Vote as above: 'One, two, three, vote.' Share the results with your students."
Neil Lasry, at John Abbott College, Quebec (2008) finds that:
"...whereas flashcards require taking class-time to tabulate responses or estimate answer distributions, clickers allow instructors to automatically get precise real-time student feedback. ...From a learning perspective, using PI [Peer Instruction] with clickers does not provide any significant learning advantage over low-tech flashcards."
At Cuesta College in fall semester 2008, Astronomy 210 (introductory astronomy) students will be trained to use flashcards on the first day of class, but will use clickers for the remainder of the semester, primarily as a means to gain useful statistics on student responses. Links to the full-size front and backs of these cards (to be folded over by the students and held under their chin to respond) are posted below:




The following first-day presentation introduces students to the motivation of, and use of clickers (and in the interim, simple flashcards) in the classroom.



A contrast is made between the traditional passive mode of learning, where the focus of the students is on the instructor...



...with an active mode of learning, where the focus of the instructor, as well as the rest of the classroom, is on the students themselves.



How will this happen? Better than asking for a show of hands is to get students to commit to their answers using flashcards. (N.b.: Ed Prather at the University of Arizona recommends taking digital photos (or at least, pretending to) of the classroom after students show their flashcards as a conceit of getting students to fully participate. Ex: "Hold your flashcards up! Keep them up! I have to take a photo of this...because this is neat! It's important to me!")



Electronic response systems (clickers) will be used to compile answers such that the instructor and students can gauge how the class as a whole is doing.



The method (as detailed above by Amy Forestell) is think-(pair)-share, where a question is posed, students think about it (without discussion), and then share their answers using flashcards or clickers. If there needs to be a follow-up, then students are highly encouraged (forced) to share and defend their answers with a student who responded differently, and then share their answers again, hopefully with a shift towards a more correct answer.



Flashcards will be used to initially train students in the think-(pair)-share methodology.



Then as students purchase and register their clickers, then they will be used to respond to think-(pair)-share questions. Students receive credit no matter how they respond, but they must be present in class and respond to more than half of the questions in order to receive full participation credit for that day.



Again emphasizing the passive (read: boring) nature of a traditional classroom...



...with the active (read: more exciting) nature of an interactive classroom.



Questions, anyone? (This presentation is then immediately followed-up by a syllabus quiz using think-(pair)-share.)



Bibliography:

20100524

Astronomy quiz question: IAU classification scheme for comets, asteroids

Astronomy 210 Quiz 7, Spring Semester 2010
Cuesta College, San Luis Obispo, CA

[Version 1]

Listed below are the minimal qualifications established by the International Astronomical Union for a planet:
  • I. Orbits the sun.
  • II. Shape "rounded-out" by gravity.
  • III. Cleared/dominates orbit around sun.
Which of these qualifications are met by a comet?
(A) I only.
(B) II only.
(C) III only.
(D) Both I and II.
(E) Both II and III.
(F) Both I and III.
(G) (None of the above choices.)

Section 30674
(A) : 23 students
(B) : 5 students
(C) : 0 students
(D) : 5 students
(E) : 1 student
(F) : 1 student
(G) : 6 students

Correct answer: (A)

Comets are typically irregularly shaped, and have eccentric and tilted orbits around the sun, and thus they have not cleared out nor dominate their orbits.

"Success level": 59% (including partial credit for multiple-choice)
Discrimination index (Aubrecht & Aubrecht, 1983): 0.82

[Version 2]

Listed below are the minimal qualifications established by the International Astronomical Union for a planet:
  • I. Orbits the sun.
  • II. Shape "rounded-out" by gravity.
  • III. Cleared/dominates orbit around sun.
Which of these qualifications are met by an asteroid?
(A) I only.
(B) II only.
(C) III only.
(D) Both I and II.
(E) Both II and III.
(F) Both I and III.
(G) (None of the above choices.)

Section 30676
(A) : 23 students
(B) : 5 students
(C) : 3 students
(D) : 16 students
(E) : 5 students
(F) : 6 students
(G) : 2 students

Correct answer: (A)

Asteroids orbit the sun, typically between Mars and Jupiter. However, they are irregularly shaped (if they were spherical, they would be dwarf planets), and they have not cleared out nor dominate their orbits (if they did, they would be planets).

This quiz question was also given in Fall semester 2008.

"Success level": 46% (including partial credit for multiple-choice)
Discrimination index (Aubrecht & Aubrecht, 1983): 0.60

20100501

Astronomy quiz question: Milky Way shape

Astronomy 210 Quiz 6, Spring Semester 2010
Cuesta College, San Luis Obispo, CA

__________ is evidence that the Milky Way is shaped like a flat disk.
(A) Statistically, most other galaxies are shaped like flat disks.
(B) Naked-eye observations at dark sky locations.
(C) Distant stars appear to be dimmer than nearby stars.
(D) The precession of the axis of the Earth's rotation.

Correct answer: (B)

Since the stars of the Milky Way form a band across the night sky, as seen from Earth, its overall shape must be thin and flat, as opposed to spherical.

Section 30676
(A) : 7 students
(B) : 20 students
(C) : 30 students
(D) : 12 students

Compare to a similar quiz question from Fall semester 2008.

"Success level": 34% (including partial credit for multiple-choice)
Discrimination index (Aubrecht & Aubrecht, 1983): 0.55

20080916

Education research: preliminary feedback on clickers (Cuesta College, Astronomy 210, Fall Semester 2008)

At the start of Fall semester 2008, Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA have begun use of clickers (Classroom Performance System, einstruction.com) to engage in peer-interaction ("think-(pair)-share") discussion questions during lecture.

During the third week of instruction, students were given the opportunity to evaluate the instructional components of the course, and the use of clickers in an online "Learning Resource Survey" hosted by SurveyMonkey.com. Questions from section II are adapted from the Student Assessment of Learning Gains (SALG) survey (developed by Elaine Seymour, Wisconsin Center for Education Research, University of Wisconsin-Madison), and questions from section III (III.1, III.3, III.5, and III.7) were adapted from a "Clicker Attitude Survey" (N. W. Reay, Lei Bao, and Pengfei Li, Physics Education Research Group, Ohio State University).

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question. Note that the order of questions within sections II and III were randomly scrambled for each student.
Learning Resource Survey
Cuesta College
Astronomy 210 Fall Semester 2008 sections 70158, 70160
(N = 44)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. How much did each of the following aspects of the class help
your learning?

II.1 Lecture by instructor.
1. Strongly disagree 0 :
2. Disagree 3 : ***
3. Neutral 9 : *********
4. Agree 18 : ****************** [4.0 +/- 0.9]
5. Strongly agree 14 : **************

II.2 Working in groups on in-class activities.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 3 : ***
4. Agree 23 : *********************** [4.2 +/- 0.8]
5. Strongly agree 16 : ****************

II.3 Using clickers to participate in class.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 6 : ******
4. Agree 21 : ********************* [4.2 +/- 0.7]
5. Strongly agree 16 : ****************

II.4 Reading the textbook.
1. Strongly disagree 0 :
2. Disagree 7 : *******
3. Neutral 17 : ***************** [3.4 +/- 0.9]
4. Agree 14 : **************
5. Strongly agree 6 : ******

II.5 Demonstrations/videos in class.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 4 : ****
4. Agree 21 : ********************* [4.1 +/- 0.8]
5. Strongly agree 15 : ***************

II.6 Interacting with other students during class.
1. Strongly disagree 0 :
2. Disagree 1 : *
3. Neutral 5 : *****
4. Agree 24 : ************************ [4.2 +/- 0.7]
5. Strongly agree 14 : **************

II.7 Interacting with other students outside of class.
1. Strongly disagree 3 : ***
2. Disagree 3 : ***
3. Neutral 27 : *************************** [3.1 +/- 0.9]
4. Agree 10 : **********
5. Strongly agree 1 : *

III. Answer the following statements which may or may not describe
your beliefs about the use of clickers in this class.

III.1 I like using clickers.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 8 : ********
4. Agree 25 : ************************* [4.1 +/- 0.7]
5. Strongly agree 11 : ***********

III.2 Clickers helped me understand lectures better.
1. Strongly disagree 0 :
2. Disagree 2 : **
3. Neutral 13 : *************
4. Agree 21 : ********************* [3.8 +/- 0.8]
5. Strongly agree 8 : ********

III.3 I would recommend using clickers in future semesters of this class.
1. Strongly disagree 1 : *
2. Disagree 1 : *
3. Neutral 4 : ****
4. Agree 24 : ************************ [4.1 +/- 0.8]
5. Strongly agree 14 : **************

III.4 I will avoid other classes using clickers in future semesters.
1. Strongly disagree 16 : ****************
2. Disagree 24 : ************************ [1.8 +/- 2.5]
3. Neutral 2 : **
4. Agree 1 : *
5. Strongly agree 1 : *

III.5 Clickers were a positive experience.
1. Strongly disagree 0 :
2. Disagree 0 :
3. Neutral 6 : ******
4. Agree 26 : ************************** [4.1 +/- 0.6]
5. Strongly agree 12 : ************

III.6 Too much time in class was spent using clickers.
1. Strongly disagree 10 : **********
2. Disagree 23 : *********************** [2.1 +/- 1.6]
3. Neutral 9 : *********
4. Agree 2 : **
5. Strongly agree 0 :

III.7 Too many clicker questions were asked.
1. Strongly disagree 8 : ********
2. Disagree 23 : *********************** [2.1 +/- 1.4]
3. Neutral 11 : ***********
4. Agree 1 : *
5. Strongly agree 0 :

III.8 Using clickers was difficult.
1. Strongly disagree 16 : ****************
2. Disagree 22 : ********************** [1.8 +/- 2.5]
3. Neutral 3 : ***
4. Agree 1 : *
5. Strongly agree 1 : *

IV. (Optional.) Please type in any comments you may have regarding
the use of clickers in Astronomy 210.
The following are all of the student responses to this question, verbatim and unedited.
"I think the clickers are a cool idea, and very inventive. I had never heard of them before in real classes, and i like the college exclusive idea."

"I like the use of clickers in class and the group activities in class. I sometimes feel like am way in over my head in astronomy."

"Clickers are new to me, and that may be why I enjoy them so much. But I do like the fact that I can participate and see how I do compared to the rest of the class."

"The concept of using the clickers opens up a whole new approach to getting instant answers from the students to see how we're picking it up.Can this concept be used in other situations? I also think that if the system wants to experiment with this concept, the added cost of the clickers should be absorbed.I don't enough about them to really add more insight."

"I think it's a very organized way to gauge the students' grasps of concepts."

"I feel they let us know how we're doing. How well we understand the material of the day."

"i think the clickers are a good way of interacting with the people around and the clicker questions help me learn and better understand some of the concepts learned in class"

"I think that the questions in this survey are sell suited to an Astronomy class. If I were in English I would not like to use clickers. I think that the visual models really help to understand since the actual objects are very large and impossible to observe well from multiple perspectives/distances."

"Using the clickers in class is one of my favorite activities. It helps me learn what I don't know or I can help others with what I already know. I also like seeing the percentages of people who said different answers. It is an overall great learning experience!"

"I think that the clickers are a very interactive way for us, the students, to better understand the material. Its more visual and its helpful to see what others think the answer was and why the answer wasnt right. I believe the clickers to be very helpful."

"I enjoy using the clickers! I have not had any class use clickers before and i believe they are a postive tool to further learning in the classroom."

"At first it was hard to figure out how to get how the clickers worked, but as soon as i got it working and figured out it has been kind of fun and very helpful. It worries that me sometimes that my clicker doesn't always work and that i won't get credit."

"i like using clickers and talking to other students to find out why they chose the answer that they did. it helps me understand the question better. however, i sometimes get frustrated because my clicker's signal isn't strong enough, so im not always sure that my answer gets inputed and counted for."

"It was hard to get them a; up and running. i dont like how they were cost so much money and it is sometimes hard to get my clicker to connect with the devise that picks up signals!"

"Everything was good but should remind students to make sure that the students look up their number before going to class"

"I find clickers very useful for learning. It is very helpful because it causes inter-action and helps to keep me involved in the material. I especially like discussing the clicker questions with other classmates after the initial answer has been given."

"Once i got my clicker working and knew my number, it is a nice resource."

"I think they are a great way to engage the class but I sometimes take too long to answer. And it seems that a lot of people guess on them. But I think they are fun."

"Clickers are okay but I seem to have difficulty in knowing if it is registering correctly."

"The clickers are a cool, interactive way of learning."

"I like using clickers because they allow me to solve questions by myself. After that, I can discuss the results with other people. This system helps me to understand lectures more. Finally, I can get correct answers more confidently. I strongly recommend this system."

"To a degree, the clickers simulate test, and quiz taking experiences. As a result, this should hopefully boost the confidence of the class during exams, potentially generating higher grades all around. Also, the interaction between classmates during clicker questions creates a better understanding of the material for exam days. I think all clicker questions should have two answering periods, the initial response, and the recalculated response, in order to continue interaction and comprehension."

20101223

Education research: post- feedback on think-pair-share attitudes (Astronomy 210, Cuesta College, Fall Semester 2010)

Cuesta College students taking Astronomy 210 (introductory astronomy) at Cuesta College, San Luis Obispo, CA used flashcards to engage in peer-interaction ("think-pair-share") discussion questions during lecture.

During the last week of instruction, students were given the opportunity to evaluate the use of clickers in implementing peer-instruction in an online "Think-Pair-Share Survey" hosted by SurveyMonkey.com.

These are the complete survey results. Analysis will be forthcoming after more data has been compiled from future semesters. Values for the mean and standard deviations are given next to the modal response category for each question.

Cuesta College
Astronomy 210 Fall Semester 2010 sections 70158, 70160
(N = 64)

I. In order to receive credit for completing this survey,
first enter your first and last name below:
____


II. Recall that for this semester that flashcards are used in a think-pair-share
system, where students think and answer individually, and if there is a lack of
consensus, then students pair off and share explanations with each other before
answering again. Answer the following statements which may or may not describe
your beliefs about think-pair-share in this class.

II.1 I feel comfortable engaging with think-pair-share with other students.
1. Strongly disagree 0 :
2. Disagree 6 : ******
3. Neutral 10 : **********
4. Agree 35 : *********************************** [3.8 +/- 0.8]
5. Strongly agree 11 : ***********

II.2 I explain more often than I listen to other students during
think-pair-share.
1. Strongly disagree 0 :
2. Disagree 14 : **************
3. Neutral 33 : ********************************* [3.0 +/- 0.7]
4. Agree 15 : ***************
5. Strongly agree 0 :

II.3 I change answers more often than I keep the same answer after
think-pair-share.
1. Strongly disagree 0 :
2. Disagree 17 : *****************
3. Neutral 27 : *************************** [3.0 +/- 0.8]
4. Agree 16 : ****************
5. Strongly agree 2 : **

III. (Optional.) Please type in any comments you may have regarding the use of
think-pair-share flashcard use in this class.
The following are all of the student responses to this question, verbatim and unedited (with a few editorial context clarifications in [brackets]).
"I think you should let the students make the questions and ask their classmates"

"it seems to work fairly well for our setting."

"I think it's a pretty good way of gaining more understanding and being able to come up with an explanation, to ensure 'you' actually know why."

"Its ok"

"flash card questions are fine, but i really wish our tests/quizzes were visibly graded when handed back to us"

"great job!"

"I liked it because usually another students explanation of the answer is easier to understand and makes more sense to "

"I think flashcards are a good idea, it helps me better undertand the topics we cover in class"

"Is good."

"I think think-pair-share is beneficial because it is useful to learn from your peers"

"Hi :)"

"The think-pair-share flashcard use in class is very helpful also, it is fun to quiz yourself."

"its a great technique for students an many schools should use it more often"

"I didn't find the use of think-pair-share to be very beneficial to me in this class. I rarely had someone that could explain their answer to me in a way to make me change my answer, or to help me come to a decision if I was unclear."

"Its cool to have different insights on subjects. I like being able to discuise"

"I think the idea is great. I really appreciate the chance to explain it to somebody else because if I can do that it means I really know it. I think the idea would be even better if all the people who were in class said something during this time. Quite a few times, I am in a group and I have to do this, and I am the only one who talks, so I just assume that since nobody proved me wrong my answer must be right."

"I think the think-pair-share flashcard system is great, although, it is lacking something very important. Once we are finished sharing and are answering for the second time (actually, even if we only answer once) as a student I need to here the answer from you, the instructor. Even if my partner during the flashcard activities is right and explains it, I am speaking from a student in your class, I would like you to clearly state the correct answer and give a thorough explination about why that is the correct choice."

"I think it's a good way to learn because you get to learn it another way that may help you mote than the way the instructor did????"

"I think it's a really good way to find out where the class is for certain topics and allows people to discuss and really talk things out."

"They are a good way to figure out the answer as a class and a good change of pace from the lecture"

"I really enjoy doing think-pair-share because I am able to learn more than I would by just sitting listening to a lecture."

"I like the think pair share method. I love being able to hear the explanations that other students have. A lot of the time they explain it in simple terms ;3"

"I really learned a lot from listening to others explain as well as the teacher."

"I thought it was a great way of letting everyone think about concepts for themselves."

"I think this is a good way to learn but I think if the teacher were also to participate and explain each flashcard question afterward it would help a lot"

"Flashcard questions are a good tool. Keep using them P~DAWG."

"i think it is a good system. very helpful"

"I think its a pretty good system... a bit time consuming though"

"I like it because If you know you have the correct answer you can help other students also get the right answer and if you are uncertain you can get help from your fellow students when they are willing to share."

"If Im following along with lecture, which I usually am when I am present, I can answer most flashcard questions."

"I'm neutral for the second one b/c how i feel depends on who i am engaging with."

"Very useful. When you can explain in your own words, or you get explained the point by a peer, it is easier to grasp the material."

"I think its a good idea, but it would be nice if we went through all of the falsh card questions"

"I liked them except I wish that all correct answers were available to the students before the quizzes and tests."

"Good system, but I wish the teacher would explain the answers more than relying on other students to do it becaus a lot of the time nobody around me knows the answer."

"i wish he would go over the answer more"

"I enjoy think-pair-share because it gives me an opportunity to engage with the people around me and it either reinforces or makes me rethink my answers"

"I like using flashcards, if I know I'm right, I like convincing other people. If I am unsure, it is helpful to listen to the explanation of another student instead of just getting it wrong. It helps me remember."

"I think it is helpful but i still usually chose E because i rarely know how to explain it."

"they're grrrrrreat!"

"Time to print out a few new ones... Some are falling apart!"

"It often confuses me more. I have my own idea for the answer and they might have a different point, which gives me conflicted feelings and I'm forced to choose 'I'm lost.'"

"I think the flashcards are a great learning style"

"I think it's good."

"i think it is a helpful tool because sometimes its easier to understand from someone else."

"The use of think-pair-share flashcards is definitely beneficial because it enables the student to think for themselves and converse with other students to figure out the answwr instead of being given it."

"i like it even though its common for both me and the people i am talking to to have guessed at the answer."

"I like being able to discuss the answers with different classmates so i can get an understanding on the answer, but sometimes I feel that I don't get very good answers the questions and its hard to know why the answer is right"

"i like the thought of answering individually and if i get it wrong then seeing what everyone else got"

"I like this system because students can usually explain an outcome or event in ways that we can better understand."

"Using flashcards has helped me personally, and I would recommend this instruction technique be used for future semesters."

"Think-pair-share is usually helpful. Sometimes it is confusing when people are arguing their answers, but it is always eventually explained."

"I really like this method. We not only get to see someone elses point of view of why you may be wrong but also we get to know our classmates a little better."

"The flashcard questions help me for quizzes.. but i can never answer them in class"
Previous posts: