Logo

Remote Assessments and Proctoring - Shared screen with speaker view
Caryn Neiswender
11:22
Welcome everyone! We’ll get started in about 6 minutes
Caryn Neiswender
16:08
Thanks to all of you for joining us! We’re just a few minutes away from 10 am.
Miguel Rodriguez
21:44
Hi everyone!
Tricia Bertram Gallant (UCSD)
21:51
hi all!
Edual Ruiz
22:09
Hi!
April Cha (UCSD)
30:29
chat is now enabled. please feel free to type any questions in the chat panel.
Hyunsun Kim
30:41
I don’t understand what scffolding means...
Daniel Mertz Kane
31:11
I'm teaching a math class. How am I supposed to incorporate perspective?
Kristin Liljestrom
31:23
https://study.com/academy/lesson/scaffolding-in-education-definition-theory-examples.html
April Cha (UCSD)
32:07
@Hyunsun -scaffolding means that your assessments build on one another. Students can build on their learning and progress in stages towards the learning outcome
Piya Pal
32:10
good question
Kristin Liljestrom
32:37
Bridging what they know to new material, checking for understanding, offering support as they learn new information
Lisa Robock Shaffer
33:01
Can we assume all students have the ability to create and submit a video in response to an assessment assignment?
April Cha (UCSD)
33:15
@Daniel - you can create perspective by building in reflective questions and asking students to explain how they might have completed a problem or what did they find challenging about a particular problem
Kristin Liljestrom
33:19
Works best through discussion and checking for students subject knowledge at the start of a course
Cindy Perez
33:56
Hi @Lisa, this is a good question. Students will have different access to technology, so it’s always a good idea to have alternative options for students who might not have a webcam or external microphone.
April Cha (UCSD)
34:00
@Lisa absolutely! you can ask students to be creative and record themselves demonstrating or teaching a peer and submit their media file in canvas
Daniel Mertz Kane
34:37
@April - what does that accomplish other than making the students feel good?
Bruce Blakley
34:59
20 minute 20 question quiz tomorrow 12:30 class -how to accomodate students in distant time zone who would see this hours later?
Lisa Robock Shaffer
35:21
I was asking from an equity perspective, whether everyone has access to a camera.
Saharnaz Baghdadchi
36:42
@Lisa - They can use the camera on their phones.
Sheena Serslev
36:58
@Lisa you could have a poll that asks students if they have access to a camera/phone to film themselves and if you have students who are unable to create a video perhaps could have a couple options of different mediums for a given assignment (paper or video)
April Cha (UCSD)
37:00
@Daniel it asks the students to use higher order thinking to explain their process and examine how they might work through specific challenges. helps you as the instructor gauge if they are understanding the principles, how TAs can support their learning.
Peggy Lott
37:16
One type of assessment we use in ASL is to show students a video of someone signing and ask them questions about the structure and content. What technology would you recommend for students to view a video (without being able to view it repeatedly or view it in slow motion)?
David Sandwell
38:29
For an assignment where they will use a pencil to add the answer. How will they print the paper copy?
Zhisen (Marina) Urgolites
39:22
How to make sure that students do not use other materials or webpages during a quiz on canvas?
Kristin Liljestrom
39:33
https://filmora.wondershare.com/video-editor/slow-motion-player.html
Kristin Liljestrom
39:44
There are slow motion players for MP4 videos
April Cha (UCSD)
39:55
@Peggy yes you can embed videos in Canvas assignment prompts. we should discuss this further if there are specific configurations you need. feel free to email online@ucsd.edu
Adarsh Parthasarathy
40:28
@Daniel there are great ways to do take home math exams. One way is to require students to submit their exam a specified amount of time after they have viewed the question set. this, combined with randomizing questions and multiple exam versions, along with a sufficient exam length, could alleviate some academic integrity issues.
April Cha (UCSD)
40:53
kaltura player allows you to also control the playback speed
Stacey Williams
41:29
@Zhisen there are online proctoring services that can be used, Like ProctorU. https://www.proctoru.com/
Darwin
41:43
Can I give a short written answer quiz? Would I be able to print out each student's answer to the quiz questions?
Stacey Livingstone
42:00
Sorry, I was also reading the chat questions, why should we not click “Let Students See Their Quiz Responses”
Edual Ruiz
42:38
@Stacey they can compare responses and share answers if you let students see their quiz responses
Vincent Nijs
42:53
If you don’t allow multiple attempts students cannot edit any answers after they submit. Is there a way around this? I do *not* want them to see answers after submit but I do want them to be able to edit after submitting, at a least within the time allotted
Stacey Livingstone
42:57
okay thanks
Cindy Perez
43:02
Hi @Zhisen, ETS can provide more information regarding the settings, but Canvas will store data on students who click out of the quiz tab. You could let students know in advance that you have access to view these settings. We’re also in the process of getting Respondus LockDown browser, which will lock down the students testing environment. More information about this will be made available on our website digitallearning.ucsd.edu/instructors/resources/proctoring
Zhisen (Marina) Urgolites
43:09
Is ProctorU free? If not, does UCSD have subscription to it?
April Cha (UCSD)
43:10
@ Darwin, yes Canvas will allow you to create quizzes with short answer/essay questions. you can export these from the gradebook for viewing or you can simply use the speedgrader to see student responses
Daniel Mertz Kane
43:29
Does that really help much? They can still record all of the questions and give the students after them basically unlimited time to figure out the answers.
Cindy Perez
44:49
@Zhishen, we have a contract with ProctorU but given the level of security that live proctoring provides (as well proctoring capacity), we recommend that this option be reserved for high stakes exams such as final exams
Darwin
45:16
Thank you
Bronwyn Kaiser
45:41
@Cindy Didn't Berkeley say proctoring services can't be used? Any sense if that might become broader?
Adarsh Parthasarathy
45:45
@Daniel while it's true students could croud source answers from multiple exam versions, a sufficient number of questions would make such crowdsourcing unrealistic. allowing the exam sheet to only be available for 12 hours would also balance time zone considerations with student wellbeing concerns. In a class with 200 people with 20 different exam versions, cheating would be unrealistic if the exams were designed to take close to the 3 hour time limit for finals. of course it isn't a perfect solution but it would appear that one doesn't exist in these circumstances
Zhisen (Marina) Urgolites
46:40
My class is over 300 students. Essay questions would be a little too much for grading for instructor and TA . There might need to be multiple choice questions that could be automatically graded, for midterms and final. In that case, can I use ProctorU for midterm?
Cindy Perez
47:30
Hi @Bronwyn, we’re following messaging from the EVC Office - as of now, there is no indication that proctoring won’t be allowed at UCSD.
Stacey Livingstone
48:15
sorry, who will be assigned as a proctor, the instructor and Was, or are you working with someone at UCSD or beyond to provide proctors
Stacey Livingstone
48:33
sounds like you have a service you will be using
Christine Alvarado
48:41
Similar question to Bronwyn: Many faculty and students are very uncomfortable with remote proctoring. Can a student refuse? Are we (as an institution) really OK with allowing instructors to require it? (Personally, I have concerns).
Karen Flammer
48:43
@Bronwyn, Berkeley and other campuses are not using proctoring services this semester due to all the issues mentioned, privacy concerns, equitable access, etc.. They are also concerned about the availability of proctoring based on the flood of requests. Our campus is still allowing proctoring.
Cindy Perez
49:09
@Stavey, the proctoring services that Caryn is reviewing right now are all managed by 3rd parties that UCSD has contracted. They are all professionally trained proctors that work for these proctoring companies.
April Cha (UCSD)
49:30
@Zhisen, we'd be happy to discuss this further with you to better understand your exams. we typically recommend live proctoring for highest-stakes exams and following formative assessment design practices that prepare students for their final exam. please email online@ucsd.edu and I'd be happy to discuss more with you
Stacey Livingstone
49:40
okay thanks
Zhisen (Marina) Urgolites
50:08
Sounds good. Thank you, April!
Karen Flammer
50:23
@Christine - Faculty need to offer alternatives to proctoring if students object to proctoring or if they do not have the technology required. This is why we are encouraging alternatives to proctoring.
Haozhe Yi
51:09
Good morning, sorry I was late, just want to know will this video be shared later?
Cindy Perez
51:37
Hi @Haozhe, this video is being recorded and will be available on our website at digitallearning.ucsd.edu as well as commons.ucsd.edu
Cindy Perez
51:44
The slides will also be made available
Haozhe Yi
51:58
Thanks a lot, that would be really helpfu
Haozhe Yi
51:59
l
Lynn
52:56
Are we not allowed to use the allocated 3-hr time slot to give a 2 hr final exam? Why is 48 hr required since it is scheduled in advance.
Cindy Perez
54:00
Hi @Lynn, these are the minimum requirements that our contracted proctoring services require - this is due to multiple reasons, but the main issue is proctoring capacity.
Christine Alvarado
54:09
If students can opt out of proctoring, why would we use it at all? Doesn't it put extra stress and limitation on some students and not others?
Bronwyn Kaiser
54:27
@Lynn also, that 3-hour time slot might fall 2-5am depending on where a student lives
Lynn
54:42
So the 48 hr recommendation applies primarily to ProctorU?
Kristin Liljestrom
54:53
Can someone please repeat what the tool is for automated proctoring?
Stacey Livingstone
55:05
how would an instructor sign up for the training
Clarissa Reese
55:05
can Canvas quizzes be password protected?
Benjamin Ciotti
55:40
Kristin: Examity
April Cha (UCSD)
55:45
@Clarissa, yes canvas quizzes can be password protected
Kristin Liljestrom
55:51
Thank you, Benjamin!
Clarissa Reese
55:58
thank you
April Cha (UCSD)
56:46
@Kristin, we are also currently looking at Respondus as an alternative. info coming soon on our website digitallearning.ucsd.edu
Kristin Liljestrom
57:22
Thank you, April!
David M Kamensky
57:30
What about DIY proctoring via Zoom (maybe with an alternate time slot to accommodate different time zones)? I think some colleagues used that in the winter for finals.
April Cha (UCSD)
58:02
@Lynn 48-hour windows are a minimum recommended window for all live proctoring sessions (currently only available through proctoru)
Elisa Geiss
58:47
If we already have a proctoring service set up, do we need to do the expression of interest form?
Cindy Perez
59:02
@Lynn, we still recommend a larger window even for automated proctoring. If all of your students are taking the exam within the same 2 hour window and they have any technical issues, proctoring support (as well as TAs or anyone else the students reach out to) will be overwhelmed
Hyunsun Kim
01:00:12
Is there a randomizing function if using gradescope?
Maziar Ghazinejad
01:00:24
Rather than using Proctoring Service, can we have course TAs and instructor to monitor exam via zoom?
Georgia Kayser
01:00:34
While students have a 48 hour window, we can still limit the time possible for the exam/quiz, correct? Eg. 48 hour window with a 1.5 hour exam.
April Cha (UCSD)
01:00:50
yes, that's correct @Georgia. Thank you for clarifying
Curt Schurgers
01:01:14
To echo the other question, can we use zoom to proctor ourselves, and can we record?
Todd Kemp
01:01:36
Some of the math faculty would like to design a proctoring method using Zoom (with their TAs monitoring). It sounds like that’s discouraged, but is it allowed?
Sally Sadoff
01:02:09
I have the same question as Georgia, Kurt and Todd
Sally Sadoff
01:02:17
Sorry Curt
Maziar Ghazinejad
01:02:25
Same here?
Vincent Nijs
01:02:30
Todd: I did that for a winter exam. Students had to have their webcam turned on. Seemed to work ok.
Georgia Kayser
01:02:59
Some students do not have camera’s. They would not be able to take the proctor u, correct. What do you suggest for those students?
Curt Schurgers
01:03:14
I already have some students express privacy concerns with using zoom (and recording zoom sessions).
Melissa Famulari
01:04:56
For classes that cannot use essay exams, Econ is using individual proctoring via zoom as opposed to group proctoring via zoom.
Heather Pines
01:04:56
Due to privacy concerns, are we satisfied with randomizing questions and answer choices as a means for ensuring academic integrity for a multiple choice exam in Canvas? Are there ways to prevent students from checking websites or pdfs of notes during the exam?
Christine Alvarado
01:05:15
Thanks.
April Cha (UCSD)
01:05:17
@Curt and others, regarding using Zoom, you'll notice that Zoom doesn't replicate the live proctoring services such as authentication, AI tracking, and comprehensive reports. Another consideration is requiring students to be in a digital room at the same time can be challenging. there are several challenges and we are recommending that instructors really think about their assessment design first. Digital Learning and Engaged Teaching Hubs are all here to support that effort
April Cha (UCSD)
01:05:26
online@ucsd.edu and engagedteaching@ucsd.edu
Tricia Bertram Gallant (UCSD)
01:06:53
@Heather - there are NOT ways to prevent students from checking websites or pdfs. We recommend making "open resource" exams - timed and well-designed questions so that too much time spent outside of the exam (looking for answers) means that they likely won't score well
Heather Pines
01:07:50
Thank you
Zhisen (Marina) Urgolites
01:08:07
There is something called Respondous Lockdown Browser which would prevent students from navigating to other screens that is not the exam screen. I wonder if UCSD would considering using it?
Tricia Bertram Gallant (UCSD)
01:08:09
without clear guidance from the University or your department, I think every instructor be facing a right vs. right choice. It is right to take measures to protect privacy but it is also right to ensure integrity. I think there are ways to balance both, but it takes more work on assessment design
Zhisen (Marina) Urgolites
01:08:37
That would address Heather’s concern, and my concern too, but students using other webpage or digital resources during exam
Cindy Perez
01:09:16
Hi @Zhisen, we are currently working on enabling Respondus on campus. More information TBA on our website digitallearning.ucsd.edu
Bruce Blakley
01:10:30
How about one on one verbal finals?
Zhisen (Marina) Urgolites
01:10:34
@ Cindy, if UCSD could start to use Respondous lockdown browser quick, it would be amazing. My more than 300-student class has the first midterm on around April 18, if it would be available before that, it would be amazing
Tricia Bertram Gallant (UCSD)
01:11:27
@Bruce Blakley - oral exams would be a terrific option if your class is a sufficient size to manage that
April Cha (UCSD)
01:12:54
@Bruce, echoing Tricia's comment, this would be a great option given that you are assessing specific demonstration skills. also options to have students record themselves and upload for review. - this will depend on what you are needing to assess
Tricia Bertram Gallant (UCSD)
01:13:08
there is a good question about the 48 hour time window. As far as I am aware, that it only required if you are using one of those online proctoring services. otherwise, your exam occurs during the scheduled time. Karen Flammer or others - please correct me if I'm wrong
Cindy Perez
01:13:49
Yes, the 48 window is a requirement for our contracted proctoring services only.
April Cha (UCSD)
01:14:21
the 48-hour minimum window is for Live proctoring services (currently only available through proctoru)
Bronwyn Kaiser
01:14:26
But it's also a general recommendation to have a wider window regardless, right? Because of time zones and whatnot
April Cha (UCSD)
01:14:59
yes @Bronwyn, thank you for that. a wider window is always recommended for larger classes
Kathleen Johnson
01:15:04
Faculty who wish to record their remote classes should, at the start of each class session that will be recorded, announce to the students (on air) that the class will be recorded and made available to students asynchronously. This announcement gives all participants fair notice of the recording in much the same way as customer service telephone lines announce at the beginning of a call that “this call may be recorded for quality assurance purposes.” In addition to making an announcement at the beginning of each class session to be recorded, it would be a best practice for faculty to note on their syllabi that class sessions will be recorded and made available to students asynchronously. Finally, for documentation purposes, it is best if the oral announcement at the beginning of each class is itself recorded, so there is no question about whether the announcement was made for any particular class session.
Karen Flammer
01:15:46
Thanks, Kathleen, absolutely correct!
Karen Flammer
01:16:25
Same is true when faculty use podcasting. There needs to be a sign on the door or announcement.
Melissa Famulari
01:17:01
What is the cost of proctoring services via the AI office ?
Benjamin Ciotti
01:17:24
Melissa: they are free
Melissa Famulari
01:17:42
Thanks you!
Benjamin Ciotti
01:17:50
sure!
Karen Flammer
01:18:21
And available from keepteaching.ucsd.edu
Jim Branson
01:19:04
I was surprised by the last answer that you can’t record the students video session in a test. Was that right?
Lisa Robock Shaffer
01:19:32
Agree that staff support has been outstanding! I feel very well supported as we muddle through.
Cindy Perez
01:19:53
@Jim, you can ask students to share their screen if you would like to see what they are seeing on their screen. Whether or not this can be recorded, I will defer to ETS and EdTech
Edual Ruiz
01:20:06
@Jim - I think it was more about the limitations of the technology, than a policy issue.
Georgia Kayser
01:23:01
For those of us who have 75-400 students, it is very difficult to use the recommended forms of assessment. To maintain privacy and integrity, what do you recommend for proctoring student exams? Proctor U fails on privacy. Zoom is difficult with the 48 hour window. It would be helpful to get some suggestions for our larger classes.
Kristin Liljestrom
01:23:41
Bye Everyone!
Jennifer Maynard
01:23:50
Bye everyone!!