Modeling Human Trust in an Adaptive Automated Assistant through an Interactive Computer Game

Thank you for your willingness to participate in this study

DO NOT use REFRESH or BACK thoughout the study

If you encounter any technical difficulties while playing the game, please make note of the issue and the point in the game in which you experience this issue in the survey at the end. We greatly appreciate your feedback.

Press Next to continue

Next

Before continuing with this study, please ensure you can see the black border around all four sides of the green box.

If you can not see all four borders, you will not be able to complete this study.

Press Next to continue

Next

Enter your WorkerID from Amazon Mechanical Turk:

In the box below, enter your WorkerID provided by Amazon Mechanical Turk.
After entering your WorkerID, press "Next" to continue.

Please make sure that your WorkerID is correct.

RESEARCH PARTICIPANT CONSENT FORM

NSF CPS-Frontier: Cognitive Autonomy for Human CPS: A Collaborative Study
PIs: Dr. Brandon Pitts, Dr. Tahira Reid-Smith, and Dr. Neera Jain
Schools of Industrial and Mechanical Engineering
Purdue University

The hyperlink below will direct you to a new tab to read through the research consent form. Please read through the document carefully. After reading through the form, return to this tab and press "Next" if you consent to participating.

If you have any questions or concerns, please send them to Purdue.CPS@gmail.com

Press "Next" to continue

Next

Instructions

Your task in this study is to improve your proficiency at playing an obstacle avoidance game using your dominant hand. In the game, you are tasked with navigating a penguin across an Arctic course to its home through a series of obstacles. A feature of this game is that it includes an algorithm that can provide assistance to you as you play. Specifically, the algorithm will scale up or down your input to more closely match how an expert would play the game.

Game Walkthrough

Previous Next

Press Next to continue

Next

Press Back to review the previous page

Back

Instructions

Your primary goal is to avoid the obstacles as well as minimize the time it takes for you to successfully take the penguin to its home. To accomplish these goals, aim to navigate as close as possible to the barriers (without colliding into them).

Game Walkthrough

Previous Next

Press Next to continue

Next

Press Back to review the previous page

Back

Instructions

To start the game, move the cursor to the red box (Starting point). When ready, click and hold the left button on the mouse to begin moving the penguin across the Arctic course.

You will play the game 11 times. The first game you play will be a practice round to become familiar with the game dynamics. During this practice round,you will not have the option of selecting to receive assistance from the game's assistance algorithm. The option of doing so will be available in games 1-10.
Each time you complete the game, press next and you will be re-directed to play again.

Please maximize the screen size before starting the game! Hold the mouse in your dominant hand.

Press Next to continue

Next

Press Back to review the previous page

Back

Practice Game

Take your cursor to the red box. Click to begin the game. Move the mouse to control the penguin and take it home. Be sure to use your dominant hand.

Press Next to continue after you complete the practice rounds

Next

Practice Results

A summary of the results of each trial game performance will be provided after each respective completion.

Next

Assistance Level Selector

Instructions

In the following games you will have the option of receiving assistance from automation to optimize your performance throughout the game.

Two options are available: Disable and Enable assistance

Select your desired option for game 1 below:

Press Next to continue

Next

Game

Take your cursor to the red box. Click to begin the game. Move the mouse to control the penguin and take it home. Be sure to use your dominant hand.

Press Next to continue once you complete the game

Next

Game Results

The results are provided below.

Next

Game Survey

The following questions ask about your trust and self-confidence while interacting with the game. In answering the following questions refer to the definitions of trust and self-confidence provided below:

Trust is defined as assured reliance on the character, ability, strength, or truth of someone or something.

In the context of this game, answer the questions below regarding trust as your assured reliance on the ability of the automation in aiding your performance.

Self-confidence is defined as confidence in oneself and in one's powers and abilities.

In the context of this game, answer the questions below regarding self-confidence as your confidence in performing the game without any assistance.

Based on your experience in the previous game, please rate your level of trust in the automation:

Based on your experience in the previous game, please rate your agreement with the following statement:

"Using the automation helps to improve my score in the game."

Based on your experience in the previous game, please rate your level of self-confidence in playing the game:

Instructions

In the following games you will have the option of receiving assistance from automation to optimize your performance throughout the game.

Two options are available: Disable and Enable assistance

Select your desired option for game below:

Game Assistance Selector

Press Next to continue

Next

Last Game Survey

The following questions ask about your trust and self-confidence while interacting with the game. In answering the following questions refer to the definitions of trust and self-confidence provided below:

Trust is defined as assured reliance on the character, ability, strength, or truth of someone or something.

In the context of this game, answer the questions below regarding trust as your assured reliance on the ability of the automation in aiding your performance.

Self-confidence is defined as confidence in oneself and in one's powers and abilities.

In the context of this game, answer the questions below regarding self-confidence as your confidence in performing the game without any assistance.

Based on your experience in the previous game, please rate your level of trust in the automation:

Based on your experience in the previous game, please rate your agreement with the following statement:

"Using the automation helps to improve my score in the game."

Based on your experience in the previous game, please rate your level of self-confidence in playing the game:

Final Assistance Level Selection

Congratulations! You have completed all fifteen games. If you were to play another game, what assistance option would you choose?

Two options are available: Disable and Enable assistance

Select your desired option below: below:

Game Assistance Selector

Press Next to continue

Next

Thank you for completing the study. Please fill out and submit the survey below before closing out of this window. Your completion code for MTurk will be provided at the end of this survey. If you would like to open the survey on a separate new tab, click here. // TODO: ADD SURVEY LINK HERE FOR HYPERLINK