Today's testing session went pretty well. I had a total of 10 users play the game and complete a survey.
This latest prototype generally achieved it's purpose, and all of the users testing it had little problem grasping the concept of the game and how the physical controls operated. 100% of users responded that they understood the game's concept. 8 out of 10 understood it well from my instructions given, 2 users would've preferred some more explanation. Especially for those who had never played Guess Who, I could've explained the elimination concept more clearly in detail, as those who never played had trouble choosing the correct character tiles to eliminate at first.
The game board was successful and I received positive feedback on it's construction. There were a few technical issues, where 2 of the tiles weren't able to make an adequate contact with the earth points. As the tiles are pretty thick and heavy, the steel wool helped to cushion the impact when the tile drops, but for one tile (#6) it broke off, so when it was dropped, sometimes the metal to metal contact caused the tile to bounce and not register a move - usually causing the frog character to get hit by a truck. Another tile's hinge was a bit too tight (#4), so it didn't drop down easily, also causing problems with the game. At times this resulted in the user losing the game, when they otherwise would've won. 3 users noted in the survey to improve the tech breakdowns on the game board as an issue, so this is something I will definitely improve in the next iteration.
Most participants grasped the guessing/elimination concept quickly. 4 of the 10 users had a little trouble matching the clues to the eliminate the correct frogs - for example some users had trouble eliminating the right tiles after receiving a clue that used a negative style description, "I am not wearing a hat" - users would put down tiles of the frog's not wearing a hat, rather than eliminating the opposite frogs with hats. However, no one had trouble with the opposite clue, "I'm wearing a hat", users all correctly eliminated frogs not wearing hats.
I personally don't think I'd change this type of negative clue, as it does require a bit more mental challenge, and over playing multiple times, users tended to realise this mistake and self-correct to eliminate the right character tiles.
I received positive feedback regarding enjoyment and fun users had, and about the uniqueness of the controls. 7 users rated the game 5 out of a 5 point scale (5 being the best score), and the remaining 3 rated it a 4. As for uniqueness, 7 rated it 5 out of 5, 2 users rated it a 4, and 1 user rated it a 3 (5 being the best score).
As for the difficulty, there was a wider spread of replies, this may be due to the fact that the earlier sessions, the speed of the trucks was faster and the earlier users found it a bit too hard, so I compensated later by slowing the speed down. Half of the users found the difficulty suitable, rating it an average of 3 (challenging, but not impossible), and an the rest evenly spread on either side of this rating. Some user suggestions included creating levels to help ease players in and teach them how to play, gradually making the levels more difficult. Another was to be able to choose a difficulty level. This is a definite consideration for the next prototype.
Unfortunately I didn't capture any recording of wins - here's some recording of players almost winning, one user would've won if my game board didn't fail :(
Survey Link:
http://goo.gl/forms/ayAlSBwWgu
Summary of responses:
https://docs.google.com/forms/d/1JfgVLDcQDcQhkIdgUM1F2P1qE-_GWyKw7wCLIwAiEFk/viewanalytics
This latest prototype generally achieved it's purpose, and all of the users testing it had little problem grasping the concept of the game and how the physical controls operated. 100% of users responded that they understood the game's concept. 8 out of 10 understood it well from my instructions given, 2 users would've preferred some more explanation. Especially for those who had never played Guess Who, I could've explained the elimination concept more clearly in detail, as those who never played had trouble choosing the correct character tiles to eliminate at first.
The game board was successful and I received positive feedback on it's construction. There were a few technical issues, where 2 of the tiles weren't able to make an adequate contact with the earth points. As the tiles are pretty thick and heavy, the steel wool helped to cushion the impact when the tile drops, but for one tile (#6) it broke off, so when it was dropped, sometimes the metal to metal contact caused the tile to bounce and not register a move - usually causing the frog character to get hit by a truck. Another tile's hinge was a bit too tight (#4), so it didn't drop down easily, also causing problems with the game. At times this resulted in the user losing the game, when they otherwise would've won. 3 users noted in the survey to improve the tech breakdowns on the game board as an issue, so this is something I will definitely improve in the next iteration.
Most participants grasped the guessing/elimination concept quickly. 4 of the 10 users had a little trouble matching the clues to the eliminate the correct frogs - for example some users had trouble eliminating the right tiles after receiving a clue that used a negative style description, "I am not wearing a hat" - users would put down tiles of the frog's not wearing a hat, rather than eliminating the opposite frogs with hats. However, no one had trouble with the opposite clue, "I'm wearing a hat", users all correctly eliminated frogs not wearing hats.
I personally don't think I'd change this type of negative clue, as it does require a bit more mental challenge, and over playing multiple times, users tended to realise this mistake and self-correct to eliminate the right character tiles.
I received positive feedback regarding enjoyment and fun users had, and about the uniqueness of the controls. 7 users rated the game 5 out of a 5 point scale (5 being the best score), and the remaining 3 rated it a 4. As for uniqueness, 7 rated it 5 out of 5, 2 users rated it a 4, and 1 user rated it a 3 (5 being the best score).
As for the difficulty, there was a wider spread of replies, this may be due to the fact that the earlier sessions, the speed of the trucks was faster and the earlier users found it a bit too hard, so I compensated later by slowing the speed down. Half of the users found the difficulty suitable, rating it an average of 3 (challenging, but not impossible), and an the rest evenly spread on either side of this rating. Some user suggestions included creating levels to help ease players in and teach them how to play, gradually making the levels more difficult. Another was to be able to choose a difficulty level. This is a definite consideration for the next prototype.
Unfortunately I didn't capture any recording of wins - here's some recording of players almost winning, one user would've won if my game board didn't fail :(
Survey Link:
http://goo.gl/forms/ayAlSBwWgu
Summary of responses:
https://docs.google.com/forms/d/1JfgVLDcQDcQhkIdgUM1F2P1qE-_GWyKw7wCLIwAiEFk/viewanalytics
No comments:
Post a Comment