These are my notes from user testing on the initial account creation and on-boarding of Skribe.
This form was used for the tests.
My aggregated notes and/or conclusions from the tests can be found in this gist.
- Introduction:
- Carla - 2019-04-29:
- Kate - 2019-04-29:
- Josh - 2019-04-29:
- Emily - 2019-05-02:
- Starr - 2019-05-02:
- Hilary - 2019-05-02:
- Shauna - 2019-05-03:
- Donna - 2019-05-03:
UX design is about discovering customer's needs through research and aligning them with business goals to achieve a win-win for both. We do this in 5 stages:
- strategy (UX)
- scope (UX)
- structure (UX & IA)
- skeleton (UX & UI)
- surface (UX & UI)
We are still determining some structural elements but focused mainly on the skeleton and surface stages right now. The app is functional but only in a very basic way.
There are 3 main aspects of the Chaos/Skribe ecosystem:
- Chaos = backend, internal application (you will not see).
- Skribe mobile app = not yet available publicly but linked to web app.
- Skribe web app = focus for today (in these areas).
- Skribe.com marketing page.
- sign up / account creation
- on-boarding flow in portal.
- adding / editing profile.
- additional feedback.
For this test:
- first of all, it's not a "test" it's a semi-controlled, observed experience.
- There is no success/failure or right/wrong answers. Interested in your experience.
- I'm here as a researcher - I may not fully answer questions or might answer questions with questions. Don't mean to be vague but allowing you to struggle a bit is very informative.
- user testing is usually observed in more objective way (videos, screen recording, eye-tracking) but I'm depending on your verbal feedback and taking notes so think out loud as you experience.
- We will work through a section with you commenting on what you are seeing, I may ask some questions, then we'll pause and give you a chance to answer the questionnaire in private. Answers are anonymous so no filter.
- Questions are structured to give a combination of objective, quantifiable results and also provide room for more subjective feedback.
- There are comment sections throughout were you can add extra thoughts.
Questions?
Feedback was generally positive
- tried "use my location" button but didn't work so resorted to using search
- preferred "use my location" but would have used search first if not currently in the location where she wanted to drop a pin.
- likes the map results when you type in city
- likes the password validation as typed
- "business department" label seems strange
- what if I was self-employed?
- show results of industries selections on page not just "2 items"
- might not know what types of attachments were possible to add from looking at initial screen.
- "that's exciting" => Skills - likes the drop down
- when using search feature, results may be BELOW the fold and so can't see
- have to delete search in order to get back to list of options
- tried to click on fields of profile - edit button to low
- note in sign up that adding primary now but will be able to add secondary later.
- added many locations but need a way to set a primary
- add primary location in profile info
- can edit but can't delete a location
- had to find how to add picture
- hitting Skribe logo goes nowhere (show go somewhere Skribe.com or to dashboard)
- intercom bubble close
- likes the blue
Personal iOS device
- used "current location" button
- didn't find exact results selected closest
- can I take a picture? discovered
- sideways
- need a retake button instead of cancel and repeat.
- pretty sure in previous page I had already entered name and preferred name
- business maybe should be "place of work"
- business department = kind of work or actual department name
- website - company's website or personal?
- url wasn't correct but error messages were helpful
- not sure if hit a button but popped over to "Industries"
- add attachment - not sure business card would be useful.
- Skills
- went directly to drop downs NOT search
- went through each drop down looking for results
- not sure what "data collection" means
- unsure what some fields mean
- under social science would expect to see military science
- expected a "complete" button after
- can add/refine skills
- would expect?
- more about location
- not sure where location
- low discoverability for existing location
- expected location in the profile/personal information
MacOS laptop
- easily identified CTA
- "know what I'm doing so don't need to read everything"
- likes inline validation
- tried clicking "submit" when disabled (missed adding location)
- "should have kicked me up top"
- "needs better error messaging"
- likes the use your current location feature although wouldn't use it normally
- now submit is available and visual indication is good
- "salutations I would leave blank"
- "why Mr./Mrs.?"
- Business department = Foresight
- referred to industries, attachments, and skills buttons as "inputs"
- maybe need an arrow
- "other" fields should have editable fields to add text
- likes ability to add biometric info
- education needs "other" field
- tried to click on the three progress indicators to change pages
I decided to give Josh a pop quiz so I asked him...
Q: Where is your primary location? A: "I don't know"
Low discoverability of location data
- would expect to see qualified location data
- I like the greyed out fields in navigation
- need a final submit button
- hit bottom CTA
- read entire page
- notice BETA
- tried use my current location
- chose Durham - close enough
- password not very safe (only 8 characters)
- reason “Given name”?
- not sure what “business department” should be
- “OOooo” didn’t expect another page for Industries - thought it was a field.
- clicked “other” and expected to fill in a blank
- should see the results instead of “2 items”
- adds attachments
- not sure what “Product” means
- good to see the names of actual files
- better explanations
- Skills
- used search field
- “I don’t understand what this is supposed to do”
- clicked on fields to try and edit
- went immediately
- separate phone from social media?
- verbiage
- “is this NOT my primary
Would normally sign up on phone
- doesn't like when Intercom is in the way, pops up
- like the colors - cyan
- very to the point
- like the logo
- used search to find location
- didn't use the "current location" button b/c I don't live here
- map made me feel like I did something wrong
- usually the map is shown below
- password info wasn't helpful before typing
- adding photo sideways BUG
- had fields filled, went back to add image, fields were deleted when return
- progress buttons makes her think swipable
- "Industrie" thought were fields not buttons
- nice that you can pick more than one.
- "Attachments" should be supporting documentation
- website info was hard "usually you can type in anything"
- would be nice to see actual results of adding "Industries, Attahccments, etc."
- right to drop-down expanded list in Skills
- didn't notice icons but not bad
- would have preferred to see further profile info in onboarding
- tried clicking rows
- added date of birth - DOB order seems odd
- "I wanna click on these things" top nav
- tapped hamburger
- found location info on her own
- confused by the intention of location data
- Would Google first and read
- reviews very important
- THEN app store reviews
- clicked off the Intercom - distracting
- doesn't like the white part
- too many words
- want to see a picture
- something not like clip art
- Collect data, get paid - immediately understandable
- "paid" and "opportunites" were helpful
- used "use your primary location" button
- "cool", "it's really fast"
- I like that it gave me an opportunity to autofill my name and email
- not too many fields
- password field was easy
- get the feeling I'm singing up for something but not sure what
- maybe an extra thing to get more info as to WHY
- a more info page with examples of other people/info so I know what I'm signing up for
- like to put pictures in
- examples of "Mr. and Mrs." not appropriate
- looking for a save button after entering name
- "getting a little wiggy" after asking for more
- "cool that you can add an attachment"
- not evident that buttons for Industries, Attachments were buttons
"What would you do if you didn't see an option under Industries"
- I would click "Other" and expectation is to have a place to enter specifics
Skills
- went right to expanding menus
- pretty clear
- went right to top nav
- popped open hamburger
- I would start looking for next steps
"Where is your location information"
- unsuccsessful in finding location info
- "collect data, get paid"
- people still don't know what "data" is - might be too vague
- what kind of data?
- clean, simple, clear
Q: was there anything unclear about sign-up?
- "other" category in the how did you hear about us section
- short, not too many fields
- "Mr. and Mrs." seems weird for US
- found progress button OK
- clicked on Industries and said "Oh!" - thought it was a form field
- inputting
- "why would you need my professional information?"
- went to browser to get URL
- None of the skills pertain to me. Do I need to have one of these skills?
- Would this prevent me from getting work?
- A lot of N/As
- I don't like it, might look better if it was just blank
- Tried clicking on rows
- had to find the Edit button
- found the tabs and started scrolling through
- lots MORE N/As
- date format looks odd for US, great for overseas
- now that I have a profile built what happens now?
- What happens now?
- expects to get an email but should I do something else.
Q: "Can you find your location info" A: YES Q: "Is location data where you would expect it to be?" A: NO - I would think it would be with Profile
- easy to read, user friendly
- Intercom is obtrusive
- could put the logo for SNI
- color is good easy on the eyes
- CTA is easy to understand
- search for location b/c not where she lives
- simple not asking for a lot
- would be nice to have an "other" field
- social media
- dots make you want to swipe - confusing
- continue would be clearer
- expected to fill in blank when clicking on "Industries, Education, etc."
- 1 item is confusing, not enough info
- Skills
- started expanding lists
- good feedback and expected results
- Q: "Is there any information here that tells you the purpose of this page"
- A: copy is a little vague, can't understand the purpose of this page.
- N/A on a lot of things - think don't need to fill it in.
- tend to not fill in information that isn't required
- found edit profile info easily
- intercom button obscuring bottom of list
- Q: "where would your location information be located"
- A: thought it should be under personal info
- "why would you need to put in more"