Skip to content

Instantly share code, notes, and snippets.

@Crowbrammer
Created January 16, 2024 19:32
Show Gist options
  • Save Crowbrammer/b7f97c5513c2145e02a1014fee867c91 to your computer and use it in GitHub Desktop.
Save Crowbrammer/b7f97c5513c2145e02a1014fee867c91 to your computer and use it in GitHub Desktop.
Cognitive load testing

Step 1: Experience

Is this Kolb's cycle reflecting on an experiment from a previous Kolb's?

Always cycle experiments from the previous Kolb's into your next one to ensure your marginal gains are compounding._

  • Yes
  • No

How will I use this Kolb's?

To see how valid measuring cognitive load is

What skill is this for?

Cognitive load measuring

What's the experiment from the past reflection and abstraction that you want to reflect on? (Originally: What experience do you want to reflect on?)

I tried:

Measuring my cognitive load every 20 minutes per this template

Pasted image 20240116140848.png

What would a marginal gain look like?

_Remember that marginal gains look different at different levels of the conscious competence model. Answer:

  • _What's my current competence?
  • _When am I this competent? (How do I know I'm this competent?)
  • _What's the next competency?
  • When will I be at X? (e.g. X = conscious competence)

From: UI. When I don't even know what I'm doing wrong.

To: CI. When I know if what I'm doing is a mistake.

Step 2: Reflection

List and describe the sequence of events, in chronological order

  • I opened some documentation on a thing called Discljord for to create a Discord bot using the Clojure programming language.
  • I set a looping 20-minute timer
  • I prestudied and TLS-ed it.
  • Every time the timer went off, I measured my cognitive load.

cognitive load template Cognitive load efficiency at 31%.

How did you feel about the experience?

Unsure when I went to try to measure my cognitive load. I felt like I didn't have an accurate recall of what cognitive load I was at. I also didn't know what "100%" felt like.

I felt unimpressed when I realized most of the session was low cognitive load, esp. when I got side-swept with a notification in my Github account or when I strayed into Discord.

Which aspects (if any) of the process felt especially difficult? Which aspects felt like they went well?

Difficult:

Knowing how much of my time was actually at each part. I tended to ballpark how much time was spent at each, but I couldn't be sure.

Allocating my time using the template. When I incremented "4" to "7" at 0% on my second time through, I then had to remember mentally that I had 17 minutes left to allocate. Then I incremented "6" to "13" at 20%, and I had to remember that I had 10 minutes left to allocate. Mental record keeping.

Well:

I learned that most of prestudy isn't cognitively challenging... until you get to comparing backbones. Relating the ideas themselves was 40%. I also saw my cognitive load spike to 60-80% when I asked "Why are events important?" and then I looked into unfamiliar code, seeing things like multimethods or a bunch of Discord-specific terms like "guild" and "snowflake" and also seeing binary encoding or the term "dispatch". I also saw new things with hard-to-find info like "impl", and I'm familiar with "spec" but I didn't understand how it worked... e.g. these are Clojure-specific terms.

How did you respond to challenges and difficulties during this process?

Measuring my cognitive load every 20 minutes per this template

  • I didn't truly know the time spent, but I ballparked it.
  • I had a mental abacus in my head as I manually incremented the times in the template.

What were the triggers to you feeling the way you did? (What were the triggers to you feeling that X was difficult?)

  • vague memory, forgetting, expected to recall re: the cognitive load durations.
  • seeing most of my time spent at low cognitive load and knowing partially why

Why do you think you acted the way you did during this experience?

  • I figured my estimate was better than nothing, and I at least had _some idea.
  • My template doesn't support calculations... it doesn't let me just write out the current rounds' number.

Step 3: Abstraction

What habits, beliefs, and tendencies can you identify from your reflection that explains why you acted the way you did?

(TLS the Kolb's... improve it)

  • I'm likely not remembering my level of cognitive load accurately...
  • Unfriendly template requires mentally tracking how much time is still unallocated
  • Gathering concepts isn't high cognitive load
  • Relating concepts is higher cognitive load
  • Relating backbones is somewhat higher than just relating concepts?
  • Newness/foreignness of material vastly increases cognitive load.

Do you act or respond in similar ways in other parts of your life?

This can help you to identify the holistic impact of the habits and tendencies you found above.

  • I don't remember my dreams that well, most of my day, nor lots of things in my past.
  • Collecting keywords isn't demanding, but the relating of them is...
  • When I'm in a new environment generally, in the physical world, it's tougher.

Step 4: Experiment

Guidelines for experiment

Keep your experiments concise, specific, and actionable. Avoid vague statements of intention. Imagine waking up tomorrow and seeing this list. You want to have a clear idea of exactly what you need to do to immediately act on your experiments.

Less than 3 experiments is ideal to improve your chances of success and make efficient progress with each cycle. More than 4 experiments is highly unadvised.

List some potential solutions and actions to experiment on.

Do this again, but measure every ten minutes. Try it four times.

Other ideas:

  • Do this re: teaching with SIR..
  • Do this re: writing generated questions.
  • Do this re: answering generated questions.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment