Spotlight / An inquiry into attentionMachine Spirits · EPOL 479
Week 04 / Reading, selection, power

Start here · ten short chapters

What is
attention?

A machine weights a word.
A reader follows a sentence.
A platform counts the looks.

One word, three very different things. This page takes them one at a time: first the mechanism inside a Transformer, then the systems in a reading brain, then the economy that trades in attention. No background is needed. Every chapter says what to do.

Or pick a part ↓
FILE 479 / 04 THE READER IS PRESENT
An empty reading desk, lit by a shaft of daylight, stands before an immense wall of archive drawers.
Plate 01 / A place has been prepared for you.Generated allegory

How this page works

1 · Read a one-minute primer

Each chapter opens with a short explanation and names the paper it comes from: Vaswani et al. 2017, Petersen & Posner 2012, Terranova 2012.

2 · Do one thing

A “What to do” list tells you exactly which buttons to press in the activity. Nothing on this page is graded or recorded.

3 · Keep one idea

Each chapter ends with a single sentence worth remembering, then a Next button. The rail on the left keeps your place.

The question to carry through

What does calling all three of these “attention” gain us,
and what does it cost?

Adapted from the Week 4 overview and activity.

Prefer the lecture?

Step through the Week 4 slides, with a deep dive into each simulation.

28 slides converted from the lecture. Open the contents to jump straight to a simulation, or read in order and drop into the lab where a slide meets an activity.

Go deeper · the frame behind this page, and where the week sits in the course

Week 4 / The question behind the activities

One word.
Different kinds of attention.

Attention makes some information consequential while leaving the rest in the background.

For human readers, attention is embodied, limited, motivated and socially organized. It includes getting ready, orienting, sustaining a purpose and managing conflict. In a Transformer, attention is a mathematical operation that weights relations among representations.

The shared word can illuminate or mislead. We can inspect computational weights directly, but those weights are neither a report of conscious focus nor a complete explanation of a model’s decision. Human attention also includes processes outside awareness. A working attention mechanism and an experience of attending are different questions.

Where this week sits

  1. Week 03 / RecognitionDoes recognition need a conscious partner?

    Last week tested the relation between recognition and awareness.

  2. Week 04 / AttentionWhat does attention explain once awareness is set aside?

    A mathematical operation gives us something we can inspect, change and compare.

  3. Week 05 / AlignmentWhat is foregrounded—and on whose behalf?

    Selection is never neutral. The next question is whose purposes a system should serve.

Before the answer,
consider the instruction.

In Kafka’s Before the Law, a man waits at an entrance whose access is controlled by a doorkeeper. In Debord’s The Society of the Spectacle, representations mediate relations between people. Together they suggest a question for this lab: who arranges the encounter, and whose terms make a response count?

About this frame

This is our interpretive frame, alongside the three attention readings. Kafka’s parable invites questions about authority, access and waiting. Debord’s critique concerns the organization of social life through representations under commodity production; it is larger than a complaint about distracting screens. These concerns lead into Terranova’s account of how attention is valued.

Sources: Kafka, The Trial, chapter 9, including the parable (David Wyllie translation); Debord, The Society of the Spectacle, theses 4–6 and 24 (Ken Knabb translation). The two illustrations are generated allegories, not historical photographs or scientific evidence.

Take away. “Attention” is a word shared by a formula, a set of brain networks and a market. Keep them apart until Chapter 7 puts them side by side.