SM2007

The mathematics behind SOCR

The first formalization of the comparator hypothesis (Miller & Matzel, 1988), the sometimes competing retrieval model (or SOCR; Stout & Miller, 2007) learns from local error and responds as a function of the relative associative strength between present and retrieved stimuli.

1 - Learning associations

The SOCR model uses two different learning equations for the strengthening and weakening of associations. Whenever two stimuli are contiguous, strengthening occurs. In such a case, the strengthening of the association from stimulus i to j after trial t, vi, jt is given by:

Δvi, jt = xitαiαj(λj − vi, jt − 1)

where xit denotes the presence (1) or absence (0) of stimulus i on trial t. As such, the SOCR model only learns about stimuli that are presented. The parameters αi and αj are the saliencies of stimuli i and j, respectively, and λj is the maximum association strength supported by j (the asymptote).

Whenever stimulus i is presented alone (i.e., stimulus j is absent), the weakening of that association is given by:

Δvi, jt = xiαi × −ωjvi, jt − 1

where ωj determines the weakening rate for stimulus j.1

2 - Activating stimuli

SOCR posits competition by stimuli that are presented and/or associatively retrieved. Dropping the trial notation for the sake of simplicity, the degree to which stimulus i activates stimulus j, acti, j, is given by:

acti, j = xivi, j + xjρjαj

where ρj (bound between 0 and +) determines how much of salience of stimulus j contributes to its unconditioned activation. These first-order activation values are the key quantities involved in the comparison processes.

3 - Generating responses and comparison processes

Stimulus i generates j-oriented responding at the time of retrieval as a function of its relative ability to activate stimulus j. This relative ability is expressed as a comparison process, given by:

rij = acti, j − Σk ≠ i, jKγk × oi, k, j × rik × rkj where rij is the relative activation of stimulus j by stimulus i, K is the set of all experimental stimuli not including i or j, γk is a parameter determining the degree to which stimulus k, a comparison stimulus, contributes to the comparison process (bound between 0 and 1), and oi, k, j is an operator switch that determines whether i and k associations with j engage in facilitation or competition. Finally, rik is the relative activation of stimulus k by stimulus i, representing the ability of stimulus i to activate a comparison, and rkj is the relative activation of stimulus j by stimulus k, representing the ability of the comparison stimulus k to activate stimulus j.2

Most notably, the last two quantities (rik and rkj) are also determined by their corresponding instantiations of Eq. 3. That is, they involve comparison processes themselves. The number of potential comparison processes is technically infinite (each comparison process can nest two extra comparison processes itself), so the user must determine the order of the model using an extra global parameter (order). For all n-th order models (with n > 0), the model will behave like the extended comparator hypothesis (Denniston et al., 2001), implementing n comparison processes each time the relative activations are calculated. With order = 0, SM2007 will behave like it was originally written and only consider one comparison process. Indeed, n-th order models are accomplished via recursion using the 0-th order model as the stopping condition. When such a condition is reached, the rik and rkj terms in Eq. 3 become acti, k and actk, j, respectively.

4 - Switching between facilitation and competition

The operator switch in Eq. 3, oi, k, j, changes as subjects learn to discriminate between the directly (via i) and indirectly activated (via k) representations of stimulus j. The change to this quantity depends on the value of vi, j, as follows:

$$ \tag{Eq.4} \Delta o_{i,k,j} = \begin{cases} \tau_j\alpha_iv_{i,k}v_{k,j}(1-o_{i,k,j}) &\text{, if } v_{i,j} = 0\\ 1-o_{i,k,j} & \text{, otherwise} \end{cases} $$

where negative values of o indicate facilitation and positive values of o indicate competition. The default value for all operator switches at the outset of training is set as -1 by default. The parameter τj specifies the learning rate for the operator switches related to stimulus j.

References

Denniston, J. C., Savastano, H. I., & Miller, R. R. (2001). The extended comparator hypothesis: Learning by contiguity, responding by relative strength. In Handbook of contemporary learning theories (pp. 65–117). Lawrence Erlbaum Associates Publishers.
Miller, R. R., & Matzel, L. D. (1988). The Comparator Hypothesis: A Response Rule for The Expression of Associations. In G. H. Bower (Ed.), Psychology of Learning and Motivation (Vol. 22, pp. 51–92). Academic Press. https://doi.org/10.1016/S0079-7421(08)60038-9
Stout, S. C., & Miller, R. R. (2007). Sometimes-competing retrieval (SOCR): A formalization of the comparator hypothesis. Psychological Review, 114, 759–783. https://doi.org/10.1037/0033-295X.114.3.759
Witnauer, J. E., Wojick, B. M., Polack, C. W., & Miller, R. R. (2012). Performance factors in associative learning: Assessment of the sometimes competing retrieval model. Learning & Behavior, 40, 347–366. https://doi.org/10.3758/s13420-012-0086-2

  1. The calmr implementation of the SOCR model specifies different ω, ρ, γ, and τ parameters for each stimulus, but the authors of the model meant these parameters as global parameters.↩︎

  2. In the aim of generality, the SOCR implementation in calmr does not distinguish between relative activation and response generation. The published formalizations of SOCR made a special distinction (and adopted a different notation) for calculating US responding (e.g., Witnauer et al., 2012), but such responding is a direct result of relative activation of the US representation by a CS.↩︎