News & Blog

A commentary on “Visual attention is not limited to the oculomotor range” by Hanning, Szinte & Deubel (2019)

We read with great interest the recent PNAS paper by Hanning and colleagues, in which they use a variant of Craighero et al’s Eye Abduction paradigm to test the proposal that exogenous covert attention is constrained by the oculomotor range (Smith & Schenk 2012; Casteau & Smith 2019). If you’re not familiar with the paradigm, figure A illustrates the setup. The idea is that by abducting the eye by ~35-40 degrees it is possible to present stimuli at locations that can be seen but cannot be reached with a saccadic eye-movement. This neat procedure decouples perception and oculomotor control, and in 2012 we showed that peripheral cues beyond the oculomotor range did not summon attention (Smith, Rorden & Schenk 2012).

In the Hanning version of the task participants are shown 4 channels of noise, 3 within the range of eye-movements and one beyond. One of the locations is cued for 50ms, and 100ms later a probe appears in one of the channels for 50ms. Participants must report the orientation of the probe with button press. People are really bad at this task, and accuracy is only above chance at the cued location. Critically, this attentional facilitation for the cued location is observed even when the cued channel is beyond the range of eye-movements, contrary to our previous findings. Hanning and colleagues argue this is problematic for premotor theory, and argue the data are more consistent with selection-for-action models like VAM. They conclude that covert, exogenous orienting of attention is not constrained by the range of eye-movements, contrary to our previous findings.

The paper is beautifully presented, the experiment is cleverly designed and on first inspection these data look clear cut. There can be no doubt that the peripheral cues are producing enhanced target detection. So, do we need to abandon our position that covert, exogenous orienting is dependent on oculomotor activation? Perhaps not yet. Hannings’ data are convincing, but as they note in their paper, there are considerable differences in the stimuli used in our lab (e.g. Smith et al., 2012, Casteau & Smith 2018), by Craighero et al., (2012) and by Michalczyk et al., (2018) that show an effect of eye-abduction on covert attention, and those used by Hanning and colleagues. One potentially crucial difference is the difficulty of the task. Hannings’ task is extremely difficult. In fact, it is impossible to accurately discriminate the target unless it is attended (See fig 2b: dprime is ~0 at all uncued locations – you can see the task for yourself here). To understand why this is a problem we need to first consider the rationale for using a non-predictive peripheral cueing task. The reason typically given is that a non-predictive cue gives the participant no incentive to endogenously attend to the cued location, so allows a ‘pure’ measure of exogenous attention. This rationale makes sense when the task is simple detection task or a speeded discrimination, because the participant detects the target regardless of whether or not it appears at the cued location, and the differences emerge in the speed of target detection. However, this rationale does not hold true when the task is so difficult that the target is never detected at uncued locations. Why? Because under these conditions the cue is highly informative from the perspective of the participant; they only ever perceive a target when they attend a cued location, and never detect targets at uncued locations (a similar issue is found in the change blindness literature- see Smith & Schenk 2010). It therefore makes complete sense for participants to adopt an attentional set of ‘endogenously attend cued location’ in order to correctly perform the task. We know that endogenous shifts of attention can be observed at short SOAs, for example in Muller & Rabbit (1989) seminal study there is a beneficial effect of endogenous attention at 100ms SOA, and Tipples (2002) has shown a similar effect for arrows. It therefore seems likely that the peripheral cue used by Hanning et al., engaged both endogenous and exogenous attention, and it was the endogenous component of attention that produced the attentional benefit. If participants are endogenously attending the cued location, the results are in fact in exact accordance with our previous findings and those of Klein and colleagues (1980;1994), which were that endogenous orienting is independent of oculomotor control. A less critical, but still noteworthy issue is that the sample is rather small (n=6 in the critical covert attention task). In contrast, papers showing impaired exogenous attention beyond the oculomotor range tend to have larger samples (N= ~20-25), so there is also a risk that this study was somewhat underpowered to detect the interaction of interest. Hanning et al., also make the valid point that previous studies using eye-abduction did not establish the range of eye-movements for their participants. However, in our 2018 paper we measured each participants own oculomotor range, and again showed a selective deficit for covert exogenous attention at locations beyond the range of eye-movements when the eye was centred in its orbit .

To briefly summarize, Hanning et al., show that a peripheral cue produces attentional facilitation beyond the EOMR. The evidence for this effect is very clear, and we do not dispute that participants did indeed covertly orient to the cued location. However, we do dispute the claim that this shift of attention is exogenous in nature. Rather, we believe it is more likely that participants endogenously oriented to the peripheral cue because it was the only way to successful complete the task, and that the improved performance at the cued location is caused by this endogenous shift of attention. We agree with the conclusion that the data are problematic for premotor theory, but only because they show that endogenous orienting is possible to locations that cannot become the goal of a saccade.

We asked Hanning & colleagues if they would like to reply to our comment, and will add it here ASAP if they do. Nina will be joining us in Durham for our workshop and we’re looking forward to some lively discussions! (there are still some places if you fancy joining us)

 

References

  • Casteau, S.; Smith, D.T. Covert attention beyond the range of eye-movements: Evidence for a dissociation between exogenous and endogenous orienting. Cortex [Google Scholar] [CrossRef]
  • Casteau, S & Smith, D.T. (2019). Associations and Dissociations between Oculomotor Readiness and Covert Attention. Vision 3: 17.
  • Craighero, L.; Nascimben, M.; Fadiga, L. Eye position affects orienting of visuospatial attention. Biol.2004, 14, 331–333. [Google Scholar] [CrossRef]
  • Hanning, N., Szinte, M,. & Deubel H. Visual attention is not limited to the oculomotor range. Proceedings of the National Academy of Sciences 2019, 116 (19) 9665-9670; DOI: 10.1073/pnas.1813465116
  • Klein, R.M. Does oculomotor readiness mediate cognitive control of visual attention? Perform. 1980, 8, 259–276. [Google Scholar]
  • Klein, R.M.; Pontefract, A. Does Oculomotor Readiness Mediate Cognitive Control of Visual Attention? Revisited! In Attention and performance XV: Conscious and Nonconscious Information Processing; Umiltà, C., Moscovitch, M., Eds.; The MIT Press: Cambrige, MA, USA, 1994; pp. 333–350. [Google Scholar]
  • Smith, D.T.; Schenk, T. The Premotor theory of attention: Time to move on? Neuropsychologia 2012, 50, 1104–1114. [Google Scholar] [CrossRef]
  • Michalczyk, L.; Paszulewicz, J.; Bielas, J.; Wolski, P. Is saccade preparation required for inhibition of return (IOR)? Lett. 2018, 665, 13–17. [Google Scholar] [CrossRef] [PubMed]
  • Smith DT & Schenk, T. (2010). Inhibition of return exaggerates change blindness. Quarterly Journal Of Experimental Psychology 63(11): 2231-2238.
  • Smith, D.T. Smith, D.T.; Schenk, T.; Rorden, C. Saccade preparation is required for exogenous attention but not endogenous attention or IOR. Exp. Psychol Hum. Percept. Perform. 2012, 38, 1438–1447. [Google Scholar] [CrossRef] [PubMed]

 

Daniel T. Smith & Soazig Casteau,

Dept of Psychology, Durham University UK

Workshop Update: Program and talk abstracts are now ready!

Only 2 weeks left before the Cognitive and Motor Processes in Spatial Attention workshop! We have to confess that we are very very excited about this upcoming event here in Durham.

We have just put the final touch to our program and by the look of it, we can guarantee you that it is going to be brilliant. Ho well, we may be biased a little bit, but you can have a look for yourself by clicking on the link below…

Motor Processes in Spatial Attention Program

All the abstracts of these fantastic talks are available HERE

There are only 4 days left now to register – hurry up! Fees are only £20 – coffee breaks, wine reception and lunch on Friday are included!

 

Tasty review paper published in Vision

Last summer Soazig and I were approached about writing a review article on oculomotor readiness hypothesis / premotor theory for a special issue of Vision on “Eye Movements and Visual Cognition”. This was a very tempting opportunity, and I must admit I was flattered to be courted by psychology bigwigs like Klein and Liversedge, but I had a couple of reservations. Firstly, this is quite a crowded field, and there had already been some excellent reviews of the literature, including one I had written with Thomas Schenk just a few years ago. Did we really have something new to say? Could we produce something that offered more insight than just describing recent developments in the field? Secondly, writing any paper is time consuming, but with the pressures of the imminent REF there is a distinct disincentive to publishing papers that are not eligible for submission, such as review papers. On the flip side, writing a review seemed like a a great opportunity to articulate the theoretical ideas about attention and eye-movements that we had been bubbling around over the last few years and in the end the decision was easy.

We spent quite some time kicking round ideas for a structure and two key concepts formed the basis of the review. Firstly, that it was absolutely critical to explicitly a differentiate between presaccadic attention, covert endogenous attention and covert exogenous attention. Secondly, that the evidence from neuropsychological studies had been rather neglected in favour of psychophysical or neurophysiological evidence. Once we had these ideas, the review started to fall into place and we were able to develop our key lines of argument, which were (1) presaccadic attention is qualitatively different from covert attention, so studies of presaccadic attention don’t speak to oculomotor readiness / premotor theory per se (2) The neuropsychological evidence for a mandatory coupling between covert exogenous orienting and saccade programming is pretty strong, but the evidence is actually really weak for a causal link between endogenous attention and saccade programming. In the end we felt convinced that the evidence was most convincing for an oculomotor readiness theory of exogenous orienting, (hence the snazzy acronym of OREO) and we hope you will read the paper and be convinced too!

The paper is open access, and you can find it here: https://www.mdpi.com/2411-5150/3/2/17/htm

Casteau, S & Smith, D.T. (2019). Associations and Dissociations between Oculomotor Readiness and Covert Attention. Vision 3: 17.

Writing this review has been an interesting process, as it touches on some conceptual issues that Soazig and I have been struggling with over the last few years. One thing I have never understood is why saccade deviation away from an attended location is often cited as evidence for premotor theory. Everyone says it, but it makes no sense! Surely the saccade should be deviated towards the attended location if it’s associated with a saccade programme? Maybe now someone will explain it to me at our upcoming workshop on attention and motor control (all welcome 😊): http://motorbiasproject.com/workshop

RIO Group conference report

Last week Soazig and I had a very enjoyable couple of days at the annual RIO (Research in Imagery & Observation) group meeting held at Teesside University. Now, imagery isn’t our usual sort of thing, but the chance to attend a free conference in our own backyard seemed to good to miss. On day 1 we saw some fascinating presentations from students in Shaun Boe’s lab who had travelled all the way from Dalhousie in Canada. The first thing to note  is that most of the contemporary research was focused on AOMI (which everyone pronounced AY-OH-ME, much to Soazigs irritation). AOMI involves action observation (i.e. watching an expert do the task) while simultaneously engaging in mental imagery (imagining performing the action). The key message I took from these talks was that although it was generally agreed that mental imagery was jolly helpful for improving skills, there was no real agreement about either the optimal ‘dosage’ or at what point during skill acquisition AOMI was most effective. Boe’s group showed some pretty nice evidence that AOMI was most effective during skill acquisition; the ‘cognitive’ and ‘associative’ phases in Fitts & Posner (1967) model of expertise. In a particularly interesting finding, Sarah Kraeutner argued that imagery could reduce endpoint variability without necessarily improving overall accuracy in a dart throwing task. However, a number of audience members commented that although the dart-throwing paradigm is a classic task, it has problems as a model of skill acquisition, particularly with respect to controlling prior experience of the task. Also in this session was a fascinating talk from Jack Binks on using imagery to rehabilitate motor skills after stoke. Richard Ramsay then gave an eclectic keynote covering cognitive and brain mechanisms of social perception, which I found particularly interesting with respect to our work with Geoff Cole on perspective taking and social attention.

On day 2 Soazig and I did presentations on topics that, to be fair, were a bit tangentially related to mental imagery. Soazig presented our preliminary data on the effects of TMS over FEF on presaccadic and premotor shifts of attention. The cool result here is that the neurostimulation disrupts presaccadic attention but has no effect on the pre-reaching shift of attention. I presented some neuropsychological  demonstrating that patients with Progressive Supranuclear Palsy have a deficit of VSWM that maps onto their oculomotor paralysis (see Smith & Archibald 2019). I argued this research had more direct relevance for mental imagery, as there is evidence that making eye-movements can interfere with the generation of visual imagery (e.g. Andrade, Kavanagh & Baddeley 1997), followed by a cheeky plug for our own workshop in July. I discussed the overlap between eye-movements, imagery and attention at some length with Dan Eaves (Teesside), and we were both struck by the fact that there are motor theories of attention, such as Kleins Oculomotor Readiness Hypothesis (OMRH) & Rizzolatti’s Premotor Theory (PMT), and motor theories of mental imagery such as Jeannerods Motor Simulation Theory. However, there seems to be little effort to reconcile or integrate these views, and we agreed this could be an area that is ripe for further study.  The day 2 keynote was given by Robert Hardwick (KU Leuven), who presented a fascinating meta-analysis of studies examining imagery, action observation and action execution, and finished with an appeal to develop more theoretically principled models of mental imagery. Again, I was struck by the parallels between the dominance of Simulation Theory in the motor imagery literature and that of OMRH/PMT in the literature on spatial attention, and the need to develop beyond these ideas. There was also time for a bit of light schmoozing around the posters, and I was delighted to talk briefly with Zoe Franklin about TMS and eyetracking, Elaine Poliakoff about her work on imagery in Parkinsons Disease, Shaun Boe about his ideas on the neural and cognitive mechanisms underpinned AOMI, Gabriel Valadez Roque about using imagery to rehabilitate stroke patients in Mexico and Martin Edwards, with whom I mainly exchanged academic gossip 😉.

The final session was a discussion led by Stefan Vogt which touched on future directions for imagery research. Naturally I made sure I had my 2 cents worth about motor theories of attention and imagery. There was also a prize for the best student contribution, which was won by Sylvia Chiou from Bielefeld for her excellent talk “Is temporal information integrated with spatial information during action observation? Effects of visual attention on the processing of whole-body movement sequences”. After all that excitement we retired to the Dickens Inn where refreshments were taken. Hats off to Dan Eaves for chairing such a well organised and welcoming conference, particularly for AOMI neophytes like me and Soazig. I was also very impressed with the Teesside Uni campus, and the quality and affordability of the catering. I would highly recommend attending the RIO group meeting to anyone with an interest in action observation, imagery or motor learning.

If you are interested in the research we presented my slides can be found here: RIO group talk

Our Cortex paper describing a deficit of spatial working memory in PSP is open access and can be found here: https://www.sciencedirect.com/science/article/pii/S0010945218302211?via%3Dihub

Smith, D.T. & Archibald, N. (2018). Spatial Working Memory in Progressive Supranuclear Palsy. Cortex

My internship at Durham University: A blogpost by Bianca Biebl from Ludwig Maximilians Universitat

When I embarked on my journey to travel from Munich to Durham for six weeks, I kept wishing that I was already there. That I already knew my accommodation was okay, my colleagues at university friendly and my tasks neither mind-numbing nor overcharging. Upon arrival I soon realized that my accommodation was really nice – even though a bit far from city centre. And regarding my internship, not only did I immediately feel like part of a team with my two supervisors but I also had a great task, which I knew would benefit me greatly for my academic growth. Of course, designing, programming, recruiting, testing and analyzing EyeTracking data was not an easy task. However, with every error message that I managed to resolve by myself and with every additional student I successfully tested, my self-confidence grew and in the end I could actually present a well-working experiment and proper results. This feeling of accomplishment was further encouraged by the supportive feedback by my supervisors and the mutual brainstorming for new ideas to improve every little detail. I also really appreciated the open-mindedness of everyone at university regarding any question I had, which made me feel really welcome. Another aspect of my internship I thoroughly enjoyed was a weekly event, where researchers and PhD students listened to various talks by external scientists while having a glass of wine. Some of my most memorable moments however were surely made during the weekends, where I explored the beautiful surrounding areas like the seaside, Newcastle, York or Edinburgh. The only thing I felt was missing from my time in Durham was contact with other people inside and outside of work. Since I was mostly working on my own, had the office to myself for great periods of time and spent evening and weekends alone, I would have liked to e.g. have more regular meetings or eat lunch together. Altogether however, I had a wonderful time in this beautiful city, learned a great deal and met some truly lovely people.  

Some advice for anyone thinking about a research internship at Durham University 

  • AirBnbs are a great way to stay at Durham – look for ones close to university and city centre 
  • Find a supervisor who is interested in the same topics as you are – there is really something for everyone here 
  • Take care of your network access beforehand  – it takes a few weeks 
  • People at university (colleagues / reception) or in the tourist office in town will help you with any problems – just ask 
  • Use Durham’s amazing location to travel around the north of England – it’s worth it!