The attention mechanism in higher dimensions