著者
Jasper van DoornmalenAlexander KozachinskiyCorinna MathwieserTomasz SteiferFelipe UrrutiaJosé VerschaePrzemysław Andrzej Wałȩga
要旨
In this note, we show that the problem of checking, whether a sequence of bits is ordered, is not doable by 1-head 1-layer transformers but is doable by a 2-head 1-layer transformer. Unlike similar previous results, our results assume the model where transformers have an output MLP.
論文情報
- arXiv ID:
- 2609.25588v1
- 公開日: