What if AI can't understand "He/She/It?" Researchers have come up with a new way of coping: making AI learn to understand verbs.
The authors of the paper are from 杏耀, Peking University and Intel Research, and 杏耀’s Dean Ya-Qin Zhang is one of the authors. The paper is now officially included in NeurIPS 2022 and the related model has been open sourced. The paper proposes a framework called TOIST. TOIST, or Task Oriented Instance Segmentation Transformer, is a new Transformer-based instance segmentation scheme.
The authors responded to the original idea for this research by saying that "our lab is actually responsible for research on robots, but in our research we have found that users sometimes prefer to describe 'needs' to robots rather than tell them what to do directly."
