- the official example scripts: (give details below) Platform: Google Colab. Python version: PyTorch version (GPU?): donglixp assigned wolfshow on Dec 2, 2021. lockon-n mentioned this issue on Dec 19, 2021. Add a processor for markuplm like layoutlmv2. NielsRogge/transformers#28.
- cnndm-unilm-large-cased-config.json 610 Bytes add unilm large cased config about 1 year ago; cnndm-unilm-large-cased.bin. LFS 670 MB add cnndm unilm large cased weight about 1 year ago; default-infoxlm-pytorch-model.bin. LFS 1.88 GB add infoxlm weight 12 months ago; infoxlm ...
- A new model, called XLM-R, that uses self-supervised training techniques to achieve state-of-the-art performance in cross-lingual understanding, a task in which a model is trained in one language and then used with other languages without additional training data. Our model improves upon previous multilingual approaches by incorporating more.
- UniLMは入力となる記事側は従来のBERTと同様に双方向で繋ぎますが、出力となる要約側は片方向で繋いでいます(図の点線部)。 UniLMはこのように繋ぎ方を工夫することで、BERTの構造を利用しつつ、要約の生成を可能にしています。