使用语言模型GPT2来解决文本生成任务

This resource summarizes the resources used to solve text generation tasks using the language model GPT2, including papers, code, demo demos, and hands-on tutorials.

本资源汇总了使用语言模型GPT2来解决文本生成任务的资源,包括论文、代码、展示demo和动手教程。

GPT-2

GPT-2 is a large transformer-based language model released by OpenAI in February 2019. It contains 1.5 billion parameters and is trained on a 8 million web dataset. According to reports, the model is a direct extension of the GPT model, training on more than 10 times the amount of data, the parameter amount is also 10 times more. In terms of performance, the model is capable of producing coherent text paragraphs and achieves SOTA performance on many language modeling benchmarks. Moreover, the model can perform preliminary reading comprehension, machine translation, question and answer and automatic summarization without task-specific training.

GPT-2是OpenAI于2019年2月发布的基于 transformer 的大型语言模型,包含 15 亿参数、在一个 800 万网页数据集上训练而成。据介绍,该模型是对 GPT 模型的直接扩展,在超出 10 倍的数据量上进行训练,参数量也多出了 10 倍。在性能方面,该模型能够生产连贯的文本段落,在许多语言建模基准上取得了 SOTA 表现。而且该模型在没有任务特定训练的情况下,能够做到初步的阅读理解、机器翻译、问答和自动摘要。

GPT-2 Demo

GPT-2_Explorer Demo It can give the next ten words of the possibility ranking and their corresponding probabilities according to the currently input text. You can select one of the words, then see the list of the next possible word, and so on, and finally complete one. Article.

GPT-2_Explorer Demo 它可以根据当前输入的文本给出可能性排名前十的下一个单词及其对应概率,你可以选择其中一个单词,然后看到下一个可能单词的列表,如此往复,最终完成一篇文章。

点击体验 Click to GPT-2 Explorer Demo

GPT-2 elevant articles

hands-on GPT-2

GPT-2-simple

GPT-2-simple Python package to easily retrain OpenAI’s GPT-2 text-generating model on new texts.

GPT-2-simple Python包可以轻松地在新文本上重新训练OpenAI的GPT-2文本生成模型。

GPT-2-simple Demo

GPT-2-simple Demo Writes a follow-up story based on the current input text.

GPT-2-simple Demo 根据当前输入文本编写后续的故事。

点击体验 Click to gpt-2-simple Demo

grover: OpenGPT-2

Grover is a model for Neural Fake News — both generation and detection.

Grover是神经虚假新闻的模型 - 生成和检测。

grover demo

Generate articles based on information such as title, author, and more. Grover can also detect if text is generated by the machine.

根据标题、作者等信息生成文章。grover 还可以检测文本是否由机器生成。

点击体验 Click to GROVER

我来评几句
登录后评论

已发表评论数()

相关站点

热门文章