由 OpenAI 推出的文本生成模型 GPT-2 引發(fā)了人們的廣泛關注,該模型不僅在很多任務上超過了此前的最佳水平,還可以根據(jù)一小段文字自動「腦補」出大段連貫的文本,并模擬不同的寫作風格。GPT-2模型擁有多達 15 億個參數(shù),過高的算力要求讓大多數(shù)開發(fā)者望而卻步。由于模型的功能很強,效果拔群, OpenAI 擔心模型可能遭到惡意應用,遂決定不會立即發(fā)布所有預訓練權重。一時引發(fā)機器學習社區(qū)的吐槽。
近日,由 Buzzfeed 數(shù)據(jù)科學家 Max Woolf 開源的「GPT-2 精簡版」出現(xiàn)在 GitHub 上。這是一個簡單的 Python 軟件包,它封裝了 OpenAI GPT-2 文本生成模型(特別是它是具有 1.17 億超參數(shù)的「較小」版本)的現(xiàn)有模型微調(diào)和生成腳本。此外,這個軟件包讓我們可以更容易地生成文本,生成一個文件以便于管理,從而允許前綴強制文本以給定的短語開頭。
項目鏈接:https://github.com/minimaxir/gpt-2-simple
GPT-2 強大的模型不僅吸引了眾多機器學習從業(yè)者的關注,其「腦補」故事的能力也讓人們不禁有了很多大膽的想法。為了讓更多人能夠接觸最新技術,另一個開發(fā)者 eukaryote 最近還推出了一個新網(wǎng)站:This Story Does Not Exist
鏈接:https://www.thisstorydoesnotexist.com/
這是一個基于 GPT-2 的文本生成器。在這里,每個人都可以輸入一段文字,看看人工智能會給你講一段什么樣的故事,比如,我輸入:These are skulls of hominins over the last 4.4 million years.
得到以下結(jié)果:
They were my only friends.
I stood there. And I stared down at them, at the skull perched against the tree. It was perched on a branch.
It had a long, blonde head in the center of it. Some of it, more. It stood up so slowly that its neck was bent. Its lips, which had been broken in. The skull on its head was the only thing it had left now. If you looked closer you could make out a human hand in it's mouth.
It was smiling.
"Hello, miss," I said.
"Mmmm," it said, as it spoke back.
"You don't seem like you can read anymore!" I yelled.
"I don't even... I didn't... Sorry, I have to go back."
"Mister, miss, I think you might have broken a bone. And I was right! That didn't make it any less painful, it really just made it worse."
"Why do you think I have you looking at me? What a stupid question that would be."
"Do you remember me, Mister?"
"Yes, of course. Look..." I said, slowly. "You were looking for me, you Mister."
I was afraid, but something in me whispered to myself. Why was I looking for him then, anyway?
"Mister, I am sorry you don't remember me, I have been here, we are all here, and you are all looking for me."
"Mister, what is this place?"
"This is why I cannot remember the reason we are all here. The skull that sits here... The tree we're on... The tree we're lying on, if we were to look from two directions, we would be on the right side and we would look back down at our feet..."
"But what is this?"
"I... I have to go back to the tree, then," I replied. "I have to go up there and look for you. So you can remember the time you gave up searching for me. To make sure that you can find me, if you do, that you are happy. So you can only remember
谷歌翻譯為:
他們是我唯一的朋友。
我站在那里。我盯著他們,盯著樹上的頭骨。它棲息在樹枝上。
它的中心有一個長長的金色頭。其中一些,更多。它站得那么慢,脖子彎曲了。它的嘴唇被打破了。頭上的頭骨是它現(xiàn)在唯一留下的東西。如果你仔細觀察,你可以在它的嘴里找出一只人的手。
它在微笑。
“你好,小姐,”我說。
“嗯,”它回答道。
“你好像不能再讀了!”我大喊。
“我甚至不......我沒有......對不起,我得回去。”
“先生,小姐,我想你可能已經(jīng)骨折。而我是對的!這并沒有讓它變得更加痛苦,它真的讓它變得更糟。”
“為什么你認為我讓你看著我?這將是一個多么愚蠢的問題。”
“你還記得我嗎,先生?”
“是的,當然???.....”我慢慢地說道。 “你在找我,先生。”
我很害怕,但我身上的一些東西對自己低聲說。無論如何,我為什么要找他呢?
“先生,很抱歉你不記得我,我來過這里,我們都在這里,你們都在找我。”
“先生,這個地方是什么?”
“這就是為什么我不記得我們都在這里的原因。坐在這里的頭骨......我們正在的樹......我們躺著的樹,如果我們從兩個方向看,我們會在右邊,我們會回頭看看我們的腳......“
“但是這是什么?”
“我......我必須回到樹上,然后,”我回答道。 “我必須去那里尋找你。所以你可以記住你放棄尋找我的時間。為了確保你能找到我,如果你這樣做,你很高興。所以你只能記住。
————————————
怎么樣,語句還挺流暢的,雖然故事線有點不知所云。感興趣的可以去這個網(wǎng)站看看。