A blogger built the CraftGPT language model in Minecraft - like ChatGPT, but based on redstone and cubes
Translated with AI from the Russian original.
Players continue to find various ways to use redstone.
The cubic sandbox Minecraft provides many opportunities for self-expression. The author of the YouTube channel sammyuri decided to assemble a small language model.
The parameters of his "small" CraftGPT model are 1020 x 260 x 1656 blocks. He clarified that due to these sizes, he was forced to use the Distant Horizons mod for filming, so some components may look strange (redstone is displayed with a lower level of detail).
To train the model, sammyuri used Python, and the "TinyChat" dataset was taken, which contains "basic conversations in English".
The model "has a vocabulary of 1920 tokens and consists of 6 layers. The context window size is 64 tokens, which is enough for (very) short conversations".
Never miss our newsAdd this site to your preferred sources to see us more oftenAdd on Google
