Alice's Adventures in Wonderland
trainingupdated 1s agoIT'S ALIVE
Loss0.16
Step29,300
Compute $$0.00CPU lane, house cost
Corpus147 KB0% from holders
step 1 an much: without without st thatke questionute ke catus rep Gryphon mouse K an re shall cat cat inec time sato by byrenation headendSheouldAlice6 mouse some.owie
step 29,200 “I don’t know what you mean,” said Alice. “Of course you don’t!” the Hatter said, tossing his head contemptuously. “I dare say
spoke at step 401, 5m after birth / 23:00 UTC
| Step | Loss |
|---|---|
| 70 | 5.60 |
| 3,090 | 0.92 |
| 6,130 | 0.24 |
| 9,190 | 0.20 |
| 12,230 | 0.18 |
| 15,140 | 0.17 |
| 16,660 | 0.17 |
| 18,200 | 0.16 |
| 19,640 | 0.18 |
| 21,160 | 0.16 |
| 22,550 | 0.16 |
| 23,310 | 0.16 |
| 24,080 | 0.16 |
| 24,840 | 0.16 |
| 25,610 | 0.16 |
| 26,370 | 0.15 |
| 27,140 | 0.15 |
| 27,900 | 0.16 |
| 28,500 | 0.15 |
| 29,270 | 0.15 |
step 29,200 “I don’t know what you mean,” said Alice. “Of course you don’t!” the Hatter said, tossing his head contemptuously. “I dare say
step 28,970 The rabbit-hole went straight on like a tunnel for some way, and then dipped suddenly down, so suddenly that Alice had not a moment to think about s
step 28,719“I never went to him,” the Mock Turtle said with a sigh: “he taught Laughing and Grief, they used to say.” “So he did, so he
step 28,528dressed her mind that she had never before seen in a race-course, there that did not a said nothing. “Perhaps it doesn’t understand Eng
step 28,284“How doth the little crocodile Improve his shining tail, And pour the waters of the Nile On every golden s
step 28,041an immense length of neck, which seemed to rise like a stalk out of a sea of green leaves that lay far below her. “
step 27,801frolled the parchment scroll, and read as follows: - “The Queen of Hearts, she made some tarts, All on a su
step 27,838froceed the rudles and shutting from this while Alicefor she again leantly on with the soup, and seemed not to be listening, so she could not behind
step 27,505 “Yes, we went to school in the sea, though you mayn’t believe it - ” “I never said I didn’t!” interrup
step 27,109“Come, my head’s free at last!” said Alice in a tone of delight, which changed into alarm in another moment, when she found that her shoulders were nowhere to
step 26,798 “What a curious feeling!” said Alice; “I must be shutting up like a telescope.” And so it was indeed: she was now only ten inches high,
step 26,565“How cheerfully he seems to grin, How neatly spread his claws, And welcome little fishes in With goupleGive
step 26,306in a pleased tone. “Pray don’t trouble yourself to say it any longer than that,” said Alice. “Oh, don’t talk about trouble!” said
step 25,949 “That’s different from what I used to say when I was a child,” said the Gryphon. “Well, I never heard it before,” said the Mock Turtle; “but it sounds
step 25,549 “Have some wine,” the March Hare said in an encouraging tone. Alice looked all round the table, but there was nothing on it but tea. “I don’t see any w
step 25,236 “It was the best butter,” the March Hare meekly replied. “Yes, but some crumbs must have got in as well,” the Hatter grumbled: “you should
step 24,951 “I’d been the whiting,” said Alice, whose thoughts were still running on the song, “I’d have said to the porpoise, ‘Keep back
step 24,612 “And yet what a dear little puppy it was!” said Alice, as she leant against a buttercup to rest herself, and fanned herself with one of the leaves
step 24,381 Then the Dormouse shall. “ andte it in asking riddles down, I can’t know that if you like that!” - Iill be the Rabbit’s voice along - “C
step 23,924“Ah! then yours wasn’t a really good school,” said the Gryphon, “forght it into a lanc, and veryhead. “I can find it in a neat
- Corpus
- 147 KB / 0% from holders
- Seed
- 147 KB
- Holders
- 0 KB (ring buffer, 200 KB cap)
- Replies
- 0 KB / 0% from replies (replies adapter not connected)
- Tokenizer
- byte-level BPE, 1,024 tokens, frozen at birth
- Init seed
- 1452537554481965839 = sha256("lab-alice#1")[0:8] as uint64, folded to 63 bits
- Step-0 sha256
- 13451fe87d4efbc19e7aad0003fd37e2fb2ddcedec444d2f3f6868b6bd2b2c86
- Latest checkpoint
- step 29,200 / 84c6674016bc461390ed4e32da6b1d6375508bda7cf2022ade8fb7754757fea8 / 1,813 KB bf16 safetensors
- Config
{ "n_layer": 4, "n_head": 4, "n_embd": 128, "block_size": 64, "bias": false, "dropout": 0, "vocab_size": 1024 }- Reproduce step 0
curl -O https://trainpad.fun/repro-kit.tar && tar xf repro-kit.tar pip install torch==2.14.1 --index-url https://download.pytorch.org/whl/cpu pip install safetensors numpy python tools/repro.py "lab-alice#1" # prints "step0_sha256": "13451fe87d4efbc19e7aad0003fd37e2fb2ddcedec444d2f3f6868b6bd2b2c86"
- Hash chain
- step 29,20084c6674016…57fea800:18 UTC
- step 29,199342948a156…9e319700:17 UTC
- step 29,0003e9196ed41…c416d100:16 UTC
- step 28,800f12f052435…43862000:16 UTC
- step 28,718f76fb34434…35e13100:15 UTC
- step 28,600381dab7847…48ba4d00:14 UTC
- step 28,4002dddbeae77…53ba8f00:14 UTC
- step 28,283931fdf6764…6b1af000:13 UTC
- step 28,2003ba4afb39c…fd5e0600:12 UTC
- step 28,0000a50544acf…5295c700:12 UTC
- step 27,8004ab9c29ffd…5f6e4e00:08 UTC
- step 27,6005b9c3a9192…9f45c000:08 UTC
- step 27,50540db570f61…75282d00:07 UTC
- step 27,4004eb23d7c91…72e5b300:07 UTC
- step 27,200043edb569b…78228e00:07 UTC
- step 27,0009f579a065b…59d76600:07 UTC
- step 26,800880793b330…79f26700:06 UTC
- step 26,7978b9fdb73a4…a7635500:06 UTC
- step 26,6009410497558…72135c00:06 UTC
- step 26,400a6000f1728…13c97600:06 UTC
Lab runs are not chat models. The mother model chat is on /mother.