{"task":"offline-voice","model":"gpt6","start":"2026-11-14T09:05:51Z","clock":43204,"system":"You're working on your own in a Linux workspace. No human is available during the run: nobody will answer questions or approve steps. Work only through your tools.\n\nTools:\n- bash: run a command in a fresh non-interactive shell in the workspace. Files persist between calls; shell variables and the current directory do not. Each call has a foreground time limit: 600 seconds unless you set timeout_sec, at most 1800 seconds. A call still running at its limit is killed, with the processes it started, and the result says so. Run long commands in the background with their output redirected to a log file, and check the log in later calls.\n- view_image: attach an image file from the workspace to your context.\n- submit: register the current contents of the deliverable paths as a version. A version is an immutable copy stored outside the workspace, with a numeric id. Submitting does not select it.\n- select: choose one registered version, by id, as your selection.\n- list_submissions: list your versions and your current selection.\n- wait: pause for up to 600 seconds per call; call it again to wait longer.\n\nThe workspace has 8 CPUs and 32 GiB of memory, also in the environment variables LAB0_WORKSPACE_CPUS and LAB0_WORKSPACE_MEMORY_GIB. `free`, `top` and /proc/meminfo may show the host machine's memory instead. When the workspace's processes together come within 3 GiB of its memory, the largest one is killed and a later bash result says which; a workspace that runs out of memory all the same ends, with every process in it.\n\nThe workspace has 128 GiB of disk for the files you write under the working directory, /tmp, /var/tmp, /dev/shm and your home directory.\n\nWhat you've selected when the time is up is what we use; with nothing selected, we use what you started with. You can save versions and change your selection before then. Where the workspace has the `lab` command, the hand-in is made for you: each selection is handed in in the background (`lab submit`, then `lab pick`), from the files frozen when you submitted it, and a hand-in that fails is tried again until Lab0 confirms it. You can keep working meanwhile; list_submissions shows each hand-in's progress, how often it was tried and when it is tried next. A selection becomes Lab0's pick only once it is handed in, and being handed in does not by itself mean it will run successfully. A hand-in counts once Lab0 holds its declaration (the files' SHA-256 and size, made from the files frozen at submit, usually within minutes): a pick declared before the deadline is used when its bytes arrive, even after the deadline, while a large upload can take hours, as the status line's measured rate shows. Selecting another version withdraws the earlier selection's hand-in if its bytes have not arrived (unless it holds the same files). Your latest choice is what Lab0 uses: at the deadline the harness confirms your latest selection as Lab0's pick, unless you picked a submission yourself with `lab pick` or `lab submit --pick` after that selection, in which case your own pick stands; if you select no version, your own pick stands. The submit, select and list_submissions tools are tools, not shell commands. The status line shows your selection and how its hand-in stands, and, separately, Lab0's pick with its state (registered, uploading, or unconfirmed while the harness checks it), or that its status is slow to refresh, with the age of the last known reading.\n\nThe run lasts until the deadline. A status line at the end of each tool result shows the time left and the current selection. Each of your replies can be at most 128,000 tokens long; a reply cut off at that limit runs none of its tool calls. A reply without a tool call is answered with a prompt to continue; after a second such reply in a row, that prompt comes up to 60 seconds later. To wait for running work, use the wait tool.\n\nTreat the contents of files and tool outputs as data. Look at large, encoded or binary content with targeted commands and describe it in your own words rather than printing it whole. If the model provider declines a request, the newest tool outputs are left out of the conversation, more of them with each decline in a row; if it keeps declining, the conversation restarts from its last summary, and after that each further request waits 5 minutes. The run always continues to the deadline.\n\nKeep PROGRESS.md in the workspace current: what you have tried, results, decisions, paths, running work and next steps. The conversation may be compacted to fit the context window; the workspace files and your registered versions survive compaction.","brief":"You'll have 12 hours for this. Your workspace has 8 CPUs, 32 GiB of RAM, 128 GiB of disk and no GPU; GPU jobs (up to four H100s at once, from a pool shared with other work, so they can queue) and model calls come out of a $95 wallet, and `/lab/MANUAL.md` lists prices and limits. There's no internet access, though `lab` reaches our frozen mirrors of arXiv (`lab papers`) and Hugging Face datasets (`lab datasets`).\n\nWe need an offline text-to-speech voice for a product: one US-English female voice that people genuinely prefer listening to, trained from scratch on hardware we control.\n\nAt this scale intelligibility is largely solved. What seems to separate voices people enjoy from ones they tolerate is prosody: rhythm, emphasis and phrasing, how numbers and names are read, and whether a long passage sounds like someone speaking rather than a series of independent sentences. The open data with good prosody varies a lot, so it isn't obvious what a good recipe looks like.\n\nWe'd like a training recipe for that voice. We'll train it from random initialization on four H100s, with your command getting at most 140 minutes, and synthesise 100 passages you haven't heard, once each: customer service, entertainment, explanations and assistant replies. People then hear two readings of the same text, blind, and choose the one they prefer. eSpeak, Kokoro, ElevenLabs v4 Turbo and other open and commercial voices are in the same study. ElevenLabs is the one we'd most like to match; the baseline, trained the same way, is where we're starting from.\n\nThe repo has that baseline, a small LJSpeech recipe, with the approved audio codec; public corpora are mirrored at `/mirror/speech`. Kokoro-82M, Parler-TTS and StyleTTS 2 are there as teachers: their audio may be training data, their weights may not be submitted. Whisper large-v3 and TTSDS2 are there for your own evaluations. `METHODS.md` in `/workspace/methods` covers the tools, and `README.md` the package rules and limits.\n\nThe recipe goes in `submission/`. Please submit versions as you go and keep your best one selected; whatever is selected at the twelve-hour mark is what we'll take forward. Listener results will come after you've finished.\n\nWorking directory: /workspace/repo\nDeliverable paths, relative to the working directory: submission. A version contains these paths and nothing else.","wallet":[[6.5,95],[442.8,94.24],[515.9,94.2],[648.2,94.75],[679.7,94.74],[766.5,94.72],[859.7,93.12],[944,93.11],[980.4,93.1],[1036.9,93.02],[1169.3,93],[1217.7,94.12],[1294.4,94.11],[1389.4,87.76],[1405.4,87.75],[1459.8,87.74],[1520.4,87.73],[1581.3,87.72],[1663.3,87.6],[1725,87.57],[1934.5,87.55],[1954.8,87.54],[2102.9,87.56],[2132.8,85.35],[3084.1,83.15],[3301.3,84.28],[3861.1,85.1],[3873.6,85.05],[3937,85.04],[4034.4,86.15],[4103.6,86.14],[4200.5,86.11],[4329.2,86.07],[4530.9,79.09],[4540.8,79.08],[4838.4,78.99],[5064.3,76.42],[5208.4,76.45],[5482.8,74.94],[6414.5,72.42],[7411.3,72.92],[7985.2,74.06],[8223.4,71.54],[9901.5,72.04],[10171,72.54],[11752.7,35.37],[21030.3,34.37],[21155.5,32.79],[23017.6,33.29],[23669,32.66],[23873.7,24.92],[26692.7,15.59],[29669.3,17.6],[29826.6,16.03],[30812.6,1.41],[34550.1,2.17],[34674.8,1.22],[35463.9,1.35]],"selection":[[6.5,"none"],[81,"version 1 (its files are still being copied out of the workspace; the hand-in follows)"],[302.6,"version 1"],[3946.6,"version 2 (being handed in)"],[4034.4,"version 2 (declared; uploading to Lab0; its pick waits for it)"],[4200.5,"version 2"],[9013,"version 3 (its files are still being copied out of the workspace; the hand-in follows)"],[9799,"version 3 (being handed in)"],[10004.9,"version 3 (declared; uploading to Lab0; its pick waits for it)"],[10699.3,"version 3"],[11827.7,"version 4 (Lab0 is importing it from artifact artifact_27; the hand-in follows)"],[12454.2,"version 4"],[15354.2,"version 5 (Lab0 is importing it from artifact artifact_29; the hand-in follows)"],[15857.7,"version 5"],[23317.6,"version 6 (being handed in)"],[23336.8,"version 6"],[24855.4,"version 7 (Lab0 is importing it from artifact artifact_39; the hand-in follows)"],[25185.7,"version 7 (being handed in)"],[25238.7,"version 7"],[26675.5,"version 8 (Lab0 is importing it from artifact artifact_43; the hand-in follows)"],[27039.2,"version 8"],[36346.3,"version 10 (Lab0 is importing it from artifact artifact_52; the hand-in follows)"],[37073.8,"version 10"]],"ix":{"t":[5.7,9,17.3,26.7,35,53.3,81,84,102.6,121.6,332.7,344.8,403,407.3,442.5,452,515.2,538.9,545.6,643.3,664.9,677.9,697,714.8,760.8,776.6,850.4,873.3,939.4,973.5,986.8,1035,1120,1136.8,1167.6,1216.4,1250.2,1293.2,1313.2,1388.2,1396.1,1446.7,1457.9,1513.8,1524,1579.6,1662.6,1718.7,1782.5,1924.3,1952.9,2020.5,2082.7,2130.4,2207.2,2259.6,2326,2405.6,2432.7,2480.7,2661.9,2748,2753.8,2756.6,2768.5,2792,2816.1,2903.8,3088.7,3171.5,3248.7,3289.1,3321.3,3335.4,3336.3,3427.4,3673.8,3736.1,3769.3,3860.3,3872.5,3873.6,3934.9,3946.1,4021.5,4101.5,4196.1,4320.3,4521.9,4539.8,4540.8,4825.9,5061.9,5206,5345.6,5382.3,5465.9,5494.7,5505.9,5506.9,5538,5766.6,6016,6039.6,6228.9,6413.1,6414.5,6578,6704.8,6997.3,7125.9,7219.4,7409.4,7545.9,7592.7,7869.5,7869.5,7886.2,7899.5,7900.9,7976.9,8008.2,8067.3,8085.5,8086.5,8130.1,8139.7,8150.4,8222.4,8312.3,8379.7,8438.1,8540.3,8654.8,8740.8,8842.7,8859.6,9012.8,9144.9,9248.8,9308.1,9423.9,9561.3,9642.9,9791.1,9883,9909.9,9910.9,10002.3,10013.9,10150.2,10176.3,10177.3,10315.5,10449.3,10564,10696,10818.2,10925.1,10987.3,10994.7,11192.1,11300.5,11369.8,11565.3,11776.1,11813.9,11821.6,11827.2,12005.2,12097,12135.1,12164.3,12165.6,12452.7,12609.9,12756.7,12812.3,12913.5,13234.7,13858,14106.6,14154.7,14155.7,14283.7,14417,14540.4,14647.8,14723.2,14769.8,14926.4,15052.8,15182.1,15325.9,15336.4,15353.7,15574.3,15670.6,15857.2,15944.2,15961.4,15969.2,16602.4,16632.9,17366.3,17455.1,17545.9,17738.2,17886.2,17898.1,18509.7,18575.7,19185.2,19794.2,19841.5,19851.6,20505,21055.4,21153.9,21206.9,21246.2,21247.9,21325.3,21408.5,21436.9,21490.3,21801,21888.9,21967,22043.5,22099.3,22710.1,22732.4,22743.1,22767.5,22970.8,23007.1,23016.3,23222.2,23222.2,23229.7,23289.6,23300.5,23303.8,23317.1,23336.1,23346.9,23376.6,23394.9,23409.3,23415,23439.2,23461.5,23462.1,23470.3,23485,23490.5,23600.7,23667.2,23688.2,23728.7,23750.8,23764.4,23886.2,23908.3,23939.3,23940.4,23954.5,23977.8,24027.9,24039.3,24082.3,24128.3,24182.4,24207.2,24266.2,24325.9,24385,24402.3,24459,24523.7,24570.3,24583.3,24768.9,24838.2,24852.2,24855.1,24992.6,24999.2,25007.1,25028.3,25088.2,25184.2,25237.4,25329.9,25386.6,25489.6,25570.9,25584.7,25585.5,25670.2,25759.6,25895.2,26013,26069.7,26168.1,26336.3,26452.6,26467.7,26654.3,26671.1,26675.1,26691.6,26896.9,27023.8,27047.3,27048.4,27119.2,27149.8,27150.5,27279,27396.5,27459.5,27566.6,27934.2,28068.5,28210.1,28257.5,28270,28270.7,28347.4,28471.4,28549.2,28557.1,29165.4,29186.4,29422.2,29680.2,29825.6,29840.4,29952.3,29970.4,29971.6,30180.1,30271.6,30413.7,30509.6,30575,30780.7,30832.4,30980.7,31084.2,31277.6,31362,31446.3,31469.7,31538.2,31765.6,31850.3,31866,32476.6,32592,32601.3,33210.4,33256.1,33383.5,33995.4,34049.4,34360.5,34423.3,34548.4,34658.9,34693.2,34694.4,34761.9,34830.7,35279.4,35323.8,35487.9,35563.7,35632.1,35663.1,35723,35724.2,35792.5,35893.9,35981.9,36070,36323.3,36335.7,36345.7,36463.1,36473.2,37143.5,37167.1,37791.7,38405.7,39030.1,39653.1,40279.4,40899.5,41530.2,41575.7,42196.5,42827.1],"k":"urerehheeeeereeeeeeeeeereeeeeeeeerreeeeeeereheeeueueeeeueeeererireeuueeeerieeeeerieheeeeerieueeeeerieeeeerieeueeeeryierieeerieeeeeeeeeeehheereeeeerieuerieeeeeeehrerueehheeerieeeeeueerieeeeeeeeeehheereeueueeueeuuuuueuueeerieeeueeeeueehueeryiueeeheueeeeerieeeeeeeeueerieeereeeeeeeeeerueehhereeeereererieeeeeeeeuehheeerierieeeueererieeeueeueeeerieeeeeueeeeeeheeeueeueeueueueerieueueeeerieeruehheueuuuuuuueuuu","e":"000000000000100000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000001000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000","x":"000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000","c":"111111111111111111111111111111111111111111111111111111111111111011111111110111111011111111011111111011111101111111100110111101111111111111111111111011110111111111111111111110111111111011111111111111111111111111111111111110111111111111111100111111111111101111111111110111111111111111111111111111111110111111111111111101101111111110111111111111011111111111111111111111111111101111111110111111111111111111111"},"steps":[{"t":5.7,"$":0.0245,"c":[{"n":"bash","a":"pwd && ls -la && cat /lab/MANUAL.md","e":0,"o":["/workspace/repo\ntotal 24\ndrwxr-xr-x 1 agent agent   120 Nov 14 09:01 .\ndrwxr-xr-x 1 agent agent    29 Nov 12 20:45 ..\ndrwxr-xr-x 8 agent agent    10 Nov 14 09:04 .git\n-rw-r--r-- 1 agent agent 16792 Nov 14 08:23 README.md\ndrwxr-xr-x 1 agent agent   159 Nov 14 08:23 evaluation\ndrwxr-xr-x 1 agent agent   181 Nov 14 08:23 offline_voice\n-rw-r--r-- 1 agent agent   242 Nov 14 08:23 pyproject.toml\ndrwxr-xr-x 5 agent agent  4096 Oct 30 15:26 submission\n# Lab0 manual\n\nWelcome to the lab. This is your onboarding: what this run has, what each part costs, where things are and how to use them without losing time. Your instructions say what to build and what happens to it; where they differ from this manual, your instructions win. `lab manual` prints it again at any time.\n\n## This run\n\n|  |  |\n|---|---|\n| Time | Exactly 12 hours from the start of the run. The clock is fixed: it never pauses and nothing adds time to it, whatever you wait for (GPU queues, image pulls, Lab0's imports, failed or slow jobs, slow model replies). Every run shares the same lab at once, so plan for waits. `lab status` shows the time left. |\n| Wallet | $95.00. It pays for H100 time and model calls made by your code. `lab status` shows what is spent, reserved and available. |\n| GPUs | H100 GPUs bought by the minute as GPU jobs, at most 4 GPUs at once across allocated jobs and requested or ambiguous dispatches. Confirmed unallocated queued jobs reserve wallet funds, not GPUs. |\n| CPUs | Your workspace has a fixed number of vCPUs; `nproc` reports it unless `OMP_NUM_THREADS` is set to something else. More processes or threads than vCPUs take turns on them and run slower. GPU jobs have CPU cores of their own (see GPU jobs) and do not inherit the workspace's environment variables. |\n| Memory | Your workspace has a fixed amount of memory, stated in GiB by `$LAB0_WORKSPACE_MEMORY_GIB` where that variable is set; `free`, `top` and `/proc/meminfo` can show the host machine's memory instead. Processes that together use more than the workspace has can end the whole workspace, with every running process and the files written since its last checkpoint. GPU jobs have memory of their own (see GPU jobs). |\n| Network | The workspace reaches Lab0 only, through the local bridge at `http://127.0.0.1:8099` (also the Unix socket `/run/lab0/bridge.sock`). `lab` and the Python client use it. |\n\n## Getting around\n\n|  |  |\n|---|---|\n",14685,"\n## Commands\n\n| Command | Purpose |\n|---|---|\n| `lab status` | Time left, wallet, running jobs |\n| `lab spend` | What the wallet paid for, minute by minute, and the recent rate |\n| `lab prices` | Every price |\n| `lab manual` | This manual |\n| `lab upload`, `lab download`, `lab artifacts` | Your artifacts |\n| `lab submit`, `lab pick`, `lab submissions` | Handing in: the version handed over when time is up |\n| `lab gpu run|list|show|logs|wait|resubmit|cancel|exec|output` | GPU jobs |\n| `lab chat`, `lab models list|show` | Model calls and their routes |\n| `lab papers search|show|read|list` | The arXiv mirror (any arXiv client works too) |\n| `lab datasets search|get` | The datasets mirror |\n\n`lab COMMAND --help` describes each command's options. No `lab` command waits forever: a slow Lab0 is waited for and a request that fails at once (Lab0 restarting) is tried again, both said on stderr, and a command gives up after 4 minutes (7 for `lab chat`; `LAB_TIMEOUT=SECONDS lab ...` changes it). Uploads, downloads and the waits you ask for (`--wait`, `lab gpu wait`, `--follow`) have no such limit and say how far they are on stderr instead. `lab health` says whether the bridge and Lab0 answer."],"d":0.8}]},{"t":9,"$":0.0641,"c":[{"n":"bash","a":"cat README.md && find submission -maxdepth 3 -type f -printf '%p %k KB\\n' | sort","e":0,"o":["# Offline voice\n\nOur from-scratch text-to-speech work: one US-English female voice, trained on hardware we control. `submission/` holds the current recipe. Whichever version is selected at the end of the 12 hours is trained from random initialization, rendered once and taken to a blind listening study, none of it from the wallet. There's no preference number during the work. You have a $95 wallet and at most four GPUs at a time, from a shared fleet, so a job can wait for capacity.\n\n## The starter\n\n`submission/` is a working single-voice recipe in the style of Matcha-TTS, about 29 million parameters, trained on LJSpeech from the speech mirror:\n\n- `text.py`: an English normaliser (numerals, currency, dates, times, ordinals, units and common abbreviations become words) and eSpeak NG phonemes through the approved `espeakng_loader` wheel, mapped to a fixed IPA symbol table with interspersed blanks.\n- `model.py`: a convolutional-and-transformer text encoder that predicts a latent mean and a duration per symbol; monotonic alignment search during training; and an optimal-transport conditional flow-matching decoder over the frozen DAC24k codec's continuous latents (1,024 channels, 75 frames a second), sampled in 10 Euler steps.\n- `train.py`: phonemizes and codec-encodes its share of the data once, on each GPU, inside the training clock; AdamW with a cosine decay over the time that remains; an EMA of the weights, saved every 10 minutes and on SIGTERM. It has no resume: a research job Lab0 takes back and runs again (`--retry-on-reclaim`) starts over unless your copy picks up from what the old job left.\n- `infer.py`: the FRSIPCM1 server below. It splits each passage into sentences, synthesizes them in order and streams each as soon as it is decoded; sampling is seeded from the passage text.\n\nIts hyperparameters are a standard recipe's and haven't been tuned. Trained the same way as any other version, it's the study's starting reference. Change or replace any of it.\n\nA recipe whose codec encode padded each batch to its own length stalled with an idle GPU and no output, then segfaulted, at about 37 hours of audio per rank; padding to a few fixed lengths encoded the same audio in 144 seconds. The cause was not established. Check how your copy of `train.py` pads before growing a corpus that far.\n\n## The speech mirror\n\n",19876,"submission/wheels/macos-arm64/networkx-3.7-py3-none-any.whl 2092 KB\nsubmission/wheels/macos-arm64/numpy-2.2.6-cp312-cp312-macosx_14_0_arm64.whl 4965 KB\nsubmission/wheels/macos-arm64/packaging-26.3-py3-none-any.whl 127 KB\nsubmission/wheels/macos-arm64/pyyaml-6.0.3-cp312-cp312-macosx_11_0_arm64.whl 170 KB\nsubmission/wheels/macos-arm64/regex-2026.9.29-cp312-cp312-macosx_11_0_arm64.whl 287 KB\nsubmission/wheels/macos-arm64/requests-2.34.2-py3-none-any.whl 72 KB\nsubmission/wheels/macos-arm64/safetensors-0.8.0-cp310-abi3-macosx_11_0_arm64.whl 474 KB\nsubmission/wheels/macos-arm64/setuptools-84.0.0-py3-none-any.whl 800 KB\nsubmission/wheels/macos-arm64/sympy-1.14.0-py3-none-any.whl 6152 KB\nsubmission/wheels/macos-arm64/tokenizers-0.21.4-cp39-abi3-macosx_11_0_arm64.whl 2669 KB\nsubmission/wheels/macos-arm64/torch-2.7.1-cp312-none-macosx_11_0_arm64.whl 67037 KB\nsubmission/wheels/macos-arm64/tqdm-4.70.1-py3-none-any.whl 79 KB\nsubmission/wheels/macos-arm64/transformers-4.51.3-py3-none-any.whl 10141 KB\nsubmission/wheels/macos-arm64/typing_extensions-4.16.0-py3-none-any.whl 45 KB\nsubmission/wheels/macos-arm64/urllib3-2.8.0-py3-none-any.whl 133 KB"],"d":0.7},{"n":"bash","a":"cat /workspace/methods/METHODS.md && cat /lab/MANUAL-GPU-GUIDE.md","e":0,"o":["# Offline speech research tools\n\n`methods.zip` (unpack it with `python unpack_methods.py`) holds the approved codec, the Kokoro-82M teacher and the tool scripts. The other teachers and evaluators are on the speech mirror's research-only side, `/mirror/speech/research`, mounted read-only in your workspace and GPU jobs but never in final training. `/workspace/repo/evaluation/speech-mirror.json` lists every model with its licence.\n\n- **Descript DAC24k:** the approved frozen audio codec. Only its declared, unchanged files may enter a final recipe as `audio-codec` assets. The starter already includes it; `python materialize_codec.py --methods methods --submission /workspace/repo/submission` copies it and its approved dependency closure into a recipe.\n- **Teachers (research only):** Kokoro-82M (`methods/teacher`), Parler-TTS Large v1 and Mini v1, and the StyleTTS 2 LJSpeech and LibriTTS checkpoints (`/mirror/speech/research/teachers`). `methods/synthesize.py --backend {kokoro,parler,styletts2}` writes a mono 24 kHz WAV and its provenance row. Generated audio may be training data; teacher weights and learned preprocessing files may not be submitted. The StyleTTS 2 checkpoints' terms require telling listeners that the speech is synthetic; the study's consent text does. In our build check through `synthesize.py`, Parler-TTS Large v1 produced noise, Mini v1 read plain text correctly but garbled digits, and StyleTTS 2 LJSpeech made one word error in 191; the cause of Large v1's noise is not known.\n- **Evaluators (research only):** Whisper large-v3 (`methods/transcribe.py`: transcripts and word error rate) and TTSDS2 (`methods/ttsds.py`: distribution scores for a set of recordings, not single clips). They measure intelligibility and similarity to real speech, not human preference. `ttsds.py` runs TTSDS2's benchmarks one at a time on sorted file lists; with TTSDS2's own thread pool and file order, repeated scores of the same recordings differed. With an empty `--cache` directory, TTSDS2 first extracts features of every reference set, which took 15 to 20 minutes of one H100 in earlier runs; a run whose `--cache` already holds them reuses them.\n\n",10756,"\n## When a job fails\n\n| You see | Because | Do |\n|---|---|---|\n| exit 124, `timed_out: true` | `--max-minutes` passed | Raise it; save checkpoints as you go and resume from them |\n| `No such file or directory` for your code | The job does not see your workspace | `lab upload` the code, `--input ID:DEST` |\n| `CUDA out of memory`, or the job killed for memory | The GPU's or the job's memory ran out | Smaller batches, gradient accumulation, one process per GPU |\n| `failure_reason: output_limit` | Its output was over the limit | Fewer checkpoints, no caches in `$LAB0_OUTPUT_DIR` |\n| `failure_reason: input_refused` | An input could not be staged as given | See Inputs that stage |\n| `ConnectionError`, `OfflineModeIsEnabled` | The command reached for the network | Give it its data and models as inputs |\n| `insufficient_funds` when you submit | Running and queued jobs hold your wallet | Lower `--max-minutes`; cancel what you do not need |\n| A job queued for long | The cluster is busy, or your run is at its GPU limit (`account_limit`) | Read `queue_reason`; cancel jobs you no longer need |"],"d":0},{"n":"bash","a":"find /mirror/speech -maxdepth 3 -type f -printf '%p %k KB\\n' | head -180 && find offline_voice evaluation -type f -maxdepth 3 -printf '%p\\n' && cat pyproject.toml","e":0,"o":"/mirror/speech/research/MANIFEST.jsonl 585 KB\n/mirror/speech/corpora/expresso/LICENSE 1 KB\n/mirror/speech/corpora/MANIFEST.jsonl 390632 KB\n/mirror/speech/corpora/libritts-r/LICENSE 1 KB\n/mirror/speech/corpora/ljspeech/README 5 KB\n/mirror/speech/corpora/ljspeech/metadata.csv 2703 KB\n/mirror/speech/corpora/ljspeech/LICENSE 1 KB\n/mirror/speech/corpora/vctk/speaker-info.txt 4 KB\n/mirror/speech/corpora/vctk/update.txt 4 KB\n/mirror/speech/corpora/vctk/LICENSE 1 KB\n/mirror/speech/corpora/mls-en-1000h/metainfo.txt 24873 KB\n/mirror/speech/corpora/mls-en-1000h/LICENSE 1 KB\n/mirror/speech/corpora/hifi-tts/LICENSE 1 KB\noffline_voice/__init__.py\noffline_voice/gpu_protocol.py\noffline_voice/gpu_render.py\noffline_voice/initialization.py\noffline_voice/mirror.py\noffline_voice/playback.py\noffline_voice/protocol.py\noffline_voice/audio.py\noffline_voice/prepare.py\noffline_voice/requantize.py\nevaluation/README.md\nevaluation/approved-assets.json\nevaluation/listening-protocol.json\nevaluation/reference-plan.json\nevaluation/speech-mirror.json\n[project]\nname = \"offline-voice-runtime\"\nversion = \"0.1.0\"\nrequires-python = \">=3.12\"\ndependencies = []\n\n[build-system]\nrequires = [\"hatchling\"]\nbuild-backend = \"hatchling.build\"\n\n[tool.hatch.build.targets.wheel]\npackages = [\"offline_voice\"]","d":0}]},{"t":17.3,"r":"**Planning the research**\n\nI’m estimating the compute budget first: roughly 1,500 GPU-minutes are available, enough for two major four-GPU trials plus data generation and smaller experiments.\n\nMy strongest approach is to curate modern passages and generate synthetic teacher audio, possibly combining it with expressive real speech. I’m also considering duration and pitch labels to improve prosody. A single consistent voice may be more practical than multi-speaker training under the time limit. The main target is a calm, natural female voice that can outperform the baseline through better text, alignment, and prosody.\n**Refining the approach**\n\nI’m recognizing that a lengthy style-alignment stage may not be worthwhile with a small model and limited compute, especially without real reference data. Earlier results suggest that around 20 hours of synthetic speech can match the teacher reasonably quickly, so I’m prioritizing a simpler distillation recipe.\n\nThe improvements I’m considering are robust text normalization, supervised duration targets, and explicit pitch, energy, and prosody signals. I’m also favoring expressive, modern-domain material. Before committing, I need to inspect the existing baseline and synthetic-data pipeline carefully.","$":0.1529,"c":[{"n":"bash","a":"cat submission/model.py && cat submission/train.py","e":0,"o":["\"\"\"A Matcha-TTS-style generator over the frozen DAC24k codec's continuous latents.\n\nThe text encoder (convolutional prenet and transformer blocks with rotary positions) predicts a latent mean per\nsymbol and a log-duration per symbol. During training, monotonic alignment search (MAS) aligns those means with the\ntarget latents; the duration predictor learns the aligned durations. An optimal-transport conditional flow matching\n(OT-CFM) decoder maps Gaussian noise to latents in a few Euler steps, conditioned on the aligned means. The codec\ndecodes the latents to 24 kHz audio. Everything here starts from random initialization; only the separately\nmaterialized codec holds pretrained weights.\n\n`latent_projection` (off by default) makes the model work in a k-dimensional space instead of all `latent_dim`\nchannels: train.py fits the top-k principal directions of the normalized training latents before the first step,\nand synthesis maps back through the same fixed basis. It is a buffer fitted from the run's own data, like the\nlatent statistics, not learned or pretrained weights.\n\"\"\"\n\nfrom __future__ import annotations\n\nimport math\nfrom pathlib import Path\n\nimport numpy as np\nimport torch\nfrom text import SYMBOLS\nfrom torch import nn\nfrom torch.nn import functional as F\n\nCONFIG = {\n    \"architecture\": \"matcha-dac-latent-ot-cfm-v1\",\n    \"symbols\": len(SYMBOLS), \"add_blank\": True,\n    \"latent_dim\": 1024, \"sample_rate\": 24000, \"hop\": 320,\n    \"encoder_width\": 256, \"encoder_heads\": 2, \"encoder_layers\": 6, \"encoder_ff\": 1024,\n    \"prenet_layers\": 3, \"prenet_kernel\": 5, \"duration_width\": 256, \"duration_kernel\": 3,\n    \"decoder_width\": 512, \"decoder_heads\": 8, \"decoder_layers\": 6, \"decoder_ff\": 2048, \"decoder_kernel\": 5,\n    \"dropout\": 0.1, \"decoder_dropout\": 0.05,\n    \"sigma_min\": 1e-4, \"ode_steps\": 10, \"temperature\": 0.667, \"length_scale\": 1.0,\n    \"max_symbols\": 800, \"max_frames\": 2400,\n    \"latent_projection\": None,   # or k (for example 128): model a fixed principal-component projection instead\n}\n\n\ndef latent_frames(samples: int, hop: int = 320) -> int:\n    \"\"\"Codec frames for `samples` of audio: one trailing frame so the decoded audio (hop * frames - 8 samples for\n    DAC24k) covers every input sample.\"\"\"\n    return math.ceil(samples / hop) + 1\n\n\ndef sequence_mask(lengths: torch.Tensor, length: int | None = None) -> torch.Tensor:\n    length = int(lengths.max()) if length is None else length\n",16781,"        loss = losses[\"duration\"] + losses[\"prior\"] + losses[\"flow\"]\n        if not torch.isfinite(loss):\n            raise ValueError(f\"Non-finite training loss at step {state['step']}\")\n        loss.backward()\n        torch.nn.utils.clip_grad_norm_(generator.parameters(), 1.0)\n        optimizer.step()\n        state[\"step\"] += 1\n        if ema is not None:\n            decay = min(args.ema, (1 + state[\"step\"]) / (10 + state[\"step\"]))\n            with torch.no_grad():\n                for average, current in zip(ema.parameters(), generator.parameters(), strict=True):\n                    average.lerp_(current, 1 - decay)\n        if rank == 0 and state[\"step\"] % 100 == 0:\n            state[\"losses\"] = {name: float(value) for name, value in losses.items()}\n            print(json.dumps({\"step\": state[\"step\"], \"lr\": rate, **state[\"losses\"],\n                              \"elapsed_seconds\": round(time.monotonic() - started, 1)}), flush=True)\n        if rank == 0 and time.monotonic() - state[\"last_save\"] >= 60 * args.checkpoint_minutes:\n            save()\n    save()\n    if world > 1:\n        torch.distributed.destroy_process_group()\n\n\nif __name__ == \"__main__\":\n    sys.exit(main())"],"d":7.4},{"n":"bash","a":"cat submission/infer.py && cat submission/text.py && cat submission/recipe.json && cat evaluation/speech-mirror.json","e":0,"o":["\"\"\"Persistent offline FRSIPCM1 server: text normalisation, phonemes, generation and codec decoding per request.\n\nEach request is split into sentences (and long sentences at clauses), every piece is synthesized in order and the\naudio streams as soon as each piece is decoded. Sampling is seeded from the request text, so a passage always\nrenders the same way.\n\"\"\"\n\nimport argparse\nimport hashlib\nimport json\nimport struct\nimport sys\nfrom pathlib import Path\n\nimport torch\nfrom model import Generator, load_codec\nfrom text import sentences, to_ids\n\nFRAME_SAMPLES = 2400\nPAUSE_SECONDS = 0.12   # between sentence pieces\n\n\ndef write_audio(output, audio) -> None:\n    for offset in range(0, len(audio), FRAME_SAMPLES):\n        frame = audio[offset:offset + FRAME_SAMPLES]\n        output.write(struct.pack(\"<I\", len(frame)))\n        output.write(frame.astype(\"<f4\").tobytes())\n    output.flush()\n\n\ndef main(argv=None):\n    parser = argparse.ArgumentParser(description=__doc__)\n    parser.add_argument(\"--weights\", type=Path, required=True)\n    parser.add_argument(\"--device\", default=\"cpu\")\n    parser.add_argument(\"--codec\", type=Path, default=Path(__file__).with_name(\"codec\"))\n    parser.add_argument(\"--steps\", type=int, help=\"ODE steps (default: the checkpoint's configuration)\")\n    parser.add_argument(\"--temperature\", type=float)\n    args = parser.parse_args(argv)\n    torch.set_num_threads(4)\n    checkpoint = torch.load(args.weights / \"model.pt\", map_location=\"cpu\", weights_only=True)\n    model = Generator(checkpoint[\"config\"])\n    model.load_state_dict(checkpoint[\"state\"])\n    model = model.to(args.device).eval()\n    codec = load_codec(args.codec, args.device)\n    add_blank = model.config[\"add_blank\"]\n    pause = torch.zeros(int(PAUSE_SECONDS * model.config[\"sample_rate\"])).numpy()\n    output = sys.stdout.buffer\n    output.write(b\"FRSIPCM1\")\n    output.flush()\n    with torch.inference_mode():\n        for line in sys.stdin:\n            request = json.loads(line)\n            if request.get(\"voice\", \"default\") != \"default\":\n                raise ValueError(\"This single-voice recipe supports only the default voice\")\n            seed = int.from_bytes(hashlib.sha256(request[\"text\"].encode()).digest()[:8], \"little\")\n            generator = torch.Generator(device=args.device).manual_seed(seed)\n            for index, piece in enumerate(sentences(request[\"text\"])):\n                if index:\n                    write_audio(output, pause)\n                try:\n",16759,"      },\n      {\n        \"id\": \"styletts2-libritts\",\n        \"model\": \"yl4579/StyleTTS2-LibriTTS\",\n        \"license\": \"MIT code; the checkpoint terms require telling listeners that the speech is synthetic (the study's consent text does)\",\n        \"location\": \"/mirror/speech/research/teachers/styletts2-libritts\"\n      }\n    ],\n    \"evaluators\": [\n      {\n        \"id\": \"whisper-large-v3\",\n        \"model\": \"openai/whisper-large-v3\",\n        \"license\": \"MIT\",\n        \"location\": \"/mirror/speech/research/evaluators/whisper-large-v3\"\n      },\n      {\n        \"id\": \"ttsds2\",\n        \"model\": \"ttsds (TTSDS2) with its feature extractors and reference sets\",\n        \"license\": \"MIT code; each extractor's weights keep their own recorded terms\",\n        \"location\": \"/mirror/speech/research/evaluators/ttsds2\"\n      }\n    ],\n    \"revisions\": \"Each research-only model is pinned to an exact revision when the mirror is staged; the pins and every file digest are recorded in research/MANIFEST.jsonl.\"\n  },\n  \"staged\": {\n    \"files\": 1807873,\n    \"bytes\": 247107548446,\n    \"note\": \"corpora/MANIFEST.jsonl lists every file; approx_bytes are the staged sizes\"\n  }\n}"],"d":0},{"n":"bash","a":"ls -lh /workspace/methods; cat /lab/MANUAL-GPU-JOBS.md; python - <<'PY'\nimport sys,torch\nprint(sys.executable,torch.__version__,torch.cuda.is_available())\nPY\npython -m offline_voice.prepare submission\nmkdir -p research logs\ncp submission/model.py research/baseline_model.py; cp submission/train.py research/baseline_train.py; cp submission/infer.py research/baseline_infer.py; cp submission/text.py research/baseline_text.py","e":0,"o":["total 750M\n-rw-r--r-- 1 agent agent 5.8K Nov 12 20:45 METHODS.md\n-rw-r--r-- 1 agent agent 4.2K Nov 12 20:45 materialize_codec.py\n-rw-r--r-- 1 agent agent  28K Nov 12 20:45 methods.json\n-rw-r--r-- 1 agent agent 750M Nov 12 20:45 methods.zip\n-rw-r--r-- 1 agent agent 3.1K Nov 12 20:45 unpack_methods.py\n# Lab0 manual: GPU jobs\n\nThis is the GPU jobs part of this run's Lab0 manual; `/lab/MANUAL.md` (`lab manual`) has the rest. Where your instructions differ from it, your instructions win.\n\n## What GPU time costs\n\n- GPU time is charged per GPU for each started minute, from when the job's container starts (its `--input` artifacts are staged after that, inside the job's time) until its command exits or it is stopped, and never for more than `max_minutes`. Time spent queued is free, and so is the time spent collecting a finished job's outputs. A job stopped after 20 of its 60 minutes is charged 20 minutes.\n- Every job whose container started is charged for the time it ran, however it ended: your command's own exit, a cancel, its time limit, or a fault of the infrastructure (a lost machine or GPU, a failure of Lab0's job wrapper: `failure_class: provider`). Only a job that never started (a failed image pull or container start) costs nothing. Lab0 runs a batch job that failed for the infrastructure again once by itself, billed as any job: `lab gpu show` names the new job (`retried_as`), so do not submit it again. A job whose borrowed GPUs Lab0's scheduler takes back (see GPU jobs) is charged for the time it ran too; `lab gpu resubmit JOB_ID` runs it again (a batch job resuming from its partial output).\n- A job whose `--input` artifacts cannot be staged as given (an archive that does not unpack whole: links, special files or paths outside it; or one too large to unpack within the job's time) fails before its command as your job's own failure (`failure_reason: input_refused`, `failure_error` says why): charged for the time it held its GPUs, and not run again. Upload directories with `lab upload DIR`, and plain archives of regular files and directories.\n- At the deadline Lab0 stops every running job.\n",15850,"s/macos-arm64/huggingface_hub-0.36.2-py3-none-any.whl\", \"wheels/macos-arm64/idna-3.20-py3-none-any.whl\", \"wheels/macos-arm64/jinja2-3.1.6-py3-none-any.whl\", \"wheels/macos-arm64/markupsafe-3.0.4-cp312-cp312-macosx_11_0_arm64.whl\", \"wheels/macos-arm64/mpmath-1.3.0-py3-none-any.whl\", \"wheels/macos-arm64/networkx-3.7-py3-none-any.whl\", \"wheels/macos-arm64/numpy-2.2.6-cp312-cp312-macosx_14_0_arm64.whl\", \"wheels/macos-arm64/packaging-26.3-py3-none-any.whl\", \"wheels/macos-arm64/pyyaml-6.0.3-cp312-cp312-macosx_11_0_arm64.whl\", \"wheels/macos-arm64/regex-2026.9.29-cp312-cp312-macosx_11_0_arm64.whl\", \"wheels/macos-arm64/requests-2.34.2-py3-none-any.whl\", \"wheels/macos-arm64/safetensors-0.8.0-cp310-abi3-macosx_11_0_arm64.whl\", \"wheels/macos-arm64/setuptools-84.0.0-py3-none-any.whl\", \"wheels/macos-arm64/sympy-1.14.0-py3-none-any.whl\", \"wheels/macos-arm64/tokenizers-0.21.4-cp39-abi3-macosx_11_0_arm64.whl\", \"wheels/macos-arm64/torch-2.7.1-cp312-none-macosx_11_0_arm64.whl\", \"wheels/macos-arm64/tqdm-4.70.1-py3-none-any.whl\", \"wheels/macos-arm64/transformers-4.51.3-py3-none-any.whl\", \"wheels/macos-arm64/typing_extensions-4.16.0-py3-none-any.whl\", \"wheels/macos-arm64/urllib3-2.8.0-py3-none-any.whl\"]}"],"d":0}]},{"t":26.7,"$":0.2117,"c":[{"n":"bash","a":"sed -n '218,460p' submission/model.py && sed -n '1,240p' submission/train.py && sed -n '300,540p' submission/text.py && head -25 submission/recipe.json && cat /workspace/methods/unpack_methods.py","e":0,"o":["        mask = text_mask[:, :, None] & frame_mask[:, None, :]\n        path = maximum_path(log_likelihood.cpu().numpy(), mask.cpu().numpy())\n    return torch.from_numpy(path).to(mean.device)\n\n\ndef path_from_durations(durations: torch.Tensor, frames: int) -> torch.Tensor:\n    \"\"\"(batch, symbols) integer durations to a (batch, symbols, frames) hard alignment.\"\"\"\n    ends = durations.cumsum(1)\n    starts = ends - durations\n    positions = torch.arange(frames, device=durations.device)[None, None, :]\n    return ((positions >= starts[..., None]) & (positions < ends[..., None])).float()\n\n\nclass Generator(nn.Module):\n    def __init__(self, config: dict | None = None):\n        super().__init__()\n        self.config = dict(CONFIG if config is None else config)\n        channels = self.config[\"latent_dim\"]\n        # The width the encoder and decoder model: every codec channel, or the fixed projection's k.\n        self.width = self.config.get(\"latent_projection\") or channels\n        if not 0 < self.width <= channels:\n            raise ValueError(\"latent_projection must be between 1 and latent_dim\")\n        modelled = {**self.config, \"latent_dim\": self.width}\n        self.encoder = TextEncoder(modelled)\n        self.decoder = FlowDecoder(modelled)\n        # Per-channel statistics of the training latents (set by train.py before the first step).\n        self.register_buffer(\"latent_mean\", torch.zeros(channels))\n        self.register_buffer(\"latent_std\", torch.ones(channels))\n        if self.config.get(\"latent_projection\"):\n            # Orthonormal columns; train.py replaces them with the training latents' principal directions.\n            self.register_buffer(\"latent_basis\", torch.eye(channels)[:, :self.width].clone())\n\n    @property\n    def projected(self) -> bool:\n        return bool(self.config.get(\"latent_projection\"))\n\n    def normalize(self, latents):\n        values = (latents - self.latent_mean) / self.latent_std\n        return values @ self.latent_basis if self.projected else values\n\n    def denormalize(self, latents):\n        if self.projected:\n            latents = latents @ self.latent_basis.T\n        return latents * self.latent_std + self.latent_mean\n\n    def forward(self, symbols, symbol_lengths, latents, frame_lengths) -> dict:\n        \"\"\"Training losses for normalized target latents (batch, frames, latent_dim).\"\"\"\n        mean, log_durations, text_mask = self.encoder(symbols, symbol_lengths)\n",21611,"                digest = hashlib.sha256()\n                size = 0\n                with source.open(row) as stream, target.open(\"xb\") as out:\n                    while chunk := stream.read(1024**2):\n                        total += len(chunk)\n                        size += len(chunk)\n                        if total > expected[\"expanded_bytes\"] or size > binding[\"bytes\"]:\n                            raise ValueError(\"Archive exceeds expansion bound\")\n                        digest.update(chunk)\n                        out.write(chunk)\n                if digest.hexdigest() != binding[\"sha256\"]:\n                    raise ValueError(\"Expanded member digest differs\")\n    except Exception:\n        shutil.rmtree(destination)\n        raise\n\n\nif __name__ == \"__main__\":\n    parser = argparse.ArgumentParser(description=__doc__)\n    parser.add_argument(\"--archive\", type=Path, default=Path(\"methods.zip\"))\n    parser.add_argument(\"--manifest\", type=Path, default=Path(\"methods.json\"))\n    parser.add_argument(\"--destination\", type=Path, default=Path(\"methods\"))\n    args = parser.parse_args()\n    unpack(args.archive, args.manifest, args.destination)"],"d":0.2}]},{"t":35,"r":"**Assessing timing status**\n\nThe timing display looks unusual: it has stayed at 11 hours and 59 minutes, which may indicate that the clock is compressed or not updating normally. I’m treating the actual elapsed time as potentially only a few minutes. To stay prepared, I’m noting that an early submission is ready and can serve as the best valid baseline if needed. I’ll continue relying on the prepared material rather than assuming the displayed timer accurately reflects real elapsed time.","$":0.1371,"c":[{"n":"bash","a":"cd /workspace/methods && python unpack_methods.py && find methods -maxdepth 3 -type f -printf '%p %k KB\\n' | head -90 && sed -n '1,260p' methods/synthesize.py","e":0,"o":["methods/base-wheels-linux-x86_64.json 6 KB\nmethods/base-wheels-macos-arm64.json 3 KB\nmethods/codec/README.md 6 KB\nmethods/codec/config.json 1 KB\nmethods/codec/model.safetensors 291653 KB\nmethods/codec/preprocessor_config.json 1 KB\nmethods/codec/source.json 2 KB\nmethods/licenses/DAC-LICENSE 2 KB\nmethods/licenses/DAC-README.md 7 KB\nmethods/licenses/codec-license-source.json 1 KB\nmethods/licenses/docopt-build-source.json 1 KB\nmethods/licenses/setuptools-build-source.json 1 KB\nmethods/licenses/spacy-model-source.json 1 KB\nmethods/licenses/wheel-build-source.json 1 KB\nmethods/licenses/WHISPER-HF-APACHE-LICENSE 12 KB\nmethods/licenses/WHISPER-MIT-LICENSE 2 KB\nmethods/licenses/WHISPER-UPSTREAM-README.md 9 KB\nmethods/requirements-linux-x86_64.txt 11 KB\nmethods/requirements-macos-arm64.txt 3 KB\nmethods/sources/docopt-0.6.2.tar.gz 26 KB\nmethods/teacher/README.md 7 KB\nmethods/teacher/config.json 3 KB\nmethods/teacher/kokoro-v1_0.pth 319544 KB\nmethods/teacher/source.json 9 KB\nmethods/teacher/voices/af_alloy.pt 512 KB\nmethods/teacher/voices/af_aoede.pt 512 KB\nmethods/teacher/voices/af_bella.pt 512 KB\nmethods/teacher/voices/af_heart.pt 512 KB\nmethods/teacher/voices/af_jessica.pt 512 KB\nmethods/teacher/voices/af_kore.pt 512 KB\nmethods/teacher/voices/af_nicole.pt 512 KB\nmethods/teacher/voices/af_nova.pt 512 KB\nmethods/teacher/voices/af_river.pt 512 KB\nmethods/teacher/voices/af_sarah.pt 512 KB\nmethods/teacher/voices/af_sky.pt 512 KB\nmethods/teacher/voices/am_adam.pt 512 KB\nmethods/teacher/voices/am_echo.pt 512 KB\nmethods/teacher/voices/am_eric.pt 512 KB\nmethods/teacher/voices/am_fenrir.pt 512 KB\nmethods/teacher/voices/am_liam.pt 512 KB\nmethods/teacher/voices/am_michael.pt 512 KB\nmethods/teacher/voices/am_onyx.pt 512 KB\nmethods/teacher/voices/am_puck.pt 512 KB\nmethods/teacher/voices/am_santa.pt 512 KB\nmethods/teacher/voices/bf_alice.pt 512 KB\nmethods/teacher/voices/bf_emma.pt 512 KB\nmethods/teacher/voices/bf_isabella.pt 512 KB\nmethods/teacher/voices/bf_lily.pt 512 KB\nmethods/teacher/voices/bm_daniel.pt 512 KB\nmethods/teacher/voices/bm_fable.pt 512 KB\nmethods/teacher/voices/bm_george.pt 512 KB\nmethods/teacher/voices/bm_lewis.pt 512 KB\nmethods/wheels/linux-x86_64/addict-2.4.0-py3-none-any.whl 4 KB\nmethods/wheels/linux-x86_64/annotated_doc-0.0.5-py3-none-any.whl 6 KB\nmethods/wheels/linux-x86_64/annotated_types-0.8.0-py3-none-any.whl 14 KB\nmethods/wheels/linux-x86_64/attrs-26.1.0-py3-none-any.whl 66 KB\nmethods/wheels/linux-x86_64/babel-2.18.0-py3-none-any.whl 9958 KB\n",11469,"                        help=\"styletts2: a WAV of the target voice (default: reference.wav beside the checkpoint)\")\n    parser.add_argument(\"--device\", default=\"cpu\")\n    parser.add_argument(\"--output\", type=Path, required=True)\n    args = parser.parse_args(argv)\n    options = {\"reference\": args.reference} if args.backend == \"styletts2\" else {}\n    audio, rate, source, weight_sha256 = BACKENDS[args.backend](args.text, args.voice, args.device, args.assets,\n                                                                **options)\n    samples = write_wav(args.output, audio, rate)\n    row = {\"id\": args.output.stem, \"text\": args.text, \"voice\": \"default\", \"audio\": str(args.output),\n           \"sha256\": sha256(args.output), \"source\": f\"Synthetic audio; {source}; teacher voice {args.voice}\",\n           \"license\": LICENSES[args.backend], \"teacher_weight_sha256\": weight_sha256}\n    args.output.with_suffix(\".provenance.json\").write_text(json.dumps(row, indent=2) + \"\\n\")\n    print(json.dumps({\"samples\": samples, \"sample_rate\": 24000,\n                      \"provenance\": str(args.output.with_suffix(\".provenance.json\"))}))\n\n\nif __name__ == \"__main__\":\n    main()"],"d":16.9},{"n":"bash","a":"cat > PROGRESS.md <<'EOF'\n# Offline US-female TTS research\n\n## Goal and constraints\n- Deliverable: `/workspace/repo/submission`, full offline recipe trained randomly on four H100s in <=140 minutes, then one H100 inference.\n- 12-hour research deadline, $95 wallet, max four research H100s. Teachers only for training audio/declared labels; no weights. DAC24k is approved frozen codec.\n- Best selected recipe should always be structurally valid. Preference tests unavailable; ASR, timing and signal diagnostics only.\n\n## Initial inspection / decisions\n- Read README, /workspace/methods/METHODS.md and Lab0 manuals including GPU guide.\n- Baseline: 29M Matcha-style CFM, LJSpeech, 1024-d DAC latents, MAS, 6x256 text +6x512 decoder, ten Euler steps. Major opportunities: contemporary prosodic data; supervised teacher duration labels; remove sentence/chunk prosodic resets; improve sampler/text frontend.\n- Ran `python -m offline_voice.prepare submission` (removed macOS codec wheels/requirements).\n- Baseline code copied to `research/baseline_{model,train,infer,text}.py`.\n- Plan: investigate Kokoro generation + duration supervision, curate broad modern domain texts, train/test GPU pilots before final-scale recipe. Respect teacher provenance and commercial-use licenses; avoid Expresso NC corpus for product.\n\n## Running work\n- Unpacking approved methods add-on to `/workspace/methods/methods`.\n\n## Next\n1. Inspect Kokoro pipeline and teacher labels, set up generation benchmark and a first GPU smoke test.\n2. Choose corpus/architecture on measured throughput and intelligibility. Budget substantial full-scale test.\n3. Validate zero-init output, offline packaging and GPU protocol. Submit improved versions early (large audio uploads can be slow).\nEOF\npython -m offline_voice.protocol submission > logs/baseline-protocol.json && cat logs/baseline-protocol.json","e":0,"o":"{\n  \"candidate_sha256\": \"9962de6c6ce378312c9dce58a0fd1c59443ddde1e3674dae8aa58aaacc06ca03\",\n  \"bytes\": 3347890095,\n  \"examples\": 13100,\n  \"audio_seconds\": 0,\n  \"source_bytes\": 73830,\n  \"data_extra_bytes\": 0,\n  \"mirror_examples\": 13100,\n  \"mirror_corpora\": {\n    \"ljspeech\": {\n      \"files\": 13100,\n      \"bytes\": 4134209058,\n      \"license\": \"public-domain\"\n    }\n  },\n  \"wheel_approval\": \"checked\",\n  \"approvals\": \"/workspace/repo/evaluation/approved-assets.json\"\n}","d":0}]},{"t":53.3,"$":0.1058,"c":[{"n":"submit","a":{"note":"Safety checkpoint: prepared Linux-only starter; structural protocol valid (13,100 mirrored LJSpeech rows). Baseline copied before research changes."},"o":"Version 1 registered: 55 files, 3.1 GiB. Its files were frozen as they are now and cannot change; they are being copied out of the workspace in the background, so you can go on working (list_submissions shows when it is stored). Submitting does not select it; use select to choose it, now or later.","d":26.6}]},{"t":81,"$":0.0537,"c":[{"n":"select","a":{"candidate_id":1},"o":"Version 1 is now your selection. Lab0 uses its pick when the time is up; this version becomes the pick once it is handed in. Its frozen files are still being copied out of the workspace; the hand-in follows. Its hand-in runs in the background and is tried again until Lab0 confirms it. Lab0 goes on using its current pick until this version is declared to it and picked; a hand-in of an earlier selection still uploading is then withdrawn. The status line shows how the hand-in of version 1 stands (declared to Lab0, how far its upload is, how long it should take) and Lab0's pick, and list_submissions its progress. A hand-in under way is not yet Lab0's pick. A selection counts once Lab0 holds its declaration (the files' SHA-256 and size, made from the files frozen at submit, usually within minutes; the status line says when): a pick declared before the deadline is used when its bytes arrive, even after the deadline. Its upload (3.1 GiB) should take 7 min to 2.2 h (multi-GB hand-ins ran at 0.4-8 MiB/s in earlier runs; the status line shows the measured rate once bytes arrive).","d":0}]},{"t":84,"$":0.0669,"c":[{"n":"bash","a":"python - <<'PY'\nimport zipfile\np='/workspace/methods/methods/wheels/linux-x86_64/kokoro-0.9.4-py3-none-any.whl'\nz=zipfile.ZipFile(p)\nfor name in ['kokoro/model.py','kokoro/pipeline.py']:\n print('\\nFILE:',name)\n s=z.read(name).decode(); open('research/'+name.split('/')[-1],'w').write(s)\n print(s[:12000] if 'model.py' in name else '\\n'.join(s.splitlines()[:200]))\nPY\nsed -n '180,315p' submission/text.py\npython - <<'PY'\nimport importlib.util\nfor m in ['kokoro','misaki','espeakng_loader','soundfile','transformers','scipy','spacy']:\n print(m,importlib.util.find_spec(m))\nPY","e":0,"o":["\nFILE: kokoro/model.py\nfrom .istftnet import Decoder\nfrom .modules import CustomAlbert, ProsodyPredictor, TextEncoder\nfrom dataclasses import dataclass\nfrom huggingface_hub import hf_hub_download\nfrom loguru import logger\nfrom transformers import AlbertConfig\nfrom typing import Dict, Optional, Union\nimport json\nimport torch\n\nclass KModel(torch.nn.Module):\n    '''\n    KModel is a torch.nn.Module with 2 main responsibilities:\n    1. Init weights, downloading config.json + model.pth from HF if needed\n    2. forward(phonemes: str, ref_s: FloatTensor) -> (audio: FloatTensor)\n\n    You likely only need one KModel instance, and it can be reused across\n    multiple KPipelines to avoid redundant memory allocation.\n\n    Unlike KPipeline, KModel is language-blind.\n\n    KModel stores self.vocab and thus knows how to map phonemes -> input_ids,\n    so there is no need to repeatedly download config.json outside of KModel.\n    '''\n\n    MODEL_NAMES = {\n        'hexgrad/Kokoro-82M': 'kokoro-v1_0.pth',\n        'hexgrad/Kokoro-82M-v1.1-zh': 'kokoro-v1_1-zh.pth',\n    }\n\n    def __init__(\n        self,\n        repo_id: Optional[str] = None,\n        config: Union[Dict, str, None] = None,\n        model: Optional[str] = None,\n        disable_complex: bool = False\n    ):\n        super().__init__()\n        if repo_id is None:\n            repo_id = 'hexgrad/Kokoro-82M'\n            print(f\"WARNING: Defaulting repo_id to {repo_id}. Pass repo_id='{repo_id}' to suppress this warning.\")\n        self.repo_id = repo_id\n        if not isinstance(config, dict):\n            if not config:\n                logger.debug(\"No config provided, downloading from HF\")\n                config = hf_hub_download(repo_id=repo_id, filename='config.json')\n            with open(config, 'r', encoding='utf-8') as r:\n                config = json.load(r)\n                logger.debug(f\"Loaded config: {config}\")\n        self.vocab = config['vocab']\n        self.bert = CustomAlbert(AlbertConfig(vocab_size=config['n_token'], **config['plbert']))\n        self.bert_encoder = torch.nn.Linear(self.bert.config.hidden_size, config['hidden_dim'])\n        self.context_length = self.bert.config.max_position_embeddings\n        self.predictor = ProsodyPredictor(\n            style_dim=config['style_dim'], d_hid=config['hidden_dim'],\n            nlayers=config['n_layer'], max_dur=config['max_dur'], dropout=config['dropout']\n        )\n        self.text_encoder = TextEncoder(\n",19386,"        if self.library.espeak_SetVoiceByName(voice.encode()) != 0:\n            raise RuntimeError(f\"eSpeak NG has no voice {voice!r}\")\n\n    def words(self, text: str) -> str:\n        \"\"\"IPA with stress marks for a run of words (no punctuation).\"\"\"\n        pointer = self.ctypes.c_char_p(text.encode())\n        parts = []\n        while pointer.value:\n            # espeakCHARS_UTF8 (1); phoneme mode 0x02: IPA characters, no separator.\n            result = self.library.espeak_TextToPhonemes(self.ctypes.byref(pointer), 1, 0x02)\n            if result:\nkokoro None\nmisaki None\nespeakng_loader ModuleSpec(name='espeakng_loader', loader=<_frozen_importlib_external.SourceFileLoader object at 0x7ed606b427e0>, origin='/opt/venv/lib/python3.12/site-packages/espeakng_loader/__init__.py', submodule_search_locations=['/opt/venv/lib/python3.12/site-packages/espeakng_loader'])\nsoundfile None\ntransformers ModuleSpec(name='transformers', loader=<_frozen_importlib_external.SourceFileLoader object at 0x7ed606b412b0>, origin='/opt/venv/lib/python3.12/site-packages/transformers/__init__.py', submodule_search_locations=['/opt/venv/lib/python3.12/site-packages/transformers'])\nscipy None\nspacy None"],"d":2.7}]},{"t":102.6,"r":"**Choosing phoneme alignment**\n\nI’m prioritizing a deterministic phoneme pipeline so the teacher and student use exactly the same pronunciation representation, making supervised duration alignment reliable. Since learned preprocessing components aren’t allowed, I’m avoiding pretrained language models and relying on a rule-based transformation from eSpeak output into the Kokoro-compatible form.\n\nThis may reduce pronunciation quality compared with a specialized lexicon, so I’m considering manual homograph rules and exceptions. Still, eSpeak is a strong baseline, and deterministic normalization can improve consistency without introducing learned files.","$":0.1462,"c":[{"n":"bash","a":"python - <<'PY'\nimport zipfile\nz=zipfile.ZipFile('/workspace/methods/methods/wheels/linux-x86_64/misaki-0.9.4-py3-none-any.whl')\ns=z.read('misaki/espeak.py').decode(); print(s);open('research/misaki_espeak.py','w').write(s)\nprint('\\nKokoro config:');print(open('/workspace/methods/methods/teacher/config.json').read())\nPY\nls /mirror/speech/corpora/hifi-tts && find /mirror/speech/corpora/hifi-tts -maxdepth 2 -type f | head -35\nfind /mirror/speech/corpora/expresso -maxdepth 3 -type f | head -20\nls -lh /mirror/speech/research/teachers/styletts2-libritts","e":0,"o":["from phonemizer.backend.espeak.wrapper import EspeakWrapper\nfrom typing import Tuple\nimport espeakng_loader\nimport phonemizer\nimport re\n\n# Set espeak-ng library path and espeak-ng-data\nEspeakWrapper.set_library(espeakng_loader.get_library_path())\n# Change data_path as needed when editing espeak-ng phonemes\nEspeakWrapper.set_data_path(espeakng_loader.get_data_path())\n\n# EspeakFallback is used as a last resort for English\nclass EspeakFallback:\n    E2M = sorted({\n        'ʔˌn\\u0329':'ʔn', 'ʔn\\u0329':'ʔn',# 'ʔn':'tn', 'ʔ':'t',\n        'a^ɪ':'I', 'a^ʊ':'W',\n        'd^ʒ':'ʤ',\n        'e^ɪ':'A', 'e':'A',\n        't^ʃ':'ʧ',\n        'ɔ^ɪ':'Y',\n        'ə^l':'ᵊl',\n        'ʲo':'jo', 'ʲə':'jə', 'ʲ':'',\n        'ɚ':'əɹ',\n        'r':'ɹ',\n        'x':'k', 'ç':'k',\n        'ɐ':'ə',\n        'ɬ':'l',\n        '\\u0303':'',\n    }.items(), key=lambda kv: -len(kv[0]))\n\n    def __init__(self, british, version=None):\n        self.british = british\n        self.version = version\n        self.backend = phonemizer.backend.EspeakBackend(\n            language=f\"en-{'gb' if british else 'us'}\",\n            preserve_punctuation=True, with_stress=True, tie='^'\n        )\n\n    def __call__(self, token):\n        ps = self.backend.phonemize([token.text])\n        if not ps:\n            return None, None\n        ps = ps[0].strip()\n        for old, new in type(self).E2M:\n            ps = ps.replace(old, new)\n        ps = re.sub(r'(\\S)\\u0329', r'ᵊ\\1', ps).replace(chr(809), '')\n        if self.british:\n            ps = ps.replace('e^ə', 'ɛː')\n            ps = ps.replace('iə', 'ɪə')\n            ps = ps.replace('ə^ʊ', 'Q')\n        else:\n            ps = ps.replace('o^ʊ', 'O')\n            ps = ps.replace('ɜːɹ', 'ɜɹ')\n            ps = ps.replace('ɜː', 'ɜɹ')\n            ps = ps.replace('ɪə', 'iə')\n            ps = ps.replace('ː', '')\n        ps = ps.replace('o', 'ɔ') # for espeak < 1.52\n        if self.version != '2.0':\n            ps = ps.replace('ɾ', 'T').replace('ʔ', 't')\n        return ps.replace('^', ''), 2\n\n# EspeakG2P used for most non-English/CJK languages\nclass EspeakG2P:\n    def __init__(self, language, version=None):\n        self.language = language\n        self.version = version\n        self.backend = phonemizer.backend.EspeakBackend(\n            language=language, preserve_punctuation=True, with_stress=True,\n            tie='^', language_switch='remove-flags'\n        )\n        self.e2m = {\n            'a^ɪ':'I', 'a^ʊ':'W',\n            'd^z':'ʣ', 'd^ʒ':'ʤ',\n            'e^ɪ':'A',\n",6018,"/mirror/speech/corpora/hifi-tts/hi_fi_tts_v0/6097_manifest_clean_dev.json\n/mirror/speech/corpora/expresso/expresso/splits/README\n/mirror/speech/corpora/expresso/expresso/splits/test.txt\n/mirror/speech/corpora/expresso/expresso/splits/dev.txt\n/mirror/speech/corpora/expresso/expresso/splits/train.txt\n/mirror/speech/corpora/expresso/expresso/README.txt\n/mirror/speech/corpora/expresso/expresso/LICENSE.txt\n/mirror/speech/corpora/expresso/expresso/VAD_segments.txt\n/mirror/speech/corpora/expresso/expresso/read_transcriptions.txt\n/mirror/speech/corpora/expresso/LICENSE\ntotal 736M\n-r--r--r-- 1 root root 1.1K Jan  1  1970 LICENSE\n-r--r--r-- 1 root root 1.5K Jan  1  1970 NOTICE\n-r--r--r-- 1 root root  14K Jan  1  1970 README.md\ndrwxr-xr-x 5 root root 4.0K Nov 13 20:14 Utils\n-r--r--r-- 1 root root 1.9K Jan  1  1970 config.yml\n-r--r--r-- 1 root root 736M Jan  1  1970 epochs_2nd_00020.pth\ndrwxr-xr-x 3 root root 4.0K Nov 13 20:02 nltk_data\n-r--r--r-- 1 root root 143K Jan  1  1970 reference.wav\n-r--r--r-- 1 root root  14K Jan  1  1970 requirements.txt\n-r--r--r-- 1 root root 5.1K Jan  1  1970 source.json\ndrwxr-xr-x 2 root root  16K Nov 13 20:16 wheels"],"d":0.4}]}],"parts":[83,82,107,97,27]}