Things I'm making.

Shakira on the ocarina

A Shakira song, played note by note on Link’s ocarina in the Ocarina of Time remake, recorded on a Switch 2 in short clips and cut together into a minute of video.

The clips sounded fine on the phone and in QuickTime, and crackled in Final Cut as if they were clipping. They weren’t: the peaks sat at −15 to −18 dB with no clipped samples, the Mac wasn’t overloaded, and everything was at 48 kHz. The fault was in the timing. The console stores the audio in blocks of 1,024 samples, 21.33 ms each, meant to play back to back, but it stamps each block with a 10 ms clock, so the blocks are labelled 20 or 30 ms apart, never 21.33. Over a clip it averages out, which is why the sound stayed in sync. The phone and QuickTime ignore the labels and play the samples in order; Final Cut puts each block where its label says, so about 47 times a second two blocks overlapped or left a gap.

Each clip got two fixed copies, with the video copied bit for bit and never re-encoded: a -fixed.mov with the audio decoded to uncompressed samples, every one re-stamped by its running count, and a copy for relinking that keeps the original AAC untouched and re-labels block N at exactly N × 1,024 samples.

← All things