mirror of
https://github.com/storytold/AniCraft.git
synced 2026-11-19 09:01:29 +01:00
docs: ADR 0114, the guide's Convert Audio to Keyframes and Auto lip-sync sections with their pictures, command reference, roadmap, changelog and credits (M5)
This commit is contained in:
1 parent
d2238584ab
commit
8f1e455e43
13 files changed
+265
-13
No files matched your search
+2
-1
@@ -25,7 +25,7 @@ shaders or SDK code).
|
||||
| `assets/icons/*.svg` except `anicraft-*` (37 files: tools, transport, layer toggles, folders, guide, image, text, sound, chevrons, plus, trash, copy, ellipsis) | UI icons, stroked by `src/icons.rs` | Lucide Icons and Contributors (some derived from Feather by Cole Bemis) | <https://github.com/lucide-icons/lucide> (`icons/<name>.svg`), copied unchanged from the PhotoCraft sibling project's set (`volume-2.svg` from Lucide 0.512.0; `plus.svg`, `trash.svg`, `copy.svg` and `ellipsis.svg` from Lucide's `main` branch, 2026-11) | ISC (Lucide) and MIT (Feather), [`licenses/icons/LICENSE-lucide.txt`](licenses/icons/LICENSE-lucide.txt) |
|
||||
| `assets/app-icon/` (`anicraft.svg`, `anicraft-small.svg` and every render: PNGs, `anicraft.ico`, `hicolor/`) | App icon (engraved rabbit): window, Dock, taskbar, `anicraft.exe`, Help › About | Project owner (ArtCraft team) | Original artwork drawn in ArtCraft for AniCraft, vectorised by `assets/app-icon/trace.py` and rendered by `scripts/icons.sh` | MIT OR Apache-2.0 ([`assets/app-icon/LICENSE.txt`](assets/app-icon/LICENSE.txt)) |
|
||||
| `packaging/macos/dmg/` (`background.tiff`, `dmg-layout.DS_Store`) | macOS DMG window background and Finder layout | AniCraft contributors | Original work drawn by `packaging/macos/dmg/generate.py` in the app icon's colours; layout approach as in the PhotoCraft sibling project | MIT OR Apache-2.0 |
|
||||
| `docs/guide/images/` (9 screenshots) | User guide (Help › User Guide) | AniCraft contributors | Original work: AniCraft's own screenshots, taken by `scripts/guide-shots.sh` | MIT OR Apache-2.0 |
|
||||
| `docs/guide/images/` (11 screenshots) | User guide (Help › User Guide) | AniCraft contributors | Original work: AniCraft's own screenshots, taken by `scripts/guide-shots.sh` | MIT OR Apache-2.0 |
|
||||
| `docs/images/` (screenshots and `sample-animation.gif`) | README | AniCraft contributors | Original work: AniCraft's own screenshots (`--screenshot`) and sample animation (`anicraft-cli gif`) | MIT OR Apache-2.0 |
|
||||
| Library symbol-kind marks, selection handles, timeline marks | UI | AniCraft contributors | Original work, drawn in code (`src/panels.rs`, `src/timeline.rs`, `src/stage.rs`) | MIT OR Apache-2.0 |
|
||||
| Sample animation (ball, star, sun, hills, sky) | First launch, tests, CLI `--sample` | AniCraft contributors | Original work, generated in code (`crates/doc/src/sample.rs`) | MIT OR Apache-2.0 |
|
||||
@@ -144,6 +144,7 @@ OR Apache-2.0) is noted in the table.
|
||||
| De Casteljau subdivision, Ramer–Douglas–Peucker simplification | `crates/geom/src/edit.rs` | Public mathematical results (de Casteljau 1959; Ramer 1972; Douglas & Peucker 1973) | |
|
||||
| WAV (RIFF WAVE) reading and writing: PCM 8/16/24/32-bit, IEEE float, `WAVE_FORMAT_EXTENSIBLE` | `crates/audio/src/wav.rs` | Microsoft/IBM, *Multimedia Programming Interface and Data Specifications 1.0* (1991), and Microsoft's public `WAVE_FORMAT_EXTENSIBLE` description | Public file format descriptions. |
|
||||
| Resampling by cubic Hermite (Catmull-Rom) interpolation | `crates/audio/src/mix.rs` | E. Catmull and R. Rom, *A class of local interpolating splines* (1974); R. Keys, *Cubic convolution interpolation for digital image processing* (1981) | Public mathematical results. |
|
||||
| Sound analysis for animation (ADR 0114): loudness per frame (RMS), a centred moving average, and mouth shapes from a short-time Fourier transform (Hann window, radix-2 FFT, pre-emphasis) sorted by the vowels' first two formants | `crates/audio/src/analysis.rs` | G. E. Peterson and H. L. Barney, *Control methods used in a study of the vowels*, J. Acoust. Soc. Am. 24 (1952) (average formant frequencies); J. W. Cooley and J. W. Tukey, *An algorithm for the machine calculation of complex Fourier series*, Math. Comp. 19 (1965); F. J. Harris, *On the use of windows for harmonic analysis with the discrete Fourier transform*, Proc. IEEE 66 (1978); pre-emphasis as in public speech-processing textbooks (L. R. Rabiner and R. W. Schafer, *Digital Processing of Speech Signals*, 1978). The behaviour of Convert Audio to Keyframes and of lip-syncing from Adobe's public help pages | Published results; our own code, no speech recognition model and no data. |
|
||||
| Ogg Vorbis decoding | `crates/audio/src/vorbis.rs` | `lewton` (MIT OR Apache-2.0) with `ogg` (BSD-3-Clause); Xiph.Org's open, royalty-free Vorbis I specification | Used as a library, not copied. |
|
||||
| MP3 (MPEG-1/2 audio layers I–III) decoding | `crates/audio/src/mp3.rs` | `nanomp3` (MIT OR Apache-2.0), a port of minimp3 (CC0) | Used as a library. The MP3 patents have expired; decoding only, no encoder. |
|
||||
| Animated PNG and animated WebP files: APNG chunks (`acTL`, `fcTL`, `fdAT`), frame regions, blend and dispose ops; the WebP RIFF container (`VP8X`, `ANIM`, `ANMF`) | `crates/engine/src/anim.rs` | The APNG specification (Mozilla; part of W3C *Portable Network Graphics (PNG) Specification*, Third Edition); Google's public *WebP Container Specification* and *WebP Lossless Bitstream Specification*; PNG frame data by the `png` crate (MIT OR Apache-2.0), lossless WebP frames by `image-webp` (MIT OR Apache-2.0) | Open, royalty-free specifications; the chunks are written by our own code (ADR 0063). |
|
||||
|
||||
@@ -2,6 +2,30 @@
|
||||
|
||||
## Unreleased
|
||||
|
||||
* **Convert Audio to Keyframes and Auto Lip-Sync** (ADR 0114, #332, M5).
|
||||
* **Convert Audio to Keyframes** (Modify › Timeline, or **To Keyframes…** in a sound
|
||||
keyframe's Properties): the sound's loudness on each frame drives an object on another
|
||||
layer. Pick its **scale**, **alpha**, **X** or **Y offset**, **rotation**, or a graphic
|
||||
symbol's **first frame**, and the value in silence and at the loudest frame. **Threshold**
|
||||
ignores background noise, **Smoothing** calms the movement without moving the beat,
|
||||
**Key every** animates on twos or threes, and stereo sounds can be measured by channel. The
|
||||
keys are written as **keyframes**, or as a **motion tween's property curve** that the
|
||||
Motion Editor shows.
|
||||
* **Auto Lip-Sync** (Modify › Timeline, or **Lip Sync…** beside Looping for a graphic
|
||||
instance): speech picks the frame of a graphic symbol of mouth poses for every frame, from
|
||||
five mouth shapes (rest, open, wide, round, closed). Mouths are found by the symbol's frame
|
||||
labels, as the Lip-sync mouth chart template names them, and can be changed. It listens to
|
||||
where each frame's energy lies, with no speech recognition and nothing sent anywhere; it
|
||||
is a first pass to polish by hand.
|
||||
* **Everything previews live**: a graph of the sound's loudness with the threshold, the
|
||||
value the keys follow and where each key lands (or a row per mouth), and the keys
|
||||
themselves on the stage and the timeline. OK is one undo step; Cancel leaves nothing.
|
||||
* Headless: `sound.to_keyframes`, `sound.lip_sync` and `sound.analyse` (levels or mouth
|
||||
shapes per frame), in `anicraft-cli`, MCP and plug-ins. The same sound always gives the
|
||||
same keys.
|
||||
* Fixed: a test of the graphics-failure handling could fail at random when another test was
|
||||
running the app at the same moment; it no longer shares state with them.
|
||||
|
||||
* **Layer parenting** (fixes #388, ADR 0113, M7): a layer can follow another layer, as in
|
||||
Animate, so a forearm moves with the upper arm while each keeps its own tweens.
|
||||
* **Parenting view** in the timeline: the tree button beside **Layers** (or View › Parenting
|
||||
|
||||
@@ -376,9 +376,20 @@ pub fn curve_keys(values: &[f32], step: u32, eps: f32) -> Vec<(u32, f32)> {
|
||||
/// Differences smaller than this share of the range don't make a key.
|
||||
const KEY_EPS: f32 = 0.002;
|
||||
|
||||
/// The keys a run writes for shaped levels `shaped` (one per frame): each as (frames from the
|
||||
/// first one, the property's value). What the dialog's preview marks.
|
||||
pub fn planned_keys(prop: KeyProperty, min: f32, max: f32, step: u32, output: Output, shaped: &[f32]) -> Vec<(u32, f32)> {
|
||||
let values: Vec<f32> = shaped.iter().map(|l| min + (max - min) * l).map(|v| if prop == KeyProperty::FirstFrame { v.round() } else { v }).collect();
|
||||
let eps = ((max - min).abs() * KEY_EPS).max(1e-6);
|
||||
match output {
|
||||
Output::Keyframes => held_keys(&values, step, eps),
|
||||
Output::Motion => curve_keys(&values, step, eps),
|
||||
}
|
||||
}
|
||||
|
||||
/// The layer and object that get the keys: `layer` (default the active one) and on it
|
||||
/// `element`, else the selected object, else the only one on the keyframe at `frame`.
|
||||
fn target(s: &Session, p: &Value, frame: u32) -> Result<(LayerId, Arc<Element>)> {
|
||||
pub fn target(s: &Session, p: &Value, frame: u32) -> Result<(LayerId, Arc<Element>)> {
|
||||
let lid = opt_u64(p, "layer")?.map_or(s.layer, LayerId);
|
||||
let layer = s.timeline().layer(lid).ok_or_else(|| EngineError::State(format!("no layer with id {}", lid.0)))?;
|
||||
match layer.kind {
|
||||
@@ -571,29 +582,27 @@ fn to_keyframes(s: &mut Session, p: &Value) -> Result<Value> {
|
||||
}
|
||||
}
|
||||
let lv = levels(&src, &set)?;
|
||||
let values: Vec<f32> = lv.shaped.iter().map(|l| plan.min + (plan.max - plan.min) * l).map(|v| if plan.prop == KeyProperty::FirstFrame { v.round() } else { v }).collect();
|
||||
let eps = ((plan.max - plan.min).abs() * KEY_EPS).max(1e-6);
|
||||
let layer = s.timeline().layer(lid).ok_or_else(|| EngineError::State("the layer went away".into()))?;
|
||||
let in_motion = layer.keyframe_at(src.from).is_some_and(|k| k.motion.is_some());
|
||||
let output = plan.output.unwrap_or(if in_motion && plan.prop != KeyProperty::FirstFrame { Output::Motion } else { Output::Keyframes });
|
||||
let (keys, to) = match output {
|
||||
Output::Keyframes => {
|
||||
let keys: Vec<(u32, f32)> = held_keys(&values, plan.step, eps).into_iter().map(|(i, v)| (src.from + i, v)).collect();
|
||||
let keys: Vec<(u32, f32)> = planned_keys(plan.prop, plan.min, plan.max, plan.step, output, &lv.shaped).into_iter().map(|(i, v)| (src.from + i, v)).collect();
|
||||
let at = anchor(s, &el);
|
||||
let prop = plan.prop;
|
||||
let layer = s.layer_mut(Some(lid))?;
|
||||
write_held(layer, el.id, src.from, src.to, &keys, &|base, v| with_value(base, prop, *v, at))?;
|
||||
(keys.len(), src.to)
|
||||
}
|
||||
Output::Motion => write_curve(s, lid, &el, &plan, &src, &values, eps)?,
|
||||
Output::Motion => write_curve(s, lid, &el, &plan, &src, &lv.shaped)?,
|
||||
};
|
||||
Ok(json!({"keys": keys, "from": src.from, "to": to, "output": output.key(), "property": plan.prop.key(), "layer": lid.0, "element": el.id.0, "sound": src.sound.id.0}))
|
||||
}
|
||||
|
||||
/// Writes `values` (one per frame from `src.from`) as the property's keys in the motion tween
|
||||
/// Writes shaped levels (one per frame from `src.from`) as the property's keys in the motion tween
|
||||
/// on the span at `src.from`, making the tween when the span has none. The range is cut to the
|
||||
/// span. The keys written (per track) and the last frame they reach.
|
||||
fn write_curve(s: &mut Session, lid: LayerId, el: &Element, plan: &Plan, src: &Source, values: &[f32], eps: f32) -> Result<(usize, u32)> {
|
||||
fn write_curve(s: &mut Session, lid: LayerId, el: &Element, plan: &Plan, src: &Source, shaped: &[f32]) -> Result<(usize, u32)> {
|
||||
let tracks = plan.prop.tracks();
|
||||
if tracks.is_empty() {
|
||||
return Err(EngineError::Param("a symbol's first frame has no motion tween curve: use output: keyframes".into()));
|
||||
@@ -622,7 +631,7 @@ fn write_curve(s: &mut Session, lid: LayerId, el: &Element, plan: &Plan, src: &S
|
||||
let a = src.from - start;
|
||||
let b = (src.to - start).min(last);
|
||||
let len = (b - a + 1) as usize;
|
||||
let keys = curve_keys(values.get(..len).unwrap_or(values), plan.step, eps);
|
||||
let keys = planned_keys(plan.prop, plan.min, plan.max, plan.step, Output::Motion, shaped.get(..len).unwrap_or(shaped));
|
||||
if keys.len() > MAX_KEYS {
|
||||
return Err(EngineError::Param(format!("that is {} keys, more than {MAX_KEYS} on one curve: raise 'step' or the threshold, or shorten the range with 'from' and 'to'", keys.len())));
|
||||
}
|
||||
|
||||
@@ -77,6 +77,8 @@ pub const IMAGES: &[(&str, &[u8])] = &[
|
||||
image!("images/test-movie.png"),
|
||||
image!("images/publish-settings.png"),
|
||||
image!("images/preferences.png"),
|
||||
image!("images/audio-to-keyframes.png"),
|
||||
image!("images/lip-sync.png"),
|
||||
];
|
||||
|
||||
const STYLE: &str = include_str!("style.css");
|
||||
|
||||
@@ -0,0 +1,115 @@
|
||||
# ADR 0114: Audio to keyframes and auto lip-sync
|
||||
|
||||
* Status: accepted (2026-11-18)
|
||||
* Relates to: ADR 0020 (sound), ADR 0039 (envelopes, layer volume), ADR 0095 (audio output),
|
||||
ADR 0016 (motion tweens), ADR 0065 (templates: the Lip-sync mouth chart), ADR 0017 (plug-ins),
|
||||
ADR 0092 (surviving GPU failures), issue #332, roadmap M5
|
||||
|
||||
## Context
|
||||
|
||||
Issue #332 asks for After Effects' Convert Audio to Keyframes: a sound's amplitude, frame by
|
||||
frame, driving scale, position, rotation or opacity, with threshold and smoothing, for
|
||||
music-reactive motion and simple lip-sync. Animate users also expect its Lip Syncing: a graphic
|
||||
symbol of mouth poses whose frames a voice track picks.
|
||||
|
||||
AniCraft already has sounds on keyframes with stream sync, decoded PCM, waveforms, motion tweens
|
||||
with a curve per property, graphic instances with a first frame, and a template with a labelled
|
||||
mouth chart. What was missing is the analysis, and commands that write keys from it.
|
||||
|
||||
## Decision
|
||||
|
||||
1. **The analysis is pure and lives in the audio crate** (`anicraft_audio::analysis`, L0, no
|
||||
new dependency). `levels` is the RMS of the samples each movie frame plays (one channel or
|
||||
both; repeats and loops followed; frame boundaries as the mixer has them). `normalised`
|
||||
divides by the loudest frame, so settings mean the same for a quiet recording and a loud
|
||||
one. `shape` gates by the threshold and rescales what is above it (so the value rises from
|
||||
zero at the gate instead of jumping), then smooths with a centred moving average of *n*
|
||||
frames either side. Centred, not a trailing follower: a beat stays on its frame, which is
|
||||
what an animator lines up against the waveform. Same input, same output, always.
|
||||
|
||||
2. **The work is bounded.** At most 100 000 frames (the timeline's limit) per analysis;
|
||||
`levels` reads at most 96 M samples in all (longer frames are sampled evenly); each
|
||||
spectrum reads 512 analysis samples of at most 4 source frames. A command writes at most
|
||||
10 000 keys (the motion tween limit) and says how to get under it. Measured (release-like
|
||||
test profile, 10 minutes at 24 kHz, 14 400 frames): levels 19 ms, mouth shapes 135 ms,
|
||||
7 199 keyframes written in 79 ms.
|
||||
|
||||
3. **Lip-sync is clean-room signal processing from public phonetics, not speech
|
||||
recognition.** Vowels are told apart by their first two formants (Peterson and Barney,
|
||||
1952). Each sounding frame gets a 512-sample Hann-windowed FFT (our own radix-2,
|
||||
Cooley and Tukey 1965) at about 8 kHz, and three numbers: the share of pre-emphasised
|
||||
energy in 1.6–3.6 kHz (a front vowel's second formant, or hiss), and the centre of the
|
||||
energy in 200–1400 Hz (how high the first formant is). They sort the frame into five mouth
|
||||
shapes: **rest** (silence), **open** (ah), **wide** (ee, e, s), **round** (oh, oo) and
|
||||
**closed** (a weak low hum, and silences inside speech no longer than 0.12 s: the stops of
|
||||
b, p, m). Mouths shorter than a hold (default 2 frames) join their neighbour; closures are
|
||||
kept. No model, no training data, no network. We chose five shapes because that is what
|
||||
these measurements can honestly tell apart: f/v, l and the other consonant mouths of a
|
||||
ten-mouth chart need recognition we don't have, and the dialog and the guide say it is a
|
||||
first pass.
|
||||
|
||||
4. **Three commands, in the `sound` namespace** (which plug-ins may already call: they edit
|
||||
the document like the other sound commands, so no new plug-in policy):
|
||||
* `sound.to_keyframes` maps the shaped level onto `scale`, `scale_x`, `scale_y`, `alpha`,
|
||||
`x`, `y`, `rotation` or `first_frame` between `min` (silence) and `max` (the loudest
|
||||
frame). Scale is a percentage of the object's own size and position and rotation are
|
||||
offsets from where it is, so the same settings work on any object.
|
||||
* `sound.lip_sync` writes a keyframe wherever the mouth changes, setting the instance's
|
||||
first frame and Single Frame. `mouths` maps each shape to a frame (a number or a frame
|
||||
label); by default by the symbol's labels, the mouth chart's first (Rest, AI, E, O, MBP).
|
||||
* `sound.analyse` (read-only) returns the levels or the mouth shapes, so scripts and
|
||||
assistants can see what the others would work from.
|
||||
|
||||
The sound is the one at the playhead (a stream first), or named by `sound_layer` and
|
||||
`sound_frame`; the range defaults to the frames it is heard on. Any sync but Stop is
|
||||
accepted: an artist who dropped music in as an Event sound shouldn't be sent away.
|
||||
|
||||
5. **Two outputs.** *Keyframes*: a keyframe at each key, made as Insert Keyframe makes it
|
||||
(so it holds what the frame showed), then every keyframe in the range takes the value held
|
||||
there, including keyframes that were already on the layer. Keys are written only where the
|
||||
value changes by more than 0.2 % of the range. The frame after the range keeps what it
|
||||
showed, and a layer shorter than the sound grows to it. *Motion*: property keys on the
|
||||
span's motion tween (made for a lone object), replacing that property's keys in the range;
|
||||
flat stretches keep only their two ends. `auto` picks motion when the span has a motion
|
||||
tween. Keyframes on a span with a motion tween are refused, because they would cut the
|
||||
tween up; a symbol's first frame has no curve, so it is keyframes only.
|
||||
|
||||
6. **The dialog previews by running the command.** One dialog serves both commands
|
||||
(`src/audio_keys.rs`): the sound, the layer and object, the settings, and a graph of the
|
||||
loudness per frame with the threshold, the value the keys follow and a tick per key (for
|
||||
lip-sync, a row per mouth). The stage and timeline preview is the real command run inside
|
||||
a gesture that each change reverts and re-runs, as the plug-in dialog does (ADR 0017): what
|
||||
you see is exactly what OK keeps, in one undo step, and Cancel leaves nothing. It is
|
||||
reached from Modify › Timeline, from the Sound rows of Properties, and from a graphic
|
||||
instance's Looping rows, where Animate has Lip Syncing.
|
||||
|
||||
7. **Nothing in the file format changes.** The keys are ordinary keyframes and property
|
||||
keys, so older builds open the result.
|
||||
|
||||
8. **The flaky `gpu_watch::errors_and_the_loss_come_to_the_app_once` test was a race on
|
||||
process-wide state.** The window's graphics health is one static, and every app frame
|
||||
reads it (`gpu_watch::tick` → `take_news`), which consumes the "said once" flags. A test
|
||||
running an app on another thread could take the news between two lines of that test (and,
|
||||
the other way, be told by that test's simulated device loss to close its window). The
|
||||
logic now lives in methods of `Health`; the static is only the process's instance, and the
|
||||
test works on a `Health` of its own. The assertions are unchanged.
|
||||
|
||||
## Consequences
|
||||
|
||||
* Music-reactive motion and a first-pass lip-sync work in the app, headless and over MCP.
|
||||
* Lip-sync quality is that of a formant heuristic. It finds open, wide and round vowels and
|
||||
closures; it will mislabel some consonants and voices far from the averages. A recognition
|
||||
based pass could replace `analysis::visemes` later without changing the commands.
|
||||
* The sound's own effect (a fade) and its layer's volume are not counted in the loudness.
|
||||
|
||||
## Not in this slice
|
||||
|
||||
Driving the camera, armature layers or filter values; classic tweens between the keys; more
|
||||
mouth shapes; a script or phoneme track as input; several sounds at once; reading the keys
|
||||
back into the dialog to edit them.
|
||||
|
||||
## Question left for the lead
|
||||
|
||||
Any sync mode but Stop is accepted, although the task said "from a stream sound". An Event
|
||||
sound keeps time with the frames only while the movie plays straight through, so the keys can
|
||||
drift from what is heard after a jump. The dialog doesn't warn about it yet.
|
||||
@@ -23,4 +23,3 @@ has to renumber because another PR merged first.
|
||||
| Number | Pull request | Topic |
|
||||
|---|---|---|
|
||||
| 0037 | #38 (outside contribution) | Interface languages |
|
||||
| 0114 | m5/audio-keyframes | Audio to keyframes and lip-sync |
|
||||
@@ -187,6 +187,93 @@ speaker toggle in its timeline row. Volume applies to the layer's sounds and to
|
||||
the symbols on it. A muted layer is silent while you work and in every export, which is handy
|
||||
while you time other tracks.
|
||||
|
||||
## Convert Audio to Keyframes
|
||||
|
||||
A sound can animate for you. **Convert Audio to Keyframes** measures how loud the sound is on
|
||||
each frame and writes that onto a property of an object: a speaker that pulses with the beat, a
|
||||
logo that brightens on every hit, a jaw that drops when a character talks.
|
||||
|
||||

|
||||
|
||||
1. Put the sound on a layer and the object on another layer. **Stream** sync is best: the
|
||||
sound then stays on its frames.
|
||||
2. Choose **Modify › Timeline › Convert Audio to Keyframes…**, or select the sound's keyframe
|
||||
and press **To Keyframes…** in **Properties**.
|
||||
3. Pick the **Layer** that gets the keys (and the **Object**, when the layer holds several).
|
||||
4. Pick the **Property**, and its value **In silence** and **At the loudest**:
|
||||
|
||||
| Property | The values are |
|
||||
|---|---|
|
||||
| **Scale**, **Scale X**, **Scale Y** | percent of the object's own size (100 % is as it is) |
|
||||
| **Alpha** | opacity in percent |
|
||||
| **X offset**, **Y offset** | pixels from where the object is (negative Y is up) |
|
||||
| **Rotation** | degrees from how the object is turned |
|
||||
| **First frame** | a frame of a graphic symbol: louder shows a later frame, held as a single frame |
|
||||
|
||||
5. Shape the movement:
|
||||
* **Threshold** ignores everything quieter than this share of the loudest frame. Raise it
|
||||
so background noise doesn't make the object tremble, or so only the loud beats count.
|
||||
* **Smoothing** averages each frame with the frames either side. 0 follows every flick;
|
||||
higher values are calmer. The beat stays on its frame.
|
||||
* **Channel** (stereo sounds) measures the left side, the right side or both.
|
||||
* **Key every** 2 frames animates on twos, and so on.
|
||||
6. Choose what to **Write**: **Keyframes** on the layer, as if you had set each by hand, or a
|
||||
**Motion tween curve**, which keeps the span whole and shows in the Motion Editor (a motion
|
||||
tween is made for an object alone on its layer).
|
||||
7. Press **OK**. It is one undo step.
|
||||
|
||||
Everything is previewed while you change it. The graph shows the sound's loudness frame by
|
||||
frame, the threshold, the value the keys will follow (the white line) and a tick where each
|
||||
key lands; the stage and the timeline show the keys themselves. Click or drag in the graph to
|
||||
see another frame on the stage. Clear **Preview** to compare with the document as it was.
|
||||
|
||||
Scale and rotation turn about the object's transformation point (the middle of a shape that
|
||||
has none). Keyframes that were already on the layer keep their place and take the value. After
|
||||
the sound ends, the layer carries on as it was. A layer shorter than the sound grows to its
|
||||
length.
|
||||
|
||||
## Auto lip-sync
|
||||
|
||||
**Auto Lip-Sync** listens to speech and picks a mouth for every frame, as Animate's Lip Syncing
|
||||
does. It is a first pass: expect to fix some mouths by hand afterwards.
|
||||
|
||||

|
||||
|
||||
1. Draw the mouths as the frames of a **graphic symbol**, one frame per mouth, and put an
|
||||
instance on its own layer. **File › New from Template › Lip-sync mouth chart** gives you a
|
||||
Mouth symbol with ten labelled frames to redraw.
|
||||
2. Put the dialogue on another layer, with **Stream** sync.
|
||||
3. Select the mouth and press **Lip Sync…** in **Properties** (beside Looping), or choose
|
||||
**Modify › Timeline › Auto Lip-Sync…**.
|
||||
4. Check the **Mouths**. AniCraft tells five mouth shapes apart and needs a frame of your
|
||||
symbol for each:
|
||||
|
||||
| Mouth | Sounds | Frame label it looks for |
|
||||
|---|---|---|
|
||||
| **Rest** | silence | Rest |
|
||||
| **Open** | ah, as in *father* and *cat* | AI |
|
||||
| **Wide** | ee and e, and the hiss of s and t | E |
|
||||
| **Round** | oh, oo and w | O |
|
||||
| **Closed** | m, b, p and the short stops between syllables | MBP |
|
||||
|
||||
Frames are found by their labels (other common names such as *open*, *wide*, *round* and
|
||||
*closed* work too). Choose another frame for any mouth from its menu.
|
||||
5. **Silence below** sets how quiet counts as silence. **Hold each mouth** is the fewest frames
|
||||
a mouth stays, so it doesn't flicker; closed lips are kept however short.
|
||||
6. Press **OK**. The Mouth layer gets a keyframe wherever the mouth changes, each showing one
|
||||
frame of the symbol (**Single frame**). It is one undo step.
|
||||
|
||||
The preview shows a row for each mouth with the frames it gets, under the sound's loudness.
|
||||
|
||||
How it listens: no speech recognition and nothing sent anywhere. Each frame's sound is sorted
|
||||
by where its energy lies (low for *oo*, in the middle for *ah*, high for *ee* and *s*), which is
|
||||
what tells vowels apart. It cannot tell *f* from *s* or *l* from *d*, so the chart's other mouths
|
||||
(FV, L, WQ, U and the consonants) are yours to place. The same sound always gives the same
|
||||
keys.
|
||||
|
||||
To fix a mouth afterwards, select its keyframe and change **First frame** in Properties, or
|
||||
move the keyframe on the timeline.
|
||||
|
||||
## Sounds inside symbols and buttons
|
||||
|
||||
Sounds placed on a symbol's own timeline play too:
|
||||
@@ -242,3 +329,8 @@ Lottie animations carry no sound. See [Exporting and Publish](exporting-and-publ
|
||||
|
||||
* Picking a colour from a bitmap's pixels with the Eyedropper.
|
||||
* Panning beyond what the envelope does.
|
||||
* Convert Audio to Keyframes on the camera or an armature layer, a filter's values, or with a
|
||||
classic tween between the keys; the sound's own effect (a fade) isn't counted in its
|
||||
loudness.
|
||||
* Lip-sync that tells more mouths apart (F and V, L, the chart's other consonants), or reads a
|
||||
script; lip-syncing several sounds in one go.
|
||||
Binary file not shown.
|
After Width: | Height: | Size: 128 KiB |
Binary file not shown.
|
After Width: | Height: | Size: 104 KiB |
@@ -252,6 +252,10 @@ This page is generated from the command registry, so it always matches the versi
|
||||
Parameters: `{distance (stage units, above 0 up to 1000), direction?: expand|inset (default expand), id? (default: the selected shapes)} moves each fill's outline out or in by the distance: expanding rounds corners, insetting keeps them; holes shrink as the fill grows; a fill thinner than twice an inset is removed. A drawing object's line follows its new outline → {changed, removed}`
|
||||
- **Soften Fill Edges…** `modify.soften_fill_edges` · Modify › Shape · changes the document
|
||||
Parameters: `{distance (the soft edge's width in stage units, above 0 up to 1000), steps? (1..=50 bands, default 4), direction?: expand|inset (default expand: the edge is added round the fill; inset: taken from it), id? (default: the selected shapes)} surrounds each fill with bands of its own paint whose alpha steps down outwards: band i of n has (n + 1 - i) / (n + 1) of the fill's alpha. Colour and gradient fills only → {softened, bands}`
|
||||
- **Convert Audio to Keyframes…** `sound.to_keyframes` · Modify › Timeline · changes the document
|
||||
Parameters: `{property: scale|scale_x|scale_y|alpha|x|y|rotation|first_frame, min, max (the property's value in silence and at the loudest frame: scale % of the object's size, alpha %, x and y pixels from where it is, rotation degrees from how it is turned, first_frame a 0-based frame of the graphic symbol), layer? (the layer that gets the keys; default the active layer), element? (the object on it; default the selected one, or the only one), sound_layer?, sound_frame? (the sound's keyframe; default the sound at the playhead), threshold? (0–0.99 of the loudest frame: quieter is silence; default 0.05), smoothing? (0–24 frames either side; default 1), channel?: both|left|right, step? (a key every n frames, 1–240; default 1), output?: auto|keyframes|motion (motion writes the property's curve in the motion tween on the span; auto picks it when the span has one), from?, to? (frames; default the frames the sound is heard on)} → {keys, from, to, output, property, layer, element}`
|
||||
- **Auto Lip-Sync…** `sound.lip_sync` · Modify › Timeline · changes the document
|
||||
Parameters: `{layer? (the layer with the mouth; default the active layer), element? (a graphic symbol instance of mouth poses on it; default the selected one, or the only one), mouths?: {rest, open, wide, round, closed} (each a 0-based frame of the symbol or a frame label in it; default by the symbol's frame labels, as the Lip-sync mouth chart template names them), sound_layer?, sound_frame? (the speech; default the sound at the playhead), threshold? (0–0.99 of the loudest frame: quieter is silence; default 0.08), hold? (fewest frames a mouth is held, 1–12; default 2), from?, to? (frames; default the frames the sound is heard on)} → {keys, from, to, layer, element, mouths, counts}`
|
||||
|
||||
## Commands
|
||||
|
||||
@@ -751,6 +755,8 @@ These commands have no menu item: the panels, the stage and the timeline use the
|
||||
Parameters: `{sound} (from the library and every keyframe that uses it)`
|
||||
- **Rename Sound** `sound.rename` · changes the document
|
||||
Parameters: `{sound, name}`
|
||||
- **Analyse Sound** `sound.analyse`
|
||||
Parameters: `{what?: levels|visemes (default levels), sound_layer?, sound_frame?, from?, to?, threshold?, smoothing?, channel? (levels), hold? (visemes)} → {sound, name, layer, keyframe, from, to, fps, levels (each frame's loudness, 0–1 of the loudest) and values (gated and smoothed), or visemes (rest|open|wide|round|closed per frame)}`
|
||||
- **Set Actions** `actions.set` · changes the document
|
||||
Parameters: `{actions: [{op: stop|play|goto_and_play|goto_and_stop|next_frame|prev_frame|next_scene|prev_scene|trace|set_property, target?, frame?, scene?, message?, property?, value?}] | plugin: id, entry?, symbol?: id (a movie clip's timeline), layer?, frame?} sets what the keyframe at the frame runs; or {element, event: click|press|release|over|out, actions} sets an instance's event handler. An empty list clears it`
|
||||
- **Clear Actions** `actions.clear` · changes the document
|
||||
|
||||
+2
-2
@@ -19,7 +19,7 @@ This integration depends on craft-libs #1962 and still requires hosted parity va
|
||||
| Plug-ins | **WebAssembly plug-ins** (ADR 0017, `docs/plugins.md`): sandboxed modules run by `wasmi` with no imports but the AniCraft ABI (`anicraft.call`/`anicraft.response`: JSON requests that run registry commands, read a compact document view or the active layer's elements, and log); fuel (10⁹ instructions), memory (256 MiB), wall-clock (5 s), request, size and log limits, a fresh instance per run; file, plug-in, undo and clipboard commands refused. `plugin.install/list/run/remove/reload`; a run is atomic and one undo step named after the plug-in. App: **Commands** menu (Plug-ins, Install, Manage, Reload), palette entries, a dialog generated from the manifest's parameters with a live preview; plug-ins load from `<settings>/plugins` or `ANICRAFT_PLUGINS`; CLI `--plugins`. Samples in Rust (Star Field, Jitter Selection, guest SDK) in `examples/plugins`. Frame scripts: see Interactivity. **Exporter and ease plug-ins** (ADR 0088): `kind: "exporter"` declares a format (name, extension, options) and gets evaluated frames (`movie`, `frame`: the flattened display list, never the document), returning the file's bytes from `ac_export` (64 MiB cap, 5·10¹⁰ instructions, 10 min); File › Export lists it with an Export window (options, frames, file, progress bar and Cancel on a worker thread); `file.export_plugin`, `file.export_formats`, `anicraft-cli export --format <id>` and `formats`. `kind: "ease"` declares named eases, `ac_ease(i, t)` sampled into 257 values at load (NaN, unbounded or end-missing eases refused); `Easing::Sampled` keeps the table in the document, so it plays the same without the plug-in; the ease menus list them under Plug-in eases; `{plugin, ease}` easing params. Samples: Plain Text Frames and Stepped Eases, built and run in CI. Not yet: plug-in formats in Publish, bitmaps' pixels and sounds for exporters, ease plug-ins with parameters, background runs of command plug-ins, a binary document view. |
|
||||
| Interactivity | **Frame actions, frame scripts and Test Movie, first slice** (ADR 0024): a typed timeline action IR (`anicraft-actions`: stop, play, go to a frame or label in a scene, next/previous frame and scene, trace, set x/y/alpha/visible/rotation/scale, instance-name target paths) on keyframes and on button and movie clip instances (click, press, release, over, out); a pure, deterministic, budgeted player in `anicraft-doc` (`step(doc, &state, &events)`; movie clip playheads, button Up/Over/Down states with Hit-frame hit tests, script-set properties) drawn by `evaluate_player`, while `evaluate` and exports stay script-free. **Actions panel** (F9: structured lists, targets/labels/scenes picked from the document; movie clip timelines too), instance name and events in Properties, an "a" on keyframes with actions. **Frame scripts** on the plug-in host (`kind: "frame-script"`, entry points, `player`/`action` ops, 20 M instructions per frame shared, no document access). **Test Movie** (Control › Test Movie, Ctrl+Enter): the player at the document frame rate in its own window with the pointer, restart/pause/step and an Output panel. **A window of its own on the desktop** (ADR 0062): sized to the stage at 100 % (smaller to fit the screen), titled with the document, back where it was last (not on Wayland, where the desktop places windows), with the keyboard when it opens; Esc or Ctrl+W (⌘W) closes it, Ctrl+Enter restarts it in place, and the editor's Ctrl/Alt shortcuts work from it; floating inside the editor in the web build, where the system can't open windows (it says so), or by choice in Preferences › Test Movie. Not yet: full screen, zoom in the movie window, remembering its size. Headless: `actions.set/clear/list`, `instance.set_name`, `control.test_movie` (timed pointer events, returns output and state). **HTML canvas export** (ADR 0028, `file.export_html`, File › Export › Export HTML Canvas…): one self-contained page (data, player and drawing code inline; images and sounds embedded) that plays in any browser with canvas 2D; every used timeline baked frame by frame (tweens of every kind exact, identical paths, paints and frames stored once), movie clips, buttons with Hit areas and every action run by `player.js`, a port of the Rust player checked against it step by step in Boa (state, output and display list); masks and fading/blending groups on offscreen layers; **filters and Subtract/Invert in the page** (ADR 0072: `filters.js`, a port of the renderer's filters run over the group's pixels on a layer that reaches past the canvas by the filters' reach, Subtract and Invert composited per pixel, results kept while the group is unchanged; equal to the oracle's pixels within 9.3e-4 in Boa; 3.4 ms a frame for the demo's filters at 1080p while they change); Web Audio for Event/Start/Stop/Stream sounds; bitmap tints, 9-slice scaling and plug-in frame scripts reported. Not yet: 9-slice in the page, keeping a moving filtered group's pixels, filters off the main thread. **Kept frame scripts** (ADR 0013 tier 1): scripts written in another language (an Animate document's ActionScript) kept verbatim on keyframes with their language, symbol linkage classes and the document class; the Actions panel's **Script** view (monospace editor with line numbers, language, live and undoable), the same "a" marker, Class rows in Properties; `script.set/clear/list/set_class`; **ActionScript timeline subset runs** (ADR 0013 tier 2): a hand-written, bounded lexer and parser (`anicraft_actions::as3`) lower stop/play/go to/next and previous frame and scene on instance-name paths, mouse listeners (click, down, up, roll over and out; named or inline functions, `currentTarget`), `trace` and property settings to the action IR, compiled once per script; anything else is reported with line and column and the script doesn't run (never half-run), `navigateToURL` and the like are ignored and noted; the player keeps listeners per instance, Test Movie's Output says which scripts run and which don't and why, the Script view lists problems in place, the XFL report and `script.list/check` say what runs, and the HTML page runs the same steps (`player.js` checked against the Rust player). **ActionScript small logic** (ADR 0052): scripts compile to a small typed script IR evaluated by the player with fuel (100,000 per script or listener call, 1,000,000 per step; an endless loop or a run-time error stops its script with an Output line and the movie plays on): typed variables (Number, int, uint, Boolean, String, untyped) kept per timeline instance across its frame scripts, expressions as ECMA-262 has them, `if`/`else`, `for`/`while`/`do`, functions with parameters, results and recursion, called from any frame of the same timeline (a timeline-level link step; names that aren't there keep the script from running, said in place), property reads of instances and timelines (`x`, `y`, `alpha`, `visible`, `rotation`, `scaleX/Y`, `currentFrame`, `tLine truncated
|
||||
| Headless | CLI: info, render, render-seq, **gif**, **apng**, **webp**, commands, exec, run, serve (JSON-lines). **MCP server** (`anicraft-cli mcp`, `docs/mcp.md`): stdio JSON-RPC, protocol 2025-06-18 (and 2025-03-26, 2024-11-05); five tools over the command registry (list, run, run a script, describe the document, render a frame as a PNG picture); confirmation tiers and undo apply as in the app. **Live control** (ADR 0104, `docs/control-protocol.md`): `anicraft --control <port>` and `anicraft-cli mcp --bridge <port>` run the same tools on the open window, on this computer only, with a per-run token in `control.json`. |
|
||||
| Sound | **Audio layers, first slice** (ADR 0020): WAV (own reader), Ogg Vorbis (`lewton`) and MP3 (`nanomp3`) import, bounded and crash-proof; sounds live in the library, stored in `.anicraft` as imported, decoded once in the background. A sound belongs to a keyframe as in Animate (Properties › Sound: name, Sync Event/Start/Stop/Stream, Repeat ×N or Loop); Import to Stage puts one on a new layer spanning its length, Import to Library only adds it, the Library previews, places and deletes sounds. The timeline draws each sound's waveform over its span. Stage playback plays the mix through `cpal` (default feature `sound-output`) and the playhead follows the audio clock; stream sounds resync after a jump and scrubbing plays one-frame snippets. Mixing is pure and sample-exact (`doc::sound::voices` + `audio::mix`, Catmull-Rom resampling between rates). Headless: `sound.place/set/remove/rename/delete`, `file.import_to_library`, **`file.export_audio`** (WAV, 16/24-bit or float, any rate), and Export Video carries the soundtrack (Opus in WebM, AAC in MP4, by the user's ffmpeg). **Second slice** (ADR 0039): each frame sound has an **Effect** (None, Left channel, Right channel, Fade left to right, Fade right to left, Fade in, Fade out, shaped over the time it is heard, or **Custom**: up to 16 volume points per channel in the **Edit Envelope** window, drawn on each channel's waveform; the timeline's waveform follows the envelope). Layers holding sounds get a **Volume** and **Mute** (Properties, and a speaker toggle in the timeline); volumes multiply down through symbols and muted layers are silent in playback and every export. **Sounds inside symbols** play: a graphic's on its own frames mapped to the parent's time (loop mode and first frame apply; streams join mid-way and follow the parent playhead), a movie clip's on a loop from when the instance appeared; in the interactive player and **Test Movie** (which now has sound, the picture keeping time with it) movie clips start theirs as their own timelines reach them. The HTML page carries envelopes, volumes and graphic sounds. Headless: `sound.set {effect, envelope}`, `layer.set_volume`, `layer.toggle_mute`. **Sounds on button frames** (ADR 0057) play in Test Movie and the HTML page as the pointer changes the button's state (Over, Down, and Up and Hit on leaving and release, as the SWF format keeps them; never in the soundtrack); `control.test_movie` lists the sounds it starts. **XFL** brings sounds whose file is in the package (WAV, Ogg, MP3) with the sounds on frames that use them, buttons' included. **Output polish** (ADR 0095): the playhead follows the sound *heard* (the device's latency taken off, frames dropped rather than drifting; under a frame off over an hour in tests), event sounds play to their end across a loop and after the last frame (Enter stops all), a **monitor volume and mute** in the timeline header (Control › Mute Sounds; the listener's, in preferences, never in exports), **Control › Audio Scrubbing** (a slice of at least 1/20 s), a lost or missing device never crashes (silent playback, one notice, a log line, reopened on the next play; a new default device is followed), and the **web build plays sound through Web Audio**. The device sits behind an `Output` trait, so the clock and mixing paths are tested with a fake one. Not yet: sounds kept only in Animate's own data format (undocumented; reported), sound effects and in/out points from XFL, sound panning beyond the envelope, audio in Lottie, stream sounds that follow go-tos in the HTML page, lossless compression of stored WAVs, choosing an output device other than the system's default, `stopAllSounds` as a timeline action. |
|
||||
| Sound | **Audio layers, first slice** (ADR 0020): WAV (own reader), Ogg Vorbis (`lewton`) and MP3 (`nanomp3`) import, bounded and crash-proof; sounds live in the library, stored in `.anicraft` as imported, decoded once in the background. A sound belongs to a keyframe as in Animate (Properties › Sound: name, Sync Event/Start/Stop/Stream, Repeat ×N or Loop); Import to Stage puts one on a new layer spanning its length, Import to Library only adds it, the Library previews, places and deletes sounds. The timeline draws each sound's waveform over its span. Stage playback plays the mix through `cpal` (default feature `sound-output`) and the playhead follows the audio clock; stream sounds resync after a jump and scrubbing plays one-frame snippets. Mixing is pure and sample-exact (`doc::sound::voices` + `audio::mix`, Catmull-Rom resampling between rates). Headless: `sound.place/set/remove/rename/delete`, `file.import_to_library`, **`file.export_audio`** (WAV, 16/24-bit or float, any rate), and Export Video carries the soundtrack (Opus in WebM, AAC in MP4, by the user's ffmpeg). **Second slice** (ADR 0039): each frame sound has an **Effect** (None, Left channel, Right channel, Fade left to right, Fade right to left, Fade in, Fade out, shaped over the time it is heard, or **Custom**: up to 16 volume points per channel in the **Edit Envelope** window, drawn on each channel's waveform; the timeline's waveform follows the envelope). Layers holding sounds get a **Volume** and **Mute** (Properties, and a speaker toggle in the timeline); volumes multiply down through symbols and muted layers are silent in playback and every export. **Sounds inside symbols** play: a graphic's on its own frames mapped to the parent's time (loop mode and first frame apply; streams join mid-way and follow the parent playhead), a movie clip's on a loop from when the instance appeared; in the interactive player and **Test Movie** (which now has sound, the picture keeping time with it) movie clips start theirs as their own timelines reach them. The HTML page carries envelopes, volumes and graphic sounds. Headless: `sound.set {effect, envelope}`, `layer.set_volume`, `layer.toggle_mute`. **Sounds on button frames** (ADR 0057) play in Test Movie and the HTML page as the pointer changes the button's state (Over, Down, and Up and Hit on leaving and release, as the SWF format keeps them; never in the soundtrack); `control.test_movie` lists the sounds it starts. **XFL** brings sounds whose file is in the package (WAV, Ogg, MP3) with the sounds on frames that use them, buttons' included. **Output polish** (ADR 0095): the playhead follows the sound *heard* (the device's latency taken off, frames dropped rather than drifting; under a frame off over an hour in tests), event sounds play to their end across a loop and after the last frame (Enter stops all), a **monitor volume and mute** in the timeline header (Control › Mute Sounds; the listener's, in preferences, never in exports), **Control › Audio Scrubbing** (a slice of at least 1/20 s), a lost or missing device never crashes (silent playback, one notice, a log line, reopened on the next play; a new default device is followed), and the **web build plays sound through Web Audio**. The device sits behind an `Output` trait, so the clock and mixing paths are tested with a fake one. **Audio to keyframes and auto lip-sync, first slice** (ADR 0114, #332): `anicraft_audio::analysis` gives a sound's loudness per movie frame (RMS, normalised to the loudest frame, gated by a threshold, smoothed by a centred average) and, for speech, one of five mouth shapes per frame (rest, open, wide, round, closed) from band energies of a short FFT sorted by the vowels' public formant values, with no speech recognition; pure, deterministic and bounded (10 minutes of sound: levels in 19 ms, mouths in 135 ms). **Convert Audio to Keyframes** (`sound.to_keyframes`; Modify › Timeline, Properties › Sound) maps the loudness onto an object's scale, alpha, position or rotation offset, or a graphic symbol's first frame, as keyframes or as a motion tween's property curve; **Auto Lip-Sync** (`sound.lip_sync`; also beside Looping in Properties) keys the frames of a graphic symbol of mouth poses, found by its frame labels as the mouth chart template names them; `sound.analyse` reports both headless. One dialog previews everything live (a graph of loudness, threshold, value and key ticks, or a row per mouth; the keys themselves on the stage and timeline), one undo step. Not yet: driving the camera, armature layers or filter values from sound; classic tweens between the keys; more than five mouth shapes (F/V, L and the other consonants are placed by hand) or a script as input; the sound's effect and layer volume in the measured loudness; sounds kept only in Animate's own data format (undocumented; reported), sound effects and in/out points from XFL, sound panning beyond the envelope, audio in Lottie, stream sounds that follow go-tos Line truncated
|
||||
| Documents | **Several open at once** (ADR 0112): tabs above the edit bar, the shown document in `App`, the others parked whole (session, view, autosave) and exchanged in O(1) (0.2 µs median); the engine and the CLI/MCP stay one document per session. Cross-document paste remaps Library ids (`engine::transfer`). Not yet: a tab in its own window, another document's Library in the panel, session restore, a shared undo budget. |
|
||||
| Files | `.anicraft` JSON load/save (v3, with scenes; v1 and v2 files open as one scene), PNG frame and sequence export, **animated GIF export** (parallel render and quantize, exact frame timing, looping), **animated PNG and animated WebP export** (WebP container writing delegates to shared `craft-webp`; APNG framing remains app-local; ADR 0063: full colour and real alpha, transparent or on the stage colour; every frame exactly the renderer's; repeated frames merged into longer delays; later frames only the rectangle that changed (APNG blends opaque changes over, WebP replaces); APNG delays exact fractions of the frame rate, WebP milliseconds that never drift; loop forever, once or N times; File › Export, Publish Settings, the web build's downloads, `anicraft-cli apng`/`webp`; not yet: lossy WebP (no permissive pure-Rust VP8 encoder exists), dispose-to-background frames, palette or RGB APNG for smaller files), **SVG frame export** (from the same evaluated frame as the renderer: stage-space paths, renderer-matched stroke widths, caps, joins and dashes, gradients under `gradientTransform`, colour effects baked in, masks as nested `clipPath`s). **Opens Animate documents** (`.fla`, `.xfl`, XFL folders; ADR 0009; `.fla` archives in every common zip layout, ZIP64 included, and hostile ones refused with a readable error, ADR 0054): stage, first scene, layers, keyframes, labels, classic tweens with ease, shapes (solid/linear/radial fills, strokes), groups, primitives, symbol instances (matrix, alpha, tint, loop, blend mode, all seven filters), library symbols, **shape tweens**, **layer folders** and **mask layers** (masks inside folders too); imported files are untitled so Save never overwrites them; what isn't supported yet is reported after opening. One damaged bitmap, sound or library symbol is left out and reported rather than refusing the whole file (#226), and a document without a stage colour gets Animate's default white (#163). Archives whose end record overstates the directory's size, as Flash CS5 to Animate write most `.fla` files, open (#356; until the shared reader does it, storytold/craft-libs#1986). Binary `.fla` (Flash CS4 and earlier) is not read and says so (#163, #289: a stretch goal in `requirements.md`, no clean-room reader yet). Every scene comes across. **Bitmaps**: library items whose image is in the package as PNG or JPEG (the original in `LIBRARY/`, else the `bin/` data file when it is PNG or JPEG), instances, and bitmap fills with their matrix (twips scale removed; repeating unless clipped); Animate's own bitmap encodings are not public and are reported, not decoded. **Text** (ADR 0014): static, dynamic and input text fields become text blocks laid out by `anicraft-text`, with face (by PostScript name, family, or the family the name suggests; `_sans`/`_serif`/`_typewriter`), size, colour, bold/italic, alignment, letter and line spacing, margins, matrix, fixed width (wraps) or auto-size, and several lines; runs in different styles become one block per run of same-style lines, stacked as in Animate; a line mixing styles takes its main style and is counted; missing families fall back and are named in the report; dynamic/input fields come across as static text (reported). **Shape hints** on shape tweens (a tolerant self-authored `shapeHints` reader, ADR 0023). Colour effects in every style (Brightness, Tint, Advanced, Alpha; ADR 0056), movie clip and button instance names, one-segment custom eases (as cubic Béziers); a symbol without `symbolType` is a movie clip; frame comments aren't labels. Stroke caps, joins and miter limit, dashed and dotted strokes (ADR 0046; ragged, stipple and hatched are drawn solid and reported). Reported rather than silently changed: gradient strokes, repeating/reflecting, focal-point, elliptical and linear-RGB gradients, reverse loop modes, extra tween spins. A self-authored corpus with golden renders covers all of it (ADR 0035). Shared `craft-xfl` readers now parse filters, shape hints, tween easing, and frame-sound envelopes; AniCraft retains document-model mapping and validation. The XFL schema audit remains in progress, including per-character styles and motion-tween records; **frame scripts are kept** verbatim (scenes and every symbol, with the language from the publish settings), with symbol linkage classes and the document class, and the report lists them as kept, not run (ADR 0013 tier 1; scripts on instances and linkage on bitmaps and sounds are reported); **Import to Stage (Ctrl+R) for SVG drawings**: editable shapes on a new layer at the playhead, with groups, use and symbols, transforms, viewBox, styles, opacity and gradients; **clip paths and opaque masks** (ADR 0021) become mask layers in a folder named after the file (clips that cut nothing dropped, clips inside clips intersected exactly when all but one are convex polygons, curves kept), and **text** becomes text blocks, one per text chunk (position, anchor, font family list, size, weight, styleLine truncated
|
||||
| Library | **Library management, first slice** (ADR 0050): nested **folders** (New Folder, rename, drag items and folders in and out, Move to; deleting a folder that holds items asks), **inline rename** (F2 or double-click the name; names unique per folder, case aside), **Duplicate Symbol** (fresh ids, same folder, “Ball copy”), **Swap Symbol** in Properties (keeps transform, colour effect, filters, looping and name), a **use count** column, **Select Unused Items** and **Delete Unused Items** (unused = not reachable from any scene; linkage classes count as used; asks first), deleting used items asks and removes their instances, fills and keyframe sounds, **sort** by name, type, use count or date added, **search** (opens the folders that lead to a match), multiple selection, a **preview** (a symbol's first frame from the oracle, a bitmap as smoothed or not, a sound's waveform with play) and **item properties** (symbol type and linkage class, bitmap **Allow Smoothing**, which the oracle, the GPU stage, SVG and HTML honour). Folders are a side table in the document (older files open flat); XFL import keeps folders and Allow Smoothing. Headless: `library.items/new_folder/rename/move/duplicate/delete/unused/delete_unused/set_smoothing`, `element.swap_symbol`. **Second slice** (ADR 0053): **drag items onto the stage** (symbols and bitmaps land at the pointer on the active layer at the playhead, sounds go onto its keyframe; several at once; one undo step; inside a symbol open for editing too), **Place on Stage** (button, right-click, or Enter) at the centre of the view, **Swap Bitmap** in Properties (a placed bitmap keeps its corner and takes the new size; a bitmap fill keeps its shape), a **Convert to Symbol** dialog with name, type and **folder** that offers the last folder and type again, and **"mixed" on every Properties row** for several elements (Scale, Rotation, Alpha, Symbol, Type, Filters, Blending, Looping, First frame, Fill, Bitmap, Stroke, Width, Style; each row compares only the elements it edits; editing a mixed row sets all, and Type sets every selected instance's symbol). Headless: `library.place {items, x, y}` (and `sound`), `element.swap_bitmap`, `kind` and `folder` on `modify.convert_to_symbol`. **9-slice scaling** (ADR 0055): Enable guides for 9-slice scaling on a symbol (Library or Properties). Scaled instances keep their corners, stretch their edges one way and the centre both ways, and strokes keep their width. Rotation and skew apply after; nested symbols, text and bitmaps scale normally. Guides are dragged as dashed lines while editing the symbol in place, or typed in Properties. The CPU, GPU, SVG and Lottie output all show it, and XFL `scaleGrid*` attributes are imported; guides switched off are kept and come back when switched on (ADR 0057). Not yet: 9-slice in HTML canvas export (scaled as a whole and reported), guides in Library previews, snapping guides. Not yet: shared libraries and importing items from another document, linkage on bitmaps and sounds, bitmap compression, dropping files from the desktop, a picture of the item while dragging, Swap Bitmap on a Library item (every use), mixed text style rows, a Colour Effect row with tint. |
|
||||
@@ -43,7 +43,7 @@ This integration depends on craft-libs #1962 and still requires hosted parity va
|
||||
| **M2** | Model at scale | ~~`Arc` structural sharing (O(changed) undo)~~ done early (ADR 0001); ~~scenes~~ ✅ (ADR 0011); ~~layer folders~~ ✅, ~~guide and motion-guide layers~~ ✅; ~~mask layers~~ ✅; ~~Movie Clip and Button behaviours~~ ✅ (playback; button states and scripting come with M6); ~~group alpha / offscreen compositing~~ ✅; ~~shape tween~~ ✅, ~~shape hints~~ ✅ (ADR 0023); ~~motion tween + Motion Editor curves~~ ✅ first slice (ADR 0016; the ease presets, saved and custom eases of ADR 0081 per segment); ~~Motion Editor and timeline retiming, Split/Join Motion~~ ✅ (ADR 0083); ~~motion paths on the stage with orient to path~~ ✅ first slice (ADR 0030), ~~path point add/delete/convert and moving the whole path~~ ✅ (ADR 0038), ~~anchors pinned to frames~~ ✅ (ADR 0049; 3D and XFL import later); ~~library management~~ ✅ first slice (ADR 0050: folders, rename, duplicate, Swap Symbol, use counts and unused items, sort, search, preview, Allow Smoothing), ~~Library and Properties polish~~ ✅ (ADR 0053: drag onto the stage, Swap Bitmap, Convert to Symbol folders, mixed on every Properties row), ~~9-slice scaling~~ ✅ first slice (ADR 0055); ~~colour effects, complete~~ ✅ (ADR 0056: Properties' Style menu with None, Brightness, Tint, Advanced and Alpha, one exact colour transform in the CPU oracle, the GPU stage, SVG `feColorMatrix`, HTML canvas and Lottie, XFL `Color` import with a corpus package, classic tweens across styles, motion tween tint colour, brightness and Advanced tracks; not yet: a colour picker for the Motion Editor's tint colour); ~~MCP server~~ ✅; perf budgets ✅ (machine-independent ones gate every PR; timing via `bench --check` on a known machine, CI once a benchmark runner exists); ~~layering check~~ ✅ (`src/architecture_tests.rs`, runs with `cargo test`). |
|
||||
| **M3** | GPU stage *(in progress; the default stage renderer since ADR 0032)* | ~~wgpu renderer behind a feature flag~~ ✅ first slice (ADR 0019: the oracle's fills, CPU tile binning with backdrops, compute coverage; gradient tables in a storage buffer); ~~per-pixel parity tests vs the CPU oracle~~ ✅ (max 1/255, mean < 0.0001/255); ~~stroke coverage as one union, no double-darkening~~ ✅ (ADR 0110: one outline per stroke from the oracle, so both renderers follow; 2,000 outlined shapes at 1080p 9.3 → 9.0 ms, self-crossing scribbles +4 to 8 %; not yet: stroke and converted fill from the same curves, an outline cache); ~~4K at 60 fps for 1,000 shapes~~ ✅ (8.8–9.0 ms); ~~no-readback textures, masks/groups/blend modes on the GPU~~ ✅ second slice (ADR 0029: window's device, 4K 10k shapes in 10.2 ms as tiles); ~~GPU binning~~ ✅ fourth slice (ADR 0048: heavy frames without masks or groups binned on the GPU, 50k shapes at 4K 122 → 22.5 ms in one texture; outline mode's hairlines as fast as tinted onion skin); ~~bitmaps and filters on the GPU~~ ✅ third slice (ADR 0032: bitmaps byte-identical, filters max 1/255; 4K filtered sample 3.9 ms, 200 bitmaps 4.4 ms); ~~hardware breadth~~ ✅ Vulkan and DX12 (FXC), software adapters refused, oracle-checked self-test; ~~GPU as the default stage renderer~~ ✅ (`gpu-stage` on by default for the app, automatic CPU fallback); ~~surviving GPU failures mid-session~~ ✅ (ADR 0092: the stage drops to the CPU at once and retries the GPU after 3, 15, 60 and 300 s or on a resize; the window's device gets an error handler and a loss callback instead of wgpu's panic, a failing surface is reconfigured then recreated, and a lost window device autosaves, reopens the window a safer way and makes the next 3 starts try it late; not yet: recreating the window's device in place, which eframe doesn't offer); next: GPU binning inside masks and groups, shared filtered layers across tiles, an image atlas, GPU exports. |
|
||||
| **M4** | Interchange *(in progress)* | **XFL import** (DOMDocument.xml, symbols, edges/fill styles decoded from the public format descriptions) with a corpus of self-authored files: first slice ✅ (see Files above); ~~larger self-authored corpus with golden render tests~~ ✅ (ADR 0035: twelve packages covering every mapped feature, exact report expectations, hostile variants, CPU-oracle goldens); ~~`.fla` variants of the corpus and a hardened zip reader~~ ✅ (ADR 0054: nine zip layouts imported identically to the folder, ZIP64, CP437 names, a 9,664-archive hostile fuzz; a 54.6 MB `.fla` imports in 0.31 s); ~~sound and video items, self-extracting and top-folder `.fla` archives~~ ✅ (ADR 0086: sound effects and custom envelopes, every sound and video that doesn't come across named with its format, Screen Video stills, zipped XFL folders and self-extracting stubs; not yet: sound in/out points, AIFF and compressed WAV, video playback); ~~SVG import (Import to Stage)~~ ✅, ~~SVG frame export~~ ✅; ~~Lottie export~~ ✅ (~~easing curves instead of per-frame keys~~ ✅, ADR 0089: keyframes with Bézier eases, moving artwork under group transforms, playback parity at every frame; not yet: motion along curved guides as spatial tangents, orient to path, nested tweens as nested transforms); ~~sprite sheet + JSON~~ ✅; ~~MP4/WebM via ffmpeg pipe~~ ✅; ~~animated PNG and WebP~~ ✅ (ADR 0063; lossless WebP; lossy WebP not yet). |
|
||||
| **M5** | Rich media | ~~Text engine~~ ✅ first slice (ADR 0012: `harfrust` shaping, `skrifa` outlines, line wrapping, outlines stored with the text); ~~per-character and paragraph styles~~ ✅ first slice (ADR 0085: styled runs (font, size, bold, italic, colour, letter spacing, superscript/subscript by the font's OS/2 metrics, underline, link) set on the selected characters while typing, mixed values in Properties, paragraph alignment, indent, margins and line spacing, runs shaped one by one and wrapped across, one fill per colour in every export, SVG links, XFL `DOMTextRun`s kept in one block, `text.style`/`text.paragraph`/`text.styles`; not yet: justified text, runs on a path's underlines, `htmlText` in fields, links that click in Test Movie and the HTML page, SVG `<text>`/`<tspan>` output, the editor showing the real faces and alignment); ~~text on a path~~ ✅ first slice (ADR 0070: a copy of a shape's outline in the block, glyphs set by arc length and stored as outlines, offset, flip and alignment, Attach to Path by picking a shape, SVG `textPath`; editing the path in place and several lines on a path later); ~~dynamic and input text fields~~ ✅ first slice (ADR 0066: Text type in Properties, instance names, `field.text`/`appendText`/`length` in scripts, typing with caret, selection, max chars and passwords in Test Movie, native inputs in the HTML export, XFL fields kept; `htmlText`, change events, embedded fonts in HTML and other `TextField` API later); ~~bitmap import and bitmap fills~~ ✅; ~~audio layers, waveform display, stream sync~~ ✅ first slice (ADR 0020: WAV, Ogg Vorbis, MP3; `cpal` output); ~~effect envelopes, layer volume and mute, sounds inside symbols~~ ✅ (ADR 0039); ~~audio output polish (latency-aware clock, event tails, monitor volume and mute, scrubbing preference, device recovery, Web Audio)~~ ✅ (ADR 0095); ~~button sounds and hit-area editing~~ ✅ (ADR 0057: state sounds in Test Movie and HTML, state names on the timeline, the Hit area over the other states, Show hit areas in Test Movie, XFL sounds in the package); ~~filters (blur, drop shadow, glow, colour matrix)~~ ✅, ~~bevel, gradient glow and gradient bevel~~ ✅ (ADR 0025; SVG export and XFL import), ~~filter presets, reordering, on/off and tweened filter values~~ ✅ (ADR 0091: drag or Alt+arrows to reorder, an eye per filter that keeps its settings, Copy/Paste Filters, presets in your preferences with a JSON file to move them; classic tweens pair lists with switched-off filters), ~~motion-tween tracks per filter property in the Motion Editor~~ ✅ (ADR 0092: blur, strength, angle, distance and Adjust Color's four, by filter slot, with curves, eases and retiming, auto-keyed from Properties › Filters, following reorders and removals), ~~filter colours, quality and switches as tracks, built-in presets and filters on text~~ ✅ (ADR 0099: a filter's colours and ramp stops channel by channel in the tint's units, with a swatch row in the Motion Editor; quality, Inner, Knockout and Hide Object as stepped tracks; classic tweens of lists that differ pair what matches and fade the rest; eight built-in presets that can be hidden, not deleted; filters on static, dynamic and input text, in every export and from XFL; not yet: the Type and on/off as tracks, ramp stop positions as tracks, Animate's filter tracks from XFL motion tweens, typed text of an input field filtered in the HTML page) and ~~blend modes~~ ✅ on Movie Clips. |
|
||||
| **M5** | Rich media | ~~Text engine~~ ✅ first slice (ADR 0012: `harfrust` shaping, `skrifa` outlines, line wrapping, outlines stored with the text); ~~per-character and paragraph styles~~ ✅ first slice (ADR 0085: styled runs (font, size, bold, italic, colour, letter spacing, superscript/subscript by the font's OS/2 metrics, underline, link) set on the selected characters while typing, mixed values in Properties, paragraph alignment, indent, margins and line spacing, runs shaped one by one and wrapped across, one fill per colour in every export, SVG links, XFL `DOMTextRun`s kept in one block, `text.style`/`text.paragraph`/`text.styles`; not yet: justified text, runs on a path's underlines, `htmlText` in fields, links that click in Test Movie and the HTML page, SVG `<text>`/`<tspan>` output, the editor showing the real faces and alignment); ~~text on a path~~ ✅ first slice (ADR 0070: a copy of a shape's outline in the block, glyphs set by arc length and stored as outlines, offset, flip and alignment, Attach to Path by picking a shape, SVG `textPath`; editing the path in place and several lines on a path later); ~~dynamic and input text fields~~ ✅ first slice (ADR 0066: Text type in Properties, instance names, `field.text`/`appendText`/`length` in scripts, typing with caret, selection, max chars and passwords in Test Movie, native inputs in the HTML export, XFL fields kept; `htmlText`, change events, embedded fonts in HTML and other `TextField` API later); ~~bitmap import and bitmap fills~~ ✅; ~~audio layers, waveform display, stream sync~~ ✅ first slice (ADR 0020: WAV, Ogg Vorbis, MP3; `cpal` output); ~~effect envelopes, layer volume and mute, sounds inside symbols~~ ✅ (ADR 0039); ~~audio output polish (latency-aware clock, event tails, monitor volume and mute, scrubbing preference, device recovery, Web Audio)~~ ✅ (ADR 0095); ~~Convert Audio to Keyframes and auto lip-sync~~ ✅ first slice (ADR 0114, #332: loudness per frame onto scale, alpha, position, rotation or a graphic's first frame, as keyframes or a motion tween curve, with threshold, smoothing and a live preview; five mouth shapes from band energies keyed onto a mouth symbol's frames; not yet: more mouth shapes, the camera, armatures and filters as targets, classic tweens between keys); ~~button sounds and hit-area editing~~ ✅ (ADR 0057: state sounds in Test Movie and HTML, state names on the timeline, the Hit area over the other states, Show hit areas in Test Movie, XFL sounds in the package); ~~filters (blur, drop shadow, glow, colour matrix)~~ ✅, ~~bevel, gradient glow and gradient bevel~~ ✅ (ADR 0025; SVG export and XFL import), ~~filter presets, reordering, on/off and tweened filter values~~ ✅ (ADR 0091: drag or Alt+arrows to reorder, an eye per filter that keeps its settings, Copy/Paste Filters, presets in your preferences with a JSON file to move them; classic tweens pair lists with switched-off filters), ~~motion-tween tracks per filter property in the Motion Editor~~ ✅ (ADR 0092: blur, strength, angle, distance and Adjust Color's four, by filter slot, with curves, eases and retiming, auto-keyed from Properties › Filters, following reorders and removals), ~~filter colours, quality and switches as tracks, built-in presets and filters on text~~ ✅ (ADR 0099: a filter's colours and ramp stops channel by channel in the tint's units, with a swatch row in the Motion Editor; quality, Inner, Knockout and Hide Object as stepped tracks; classic tweens of lists that differ pair what matches and fade the rest; eight built-in presets that can be hidden, not deleted; filters on static, dynamic and input text, in every export and from XFL; not yet: the Type and on/off as tracks, ramp stop positions as tracks, Animate's filter tracks from XFL motion tweens, typed text of an input field filtered in the HTML page) and ~~blend modes~~ ✅ on Movie Clips. |
|
||||
| **M6** | Interactivity & extensibility | **Plug-ins: the Craft-family WebAssembly system** (same host model as PhotoCraft: `wasmi` sandbox, `plugin.*` commands; AniCraft ABI for vector/timeline operations and exporters): first slice ✅ (command plug-ins over the registry, ADR 0017); ~~exporter and easing plug-ins~~ ✅ (ADR 0088); ~~frame scripts on the same sandbox~~ ✅ and ~~button states in test-movie preview~~ ✅ first slice (ADR 0024: action IR, pure player, Actions panel, Test Movie); ~~HTML canvas runtime export~~ ✅ first slice (ADR 0028: one self-contained page, baked frames, a JS port of the player tested against it; ~~filters, Subtract and Invert in the page~~ ✅, ADR 0072); ~~command macros~~ ✅ first slice (ADR 0097: every undo step records its commands; History › Save As Command with steps rewritten to act on the selection or refused with the step named; saved commands at the end of the Commands menu with shortcuts; Manage Saved Commands; Run Command…; one transactional undo step; small JSON files in the settings folder; `macro.*` headless, CLI and MCP; macros call only what plug-ins may. Not yet: Replay Steps without saving, editing a macro's steps, macros that ask for values, the browser build and the command palette). **ActionScript compatibility, low priority** (ADR 0013), last in M6 and free to slip past M8: ~~tier 1 keeps scripts~~ ✅ (XFL frame scripts and class names stored verbatim, the Actions panel's Script view, `script.*` commands); ~~tier 2 runs the ActionScript 3 timeline subset (stop, play, go to frame or label, named instances, button events) in Test Movie and HTML canvas export through the same action IR as WebAssembly frame scripts~~ ✅; ~~tier 2.5 small logic (typed variables, expressions, `if` and loops, property reads, functions across frames, enter-frame and keyboard listeners, seeded random, ADR 0052)~~ ✅. The full language, the `flash.*` API and SWF bytecode are not planned. |
|
||||
| **M7** | Advanced animation | ~~Bone/IK tool~~ ✅ first slice (ADR 0043: symbol-instance armatures on an armature layer, Bone tool, joint-angle poses tweened with easing, CCD inverse kinematics with joint limits and pins, posing with the Selection tool, Bone properties, every export; not yet: outline-following ARAP meshes, symbols, pins bound to bones, a GPU textured path, bent bitmaps in HTML/Lottie); ~~springs, joint translation, editing members in place~~ ✅ second slice (ADR 0084); not yet: runtime armatures, XFL armature import); ~~shape armatures~~ ✅ first slice (ADR 0071: bones inside one shape, automatic binding, linear blend skinning, Bind tool); ~~painted weights and reshaping a bound shape~~ ✅ second slice (ADR 0090; not yet: reshaping at a posed frame); ~~mixed armatures: symbol instances and shapes in one armature~~ ✅ (ADR 0098: bones inside a shape and bones that move instances or whole shapes in one armature, several skinned shapes, chains across the kinds with the Bone tool, one pose for IK, tweens, springs and translation, file format version 4 only for documents that use it; not yet: joining two armatures, joining a whole shape from a shape's bone by dragging, XFL import of armatures); ~~asset warp~~ ✅ first slice (ADR 0079: warp meshes on shapes and bitmaps, pins, rigid MLS, pin poses tweened, Asset Warp tool, ~~camera layer with depth~~ ✅ first slice (ADR 0027: one camera layer per scene, pan/zoom/rotate/tint, classic and motion tweens, pan-only layer depth, Camera tool, Preview Through Camera, every export); ~~layer depth in perspective, keyed over time, Layer Depth panel, attaching layers, camera colour effects, editing while previewing~~ ✅ second slice (ADR 0082; not yet: tools other than Selection while previewing, depth inside symbols, XFL camera import); ~~variable-width strokes~~ ✅ first slice (ADR 0018: width profiles, Width tool, exports, tweens); ~~Brush tool~~ ✅ first slice (ADR 0033: filled sweeps, tips, pressure, Paint Normal/Fills/Behind; not yet: Paint Selection/Inside); ~~brush library, pressure curves and the Paint Brush~~ ✅ first slice (ADR 0068: parameter presets, user brushes and brush sets, curve editor, velocity, stroke mode); ~~Eraser and Eyedropper~~ ✅ first slice (ADR 0034: five erase modes, Faucet, Erase Everything; picks solid, gradient, bitmap and line styles) and brush library; ~~tilt, textured brushes, erasing inside symbols, gradients and width profiles in the merge~~ ✅ second slice (ADR 0093: tilt turns and widens the tip per sample, paper-grain texture and scatter as vector paint, Charcoal and Spatter, the Eraser's hint for symbols and objects, width profiles carried into each merged piece; not yet: reading tilt on desktop systems (winit 0.30 reports it only on iOS), bitmap, art and pattern brushes, eraser pressure and presets, the live preview through texture and tilt); ~~graph-based easing presets library~~ ✅ first slice (ADR 0081: presets, custom multi-segment eases, saved eases, per-group classic eases, Motion Editor properties, XFL import; not yet: updating every tween that uses a saved ease, a user ease library shared between documents, Lottie-native eases instead of baked frames, motion-tween eases from XFL); ~~layer parenting~~ ✅ first slice (ADR 0113, #388: a layer follows the first object on its parent layer through position, rotation, scale and skew, chains, the timeline's parenting view with draggable dots and a parent menu, parenting keeps the stage position in one undo step, followers edited in stage space, every export; not yet: a parent that changes over time, Edit Multiple Frames and motion path editing in stage space on a follower, armature layers as followers, XFL import (no public format description)). |
|
||||
| **M8** | Release quality | ~~**Several documents open at once**~~ ✅ first slice (ADR 0112, #420: a tab per open document above the edit bar, with a dot for unsaved changes and a close button; click, middle-click, drag to reorder, right-click Close / Close Others / Close All / show the file; Ctrl+Tab, Ctrl+PageDown, Ctrl+W, Ctrl+Alt+W; each tab its own session, undo history, selection, playhead, view and Motion Editor state; New, Open, recent files, drops and restored copies open a tab, a file already open is shown; closing a tab with unsaved changes asks, quitting asks once for all; one recovery copy per open document; paste across documents brings symbols, bitmaps and sounds, renamed on a clash; a document not shown keeps no render caches; next: tearing a tab off into its own window, another document's Library in the Library panel, reopening last session's documents, a shared undo budget); ~~Installers and signing for Windows/macOS/Linux~~ ✅ first slice (ADR 0026: family `packaging/` layout, MSI, DMG, AppImage/deb/rpm/Flatpak/tar.gz, `.anicraft` registered everywhere, signing wired to the release environment; ~~opening documents from Finder~~ ✅ (ADR 0062, to be checked on a Mac); ~~AppImage desktop integration, portable mode, store readiness checks~~ ✅ (ADR 0094); next: store submissions); ~~web build (wasm) of the editor~~ ✅ first slice (ADR 0036: browser file picker and downloads, autosave in browser storage, CPU stage, CI wasm build and tests in Node, the release zip made by `packaging/web/package.sh` and checked in CI (#210); next: releases carrying it and a hosted copy, once the team decides where, Web Audio, WebGPU stage, verified in browsers); ~~localisation~~ ✅ first slice (ADR 0040: `tr!` everywhere in the shell, craft-i18n catalogs, Preferences language, pseudo-locale; next: AniCraft's catalog in craft-i18n, engine messages, right to left once egui can lay it out); accessibility: first pass ✅ (ADR 0022: screen-reader names for every control, Ctrl+F6 panel focus, high-contrast theme, 200 % scale), second pass ✅ (ADR 0064: stage elements and timeline frames for screen readers, keyboard selection on the stage, keyboard menu bar, following the system's contrast setting), ~~a light theme~~ ✅ (ADR 0077: Light palette, Follow system for light or dark, #227), next: live screen-reader passes on each platform, a light high-contrast palette; ~~crash-recovery autosave~~ ✅ (ADR 0015); ~~Find and Replace and the Movie Explorer~~ ✅ first slice (ADR 0058: `find.search`/`find.replace`/`find.goto` over text, fonts, colours, symbols, sounds and bitmaps, scene or document, linear-time patterns, Replace All as one undo step asking above 100 places, going there opens symbols in place; `explorer.tree` paged, Show filters and search, the Movie Explorer tab beside the Library, lists drawing only the rows in view; not yet: action parameters and ActionScript strings apart from code, font size and style, colour tolerance, renaming in the Movie Explorer); ~~files from the desktop, recent files and a start screen~~ ✅ first slice (ADR 0059: drops route by type and target in one undo step, Open Recent with pins and missing files, start screen with presets and thumbnails); ~~templates, SVG into the Library, drops on the timeline~~ ✅ first slice (ADR 0065: six built-in templates built in code, Save as Template with category and picture, SVG as a graphic symbol, sounds onto a frame's keyframe and media into a keyframe made there; next: exact desktop drop positions once eframe moves to winit 0.31, user template descriptions and renaming); ~~Publish Settings and Publish~~ ✅ first slice (ADR 0060: the publish profile in the document, every format with its export options and an output relative to the document's folder with `{name}`, Shift+F12 publishing in the background with progress, Cancel and one report, overwriting asked once per session, presets in Preferences, the browser's downloads as one ZIP; not yet: Animate's PublishSettings.xml from XFL, more placeholders, outputs outside the document's folder, progress inside HTML, Lottie and audio); ~~documentation book~~ ✅ first slice (ADR 0069: the user guide in `docs/guide/`, generated command and shortcut references, Help › User Guide offline), ~~search and context help~~ ✅ (ADR 0096: a prebuilt index and an offline search page with the same ranking as `anicraft-cli guide search`; F1, Help › Help for This and each panel menu open the guide at the section for the dialog, panel or tool, through a map checked against the guide's headings; F1 moves from the shortcut editor, which keeps Ctrl+Alt+Shift+K); next: translated guides, a print edition (PDF through the browser; a native PDF proposed in ADR 0096), help for single fields; ~~dockable panels and workspaces~~ ✅ first slice (ADR 0075, #249: every panel docks on any side of the stage, stacks as tabs, resizes, folds, floats in a window of its own with ADR 0062's fallback, closes and reopens wherLine truncated
|
||||
|
||||
@@ -28,7 +28,9 @@ $Shots = @(
|
||||
@("motion-editor", "motion"),
|
||||
@("test-movie", "testmovieinside"),
|
||||
@("publish-settings", "publish"),
|
||||
@("preferences", "prefs")
|
||||
@("preferences", "prefs"),
|
||||
@("audio-to-keyframes", "audiokeys"),
|
||||
@("lip-sync", "lipsynced")
|
||||
)
|
||||
New-Item -ItemType Directory -Force $Out | Out-Null
|
||||
foreach ($s in $Shots) {
|
||||
|
||||
@@ -29,6 +29,8 @@ SHOTS=(
|
||||
"test-movie testmovieinside"
|
||||
"publish-settings publish"
|
||||
"preferences prefs"
|
||||
"audio-to-keyframes audiokeys"
|
||||
"lip-sync lipsynced"
|
||||
)
|
||||
mkdir -p "$OUT"
|
||||
for row in "${SHOTS[@]}"; do
|
||||
|
||||
Reference in new issue
Block a user