⚡ Fanout Diffusion: 1-Step Generative Query Expansion

1-Step EDM Consistency Model with 1-Bit MMA Tensor Core Transformer

Generate 10 semantically aligned, diverse subquery expansion slots in < 1 millisecond (0.33 ms native CUDA MMA, ~1.2 ms CPU ONNX).

Root Query

Initial Noise Sigma (Diversity)

40 120

Inference Performance & Semantic Metrics

Model Latency (1-Step)

Query Embed Time

Mean Alignment

Slot Diversity

Decoded 10-Slot Subquery Expansions

Examples