ArXiv Domain 2026-08-31
数据来源:ArXiv Domain
LLM Domain Papers1. TreeGraft: Adaptive Multi-Drafter Grafting for Tree-Based Speculative DecodingAbstract:Speculative decoding accelerates large language model inference through a draft-then-verify paradigm. Building on this, tree-structured methods improve inference by organizing proposals into multiple candidate paths, increasing the accepted length. However, existing tree-structured methods use a single drafter for all drafting steps, creating a dilemma: a smaller drafter ...