数据来源：ArXiv Domain LLM Domain Papers1. A Virtual Member of a Community of Practice for the Society of Petroleum Engineers: From Prototype to DeploymentAbstract:We describe the evolution of a virtual assistant, called ATHENA, designed to support the capture, retrieval, and dissemination of knowledge for members of a Community of Practice (CoP) related to the Oil and Gas sector. An evaluation of a first prototype involving 75 professionals from the Society of Petroleum Engineering (SPE) showed th ...

数据来源：ArXiv Domain LLM Domain Papers1. TreeGraft: Adaptive Multi-Drafter Grafting for Tree-Based Speculative DecodingAbstract:Speculative decoding accelerates large language model inference through a draft-then-verify paradigm. Building on this, tree-structured methods improve inference by organizing proposals into multiple candidate paths, increasing the accepted length. However, existing tree-structured methods use a single drafter for all drafting steps, creating a dilemma: a smaller drafter ...

数据来源：ArXiv Domain LLM Domain Papers1. TreeGraft: Adaptive Multi-Drafter Grafting for Tree-Based Speculative DecodingAbstract:Speculative decoding accelerates large language model inference through a draft-then-verify paradigm. Building on this, tree-structured methods improve inference by organizing proposals into multiple candidate paths, increasing the accepted length. However, existing tree-structured methods use a single drafter for all drafting steps, creating a dilemma: a smaller drafter ...