All issues

Search results

Create a SpeculativeCacheManager

enhancementNew feature or requestNew feature or request

new-cache-class

Status: Open.

Feature

#6 In cattomantis/cleave;

· nasheedyasin opened on Feb 28, 2025

Optionally exclude the MLP from the Adapter

enhancementNew feature or requestNew feature or request

Status: Open.

Feature

#4 In cattomantis/cleave;

· nasheedyasin opened on Feb 26, 2025

Create a CleavedAutoModelForCausalLM to implement handle early exit mechanism from the kangaroo paper

new-model-class

Status: Open.

Feature

#1 In cattomantis/cleave;

· nasheedyasin opened on Feb 26, 2025