【kv cache merge】 I want to know if the result of calculating their respective k v cache and concatenating them together is correct

I have two prefixes, sequence1, sequence2, which are often used. I want to know if the result of calculating their respective k v cache and concatenating them together is correct

1 Like

@John6666 cc

1 Like

Yeah…
I’m not familiar with KV cache…

haa,thank you, you are so active in the community

1 Like

Basically, most of HF’s active users are on Discord.
I’m volunteering to fill in the blanks because there’s no connection between there and there.
I can’t help what I don’t know…