Skip to content

Commit

Permalink
Merge branch 'feature/damian/fb_kv_cache' of https://github.com/neura…
Browse files Browse the repository at this point in the history
…lmagic/deepsparse into feature/damian/fb_kv_cache
  • Loading branch information
dbogunowicz committed Jul 7, 2023
2 parents 042cb79 + b737f77 commit bf4eac3
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/deepsparse/transformers/engines/nl_decoder_engine.py
Original file line number Diff line number Diff line change
Expand Up @@ -165,7 +165,7 @@ def transfer_cache_state(self, cache: DecoderKVCache):
information from another NLDecoderEngine. Call this method when
you want to transfer the kv cache state from one engine to another.
:param cache: The `NLDecoderEngine` to transfer the kv cache state
:param cache: The `DecoderKVCache` object to transfer to the engine
from
"""
self.kv_cache = copy.deepcopy(cache)
Expand Down

0 comments on commit bf4eac3

Please sign in to comment.