Skip to content

Commit

Permalink
Update src/deepsparse/transformers/engines/nl_decoder_engine.py
Browse files Browse the repository at this point in the history
  • Loading branch information
dbogunowicz authored Jul 7, 2023
1 parent e81c327 commit b737f77
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/deepsparse/transformers/engines/nl_decoder_engine.py
Original file line number Diff line number Diff line change
Expand Up @@ -165,7 +165,7 @@ def transfer_cache_state(self, cache: DecoderKVCache):
information from another NLDecoderEngine. Call this method when
you want to transfer the kv cache state from one engine to another.
:param cache: The `NLDecoderEngine` to transfer the kv cache state
:param cache: The `DecoderKVCache` object to transfer to the engine
from
"""
self.kv_cache = copy.deepcopy(cache)
Expand Down

0 comments on commit b737f77

Please sign in to comment.