You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi thanks for sharing the excellent work. I wonder how the feature re-use is performed. As mentioned in your paper, feature reuse brings a huge gain, but I can not find the corresponding code for this part. From the paper, I am not sure if the feature re-use is performed just before self-attention or just before FFN.
The text was updated successfully, but these errors were encountered:
Hi thanks for sharing the excellent work. I wonder how the feature re-use is performed. As mentioned in your paper, feature reuse brings a huge gain, but I can not find the corresponding code for this part. From the paper, I am not sure if the feature re-use is performed just before self-attention or just before FFN.
The text was updated successfully, but these errors were encountered: