Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
From NVIDIA Megatron-LM for visibility #18
base: multi-query-attention
Are you sure you want to change the base?
From NVIDIA Megatron-LM for visibility #18
Changes from all commits
08e245d
5b73de7
6701e08
3396356
033d8b0
01945b9
f0161d2
7580748
a61150d
2169674
cb979cf
38873f5
7ef8b3f
5ec1e29
fa8bb59
60d03fd
86df799
cb4ce23
dd876ba
4a756e2
8f19bcd
732a689
43ee4b8
9366f3c
8499f26
3728c67
98abe37
a2b6ee4
8f331e8
cc16182
9a0e78d
7a113e7
3fb5c51
8252432
6c3ada7
f5667db
80e3863
5019bb4
c14d987
79b448a
7053e64
c2d7e2f
759d787
6c49616
ab5624b
cb42680
7adc86e
5747146
655a663
6ac4db0
8d62160
8b0a9b3
56ddf9a
8e21350
a604c95
46b850f
4a47180
dccb6df
eb7418f
8307fcd
0b5bc5e
27c3737
6dade5f
90cd925
bef7771
d0f5aa9
aae7237
b28d445
c290133
522d8a3
f03af48
bbecd08
6a89bc7
3bdae05
e93d566
b6887d3
1ea3918
db0fc33
f218582
fe1640a
1fa9464
fec11a7
6e4e9df
8fc7553
2130890
6664dc6
32949f2
df1418a
f8b7c3f
6151709
3005d02
9ec2337
e5fb1fa
028b777
dcc6634
76f9f48
bf7b978
21924d8
e6f1d81
6562666
0902af0
72008a0
2a8d8af
3f10ff6
71d8ce7
0bda578
ab7f706
77b4bfe
0cffc6b
461b06c
6b78cb1
d350231
cedd415
6b35ca8
63be779
835af44
2c9bcac
905de33
5c0697c
c394f78
cf596b9
640e62f
3eeb932
205f946
d210eb0
811a26a
405135a
fba615f
95be3cb
e79808c
e10a9f4
8e69382
e35818d
dbd2d18
8c666c2
6d8dc80
c45f951
08e80b0
643e60a
8ec4617
5ade91a
1f2d556
e464e94
0fd4617
ede39b8
2065c35
697ea61
075c727
5e23e72
884b087
ad38459
162b82d
32eac88
dcf9e77
d207755
891b8f9
31c23f5
78bef1c
5aceacb
4158084
368f561
c1c19d1
1265399
c025cec
f0d7120
45bf4c1
f5171f2
e38d92a
c31452c
d55d61a
3beefb5
5553fc1
0976661
1585be2
2bad957
12c2696
3428cd9
b3375a0
5b7374a
6ad11b0
ca6d170
dddecd1
5ab659b
3efa8c2
f07581b
85cd99b
858694f
065260b
f76b465
25f7da2
50042ff
4d5f94d
2aaf85d
c02b335
ee9dba2
fde8bb1
843a22e
b98ec86
827d5b6
31fe61a
e2a1c52
0acda93
2f9ac3c
edb51fc
cf0d855
0e6bef1
6939737
73e7b58
6ca379e
ff5cee9
a559ec1
3f90b98
e108535
3f43927
fbdc916
b1218b9
5776d06
bf74129
0e3eaa5
fcdbf90
37a2116
228dc20
f462160
7e90ec0
566d9cd
b60f5d0
13c39ac
47bb8d1
8c018ca
772faca
831d64d
4876ee1
bc4874c
6bafe92
a30d63b
0d89fc4
33d2f45
55622ff
cba8bdc
ecf0dbe
839dff2
b7814bb
a9c16c5
02d1762
6adf0bd
db6cb4e
2c950a5
739177e
d28e26e
db7d37b
File filter
Filter by extension
Conversations
Jump to
There are no files selected for viewing