GPT4All Average: Error: File does not exist%

[mann1x]

I got this error:

GPT4All
Average: Error: File does not exist%

Here's the gist: https://gist.github.com/mann1x/0d00ee36e091984a714de0d5c742f625

Now I'm running it on another model, forgot to launch it with the debug option to leave the pod running.
Will try to capture the logs before it's too late.

[CrispStrobe]

issue is:

The repository for super_glue contains custom code which must be executed to correctly load the dataset. You can inspect the repository content at https://hf.co/datasets/super_glue.
You can avoid this prompt in future by passing the argument `trust_remote_code=True`.
Do you wish to run the custom code? [y/N] Traceback (most recent call last): 
 ...
ValueError: The repository for super_glue contains custom code which must be executed to correctly load the dataset. You can inspect the repository content at https://hf.co/datasets/super_glue.
Please pass the argument `trust_remote_code=True` to allow custom code to be run.

easily fixed by exporting HF_DATASETS_TRUST_REMOTE_CODE=1 CrispStrobe@1b9c902

also i encountered (for one peculiar model) a problem with crash (of all tasks) because bfloat16 was not supported (RuntimeError: "triu_tril_cuda_template" not implemented for 'BFloat16'), was easily fixed of course master...CrispStrobe:llm-autoeval:master