cuda OOM

[fishfl]

nv RTX 3060 with 6gb mem,

follow the guide of control net and try to run the script:
python gradio_canny2image.py

And I got this:
File "D:\lib\conda_env\control\lib\site-packages\torch_utils.py", line 78, in _cuda
return torch.UntypedStorage(self.size(), device=torch.device('cuda')).copy(self, non_blocking)
RuntimeError: CUDA out of memory. Tried to allocate 58.00 MiB (GPU 0; 6.00 GiB total capacity; 5.23 GiB already allocated; 0 bytes free; 5.32 GiB reserved
in total by PyTorch) If reserved memory is >> allocated memory try setting max_split_size_mb to avoid fragmentation. See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF

6gb is not allowed to run this? any solutions?