Discord contacts can not be reached, after removing and adding them again

[TomTheDragon]

I am connected to my discord acc over the bridge and i had no problems to chat to everyone on my contact list so far, but i unfortunately removed one of the virtual contacts on the matrix side by accident
I tried adding it again by entering his id (@discord_DISCORDUSERID:HOMESERVER) and he did show up in the search, but when i message him, nothing reaches on the discord side, but his name/icon seems to get updated
I also tried to log out and in my discord acc on the bridge and to restart the bridge, but nothing seemed to fix the problem so far

[TomTheDragon]

I did some more testing and it seems that i can remove almost every Discord contact in my list, since if its gone, i will receive a invention for a new room again after a new message from that specific account got send.
But i do have a hand full of contacts with which this is not working. I also tried using double-puppeting but did not fix my problem.

I also get errors like those in the console, when ever someone tries to send me something:

2024-03-12T01:21:41Z ERR Failed to send part of message to Matrix error="failed to ensure joined: failed to PUT /_matrix/client/v3/rooms/!xxxxxxxxxxxxxxxxxxxxxx:server.de/state/m.room.member/@user:server.de: M_UNKNOWN (HTTP 404): Can't join remote room because no servers that are in the room have been provided." action="discord message create" attachment_id= author_id=92777019607121920 channel_id=641364695282089986 channel_receiver=92777019607121920 message_id=1216919011804184586 message_type=0 part_index=0 room_id=!xxxxxxxxxxxxxxxxxxxxxx:foxyden.eu

2024-03-12T01:21:41Z WRN All parts of message failed to send to Matrix action="discord message create" author_id=92777019607121920 channel_id=641364695282089986 channel_receiver=92777019607121920 handling_time=36.861077 message_id=1216919011804184586 message_type=0 room_id=!xxxxxxxxxxxxxxxxxxxxxx:server.de