-
-
Notifications
You must be signed in to change notification settings - Fork 1.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Updating to mailcow 2024-01e with Docker 25.0.3 breaks iptables / UFW usage on Debian 10 #5735
Comments
Maybe thats helpful too: These updates have been installed today alongside with mailcow:
|
Had a similar problem... What i did:
|
Tried your approach step by step – unfortunately this did not change anything for me. The issue persists. 😥 |
Maybe your problem is ufw, i don't use it in my setup... |
I don't think so as UFW uses its own chains. But I could find some other hint while playing around with docker daemon and mailcow. After shutting down mailcow, reloading UFW and restarting the docker daemon the docker daemon was not coming up again. I found this on the log: I could "fix" it temporarily by setting |
I've had a similar case. My mailcow currently is on
After some research in the logs I found out the following:
After verifying the rule I think that moby/moby#47303 has something to do with it. That's the pull request regarding to the change log entry The error message from the logs come from here Upgrade of mailcow to |
If you encounter Problems, please try to set iptables: nftables: |
Thanks for clarifying this. So does this mean there will be no "fix" for this issue (is it an issue within mailcow then?) and the only solution to this problem is to disable the netfilter isolation rule? |
I'm experiencing the same/similar (?) issue, but don't have ufw installed, only nftables. netfilter container is also restarting every x seconds
I've not made changes to /etc/nftables.conf |
Can reproduce on Debian 10 and Ubuntu 22.04 using the steps described in original issue. The usage of ufw does not affect the end result. Suggested workaround of settings DISABLE_NETFILTER_ISOLATION_RULE to Y has an effect as long as no SNAT has been set. If SNAT has been set it appears that there is also a incompatability on the nat table.
Mailcow's Netfilter seems to be breaking compatibility with nftables to iptables translation layer both for filters and network address translation. |
I had the same issue #5798 but was able on one of my servers, to fix it, with reoving old rules from |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. |
Is this the official solution for this issue or is there something in the pipeline for an upcoming release? Can a maintainer please clarify this? |
I have the same issue on debian bullseye (11). The workaround suggested by FreddleSpl0it did not work for me. |
Experiencing the same issue on Ubuntu 24.04. The iptables rules duplicate due to the restarts and the server gets unresponsive due to the many rules after a few hours (~10 hours) |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. |
It would also be really nice if a maintainer would comment on this. Sitting it out and automatically closing existing problems will not solve them. |
I'd also like to see an end to the automatic closing of issues. |
Is there anything new here? I have exactly the same problem ... |
That helped me on Ubuntu 24.04 too with even nftables was installed. |
@codiflow Debian 10 is EOL after 5 years being in production. You should really consider upgrading your OS (to 11 then 12) to be able to run modern software on it smoothly and keep your system secure. |
This is not a mailcow issue and can be closed I think @DerLinkman . |
I am using the latest Debian 12 (bookworm) and have the same problem. I think it is a mailcow problem ... |
I would confirm your assumption. Saying that this is not a Mailcow problem without investigating is just as strange as automatically closing the issue, @apio-sys . |
I don't agree, it's a setup/configuration issue of your OS not a mailcow issue. In Debian 12, nftables is used as the default UFW backend. So maybe you don't have a default setup and changed some stuff before installing mailcow. See prereqs here https://docs.mailcow.email/getstarted/prerequisite-system/ . @Fighter456 I'm not just saying this, I can confirm that with a default Ubuntu 22.04 and 24.04 and Debian 12 setup, all works as expected hence it is not a mailcow issue but simply that some people missed the prereqs. The initial post here talks about Debioan 10 which is EOL since and I don't think we want to waste any time on EOL setups. I suggest anybody experiencing this on a default setup and following prereqs as described could open a new question. The answer of @erichk4 solve the issue here. |
The problem was proven to have occurred with the initial update mentioned and has never been investigated since then. I am against closing the issue. It doesn't matter whether it concerns Debian 10 or Debian 11 or Debian 12. A problem is a problem. Moving it to another issue with the same information doesn't change anything. And I have the problem on a standard Debian 12.
As you can read a few words ago, it is also a current problem on non-EOL systems. But: What is your position with the Mailcow organization to make such a decision? |
The prereqs in my system are implemented or apply as described there and yet there is still a problem ... I don't think it's a problem with the OS |
I don't make any decisions, I just try to contribute to a great FOSS project. Hence I SUGGESTED to close the issue with an IMHO. If you want to keep it open or investigate, then please feel free to contribute @codiflow and @Fighter456 . And of course it does matter which version of the OS is used since Debian 10 is out of scope as stated here: https://docs.mailcow.email/getstarted/prerequisite-system/#supported-os . |
Instead of making useless suggestions or being an issue sheriff, use your time, contribute to the project and solve the problem. 😉 As has been said to you several times, the problem continues to occur on non-EOL systems. How would you like to help me and the others with the problem, @apio-sys? |
If you want to help, try and reproduce it on a clean system. Saying it doesn't work on Debian 12 or Ubuntu 24.04 doesn't help nobody and is totally useless. I have (re-)confirmed manually that it does on a fresh installation. Hence you have a local/conf issue and that becomes a support issue which this is not the place for. You can go to commercial support or the community forum for that. My suggestion to close this still holds since this is no longer relevant and there have been a lot of releases since. But don't worry, I won't bother you any longer. |
Why it is useless? It does not work properly after upgrading MailCow to
Please clarify what you unterstand unter a clean system. Why do you assume that those involved with the problem do not have a clean system? How does it help those (if this is done and it works) who have the problem on their unclean system? I never said that the problem is not on my side and I am willing to spend money. But as long as no one offers to help, I can only throw money away. However, since several people have reported the problem, your statement is more than questionable. We cannot always set up a fresh system to get around a problem when there are problems. Would you, dear @apio-sys , like to earn money and solve the problem? Without reinstalling, of course. |
No I would not like to earn money to solve the problem. A solution has been given by @erichk4 and confirmed working for others also. Hence case closed. IMHO. |
Then why do you write in your feedback from 11 Feb
? |
You've read the sentences above this one and understood them? Apart from unnecessary notifications, I don't see any progress here through your comments. You skillfully avoid questions and don't answer them. |
This clean system talk does not bring us one step forward or close to a solution ... my system is a standard system, there are no fundamental changes to it; moreover, nothing is mentioned in the requirements about a clean system, my system fulfills all requirements there > so mailcow must run completely and without errors or there is a problem with mailcow |
Apart from Debian 10 being EOL (which indeed is true) the initial problem is most likely related to changes within the mailcow update mentioned in my first post. And the steps mentioned by @erichk4 to fix this did not resolve my issue. I had to disabled the netfilter rules with the ENV variable. As the server will be decomissioned soon for several reasons (Debian 10 being EOL is only one of them) I will not dig deeper into it. But I'm backing @Fighter456 's opinion that closing an issue which is not really solved should not be the way to go here. So better leave this open and add a flag like "information needed" or "tests needed" to make clear that this issue still persists even if two possible workarounds exist. Maybe this issue should concentrate on fixing the issues with the Debian 12 users from now on? |
Contribution guidelines
I've found a bug and checked that ...
Description
Updating my machine like usual to the newest mailcow 2024-01e (and I think there was also a docker update) broke my UFW / iptables setup on one of my servers which is using Debian 10.
If I shutdown the mailcow container and reboot the machine everything is fine and I get an output from
iptables -L
and also fromufw status
I have two other docker containers on the same machine and they are working fine. I tried several combinations like shutting down all containers, reboot, check ufw/iptables and starting only other containers and not mailcow, reboot, check ufw/iptables.
The result was clear:
As soon as I start the mailcow docker containers with
docker compose up
both outputs break and also the firewall functionality. I can only bring it back by shutting down mailcow, reenabling UFW withufw enable
, restarting the machine and reenabling UFW again withufw enable
.Maybe the issue has to do with the Netfilter Enhancements like stated here?
Logs:
docker compose logs -t -f
https://paste.armbian.com/izeqepuzim.yaml
(text was too long)
Steps to reproduce:
Shutdown mailcow with
docker compose down
Reboot machine
Check
ufw status
Output:
iptables -L
Output:
The usual IP tables entries
Now start mailcow with
docker compose up -d
Check
ufw status
Output:
Start
ufw enable
Output:
Check
ufw reload
Output:
Check
iptables -L
Output:
Shutdown mailcow with
docker compose down
Check commands again like above: Same result
Only way to bring everything up again is to either disable ufw with
ufw disable
and reboot the machine or to shutdown mailcow, reenabling UFW withufw enable
, restarting the machine and reenabling UFW again withufw enable
.But I would really like to use both like I did for years now 😅
Which branch are you using?
master
Which architecture are you using?
x86
Operating System:
Debian GNU/Linux 10 (buster)
Server/VM specifications:
32GB RAM, 6 Cores
Is Apparmor, SELinux or similar active?
no
Virtualization technology:
KVM
Docker version:
25.0.3
docker-compose version or docker compose version:
v2.24.5
mailcow version:
2024-01e
Reverse proxy:
nginx
Logs of git diff:
Logs of iptables -L -vn:
Logs of ip6tables -L -vn:
Logs of iptables -L -vn -t nat:
Logs of ip6tables -L -vn -t nat:
DNS check:
The text was updated successfully, but these errors were encountered: