Gettings "too many open files" crashes in large modpacks on linux

[Libadoxon]

I'm currently making a large (300+ mods) forge modpack and wanted to add some fabric mods I like to it. Sadly this causes crashes. It is always that java complains about not finding a file with the reason "too many open files", this implies it reaches the soft nofile limit on Linux, which is 1024 for me. The actual file it complains about varies that why I believe its a general issue with connector instead of a specific incompatibility. The interesting part is, that it seems to only happen if I have around 250+ mods installed (as in actual files, minecraft reports around 300), I also don't need an fabric mod, just adding connector is enough. I also tried to increase the nofile limit using prlimit but to no avail. This issue only happens on Linux, on a Windows machine the modpack starts fine. Im also on the 1.20.1 version, so maybe this is fixed already, I just hadn't had time to create a 1.21 mock version