So I’ve tried to mess around with the settings for the last time and found out that turning off the safe browsing feature helps dramatically with the loading time.
This is not ideal tho, I’d still like the protection Brave offers. Don’t know if I haven’t turned something else off aswell, but turning safe browsing on definitely causes the issue.
I’m unable to diagnose this issue further, but I can provide anything I can to people that are willing to dig deeper into this and hopefully solve the issue.