Hi jonas,
I don't know if you didn't do it correctly, but I am almost sure you didn't use the advanced rules (Direction ... = Flowing ...) and you also didn't follow the link I sent you about source and destination (In your situation you need at least 4 rules for 1 port)
Plus you also combine "reserving VoIP" (1 port)with an "RTP" rule (for all ports), so I am not surprised it doesn't work.
When using QoS, you should try to limit it's use more specifically to the port that it's intended for (without overlapping each other) so preferably do not use rules for all ports.
For example ... with your rules, when you take a hot shower and someone else opens another hot water tab, you will be screaming

, because your hot water flow is overlapping and not separated
Greetings,
John