CPU usage on the node is low? That config is giving SpiceDB a hard limit of a 10th of a core, which is not much. In general, I wouldn't recommend setting CPU limits unless you're using static CPU management and setting them to a whole number, à la:
https://kubernetes.io/blog/2018/07/24/feature-highlight-cpu-manager/