Hi ,
we are using SpiceDB operator with spicedbv1.28.0. we have been doing load test on this version for past two months or so.
recently from past 1 0 days while doing load test, we are facing this error frequently "rpc error: code = Unknown desc = connection error: desc = "transport is closing"".
this error is coming for every other minute and the memory consumption shoots up which brings all pods of spicedb down cause of OOM.
we havent changed neither changed any code nor any configuration.for context we have been running the same load test last month and we haven't faced this issue before.
here are the list of errors which we are getting receiving on the client side during the load test.
"Error: 14 UNAVAILABLE: closing transport due to: connection error: desc = "error reading from server: EOF", received prior goaway: code: NO_ERROR, debug data: "max_age"
Error: 14 UNAVAILABLE: error reading from server: EOF"
"Error: 1 CANCELLED: context canceled"
please help me understand why we are facing this error now.
https://cdn.discordapp.com/attachments/844600078948630559/1209839935935352852/image.png?ex=65e8623e&is=65d5ed3e&hm=e7b9be8c54fbb78fefc890115aa8a8fd01adcf7d588b843019f0da97c8311b0f&