Hi, i am trying to deleterelationships but i wanna...
# spicedbn
n2ndy
03/10/2023, 8:27 AMHi, i am trying to deleterelationships but i wanna do in bulk. So calling the /relationships/delete api in promise.all . But it fails with an error "Max retries exceeded. Could not serialize access due to read/write dependencies among transactions" . Anyone please help how can I achieve bulk delete? I tried using authzed-node also . It gives the same error. Please help. Thanks
v
vroldanbet
03/10/2023, 9:03 AM👋🏻any chances your could share the code you are using to delete, and how you are constructing the delete request?
Are you using mysql or postgres?
n
n2ndy
03/16/2023, 11:21 AMHi @vroldanbet Sorry to respond late. I am using this format {
"relationshipFilter": {
"resourceType": "type",
"optionalResourceId":"id",
"optionalRelation":"member",
"optionalSubjectFilter":{
"subjectType":"user",
"optionalSubjectId":"user"
}
}
} and i am using postgres
n2ndy
03/16/2023, 11:23 AMI am deleting in parallel for different records. when I delete few batches are succeeded , but mostly fails
v
vroldanbet
03/16/2023, 11:25 AMright, that kind of behaviour is expected. We use PostgreSQL with serializable level. If you are doing lots of concurrent writes, PG has to "serialize" all those requests, and that might cause some writes to fail and have to be retried. Generally SpiceDB should retry writes buy perhaps we are missing something with retries in PG datastore.
vroldanbet
03/16/2023, 11:26 AMdo you have an idea of how many deletes you are running in parallel?
n
n2ndy
03/16/2023, 11:27 AMmore than 15k records
n2ndy
03/16/2023, 11:27 AMprocessing through a message queue only but message queue kinda process it in batch i believe.
v
vroldanbet
03/16/2023, 11:31 AMso you are deleting 15K records, but you don't know how many concurrent workers you are running?
n
n2ndy
03/16/2023, 11:45 AMFirst i tried with promise.all (), that was throwing the error
n2ndy
03/16/2023, 11:45 AMthen i have tried with a message queue assuming that will pick one record at a time. but that also throwing the same error.
v
vroldanbet
03/16/2023, 11:47 AMis it possible each write is touching 15K records at a time?
vroldanbet
03/16/2023, 11:47 AMmaybe you could enable debug errors and see if it should more details?
n
n2ndy
03/16/2023, 11:53 AMSure. let me try and get more details.
n2ndy
03/17/2023, 3:51 AMHi @vroldanbet , If i use cockroach db or MySQL would i get the similar kinda issues with serializable level? . Or bulk deletes in concurrent are allowed in those ?
v
vroldanbet
03/17/2023, 8:56 AMSame thing
vroldanbet
03/17/2023, 8:56 AMThey all work at the same isolation level
7 Views