I have a question regarding tracing and SpiceDB #spicedb

I have a question regarding tracing and

Will Thornton

11/27/2023, 7:51 PM

I have a question regarding tracing and the rough level of instrumentation - we seem to be missing detail regarding ~90% of the overal excution time of a trace. Any clue as to what is happening during this time? https://cdn.discordapp.com/attachments/844600078948630559/1178785200952590456/Screenshot_2023-11-27_at_19.49.18.png?ex=65776844&is=6564f344&hm=b14587f31b43c821d43b0f06d6bd5abde5f57f5134ea9e1eff330f9f254cae40&

ecordell

11/27/2023, 7:52 PM

what version of spicedb are you running? 1.27.0 introduced a bunch of improvements to the emitted trace events

Will Thornton

11/27/2023, 7:53 PM

v1.27.0

Will Thornton

11/27/2023, 7:54 PM

This particular missing execution time is consistent across all traces of this kind

ecordell

11/27/2023, 8:04 PM

interesting, would you mind filing a github issue? looks like we're dropping some event on the floor

ecordell

11/27/2023, 8:05 PM

you should be seeing that fan out via dispatch

ecordell

11/27/2023, 8:05 PM

and that should account for the rest of the time

ecordell

11/27/2023, 8:05 PM

the span context for the trace must be getting severed inadvertantly

ecordell

11/27/2023, 8:06 PM

(you should find traces for the same time period for

DispatchLookup

if you need that info before we fix this)

Will Thornton

11/27/2023, 8:12 PM

Of course - I'll link it once I am done

Will Thornton

11/27/2023, 8:17 PM

Will Thornton

11/27/2023, 8:18 PM

Very rough issue as I am not sure what other details to give - if you want me to add any additional detail let me know

Joey

11/27/2023, 8:27 PM

Lookup resources is streaming async

Joey

11/27/2023, 8:27 PM

It won’t have the same traces

Joey

11/27/2023, 8:37 PM

We’ll have to see if they can be connected