`No store specified, cannot load blob from storage` errors at startup

[ldt1996]

Bug Summary

Blob records fail to decode at startup with "No store specified, cannot load blob from storage"

Reproduction Repository (if applicable)

https://github.com/HarperFast/harper-qe-logbook/tree/main/v4-to-v5/upgrade-test-component

Steps to Reproduce

1. Run a v5 node (RocksDB engine) that receives replication data at startup. For example, a node just migrated from v4 to v5 that is rejoining a cluster with blob tables.
2. Watch the logs for the first minute after startup.

Expected Behavior

Records with blobs decode normally at startup. No decode errors.

Actual Behavior

The log shows about 58,000 "Error decoding record: No store specified, cannot load blob from storage" errors in the first 64 seconds after startup. After that the errors stop. The affected records decode to null.

Platform

Harper v5.0.21, RocksDB storage engine. The node was migrated from v4. It replicates with v4 (4.7.32) peers.

Console Errors

Error decoding record Error: No store specified, cannot load blob from storage
at Array.unpack (resources/blob.ts:1089:11)
at readExt (msgpackr/unpack.js:911)
at read (msgpackr/unpack.js:332)
at checkedRead (msgpackr/unpack.js:190)
at RecordEncoder.unpack (msgpackr/unpack.js:97)
at get (msgpackr/struct.js:650)
at LazyObject.value (msgpackr/struct.js:734)
data: 0e0020104279e055a3...

Screenshots or Videos

No response

Additional Context

All errors happen in the first 64 seconds of startup and do not come back. Partway through, logging is throttled with "Maximum log buffer rate reached, logs will be throttled."

Are you planning to fix this issue?

Maybe, depending on complexity