Is your feature request related to a problem or challenge?
I'm working with the object_store folks on upstreaming DataFusion's ObjectStoreRegistry implementation. Part of the goal is that DataFusion would adopt this new registry. I want to check with y'all that the object_store version meets your needs.
The PR is here:
apache/arrow-rs-object-store#348
The implementation is largely the same, but there have been a few tweaks:
- Replaced
dashmap with an RWLock+HashMap to remove dashmap dependency
- Remove
ObjectStoreUrl
- Add
list_urls method
- Use
object_store::parse_url to create an ObjectStore on get_store cache miss (if possible)
- Adds registry tests
- Minor doc updates
get_store returns an Option now instead of Result
Would you guys be open to adopting this new version?
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response
Is your feature request related to a problem or challenge?
I'm working with the
object_storefolks on upstreaming DataFusion'sObjectStoreRegistryimplementation. Part of the goal is that DataFusion would adopt this new registry. I want to check with y'all that theobject_storeversion meets your needs.The PR is here:
apache/arrow-rs-object-store#348
The implementation is largely the same, but there have been a few tweaks:
dashmapwith an RWLock+HashMap to removedashmapdependencyObjectStoreUrllist_urlsmethodobject_store::parse_urlto create anObjectStoreonget_storecache miss (if possible)get_storereturns anOptionnow instead ofResultWould you guys be open to adopting this new version?
Describe the solution you'd like
No response
Describe alternatives you've considered
No response
Additional context
No response