feat(litdata): Better support for filestore & co

[tchaton]

Before submitting

• Was this discussed/agreed via a Github issue? (no need for typos and docs improvements)
• Did you read the contributor guideline, Pull Request section?
• Did you make sure to update the docs?
• Did you write any new necessary tests?

This PR resolves the reading speed of using filestore & co with LitData.

Before:

After:

┌────────┬───────────────┬─────────┬───────────┬───────────┬────────────────────────────────────┬──────────────────────────────────────────────────────────────────────────────────┐
│ Cache  │ Throughput    │ Time    │ Samples   │ Storage   │ Bucket                             │ Dataset                                                                          │
├────────┼───────────────┼─────────┼───────────┼───────────┼────────────────────────────────────┼──────────────────────────────────────────────────────────────────────────────────┤
│ COLD   │        55.6/s │   14.4s │       800 │ Filestore │ filestore3                         │ v01-21-26-4k-yusen-tti-rosbags-0126-128MBuncompressed-uint8fp16                  │
├────────┼───────────────┼─────────┼───────────┼───────────┼────────────────────────────────────┼──────────────────────────────────────────────────────────────────────────────────┤
│ WARM   │        55.5/s │   14.4s │       800 │ Filestore │ filestore3                         │ v01-21-26-4k-yusen-tti-rosbags-0126-128MBuncompressed-uint8fp16                  │
├────────┼───────────────┼─────────┼───────────┼───────────┼────────────────────────────────────┼──────────────────────────────────────────────────────────────────────────────────┤
│ WARM   │        58.8/s │   13.6s │       800 │ Filestore │ filestore3                         │ v01-21-26-4k-yusen-tti-rosbags-0126-128MBuncompressed-uint8fp16                  │
└────────┴───

What does this PR do?

Fixes # (issue).

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in GitHub issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

[dhedey]

Nice! 👍

[codecov]

Codecov Report

❌ Patch coverage is 50.00000% with 8 lines in your changes missing coverage. Please review.
✅ Project coverage is 80%. Comparing base (743ca75) to head (8f1de08).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files

@@         Coverage Diff         @@
##           main   #785   +/-   ##
===================================
- Coverage    80%    80%   -0%     
===================================
  Files        52     52           
  Lines      7373   7386   +13     
===================================
+ Hits       5915   5921    +6     
- Misses     1458   1465    +7     

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.