Skip to content

Add table support to OSS server#11356

Merged
timsaucer merged 22 commits into
mainfrom
tsaucer/oss-server-tables
Sep 29, 2025
Merged

Add table support to OSS server#11356
timsaucer merged 22 commits into
mainfrom
tsaucer/oss-server-tables

Conversation

@timsaucer
Copy link
Copy Markdown
Member

@timsaucer timsaucer commented Sep 27, 2025

This PR adds support for lance tables in the OSS server, similar to the existing support for Rerun datasets.

Users can add a --table file_path option to provide a path to the table location.

Additionally it creates the __entries table that is required for using the dataframe APIs.

Unit tests were updated and verified to match the redap server.

This is an enabling feature for ongoing work such as catalog providers where we need to use the OSS server in CI.

@timsaucer timsaucer self-assigned this Sep 27, 2025
@timsaucer timsaucer added include in changelog dataplatform Rerun Data Platform integration labels Sep 27, 2025
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Sep 27, 2025

Web viewer built successfully.

Result Commit Link Manifest
867bed5 https://rerun.io/viewer/pr/11356 +nightly +main

Note: This comment is updated whenever you push a commit.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Sep 27, 2025

Latest documentation preview deployed successfully.

Result Commit Link
867bed5 https://landing-1cb75f5mu-rerun.vercel.app/docs

Note: This comment is updated whenever you push a commit.

@timsaucer timsaucer requested a review from abey79 September 28, 2025 20:22
@abey79
Copy link
Copy Markdown
Member

abey79 commented Sep 29, 2025

"Blocked" on #11361 ;)

Copy link
Copy Markdown
Member

@abey79 abey79 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great stuff! I've left a bunch of comments, some of which might be out of scope. I'll let you judge :)

Comment thread crates/store/re_server/src/store.rs
Comment thread crates/store/re_server/src/store.rs Outdated
Comment thread crates/store/re_server/Cargo.toml
Comment thread tests/assets/table/.gitattributes
Comment thread deny.toml
{ name = "cargo_metadata" }, # Older version used by ply-rs. It's small, and it's build-time only!
{ name = "core-foundation" }, # Currently, e.g. `webbrowser` and `winit` use different versions.
{ name = "core-graphics-types" }, # wgpu requires 0.2 while winit is still on 0.1
{ name = "event-listener" }, # remove after https://github.com/lancedb/lance/pull/4834 closes
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

again, by using #TODO(#issue) format, it gets picked up by our zombie todo script

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think adding an issue to track this one is necessary since CI will fail as soon as the exception is no longer encountered

Comment on lines 1115 to 1121
&self,
_request: tonic::Request<RegisterTableRequest>,
) -> Result<tonic::Response<RegisterTableResponse>, tonic::Status> {
Err(tonic::Status::unimplemented(
"register_table not implemented",
))
}
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any chance for a quick stab at this? This PR would love it :)

Comment thread crates/store/re_server/src/rerun_cloud.rs Outdated
Comment thread crates/store/re_server/src/rerun_cloud.rs
@timsaucer timsaucer marked this pull request as ready for review September 29, 2025 12:28
@timsaucer timsaucer merged commit 21753bb into main Sep 29, 2025
41 checks passed
@timsaucer timsaucer deleted the tsaucer/oss-server-tables branch September 29, 2025 14:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants