Skip to content

Comments

feat(bulk): add HNSW vector index support to bulk loader#9598

Open
shiva-istari wants to merge 3 commits intomainfrom
shiva/bulk-vector-index
Open

feat(bulk): add HNSW vector index support to bulk loader#9598
shiva-istari wants to merge 3 commits intomainfrom
shiva/bulk-vector-index

Conversation

@shiva-istari
Copy link
Contributor

@shiva-istari shiva-istari commented Feb 11, 2026

Description
Adds HNSW vector index support to Dgraph's bulk loader, enabling bulk loading of vector predicates with automatic index construction.

Checklist

  • The PR title follows the
    Conventional Commits syntax, leading
    with fix:, feat:, chore:, ci:, etc.
  • Code compiles correctly and linting (via trunk) passes locally
  • Tests added for new functionality, or regression tests for bug fixes added as applicable
  • For public APIs, new features, etc., a PR on the
    docs repo staged and linked here. This process can
    be simplified by going to the public docs site and clicking the
    "Edit this page" button at the bottom of page(s) relevant to your changes. Ensure that you
    indicate in the PR that this is an unreleased feature so that it does not get merged into
    the main docs prematurely.

@github-actions github-actions bot added area/testing Testing related issues area/bulk-loader Issues related to bulk loading. go Pull requests that update Go code labels Feb 11, 2026
@shiva-istari shiva-istari force-pushed the shiva/bulk-vector-index branch from 1348296 to b6c53f0 Compare February 11, 2026 14:23
@shiva-istari shiva-istari marked this pull request as ready for review February 16, 2026 17:36
@shiva-istari shiva-istari requested a review from a team as a code owner February 16, 2026 17:36
@blacksmith-sh

This comment has been minimized.

@shiva-istari shiva-istari force-pushed the shiva/bulk-vector-index branch 2 times, most recently from b4ec39b to ebf8d1e Compare February 18, 2026 13:41
@github-actions github-actions bot added the area/live-loader Issues related to live loading. label Feb 18, 2026
@shiva-istari shiva-istari changed the base branch from main to shiva/test-mac-os February 18, 2026 13:43
@shiva-istari shiva-istari changed the title add support for vector indexing in bulk loader feat(bulk): add HNSW vector index support to bulk loader Feb 18, 2026
@matthewmcneely matthewmcneely self-assigned this Feb 18, 2026
@shiva-istari shiva-istari force-pushed the shiva/bulk-vector-index branch from ebf8d1e to 90670da Compare February 19, 2026 12:52
@shiva-istari shiva-istari changed the base branch from shiva/test-mac-os to fix/shiva-test-mac-os February 23, 2026 10:52
@shiva-istari shiva-istari force-pushed the shiva/bulk-vector-index branch from 90670da to 52fa0a8 Compare February 23, 2026 10:54
Base automatically changed from fix/shiva-test-mac-os to main February 23, 2026 18:10
continue
}

fd, err := os.Create(hostFile)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Consider using defer to close the file descriptor.

tr := tar.NewReader(ts)
for {
header, err := tr.Next()
if err == io.EOF {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Consider using errors.Is(err, io.EOF) instead. Comparing errors directly is bad practice, because it ignores wrapped errors.

@shiva-istari shiva-istari force-pushed the shiva/bulk-vector-index branch from 52fa0a8 to 9e4b115 Compare February 24, 2026 06:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/bulk-loader Issues related to bulk loading. area/live-loader Issues related to live loading. area/testing Testing related issues go Pull requests that update Go code

Development

Successfully merging this pull request may close these issues.

3 participants