feat: Add Atlas Local Tools by Luke-Sanderson · Pull Request #632 · mongodb-js/mongodb-mcp-server

Luke-Sanderson · 2025-10-09T13:21:07Z

Proposed changes

Checklist

I have signed the MongoDB CLA

Luke-Sanderson · 2025-10-10T12:09:15Z

@nirinchev @kmruiz @himanshusinghs All PRs to the feature branch has been reviewed but we would like someone from DevTools to review before merging to main please :)

nirinchev

I've gone through the code, but not through the tests yet. There are a couple of suggested changes that will impact the test structure, so I'll hold off on reviewing the tests until those are applied.

…eview/atlas-local package, use string union version of CreationSourceType

nirinchev

Still have to go through the tests, but the implementation seems to be mostly there. I have a few nits, as well as some concerns, but those are not super blocking.

…er to original implementation

nirinchev

We should run the accuracy tests once we've fixed the mocks to check that they're indeed passing - I'd be very surprised if they do with the current wording of the prompts.

Co-authored-by: Nikola Irinchev <irinchev@me.com>

github-actions · 2025-10-21T10:23:21Z

📊 Accuracy Test Results

📈 Summary

Metric	Value
Commit SHA	`1807efbb6cd5b9032bc1fba7bacecb5b5fc4bd08`
Run ID	`6000849e-d18d-4a74-b644-4c17853145a0`
Status	done
Total Prompts Evaluated	94
Models Tested	1
Average Accuracy	88.3%
Responses with 0% Accuracy	10
Responses with 75% Accuracy	5
Responses with 100% Accuracy	81

📊 Baseline Comparison

Metric	Value
Baseline Commit	`8a5da23269267523b6196ed85a42f57713451c3f`
Baseline Run ID	`7889df8a-d68c-4900-82cc-0f0acc92873b`
Baseline Run Status	`done`
Responses Improved	2
Responses Regressed	4

📎 Download Full HTML Report - Look for the accuracy-test-summary artifact for detailed results.

Report generated on: 10/21/2025, 10:23:18 AM

…g a deployment that already exists'

jeroenvervaeke · 2025-10-21T14:54:37Z

We should run the accuracy tests once we've fixed the mocks to check that they're indeed passing - I'd be very surprised if they do with the current wording of the prompts.

I ran the accuracy tests and all the atlas-local accuracy tests succeed with 100% success rate: https://github.com/mongodb-js/mongodb-mcp-server/actions/runs/18687565982

Luke-Sanderson and others added 15 commits September 1, 2025 15:15

feat: Adds scaffolding for atlas-local tools MCP-155 (#498)

7a27749

Merge branch 'main' into feat-MCP-40

a27f2d4

feat(atlas-local): Added Atlas Local List Deployments tool (#520)

8a2db27

feat(atlas-local): Add Atlas Local List Deployments tool (#538)

6938a8f

feat(atlas-local): Add Atlas Local Create Deployment tool (#546)

e774083

feat(atlas-local): Accuracy tests for Atlas Local (#554)

bb717ab

feat(atlas-local): Split Atlas Local tests from Atlas (#552)

0d14679

feat(atlas-local): Adds Atlas Local Connect Deployment tool (#612)

cb5d335

feat: added atlas local deployment id to telemetry (#627)

91c11cc

refactor: Replace z.string with CommonArgs.string (#629)

8efb029

Merge branch 'main' into feat-MCP-40

c0f3e49

Merge branch 'main' into feat-MCP-40

cac14ae

Merge branch 'main' into feat-MCP-40

bd4a061

fix: knip ignore atlas-local dependency

14ade77

Merge branch 'main' into feat-MCP-40

5c5c2e7

Luke-Sanderson marked this pull request as ready for review October 10, 2025 08:06

Luke-Sanderson requested a review from a team as a code owner October 10, 2025 08:06

docs(atlas-local): Adds the Atlas Local Tools to the readme

5afc312

jeroenvervaeke approved these changes Oct 10, 2025

View reviewed changes

nirinchev requested changes Oct 10, 2025

View reviewed changes

Luke-Sanderson and others added 4 commits October 10, 2025 15:13

fix: Small changes from PR suggestions

c4a44e0

refactor: Move all lookupDeploymentId calls to resolveTelemetryMetadata

9eb0c1a

refactor: Update atlas local error handling

74d2218

Merge branch 'main' into feat-MCP-40

eb488ff

jeroenvervaeke mentioned this pull request Oct 16, 2025

feat: export enums as string unions instead of enums mongodb-js/atlas-local-lib-js#26

Merged

jeroenvervaeke added 4 commits October 16, 2025 15:01

move atlas local client initialization to 'TransportRunnerBase'

e33df95

use the @mongodb-js/atlas-local package instead of the @mongodb-js-pr…

c3efcd1

…eview/atlas-local package, use string union version of CreationSourceType

fix bug with fetching deployment id caused by refactor

123ab82

Merge branch 'main' into feat-MCP-40

eda00a2

jeroenvervaeke and others added 3 commits October 20, 2025 11:23

removed debug log

08eb04c

Merge branch 'main' into feat-MCP-40

a197b08

Merge branch 'main' into feat-MCP-40

30aabae

nirinchev reviewed Oct 20, 2025

View reviewed changes

jeroenvervaeke and others added 7 commits October 21, 2025 08:13

adressed pr comments in atlasLocal.ts

3e46dbb

addressed PR comments in atlasLocalTools + simplified telemetry, clos…

035d4c7

…er to original implementation

reverted emitToolEvent to be sync again

4730bfb

move AtlasLocalTools to toolConstructors

e0c8a72

return json instead of markdown table for list deployments

13b989e

fix list deployments test

78fd715

Merge branch 'main' into feat-MCP-40

596a783

nirinchev reviewed Oct 21, 2025

View reviewed changes

jeroenvervaeke and others added 4 commits October 21, 2025 10:29

Update src/tools/atlasLocal/read/listDeployments.ts

f20c09f

Co-authored-by: Nikola Irinchev <irinchev@me.com>

Update src/tools/atlasLocal/atlasLocalTool.ts

318e429

Co-authored-by: Nikola Irinchev <irinchev@me.com>

Update src/tools/atlasLocal/atlasLocalTool.ts

939cfd5

Co-authored-by: Nikola Irinchev <irinchev@me.com>

ran npm run fix, and cleaned up code after accepting suggestions

d535757

jeroenvervaeke added the accuracy-tests label Oct 21, 2025

jeroenvervaeke added 2 commits October 21, 2025 11:15

fix accuracy tests

db06cc1

updated listDeployments.test.ts after accepting suggestions

04e505c

addressed test comments

5ae9405

gagik reviewed Oct 21, 2025

View reviewed changes

Comment thread package.json

jeroenvervaeke added 3 commits October 21, 2025 14:54

added comment describing test in 'should return an error when creatin…

3de5b26

…g a deployment that already exists'

ran 'npm run fix'

e3c6708

prefixed list deployments accuacy prompts with 'local'

56d981d

jeroenvervaeke enabled auto-merge (squash) October 21, 2025 15:40

nirinchev approved these changes Oct 22, 2025

View reviewed changes

jeroenvervaeke merged commit 17b595b into main Oct 22, 2025
24 of 26 checks passed

jeroenvervaeke deleted the feat-MCP-40 branch October 22, 2025 08:00

Uh oh!

Conversation

Luke-Sanderson commented Oct 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Proposed changes

Checklist

Uh oh!

Luke-Sanderson commented Oct 10, 2025 • edited by nirinchev Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nirinchev left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

nirinchev left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

nirinchev left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

github-actions Bot commented Oct 21, 2025

📊 Accuracy Test Results

📈 Summary

📊 Baseline Comparison

Uh oh!

Uh oh!

jeroenvervaeke commented Oct 21, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Luke-Sanderson commented Oct 9, 2025 •

edited

Loading

Luke-Sanderson commented Oct 10, 2025 •

edited by nirinchev

Loading