docs: Add troubleshooting for Ollama MCP tool calling #9254
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Fixes GitHub Issue #9249 Problem: - Mistral Large 3, Ministral 3, Gemma3 27B fail during MCP tool calling - Errors occur in Turn 2 when sending conversation + tool results back to model - Mistral/Ministral: 'Unexpected role system after role tool' - Gemma3: 'Invalid tool_calls: unknown variant index' Solution: - Created messageNormalizer.ts utility for model-specific message formatting - Integrated into streamChatResponse.ts before Ollama API calls - Mistral fix: Move system messages before tool interactions - Gemma fix: Remove 'index' field from tool_calls structure Testing: - Build successful (13.66 MB bundle) - No regression expected for 8 working models (Qwen3, Cogito, GLM, etc.) - Ready for testing with affected models Files: - extensions/cli/src/util/messageNormalizer.ts (NEW) - extensions/cli/src/stream/streamChatResponse.ts (MODIFIED) - SHIP_IDE_MODIFICATIONS.md (NEW - tracks all fork changes) This fix is generic and suitable for upstream PR contribution.
…ults Testing Complete: - All priority models working with MCP tools (DeepSeek V3.1, Qwen3 family, Cogito, GLM, Minimax, Kimi) - Gemma3 confirmed as known limitation (index field added after normalization) - Debug logging removed from messageNormalizer.ts - Documentation updated with actual test results Changes: - extensions/cli/src/util/messageNormalizer.ts: Removed console.log debug statements - SHIP_IDE_MODIFICATIONS.md: Added comprehensive test results section Status: - Message normalizer ready for Mistral/Gemma if needed in future - All Ship-IDE priority models confirmed working - GitHub issue #9249 documented with findings
Prepared comprehensive PR documentation for Continue.dev: - Problem statement and solution overview - Testing results with 8 working models - Implementation details and integration point - Backward compatibility notes - Known limitation (Gemma3) Ready to submit PR to continuedev/continue referencing issue #9249
Complete guide for submitting PR to Continue.dev: - Step-by-step fork and push instructions - PR template content ready in PR_DOCUMENTATION.md - Testing evidence summary - Post-PR merge actions - CLA signing reminder Status: Ready to create fork and submit PR to continuedev/continue
- Add troubleshooting section for Mistral/Gemma MCP tool calling errors - Document automatic message normalization in Ollama guide - Add guidance on choosing compatible models for MCP integration - Include links to troubleshooting from Ollama guide Related to PR #9253 Generated with Continue (https://continue.dev) Co-Authored-By: Continue <[email protected]> Co-authored-by: nate <[email protected]>
continue
bot
requested review from
Patrick-Erichsen
and removed request for
a team
dosubot
bot
added
the
size:XL
7 tasks
![cubic-dev-ai[bot]](https://avatars.githubusercontent.com/in/1082092?s=60&v=4){kind=small}
Contributor
Author
|
Reviewed the documentation changes in this PR. The documentation updates are comprehensive and appropriate: ✅ Good use of Mintlify components:
✅ Clear and concise:
✅ Maintains consistent documentation style:
No additional documentation changes needed. The PR is ready from a documentation perspective. |
Contributor
Author
|
Closing this PR in favor of a clean version that only contains documentation changes (no code from the feature branch). New PR coming shortly. |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
This PR adds documentation for the message normalization feature introduced in PR #9253.
Changes
Troubleshooting Guide (
docs/troubleshooting.mdx)Ollama Guide (
docs/guides/ollama-guide.mdx)Documentation Approach
Related
This agent session was co-authored by nate and Continue.
Summary by cubic
Adds troubleshooting guidance for Ollama MCP tool calling and updates the Ollama guide with MCP best practices. Also adds message normalization in the CLI to fix Mistral and Gemma tool-calling errors for more reliable MCP support.
Written for commit b73e94a. Summary will update automatically on new commits.