jlcases 8 days ago

This is a clever approach to providing LLMs with specific, up-to-date package documentation context. How does it handle versioning if multiple versions of a package exist? Does it pull docs for the specific version used in the project context, or just the latest?

Also curious about the performance impact – is the doc retrieval fast enough for real-time use within an LLM interaction flow?

Nice tool for improving the accuracy of LLM responses related to package usage!

  • FiloSottile 8 days ago

    Currently it just fetches latest if a version is not specified. It should be pretty easy to use the current project version if available, assuming llm plugins stay in the working directory of the main call. PRs welcome :)

    Once the module version is in GOMODCACHE, it's extremely fast, not even noticeable.