Joplin is a FOSS, multiplatform, Nextcloud-compatible note-taking app. Apparently, the dev uses Coderabbit and is now pulling integrated chatbot support from the optional AI plugin to the main (dev) branch. (Looks like Joplin Cloud, their note syncing and sharing service, has had chatbot integration for a year, but the user needed to opt into Joplin Cloud and the AI plugin was required.) At least the functionality is disabled by default but that might easily change later…

Screenshot of https://github.com/laurent22/joplin/pull/15643

  • ChaoticNeutralCzech@lemmy.mlOP
    link
    fedilink
    arrow-up
    4
    arrow-down
    1
    ·
    7 days ago

    Not to mention, Joplin allows more than structured text (native embedded images/media, even more kinds of content with plugins) and the text-only joplin.ai.chat() will definitely “need” to be supplemented with multi-modal AI support.

    As for new techniques, I imagine the declining AI subsidies will raise the popularity of context reuse (reducing token use by not having the LLM re-read the whole notebook; is that what it’s called? I don’t remember much from videos/articles about AI trends because I don’t use it). This will require a huge framework for managing data structures distilling every cached context window… And I think non-LLM functions will be added too to save tokens, for example an LLM may want to know “is there an unfinished TODO?” without reading all of them.