ChatGPT - Offline alternatives

A few months ago, ChatGPT gained a huge following and drew attention to new AI tools. However, interest in these AI tools has since waned.

This article aims to highlight recent advances in Natural Language Processing (NLP) and Large Language Modelling (LLM), with a particular focus on offline tools similar to ChatGPT.

Cartoon by Scott Adams.

  1. Offline ChatGPT alternatives

    2. Currently there are several NLP (Natural Language Processing) tools similar to ChatGPT - Bing chat, Gemini & Bard, Llama 2, and EARNIE Bot - most of which are online. Listed below are some offline ChatGPT-like language processing tools.

    Keep in mind that new tools and updates are released on a weekly basis, so the items listed here may be outdated, replaced or modified in a short period of time. Nevertheless, it is useful to understand what is out there.

    Advantages

    Disadvantages
    • Data security
    • Intergration with the local environment
    • Easier Cusomisation of language models
    • Free from constraints & biases
    • Mostly open source
    • Optional cost-free operation
    • Limited factual database
    • May lack creativity & accuracy
    • Requires capable CPU/GPU, memory & space
    • Should be updated manually
    • Slower response

    Offline functionality of LM Studio, with a ChatGPT-like interface (from lmstudio.ai).

    NLP tool

    Remarks
    LM Studio
    • Offline ChatGPT like tool, with similar interface
    • Easy installation & setup
    • User friendly interface
    • Easy access to diverse Language Models
    • Quick adaptation to AI applications
    • Active following and updates
    PrivateGPT
    • Prioritises security and customisation
    • Tailored towards individual organisations
    • Runs only without GPU, but slow
    • Installation thourgh terminal/command prompt, might not be easy for a beginner.
    LocalGPT
    • Successor (or inspired) from PrivateGPT
    • Runs on various platforms - multicore CPU, GPU, IPU & TPU
    • Cost effective operation
    • Installation thourgh terminal/command prompt, might not be easy for a beginner
    GPT4all
    FreedomGPT
    • Known for unbiased operation
    • Training data & LLMs are mostly unaltered
    • Easy installation & setup
    • Common operations are not free
    • Relatively easier installation

  2. Offline ChatGPT (LM Studio) - Setup & Installation

    3. Among the NLP tools listed above, LM Studio is a nice option considering the ease of use. This instructions would be helpful for the installation.

    • Easy installation thourgh graphical interface, no need for libraries or special packages.
    • Compatibility with Windows, Linux & MacOS.
    • Installation of a diverse Language models & architectures.
    • Easier customisation and integration to the native environment.

    Setup files for different OS from lmstudio.ai.

  3. Common NLP tools & Applications

    4. These are some commonly used NLP tools for various applications.

    NLP Tool

    Remarks
    Local AI
    • Free & open source Open AI alternative
    • Handles Language models, audio & images
    • User friendly interface
    • No GPU needed
    • Supports various models & formats (LLMs)
    • Works with audio & images as well
    • Can be personalised and modified
    • Integration with AI applications
    Flowise AI
    • Visual builder for Language model apps, eg: personal chatbot
    • Minimal coding is required
    • Open source, free?
    • Works with building blocks
    • Can be personalised and modified
    • Integration with AI applications using a server
    Autogen AI
    • Creation of multiple agent intefactions. eg: combining LLMs, coding, audio with human interaction
    • Automation & optimisation of complex processes
    • Minimal supervision required
    • Integration of various models, formats (LLMs)
    Amphion
    • Text to audio generator (speech, music, ...)
    • Open Source
    Harpa ai
    • Chrome plugin
    • Easier browsing, website interaction & effective coding
    • One of the many similar plugins/addons

    Building an NLP tool using Flowise AI.

    Structure of a multi-agent AI system made using AutoGEN.

  4. NLP detector

    5. Below are some tools to find out if a passage has been written using an NLP tool. These are not perfect, the results are not yet completely reliable. There are also tools to modify an AI developed passage so that it cannot be detected by these detectors.

    Examination of a passage with GPTZero made from ChatGPT - suggesting a 77% probability of AI involvment.

  5. Sources & useful links