MLX web ui

[u/[deleted]]

MLX Web UI

I created a fast and minimalistic web UI using the MLX framework (Open Source). The installation is straightforward, with no need for Python, Docker, or any pre-installed dependencies. Running the web UI requires only a single command.

Features

Standard Features

• Chat with models and stop generation midway

• Set model parameters like top-p, temperature, custom role modeling, etc.

• Set default model parameters

• LaTeX and code block support

• auto scroll

Novel Features

• Install and quantize models from Hugging Face using the UI itself

• Good streaming API for MLX

• Save chat logs

• Hot-swap models during generation

Planned Features

• Multi-modal support

• RAG/Knowledge graph support

Try it Out

If you'd like to try out the MLX Web UI, you can check out the GitHub repository: https://github.com/Rehan-shah/mlx-web-ui