Test and validate model provider settings

This page outlines how to test your configured settings for a model provider, with additional details specific to using the Hugging Face provider.

After configuring the model settings in the Provider settings tab, you can verify your configuration by clicking Test / Cache model. This will send a completion request to the selected model provider and display the results in a dialog, as shown below:

When using the Local / Custom model provider, BurpGPT will automatically download and cache the specified model—if it is a valid publicly accessible Hugging Face model—before displaying the result dialog. An example of this process is shown in the screenshot below. Subsequent queries will use the cached model, avoiding repeated downloads.

Model download and caching.

Please keep in mind that the caching process can take a considerable amount of time, depending on the model size and the speed of your internet connection. Additionally, ensure that your file system has sufficient free space to accommodate the downloaded models.

Downloaded models are saved in the cache folder at these locations:

• Linux and Mac: ~/.cache/huggingface/transformers/

• Windows: %userprofile%/.cache/huggingface/transformers/

These cached models can later serve as a foundation for training your own custom models—a topic we may cover in a future post.