Version: v1.1.154 x64
Describe the Bug
After search for models on the Models tab, the assessment of the found models seems broken and Download links are not available.
While enough disc space (2x 100GB available), system RAM (currently about 18GB available) and VRAM "15.05 GB free of 15.92 GB" (according to Atomic Chat Settings - Hardware) or 12.5GB free of 16GB (according to task manager), for versions of the models is available, the Models tab claims that models would be "Heavy for your device".
In the example ("Bonsai Ternary") it appears as though Atmoic Chat assesses usability by max. size of downloadable options, opposed to the size of available downloads that are actually fitting on the system.
Claiming models (e.g. Bonsai Ternary model/quants) would be too heavy for the device or even "Not enough memory", when available downloads/quants even run on constricted mobile hardware, and versions typically used on Desktop/Laptops (in the example only 8GB in size) being perfectly fine to be hosted on the system, is simply false.
As a result of that not offering a "Show Variants" drop down menu and Download button seems like the Models tab does not work as intended.
Steps to Reproduce
- Search for e.g. "Bonsai Ternary" or "Prism-Ml" on Windows 10 Pro system with 32GB System RAM and 16GB VRAM
- See issue
Screenshots / Logs
Operating System
Windows 10 Pro
Version: v1.1.154 x64
Describe the Bug
After search for models on the Models tab, the assessment of the found models seems broken and Download links are not available.
While enough disc space (2x 100GB available), system RAM (currently about 18GB available) and VRAM "15.05 GB free of 15.92 GB" (according to Atomic Chat Settings - Hardware) or 12.5GB free of 16GB (according to task manager), for versions of the models is available, the Models tab claims that models would be "Heavy for your device".
In the example ("Bonsai Ternary") it appears as though Atmoic Chat assesses usability by max. size of downloadable options, opposed to the size of available downloads that are actually fitting on the system.
Claiming models (e.g. Bonsai Ternary model/quants) would be too heavy for the device or even "Not enough memory", when available downloads/quants even run on constricted mobile hardware, and versions typically used on Desktop/Laptops (in the example only 8GB in size) being perfectly fine to be hosted on the system, is simply false.
As a result of that not offering a "Show Variants" drop down menu and Download button seems like the Models tab does not work as intended.
Steps to Reproduce
Screenshots / Logs
Operating System
Windows 10 Pro