Logo

dev-resources.site

for different kinds of informations.

Round Two: Enhancing the Ollama Cluster

Published at
7/8/2024
Categories
ollama
openwebui
hardware
troubleshooting
Author
blacknight318
Author
13 person written this
blacknight318
open
Round Two: Enhancing the Ollama Cluster

Re-cap

Just over three weeks ago I wrote a post titled: Setting Up an Ollama + Open-WebUI Cluster, where I went over my first experiment in creating a entry barrier node for what was to become an Ollama cluster. In short, I could see the card but performance was negligible. Working on what I was previously able to accomplish it was time to bump things up.

Round Two Setup

Using the same Nvidia Quadro K620 and USB-C Power supply the only item left was the adapter and host machine. This time it was a Lenovo M700 Tiny and the ADT-Link M.2 NGFF NVMe Key M Extender Cable. Originally this was going to go into the Wifi card slot on the motherboard, what I didn't think to check was that while the NVME drive was M key the wifi card was A+E keyed, ok, let's try the NVME slot and temporary mode the drive to an external NVME-to-USB adapter. The drive booted with no problem, however NVIDIA card was not recognized at all, it did spin the fan as would be expected when signaled on, but no dice in lspci.

Adapt to M.2 A+E Key?

Sadly, after much research, any adapter to the A+E key would only support PCIe 1x, which is not worth the effort. There is a possible solution that might still work for this task, but that's another post. Keep watching for updates, and until next time, fair winds and following seas.

troubleshooting Article's
30 articles in total
Favicon
Fix 105 Common WordPress Issues Using Simple Code Snippets
Favicon
5 errores comunes en Kubernetes y cómo solucionarlos rápidamente
Favicon
Half-Duplex vs Full-Duplex: What are the Differences?
Favicon
npm error 'node' is not recognized as an internal or external command
Favicon
Troubleshooting Kubernetes Clusters and Pods: A Comprehensive Guide
Favicon
Kubernetes Logs and Debugging Techniques: Best Practices for Efficient Troubleshooting
Favicon
Effective Methods for Troubleshooting Deadlocks in SQL Server
Favicon
NuPhy Air75 V2 - firmware upgrade & troubleshooting
Favicon
Moving beyond console.log
Favicon
How to Master Kubernetes Troubleshooting? Do it with 35 Real-World Scenarios
Favicon
Owning the Chaos: A Simple Guide to Tackling Obscure Errors
Favicon
[pt-BR] Troubleshooting Linux - Comandos e ações
Favicon
The Art of Problem-Solving
Favicon
error when starting dev server
Favicon
What to do if you accidentally remove the `amd-ucode` package on Arch Linux
Favicon
Stop the cursor from jumping to the corner of the screen on a Lenovo Yoga laptop
Favicon
Advanced Linux Troubleshooting in DevOps and Cloud: Practical Use Cases and Commands
Favicon
Troubleshooting Amazon Bedrock Payment Errors: A Comprehensive Step-by-Step Guide
Favicon
Respect Your Youngers
Favicon
Troubleshooting Automatic Scrolling to Cal.com Inline Embed on Page Load
Favicon
Troubleshooting Adabas Event Replicator on z/OS Command Code A1 Error 77 Subcode 11
Favicon
Round Two: Enhancing the Ollama Cluster
Favicon
Troubleshooting with PipeOps: Error 502 with React apps
Favicon
Everything you need to know about monitoring CoreDNS for DNS performance
Favicon
Troubleshooting External Hard Drives on Linux
Favicon
How to Fix the Frustrating Error 0x80300024 When Installing Windows 11/10
Favicon
Troubleshooting Common Issues in Printed Circuit Board Fabrication
Favicon
AIO : Unable to read /etc/rancher/k3s/k3s.yaml, please start server with --write-kubeconfig-mode to modify ... permissions
Favicon
Troubleshooting 'Command Not Found: Flutter' Error: Solutions and Tips
Favicon
Fix OpenRGB Post-Sleep Glitches: Automated Profile Reload

Featured ones: