https://thenets.org/tags/ai/Recent content in Ai on Luiz Felipe F M CostaHugoen-usWed, 28 May 2025 08:02:31 +0000https://thenets.org/posts/how-to-install-ollama-open-webui-on-fedora-using-podman-quadlets/Wed, 28 May 2025 08:02:31 +0000https://thenets.org/posts/how-to-install-ollama-open-webui-on-fedora-using-podman-quadlets/<p>Ollama is a powerful tool for running large language models locally. This guide walks you through setting up Ollama on Fedora using Podman Quadlets, ensuring it runs as a systemd service with persistent storage and GPU support.</p> <h2 id="requirements">Requirements</h2> <p>Make sure you have full GPU support for podman containers:</p> <pre><code class="language-bash"># This must return something like # &gt; GPU 0: NVIDIA GeForce RTX 3070 (UUID: GPU-...) podman run --rm --security-opt=label=disable \ --device nvidia.com/gpu=all \ ubi9 \ nvidia-smi -L </code></pre> <figcaption class="code-caption">Check podman GPU support</figcaption> <p>If you have a NVIDIA GPU and the command above didn&rsquo;t work, check the following post to fix that:</p>