Headless Setup: Running an AI Server Without a Monitor
What This Article Covers
- How to set up an AI server without a display.
- How SSH works for remote administration.
- How to configure your system to boot and run without a monitor.
- Common pitfalls in headless operation.
Introduction
An AI server doesn’t need to sit next to a monitor. Most of the time it lives tucked away in a closet or basement, running quietly in the background. No monitor, no keyboard, only accessible over the network. That’s headless operation. In this article, we’ll walk through setting up a Linux system so you can manage it entirely via SSH and a web browser after the first boot.
Why Go Headless?
Headless saves power, space, and noise. You eliminate the monitor, keyboard, and the energy drain of a running display. Once the system boots, you manage it from your regular computer. This is especially useful for servers that spend hours loading, training, or serving AI models.
Understanding Headless
Headless means running a computer without a connected display, keyboard, or mouse. Setup happens beforehand or over the network. Linux comes with SSH built in, a protocol for secure remote command-line access to another machine. For graphical interfaces, web-based tools like Open WebUI or Cockpit work well.
Who Should Read This?
- Anyone who wants to hide an AI server in a closet or rack.
- Beginners exploring SSH and remote administration.
- Developers planning a small AI system without a display.
Key Terms
| Term | Meaning |
|---|---|
| Headless | Operation without display, keyboard, or mouse |
| SSH | Secure Shell, encrypted remote access |
| SSH-Key | Cryptographic key for password-less SSH login |
| IP Address | Server’s address on the network |
| Router | Distributes network connectivity in your home |
| DHCP | Automatic IP address assignment |
| BIOS/UEFI | System firmware |
| Wake-on-LAN | Start a computer remotely over the network |
| PuTTY | SSH client for Windows |
| ZeroTier/Tailscale | VPN for remote access |
Prerequisites
You’ll need:
- A computer connected to your router via Ethernet cable.
- Another computer on the same network.
- The ability to connect a monitor briefly for initial setup (unless you’re using a pre-configured image).
Initial Installation
A monitor is helpful for first setup. Boot from a USB drive, install Linux, and enable SSH. After that, you can disconnect the monitor.
# Install and start SSH
sudo apt install -y openssh-server
sudo systemctl enable ssh
sudo systemctl start sshSSH Keys Instead of Passwords
Secure authentication matters. Generate an SSH key on your client machine:
ssh-keygen -t ed25519 -C "dein-pc"
ssh-copy-id benutzer@SERVER-IPNow you can log in without entering a password. Disable password-based authentication:
sudo sed -i 's/#PasswordAuthentication yes/PasswordAuthentication no/' /etc/ssh/sshd_config
sudo systemctl restart sshRunning the Server Without a Monitor
Linux starts automatically in headless mode. Make sure the Ethernet cable is plugged in and your router assigns an IP address. Note the IP or set a static DHCP reservation in your router.
Setting Up Remote Access
For access outside your home network, consider:
These options avoid the security risks of port forwarding.
Monitoring Key Services
# Check running services
systemctl status ollama
systemctl status docker
# View logs
journalctl -u ollama -fCommon Pitfalls
- No DHCP reservation: The IP address can change over time. Reserve it in your router.
- SSH not enabled: Without SSH, you’re stuck without a monitor. Enable it before going headless.
- Password login still active: Improve security by switching to SSH keys and disabling password authentication.
- Firewall blocks SSH: ufw allows SSH by default, but verify your setup.
- Network isolation between clients: Some routers isolate devices from each other. Disable client isolation if needed.
- Wake-on-LAN not enabled: If the server shuts down, you’ll need WOL or a smart power plug to restart it remotely.
- Graphics still running: Server editions don’t do this. Desktop variants may drain power unnecessarily.
- No temperature monitoring: Headless servers run unattended. Watch CPU temps and fan speeds.
- Updating from afar: Schedule regular updates, but be careful with kernel upgrades that require a reboot.
- No backup access: Getting locked out is frustrating. Keep a way to access the system locally.
Hardware, Cost, and Security
A headless server consumes less power when no monitor is connected. Most of your budget goes into hardware. Security is critical because the machine runs unattended. SSH keys, a firewall, regular updates, and VPN for remote access are non-negotiable.
Further Reading
- Self-Hosting Overview
- Ubuntu Server Setup
- Debian for AI
- Tailscale
- Cloudflare Tunnel
- WireGuard
- Ollama Network Access
- Setting Up a Firewall
FAQ
Do I ever need a monitor again?
Only for major problems you can’t solve over the network, like when networking itself is broken.
How do I find the IP address of my headless server?
Check your router’s list of connected devices. Or use a network scanner like nmap.
Does SSH work on Windows?
Yes, using Windows Terminal, PowerShell, or PuTTY. Recent Windows versions include OpenSSH out of the box.
Can I do everything over SSH?
Almost everything. For graphical interfaces, you can use VNC or web-based tools.
Which is more secure: SSH keys or passwords?
SSH keys are significantly more secure and more convenient. Disable password login once keys work.
Can I set up the server entirely remotely?
Only if you receive a pre-installed image with SSH enabled. Otherwise, you’ll need a monitor briefly.
Does Ollama run headless?
Yes, Ollama runs as a background service and requires no display.
What happens during a power loss?
Configure BIOS/UEFI to automatically power on the machine after a power failure.
Do I need a server image?
Ubuntu Server or Debian are ideal. Desktop variants work but include unnecessary overhead.
How do I wake up the server remotely?
Use Wake-on-LAN or a smart power outlet if WOL doesn’t work.
Sources
- OpenSSH Documentation (openssh.com)
- Ubuntu Server Docs (ubuntu.com)
- Tailscale Docs (tailscale.com)
- Ollama Linux Setup (ollama.com)