VPN for Local AI

What this article covers

• Why a VPN makes sense for local AI.
• How a VPN secures remote access to AI services.
• Which solutions like WireGuard, Tailscale, and OpenVPN are suitable.
• How VPN integration works with Ollama, Docker, and reverse proxies.
• Security, performance, and common pitfalls.

Introduction: VPN for local AI

If you want to use local AI services beyond your home network, you need to secure access. A VPN establishes an encrypted connection between your device and your home network. This lets you safely access Ollama, Open WebUI, or custom agents while traveling or from the office, without exposing them directly to the internet.

Instead of opening ports and making every service publicly accessible, you first connect to the network. This is one of the simplest and most effective security measures for self-hosting.

Why do you need a VPN?

Without a VPN, any service that needs remote access must somehow be exposed to the internet. That means firewall rules, port forwarding, TLS, authentication, and constant updates. A VPN solves this differently: your device acts as though it’s on the local network. All services stay protected behind the router.

Benefits:

• No public ports: Ollama and similar tools remain invisible on the internet.
• Encryption: All traffic is protected end-to-end.
• Easy scaling: New services don’t need separate external access points.
• Access control: Only VPN participants can reach the network.
• Mobility: Access all services the same way whether you’re at home or abroad.

VPN explained

A Virtual Private Network connects two networks through an encrypted tunnel. In a home setup, your device establishes a connection to your home router or server. Through the tunnel, your device gets an IP address from the home network. This allows it to communicate with all services as if it were a local device.

Key terms:

• Client: Device that initiates the VPN connection.
• Server: Device that accepts the connection.
• Tunnel: Encrypted connection between client and server.
• Peers: Participants in a VPN network.
• Split Tunneling: Only specific traffic travels through the VPN.
• Zero Trust: Trust no device automatically; authenticate once instead.

Who should use a VPN?

• Self-hosters who want remote access to AI services.
• Teams using locally hosted tools.
• Users who don’t want to open public ports.
• Anyone who prioritizes privacy and security.

Key VPN terminology

• WireGuard: Modern, fast VPN protocol.
• Tailscale: User-friendly mesh VPN based on WireGuard.
• OpenVPN: Proven, widely deployed VPN.
• IPsec: Protocol for VPNs, often in hardware routers.
• Headscale: Self-hosted backend for Tailscale.
• Reverse-Proxy: Creates a bridge between VPN and services.

Common VPN solutions compared

WireGuard

Fast, simple, and modern. A typical setup uses one private and one public key per peer. The server runs wg and clients use the WireGuard app.

Advantages:

• Low overhead
• High speed
• Simple configuration

Disadvantages:

• No built-in interface
• Manual key management

Tailscale

Tailscale builds on WireGuard and dramatically simplifies setup. Devices connect to an account, and peers discover each other automatically. Apps exist for every major platform.

Advantages:

• Easy to set up
• Automatic peer discovery
• Good for non-technical users

Disadvantages:

• Requires Tailscale’s external control server
• For pure self-hosting, Headscale offers an alternative

OpenVPN

Long established and integrated into many routers. Configuration is more complex, but it’s very flexible.

Advantages:

• Broad support
• Many routers include it

Disadvantages:

• Higher overhead
• More configuration work

Practical example: Tailscale for local AI

1. Install server: Set up Tailscale on your AI server.
2. Install client: Install Tailscale on your phone or laptop.
3. Sign in: Connect both devices to the same account.
4. Check IP: Your AI device receives a Tailscale IP like 100.x.x.x.
5. Connect: On the client, open http://100.x.x.x:11434 or Open WebUI.

Tailscale makes remote access nearly as simple as a local network.

Practical example: WireGuard in Docker

services:
  wireguard:
    image: lscr.io/linuxserver/wireguard
    container_name: wireguard
    cap_add:
      - NET_ADMIN
      - SYS_MODULE
    environment:
      - PUID=1000
      - PGID=1000
    volumes:
      - ./wireguard:/config
    ports:
      - "51820:51820/udp"
    sysctls:
      - net.ipv4.conf.all.src_valid_mark=1
    restart: unless-stopped

After configuration, connect with the WireGuard app and you’re on the network.

VPN and reverse proxy

A VPN doesn’t replace a reverse proxy, but they complement each other. Using both lets you:

• Serve public services through a reverse proxy with TLS.
• Access management and internal services over VPN.
• Keep sensitive services accessible only within the VPN.

Common VPN pitfalls

• Wrong IP: VPN uses different IP addresses.
• DNS issues: Local hostnames may not resolve depending on your setup.
• Forgot port forwarding: WireGuard requires UDP forwarding.
• Too many peers: Keys and configurations become unwieldy.
• No failover: If the VPN server goes down, access stops.
• False security: VPN is not a substitute for strong authentication.

Further reading and resources

• BotServ.de Reverse Proxy
• BotServ.de Firewall Basics
• BotServ.de TLS Certificates
• WireGuard
• Tailscale

FAQ: VPN for local AI

Do I need a VPN for home-only use? No, only if you want remote access.

Is Tailscale secure? Yes, traffic is encrypted end-to-end. The control server only manages peer information.

Can I run WireGuard and Ollama on the same server? Yes, they operate independently.

Which is better: VPN or open ports? VPN is more secure. Open ports require a reverse proxy, TLS, and strong authentication.

Do I need a public IP? For an inbound VPN server, yes. Alternatives like Tailscale work even behind Carrier-Grade NAT.

Sources and further reading

• WireGuard: https://www.wireguard.com/
• Tailscale: https://tailscale.com/
• Headscale: https://github.com/juanfont/headscale

Summary: VPN for local AI

A VPN is one of the most important security measures for remote access to local AI. It encrypts connections and avoids public ports. WireGuard, Tailscale, and OpenVPN are all solid choices. Tailscale is especially simple, WireGuard especially fast. VPN and reverse proxy work well together. Using both gives you security without compromise.