OpenVPN = SLOW internet

Hello,

I have a problem I was hoping you guys could help me with:

Me and my dad have one Netgear WNR23500Lv2 each, both with Tomato + OpenVPN.
The VPN-setup is done 100% from GUI

When I try to download a file, I never get more than 500KB/s, so I did a test with VPN on/off:
Connected to a FTP with filezilla, stopped the VPN-service in the router, downloaded a file = 2,5MB/s
Started the VPN-service in the router, downloaded a new file = 500KB/s

With SSH I got the VPN-config-files:

SERVER_CONFIG:

Automatically generated configuration
daemon
server 10.8.0.0 255.255.255.0
proto udp
port 1194
dev tun21
keepalive 15 60
verb 3
push "route 192.168.10.0 255.255.255.0"
client-config-dir ccd
client-to-client
route 192.168.20.0 255.255.255.0
push "route 192.168.20.0 255.255.255.0"
push "dhcp-option DNS 192.168.10.1"
ca ca.crt
dh dh.pem
cert server.crt
key server.key
status-version 2
status status

CLIENT_CONFIG:

Automatically generated configuration
daemon
client
dev tun11
proto udp
remote xxx.xxx.xxx.xxx 1194
resolv-retry 30
nobind
persist-key
persist-tun
redirect-gateway def1
verb 3
ca ca.crt
cert client.crt
key client.key
status-version 2
status status

As far as I know, this seems fine. I did a "top" in SSH, and OpenVPN is using 5%MEM and 0%CPU
MEM: 19148K used, 42916K free, 0K shared, 2592K buff, 7760K cached.

I thought maybe I'm pushing ALL my traffic over VPN. How do I check this? (Still think I should get more than 500KB/s though.

Thanks for all help.
Best regards
Sindre