That seems weird that you would have to forward a port on your modem? If you did have to forward a port on both there would have to be two different numbers.
This all depends on how your modem is connected to your router. My modem is bridged. It's like it's not there. If your modem is like a router, then your router might be assigned a different number.
Your server ip is 192.168.1.4.
Your router ip could be something different like 192.168.0.4.
On your modem you would forward 192.168.0.4.
On your router you would forward 192.168.1.4.
I hope this can get you going.
You can use a service called Zoneedit.com. It is free but you need your own domain name (only about $10 a year). You can use a program called
ddclient. It is way better than the one no-ip gives you. It updates my ip every 3 min and also updates zoneedit through a secure connection.