What is the cmd you use to add the reject?
If you used something like this:
iptables -A INSERT -p tcp --dport 22 -j REJECT
to reverse/delete it you should use
iptables -D INSERT -p tcp --dport 22 -j REJECT
As you can see, the commands are almost exactly the same, except the "-A" (append) and "-D" (delete) switches