First, change ownership of the directory to the group:
chown root.adm /home/admin
Then make sure the adm group members have read and write access to all files in that tree:
chmod -R g+rw /home/admin
Remember, the execute permission (+x) when applied to directories gives access to that directory, but not the files in it.