Yes, good point! Use the sort command, first.
Heck, as long as you have sort out of the garage, forget comm and diff. Just use the sort | uniq combo with the -u flag:
sort file1.txt file2.txt |uniq -u > uniq_lines.txt
That'll send only the unique lines to a new file, which I believe is what you want to do.