LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 10-12-2014, 10:27 AM   #1
sakoi
LQ Newbie
 
Registered: Oct 2014
Posts: 2

Rep: Reputation: Disabled
hidden . dot files jpg


I have an extremly delicate problem. The photographer that recently took my wedding photos uses a Mac. I gave him an external HDD which he then formatted to FAT32 before copying over all the photos he took at our wedding. Got the HDD home (I use Ubuntu 14.04), and alle the photos were readable from the external HDD. No problem I thought.

I then copied all the photos to a NAS I have at home. Again, all the photos were readable in Ubuntu when reading them from the NAS. I then reformatted the external HDD to NTFS (my wife uses a Windows pc) and copied all the photos to the external HDD. When mounting the external HDD on my wifes Windows pc we noticed somehting strange I have never seen before. Nearly half, but not all of the pictures filename(these are ordinary jpg files) started with a .(dot) at first, and the filesize was just 4kb per file. The files were also shaded in color, indicating that they somehow were hidden. Any idea why this is, and is there anyway to fix this?
 
Old 10-12-2014, 02:43 PM   #2
John VV
LQ Muse
 
Registered: Aug 2005
Location: A2 area Mi.
Posts: 17,645

Rep: Reputation: 2654Reputation: 2654Reputation: 2654Reputation: 2654Reputation: 2654Reputation: 2654Reputation: 2654Reputation: 2654Reputation: 2654Reputation: 2654Reputation: 2654
sounds like you just copied the thumbnails or the apple meta data of the image of the images and not the full size images

what apple folder s did you grab them from ?
one of them would be just a link to the real image

Last edited by John VV; 10-12-2014 at 02:45 PM.
 
Old 10-12-2014, 03:21 PM   #3
Nogitsune
Member
 
Registered: Oct 2014
Posts: 33

Rep: Reputation: Disabled
If half of them are the 'dot files', and half of them seem perfectly fine jpg images you had expected, perhaps you actually have all the images just as you should.. and also the thumbnails (which probably are of no use). If possible, you could check the number of properly working files, and confirm (possibly with the photographer) if you have the correct number of them. Maybe also compare the number of larger files to the 4k files and see if they match.
 
Old 10-12-2014, 04:44 PM   #4
sakoi
LQ Newbie
 
Registered: Oct 2014
Posts: 2

Original Poster
Rep: Reputation: Disabled
I wish it was so. 1100 of the jpg are .(dot) files, 1600 of them ar actual files, and the grand total is 2700. The thing is when I got the disk from the photographer the total was 2700 working jpgs(and there were no duplicates), so 1100 of them have now gone bust and become .(dot) files. To make things even stranger, they (all of the 2700) was fully working and readable from my NAS up until today (when I opened them with my Ubuntu PC), but after my wifes Windows PC connected to the fileshare to view them from the same NAS 1100 of them went bust. To be more specific, once she opened the filshare every single one of the 2700 were .(dot) files, but after marking them all, right clicking and deselcting hidden(because the were all hidden files when she viewed them), 1600 showed up like you would expect like normal jpgs, but 1100 became hidden .(dot) files, not only for here, but for me as well when I try to view them from my Ubuntu PC. This is the strangest problem I have ever come across. I am guessing it has to do something with UNIX and super user permissions, because the files originally came from a MAC, and I am guessing that the MACuser copied the file to my external HDD with SUDO privileges and therefore they become hidden from a Windows user, whereas I could view them totally fine up until today. Strange....
 
Old 10-13-2014, 01:49 AM   #5
Nogitsune
Member
 
Registered: Oct 2014
Posts: 33

Rep: Reputation: Disabled
Have to admit that goes beyond my understanding, so at this point all I can do anymore is observations and guesses. Hopefully someone with more experience on the area can give something more specific.

The 4k file size sounds like allocation unit of NTFS, so it sounds like they're 'minimum' size files. Way too small for good quality JPG, so anything that's 4k size isn't going to become back. If you can somehow, anyhow, open them, then they sound like thumbnails. If you can't and they appear corrupt, in particular if the actual filesize of each of them (not just the allocated size) then the more likely case would seem to be that something went bad somewhere when copying files. Something like, a file being copied on top of itself (I once wiped whole subtree with careless root access 'cp' command that accidentally copied everything across softlink back to original subtree. Every file wrote on top of itself, and after first block the rest silently vanished, because source was no longer available).

Since the number of files matches still (1600 + 1100) It seems that 1100 of the original pictures would indeed have been destroyed. If all of them have been handled exactly the same, at each step, then it sounds like the results would be random. Obviously file systems and file operations generally shouldn't act randomly.

If you view the files on Ubuntu, then I assume under normal circumstances any file with leading dot would not show up at all. So presumably you could have both 2700 'regular' files and 2700 'dot files' and only see the regular ones. For windows, I'm not entirely sure how it would handle the situation (Normally I would test it from my server, but ever since my raid array went bust, I'm not in position where I could do that just now).

So my best guess would be that something went wrong when changing the file attributes. Assuming that both the 'dot files' and 'regular jpg' files coexisted at that point, perhaps the hidden attribute prevented the regular ones from showing up on windows, and perhaps the 'dot files' were the only ones that did show up. In a way you could say that leading dot is the unix/linux way of making the file hidden. This might be slightly far-fetched, but maybe removing the hidden attribute attempted to somehow 'merge' the files with leading dot, and (hidden) files with regular name, within the same directory. This could lead into some of them being overwritten.

Another possibility that comes to mind is based on what John VV said earlier:

Quote:
Originally Posted by John VV View Post
sounds like you just copied the thumbnails or the apple meta data of the image of the images and not the full size images

what apple folder s did you grab them from ?
one of them would be just a link to the real image
I'm not familiar with apple myself, never used one, so I don't know the details of how it handles files. However from what I gather, it's possible that when viewing files across net, the client system would be blind to the fact that some of them are in fact links. There's then possibility that when copying the files over - or when changing attributes - a situation similar to what I described (copying across symbolic link) would result, and basically either some of the links would replace the real files, or some of the files would attempt to overwrite themselves through the link. In both cases the result could be random based on whether the original file first overwrote the link, or whether the link overwrote the real file.

Well I'm not saying 'give up hope', but if none of the systems can find (some of) the original jpg files, it's highly likely that they no longer exist.. and the 4k files won't become fullsized versions of themself. If the photographer happened to still have the originals on memory card or the like, that would offer the most reliable solution.

Last edited by Nogitsune; 10-13-2014 at 01:53 AM.
 
Old 10-13-2014, 02:50 AM   #6
Hungry ghost
Senior Member
 
Registered: Dec 2004
Posts: 1,222

Rep: Reputation: 667Reputation: 667Reputation: 667Reputation: 667Reputation: 667Reputation: 667
hidden . dot files jpg

Not sure if this will help, but you could backup all the pictures somewhere else and carefully use testdisk on the external HDD to see if it's possible to restore it to its previous state... That or ask the photographer whether s/he still has the pictures.

Last edited by Hungry ghost; 10-13-2014 at 12:44 PM. Reason: spelling
 
Old 10-15-2014, 08:16 AM   #7
rtmistler
Moderator
 
Registered: Mar 2011
Location: USA
Distribution: MINT Debian, Angstrom, SUSE, Ubuntu, Debian
Posts: 9,914
Blog Entries: 13

Rep: Reputation: 4948Reputation: 4948Reputation: 4948Reputation: 4948Reputation: 4948Reputation: 4948Reputation: 4948Reputation: 4948Reputation: 4948Reputation: 4948Reputation: 4948
Quote:
Originally Posted by sad View Post
Hi

Linux is an idealistiek world and peaceful. Can we do somthing against violence in the games and someware in this world ?
Reported. Don't "jump" on someone else's question/thread just to post a random opinion you can create your own threads for that!

@sakoi, it's worth asking the photographer if they can re-give to you copies of the content which you paid for; there may be a fee, however you paid for them and therefore have a right to those image files. Sounds like something weird was done by one or more systems. If those 1100 files are still the same sized files, then rename them once again to proper names; make secondary backups of them and separately see about determining what's up with your wife's PC and how it interacts with files on the NAS. For instance, make a copy of files which it previously altered, enable as much debug as you can on the NAS and try to determine why this happens. I fear that next you may find that other files have problems. I mean, that's not an expected outcome. I think a first thing is the fact that the files are considered hidden or non-readable to her PC originally. It really should be that she can see the files on the NAS without needing to modify them.
 
Old 10-20-2014, 09:37 AM   #8
itpathshala
LQ Newbie
 
Registered: Oct 2014
Location: Noida, India
Posts: 1

Rep: Reputation: Disabled
I also find this question answer. thanks for asking..
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
rsync problems due to dot files (.*.ext) from Mac OSX created files anon091 Linux - Server 11 03-29-2013 02:19 PM
bash: mv hidden and not hidden files lupe Linux - General 4 06-22-2009 02:27 PM
How to hide dot files? cegres Linux - Newbie 2 02-07-2008 11:43 AM
Cant copy dot files with cp -r ?? windle Programming 2 02-19-2007 08:14 AM
RSYNC and dot files Buto Linux - General 1 09-22-2005 03:39 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 06:28 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration