Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place. |
Notices |
Welcome to LinuxQuestions.org, a friendly and active Linux Community.
You are currently viewing LQ as a guest. By joining our community you will have the ability to post topics, receive our newsletter, use the advanced search, subscribe to threads and access many other special features. Registration is quick, simple and absolutely free. Join our community today!
Note that registered members see fewer ads, and ContentLink is completely disabled once you log in.
Are you new to LinuxQuestions.org? Visit the following links:
Site Howto |
Site FAQ |
Sitemap |
Register Now
If you have any problems with the registration process or your account login, please contact us. If you need to reset your password, click here.
Having a problem logging in? Please visit this page to clear all LQ-related cookies.
Get a virtual cloud desktop with the Linux distro that you want in less than five minutes with Shells! With over 10 pre-installed distros to choose from, the worry-free installation life is here! Whether you are a digital nomad or just looking for flexibility, Shells can put your Linux machine on the device that you want to use.
Exclusive for LQ members, get up to 45% off per month. Click here for more info.
|
|
08-03-2015, 10:52 AM
|
#1
|
LQ Newbie
Registered: Jul 2015
Posts: 7
Rep:
|
Best practices with NTFS SSD & disk cache
Hello everyone,
I am developing an application which involves several writes per second to a NTFS SSD disk, formatted in a Linux OS. The data is received by the application through several socket connections and it is written to disk after some seconds.
In order to mount the disk and proceed with I/O operations I am using ntfs-3g. Several months have passed since I started writing continuously to the disk and the Linux system has sometimes a strange behavior.
From time to time, I hace detected that if I execute "df", the hard disk partition takes some seconds to appear. I'm afraid this is because the Linux OS is completely blocked due to a high accumulation of pages in disk cache. In my oppinion, ntfs-3g takes so much time because it tries to write into a "corrupted" or "damaged" part of the disk, doesn't it?
I would appreciate advice regarding:
- Disk cache configuration for this case (e.g. vm.dirty_ratio, vm.dirty_background_ratio).
- Good practices to extend the life of the hard disk. For instance, is it good to format it each month/each three months, etc.
- Any other setting in Linux OS regarding the disk subsystem.
Thanks in advance.
|
|
|
08-04-2015, 03:35 AM
|
#2
|
Member
Registered: Sep 2005
Distribution: debian, linux from scratch
Posts: 190
Rep:
|
I remember there used to be issues with SSDs that the amount of writes/reads you could do are limited.
Does anyone know if this is still the case? If so, a normal hard disk would be better.
Do you need the speed advantage of your SSD?
|
|
|
08-04-2015, 12:23 PM
|
#3
|
LQ Newbie
Registered: Jul 2015
Posts: 7
Original Poster
Rep:
|
In this case, the disk must be an SSD. In order to access it from a Windows OS, I formatted it as NTFS. However, after some time writing intensively I have detected some little issues... :S
Maybe, it should be better to use another file system, which one would you recommend in this case?
Maybe ext4? I would need a little support (at least read) from a Windows OS.
Thanks again.
Last edited by lopezavila69; 08-04-2015 at 12:25 PM.
|
|
|
08-04-2015, 01:27 PM
|
#4
|
Member
Registered: Jan 2007
Location: Texas
Distribution: OpenSuSE Tumbleweed, Kernel 4.14*
Posts: 137
Rep:
|
I'm not plugging anyone's particular software and have no opinion of the vendor, but Paragon makes a Windows utility that they say can give Windows read/write capabilities on an EXT file system. Here is a link:
http://www.paragon-software.com/home/extfs-windows/
|
|
|
08-04-2015, 03:42 PM
|
#5
|
Moderator
Registered: Mar 2008
Posts: 22,177
|
"involves several writes per second to a NTFS SSD disk" This is not uncommon.
Might consider telling us about swap or memory amounts and results from top and maybe even power saving issues.
|
|
|
08-05-2015, 11:47 AM
|
#6
|
LQ Newbie
Registered: Jul 2015
Posts: 7
Original Poster
Rep:
|
Hello,
I have tested Paragon software (requires register to download) and Ext2Fsd ( http://www.ext2fsd.com/) and both support read and write operations over EXT4 on Windows OS (tested in Windows 7). In case of using one of these applications I would be able to work with a SSD formatted with EXT4.
Regarding top statistics, the application which records data from the sockets to the disk consumes usually between 20 to 30% CPU in a two-core Intel CPU. Furthermore, swapping is not enabled and I configured systctl.conf with:
Please, let me know if you need any other information.
Best regards.
|
|
|
08-09-2015, 03:10 PM
|
#7
|
LQ Guru
Registered: Nov 2010
Location: Colorado
Distribution: OpenSUSE, CentOS
Posts: 5,573
|
Quote:
Originally Posted by hoes
I remember there used to be issues with SSDs that the amount of writes/reads you could do are limited.
Does anyone know if this is still the case?
|
Sure, but it depends on your definition of the word "limited". If you mean "is there a limit?", the answer is yes. If you mean "is there a limit you could realistically hit within the lifetime of the rest of the machine?", the answer is likely no. The limit depends on the drive, but it's generally somewhere around 1000x the drive's capacity. It takes a lot of work to write/delete the entire contents of a drive 1000x.
|
|
|
All times are GMT -5. The time now is 11:20 AM.
|
LinuxQuestions.org is looking for people interested in writing
Editorials, Articles, Reviews, and more. If you'd like to contribute
content, let us know.
|
Latest Threads
LQ News
|
|