LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - General
User Name
Password
Linux - General This Linux forum is for general Linux questions and discussion.
If it is Linux Related and doesn't seem to fit in any other forum then this is the place.

Notices


Reply
  Search this Thread
Old 08-03-2015, 10:52 AM   #1
lopezavila69
LQ Newbie
 
Registered: Jul 2015
Posts: 7

Rep: Reputation: Disabled
Best practices with NTFS SSD & disk cache


Hello everyone,

I am developing an application which involves several writes per second to a NTFS SSD disk, formatted in a Linux OS. The data is received by the application through several socket connections and it is written to disk after some seconds.

In order to mount the disk and proceed with I/O operations I am using ntfs-3g. Several months have passed since I started writing continuously to the disk and the Linux system has sometimes a strange behavior.

From time to time, I hace detected that if I execute "df", the hard disk partition takes some seconds to appear. I'm afraid this is because the Linux OS is completely blocked due to a high accumulation of pages in disk cache. In my oppinion, ntfs-3g takes so much time because it tries to write into a "corrupted" or "damaged" part of the disk, doesn't it?


I would appreciate advice regarding:

- Disk cache configuration for this case (e.g. vm.dirty_ratio, vm.dirty_background_ratio).

- Good practices to extend the life of the hard disk. For instance, is it good to format it each month/each three months, etc.

- Any other setting in Linux OS regarding the disk subsystem.

Thanks in advance.
 
Old 08-04-2015, 03:35 AM   #2
hoes
Member
 
Registered: Sep 2005
Distribution: debian, linux from scratch
Posts: 190

Rep: Reputation: 51
I remember there used to be issues with SSDs that the amount of writes/reads you could do are limited.
Does anyone know if this is still the case? If so, a normal hard disk would be better.
Do you need the speed advantage of your SSD?
 
Old 08-04-2015, 12:23 PM   #3
lopezavila69
LQ Newbie
 
Registered: Jul 2015
Posts: 7

Original Poster
Rep: Reputation: Disabled
In this case, the disk must be an SSD. In order to access it from a Windows OS, I formatted it as NTFS. However, after some time writing intensively I have detected some little issues... :S

Maybe, it should be better to use another file system, which one would you recommend in this case?
Maybe ext4? I would need a little support (at least read) from a Windows OS.

Thanks again.

Last edited by lopezavila69; 08-04-2015 at 12:25 PM.
 
Old 08-04-2015, 01:27 PM   #4
purevw
Member
 
Registered: Jan 2007
Location: Texas
Distribution: OpenSuSE Tumbleweed, Kernel 4.14*
Posts: 137

Rep: Reputation: 52
I'm not plugging anyone's particular software and have no opinion of the vendor, but Paragon makes a Windows utility that they say can give Windows read/write capabilities on an EXT file system. Here is a link:

http://www.paragon-software.com/home/extfs-windows/
 
Old 08-04-2015, 03:42 PM   #5
jefro
Moderator
 
Registered: Mar 2008
Posts: 22,177

Rep: Reputation: 3645Reputation: 3645Reputation: 3645Reputation: 3645Reputation: 3645Reputation: 3645Reputation: 3645Reputation: 3645Reputation: 3645Reputation: 3645Reputation: 3645
"involves several writes per second to a NTFS SSD disk" This is not uncommon.

Might consider telling us about swap or memory amounts and results from top and maybe even power saving issues.
 
Old 08-05-2015, 11:47 AM   #6
lopezavila69
LQ Newbie
 
Registered: Jul 2015
Posts: 7

Original Poster
Rep: Reputation: Disabled
Hello,

I have tested Paragon software (requires register to download) and Ext2Fsd (http://www.ext2fsd.com/) and both support read and write operations over EXT4 on Windows OS (tested in Windows 7). In case of using one of these applications I would be able to work with a SSD formatted with EXT4.

Regarding top statistics, the application which records data from the sockets to the disk consumes usually between 20 to 30% CPU in a two-core Intel CPU. Furthermore, swapping is not enabled and I configured systctl.conf with:
  • vm.min_free_kbytes=65536

Please, let me know if you need any other information.
Best regards.
 
Old 08-09-2015, 03:10 PM   #7
suicidaleggroll
LQ Guru
 
Registered: Nov 2010
Location: Colorado
Distribution: OpenSUSE, CentOS
Posts: 5,573

Rep: Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142Reputation: 2142
Quote:
Originally Posted by hoes View Post
I remember there used to be issues with SSDs that the amount of writes/reads you could do are limited.
Does anyone know if this is still the case?
Sure, but it depends on your definition of the word "limited". If you mean "is there a limit?", the answer is yes. If you mean "is there a limit you could realistically hit within the lifetime of the rest of the machine?", the answer is likely no. The limit depends on the drive, but it's generally somewhere around 1000x the drive's capacity. It takes a lot of work to write/delete the entire contents of a drive 1000x.
 
  


Reply

Tags
disk diagnostics, ntfs3g, ssd


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Polipo cache to disk, cannot activate disk caching, different browsers redownload con Trauma Linux - Software 8 12-07-2013 12:13 PM
How to change disk size by editing disk information on the hard disk? xptchina Linux - Virtualization and Cloud 2 12-16-2010 09:12 AM
Can I use a solid state drive as a cache for a larger hard disk? jcreigh Linux - General 1 12-03-2008 12:28 AM
60GB laptop hard disk & 200GB external USB hard disk linux compatibility powah Linux - Hardware 0 03-07-2006 11:55 AM
hard disk cache. yapp Linux - Hardware 6 10-31-2003 05:50 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - General

All times are GMT -5. The time now is 11:20 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration