LinuxQuestions.org
Visit Jeremy's Blog.
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 11-12-2017, 11:22 PM   #1
ballsystemlord
Member
 
Registered: Aug 2014
Distribution: Devuan
Posts: 171

Rep: Reputation: Disabled
Post How to do data analytics


Hello,
Recently I finished collecting data about M.2 SSDs. I'm planning to buy one and needed a different metric then is typically used by reviewing sites. I broke out libreoffice and soon had a spreadsheet with lots of data in it.
The problem is that the name for the rows and columns are pretty far away from the vast majority of the actual data making identifying the fields something of an art, even for me.
I know that I could use gnuplot to give me what I want but the manual is 800 pages of bliss (which would take too long to read). I might be able to use a tool inside libreoffice to do data analytics but my entire being is telling me that there's a tool out there for me and I'm going about this the hard way or the "Learn the IDE" way, both of which have large downsides. I know I already tried using the builtin math functions and broke one of the metrics results.
All the numbers are integers or can be promoted to integers.
Ideas?
Thanks!
 
Old 11-13-2017, 08:58 PM   #2
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 18,493

Rep: Reputation: 3099Reputation: 3099Reputation: 3099Reputation: 3099Reputation: 3099Reputation: 3099Reputation: 3099Reputation: 3099Reputation: 3099Reputation: 3099Reputation: 3099
Anything will have a learning curve - better probably to use what you have already. Calc has graphing (charts) and math functions as you mention. Also has a pretty average reputation for intensive work.
Might be worth doing some data reduction if the data are all over the place as you describe. Delete (or hide) rows/columns if you can easily identify them. I might be inclined to export as csv and use something like awk - say " if column2 and column3 and column28 are all zero delete the entire record". Then re-import the reduced file.
The less work you give calc, apparently the better - me purely surmising from what I read of users complaining.
 
1 members found this post helpful.
Old 11-13-2017, 09:38 PM   #3
ballsystemlord
Member
 
Registered: Aug 2014
Distribution: Devuan
Posts: 171

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by syg00 View Post
Anything will have a learning curve - better probably to use what you have already.
I'm not a .

Quote:
Originally Posted by syg00 View Post
Calc has graphing (charts) and math functions as you mention. Also has a pretty average reputation for intensive work.
Might be worth doing some data reduction if the data are all over the place as you describe. Delete (or hide) rows/columns if you can easily identify them. I might be inclined to export as csv and use something like awk - say " if column2 and column3 and column28 are all zero delete the entire record". Then re-import the reduced file.
Good idea, but it would be nice to visualize it in some way. I wonder if awk could generate an xpm image. Hmm...... You have me thinking of something penguiny.
 
Old 11-13-2017, 11:13 PM   #4
AwesomeMachine
LQ Guru
 
Registered: Jan 2005
Location: USA and Italy
Distribution: Debian testing/sid; OpenSuSE; Fedora; Mint
Posts: 5,511

Rep: Reputation: 1007Reputation: 1007Reputation: 1007Reputation: 1007Reputation: 1007Reputation: 1007Reputation: 1007Reputation: 1007
It took me about five minutes to figure out gnuplot. There are plenty of examples online.
 
  


Reply


Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: Data Analytics with Elasticsearch and Scylla LXer Syndicated Linux News 0 08-03-2017 10:12 PM
LXer: Apache Arrow Set to Accelerate Big Data Analytics LXer Syndicated Linux News 0 02-18-2016 06:51 PM
LXer: Looker Unveils New 'Self-Service' Big Data Analytics Platform LXer Syndicated Linux News 0 05-20-2014 09:15 PM
LXer: PostGres-XL released to tackle big data analytics and more LXer Syndicated Linux News 0 05-13-2014 11:00 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 08:07 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Facebook: linuxquestions Google+: linuxquestions
Open Source Consulting | Domain Registration