LinuxQuestions.org
Help answer threads with 0 replies.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Software
User Name
Password
Linux - Software This forum is for Software issues.
Having a problem installing a new program? Want to know which application is best for the job? Post your question in this forum.

Notices


Reply
  Search this Thread
Old 10-10-2019, 10:57 AM   #1
ivano8
LQ Newbie
 
Registered: Jul 2019
Posts: 12

Rep: Reputation: Disabled
uploading big files in google drive


I have 2 giga and plus files,since it takes ages to download them
so I need to resume broken downloads, namely I cannot leave my pc open all the time to upload

Actual situation
files stop to be uploaded when my internet connection does not work, and cannot be resumed

Expected situation
slowly the files get updated while I am performing other tasks, they do not get broken
 
Old 10-10-2019, 11:02 AM   #2
scasey
LQ Veteran
 
Registered: Feb 2013
Location: Tucson, AZ, USA
Distribution: CentOS 7.9.2009
Posts: 5,727

Rep: Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211
Quote:
Originally Posted by ivano8 View Post
I have 2 giga and plus files,since it takes ages to download them
so I need to resume broken downloads, namely I cannot leave my pc open all the time to upload

Actual situation
files stop to be uploaded when my internet connection does not work, and cannot be resumed

Expected situation
slowly the files get updated while I am performing other tasks, they do not get broken
Is there an question here? I'm not sure how this relates to anything Linux.

What flavor of Linux are you running?
What is the type and connection speed of your internet connection?

Please review the "How To Ask A Question" link in my signature.
 
Old 10-10-2019, 11:08 AM   #3
pan64
LQ Addict
 
Registered: Mar 2012
Location: Hungary
Distribution: debian/ubuntu/suse ...
Posts: 21,838

Rep: Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308
the "usual" way [in such cases] is to split file into smaller parts....
 
Old 10-10-2019, 11:45 AM   #4
ivano8
LQ Newbie
 
Registered: Jul 2019
Posts: 12

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by pan64 View Post
the "usual" way [in such cases] is to split file into smaller parts....
this is really inefficient, especially for videos, AFAIK windows users get a resume function, I guess I will rather see for a NAS or some operative system agnostic solution.

Sorry if the question does not meet the standards of 'How to ask a question', I wanted to give just the essential information from a product owner point of view. Anyway I see your point I am using Linux GNU Manjaro with LXDE (so in theory if I can avoid to get gnome dependencies would be better for my system I guess, but is not important, my kernel is 4.19.66).
 
Old 10-10-2019, 11:58 AM   #5
scasey
LQ Veteran
 
Registered: Feb 2013
Location: Tucson, AZ, USA
Distribution: CentOS 7.9.2009
Posts: 5,727

Rep: Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211
Quote:
Originally Posted by ivano8 View Post
Sorry if the question does not meet the standards of 'How to ask a question'
It is less about "standards" and more about what do you expect us to help you with?
You've only stated that you have a problem; and that you'd like not to have that problem.

Here are things that you need to share to enable us to help:
Again, what is your connection type and speed?
What tool are you using to make the connection? "Resumability" is often managed by the client software.
Does the client software you're using support that functionality?
Does Google Cloud support that functionality?
 
Old 10-10-2019, 12:15 PM   #6
ivano8
LQ Newbie
 
Registered: Jul 2019
Posts: 12

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by scasey View Post
It is less about "standards" and more about what do you expect us to help you with?
You've only stated that you have a problem; and that you'd like not to have that problem.

Here are things that you need to share to enable us to help:
Again, what is your connection type and speed?
What tool are you using to make the connection? "Resumability" is often managed by the client software.
Does the client software you're using support that functionality?
Does Google Cloud support that functionality?
Thank you to come back to me, truly appreciated.

>Again, what is your connection type and speed?

I have declared 40Mb/sec upload velocity, I did not run any test.

>What tool are you using to make the connection? "Resumability" is often managed by the client software.

At the moment I am using Firefox and Midori exploiting the web service functionality furnished by Alphabet.No client.

>Does the client software you're using support that functionality?

I am not using any client, and I cannot orientate my self as there are a lot of clients, my
shortlist would be rclone, ocamlfuse and grive 2 as far as I can see the github projects

>Does Google Cloud support that functionality?

I guess so because I found a link that shows how to resume files in w$, the not free redmond system has allegedly a resume function in the action bar on the left(where appear the running programs at the startup)


What really surprise me is that cannot find documentation on the internet regarding how to use this well known storage cloud service, and to be strictly honest cannot explain why Alphabet is not going to support Linux users. Would be afraid if Linus could do another "Nvidia" affirmation at this regard

Last edited by ivano8; 10-10-2019 at 12:18 PM.
 
Old 10-10-2019, 12:43 PM   #7
scasey
LQ Veteran
 
Registered: Feb 2013
Location: Tucson, AZ, USA
Distribution: CentOS 7.9.2009
Posts: 5,727

Rep: Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211
If you're using browsers, then the browser is your client, so you're then dependent upon what the remote website/server supports.
This search returned several links to pages on cloud.google.com about resuming uploads. It appears that managing a Google Drive is done via web pages, so it shouldn't matter what the underlying operating system is.

By "w$" are you referring to Windows? If you see a link on a Windows browser that you don't see on a Linux browser you should search Google's help for why that might be. Are you using the "app" on Windows?

See Google Docs and Support. I'm not sure how "Alphabet" is involved.

You still didn't share your connection type (Cable, DSL, dial-up,?)...and you should probably run some speed tests to see what you actually have.

EDIT: I still don't see how this is a Linux software technical question. Just sayin'

Last edited by scasey; 10-10-2019 at 12:46 PM.
 
Old 10-10-2019, 01:51 PM   #8
ondoho
LQ Addict
 
Registered: Dec 2013
Posts: 19,872
Blog Entries: 12

Rep: Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053Reputation: 6053
I'm pretty sure that recent Firefox versions automatically try to resume paused/interrupted downloads, and CLI utilities like curl and wget, too.
 
Old 10-10-2019, 03:55 PM   #9
jefro
Moderator
 
Registered: Mar 2008
Posts: 21,980

Rep: Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624Reputation: 3624
rsync or rclone maybe??
 
Old 10-10-2019, 04:43 PM   #10
scasey
LQ Veteran
 
Registered: Feb 2013
Location: Tucson, AZ, USA
Distribution: CentOS 7.9.2009
Posts: 5,727

Rep: Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211Reputation: 2211
I just had a friend send me a link to ~70 jpeg files on his Google Drive, ranging from 1MB to 4MB each (they are scans of scrapbook pages).
I find navigating through them on the Google Drive to be tedious at best.

I requested a download of all files, the Google app zipped them up and they downloaded in a blink (zip files was 100MB).

This on Firefox 69.0.2.
That's certainly not the OPs "2 giga and plus" by a long shot, 'tho.
 
Old 10-10-2019, 06:52 PM   #11
dugan
LQ Guru
 
Registered: Nov 2003
Location: Canada
Distribution: distro hopper
Posts: 11,223

Rep: Reputation: 5320Reputation: 5320Reputation: 5320Reputation: 5320Reputation: 5320Reputation: 5320Reputation: 5320Reputation: 5320Reputation: 5320Reputation: 5320Reputation: 5320
Quote:
Originally Posted by ivano8 View Post
so I need to resume broken downloads
Paste the download URL into a terminal and download it with "wget -c". Use "wget -c --content-disposition if there's redirection involved."
 
Old 10-11-2019, 12:53 AM   #12
pan64
LQ Addict
 
Registered: Mar 2012
Location: Hungary
Distribution: debian/ubuntu/suse ...
Posts: 21,838

Rep: Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308Reputation: 7308
Quote:
Originally Posted by ivano8 View Post
this is really inefficient, especially for videos, AFAIK windows users get a resume function, I guess I will rather see for a NAS or some operative system agnostic solution.

Sorry if the question does not meet the standards of 'How to ask a question', I wanted to give just the essential information from a product owner point of view. Anyway I see your point I am using Linux GNU Manjaro with LXDE (so in theory if I can avoid to get gnome dependencies would be better for my system I guess, but is not important, my kernel is 4.19.66).
As you stated it is not about efficiency, but about safety. If you cannot upload/download big file you have to split it.
There are possibilities to resume downloads (and probably uploads too), but it may depend on external services (like google drive or others) which cannot be modified.
rsync is definitely designed to work on slow and unstable networks.
 
Old 10-11-2019, 03:08 PM   #13
ivano8
LQ Newbie
 
Registered: Jul 2019
Posts: 12

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by pan64 View Post
As you stated it is not about efficiency, but about safety. If you cannot upload/download big file you have to split it.
There are possibilities to resume downloads (and probably uploads too), but it may depend on external services (like google drive or others) which cannot be modified.
rsync is definitely designed to work on slow and unstable networks.
I am going to look into thank you very much

Last edited by ivano8; 10-11-2019 at 03:13 PM.
 
Old 10-11-2019, 03:13 PM   #14
ivano8
LQ Newbie
 
Registered: Jul 2019
Posts: 12

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by dugan View Post
Paste the download URL into a terminal and download it with "wget -c". Use "wget -c --content-disposition if there's redirection involved."
Looks as a decent workaround, this
Code:
`wget -c`
, but I am going to upload a file, not download, i guess would be more a
Code:
curl
command, but I doubt I can easily see where google drive is uploading under the hood
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
LXer: Big Apple, Big Google, Big Brother LXer Syndicated Linux News 1 04-26-2011 03:06 AM
Big O, Big Omega, and Big Theta oulevon Programming 7 05-26-2010 07:18 AM
How BIG are "Big files" in "XFS is the best with big files"? ingerudo Linux - General 1 09-11-2009 08:36 AM
LXer: Why Big Compute and Big Storage will meet Big Pipe at the Last Mile LXer Syndicated Linux News 0 12-23-2007 01:20 PM
ftp problem with uploading big files joeSVK Linux - Networking 2 05-10-2005 03:52 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Software

All times are GMT -5. The time now is 12:45 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration