LinuxQuestions.org
Visit Jeremy's Blog.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Virtualization and Cloud
User Name
Password
Linux - Virtualization and Cloud This forum is for the discussion of all topics relating to Linux Virtualization and Linux Cloud platforms. Xen, KVM, OpenVZ, VirtualBox, VMware, Linux-VServer and all other Linux Virtualization platforms are welcome. OpenStack, CloudStack, ownCloud, Cloud Foundry, Eucalyptus, Nimbus, OpenNebula and all other Linux Cloud platforms are welcome. Note that questions relating solely to non-Linux OS's should be asked in the General forum.

Notices


Reply
  Search this Thread
Old 04-15-2015, 11:25 AM   #1
usao
Member
 
Registered: Dec 2011
Location: Chandler, AZ
Posts: 286

Rep: Reputation: Disabled
Amazon AWS Linux servers


We created a "free" t2.micro instance in order to test remote backups. I fully understand there may be limitations due to the "free" and "small" nature of the instance, but where can I find some details regarding the expected network bandwidth?
In our tests so-far, we are only getting about 7 MByte/sec throughput, which is well below what we expected.
Ive poked around on the AWS website, but I can't seem to locate any documentation on network bandwidth as it relates to the "price" and "size" of the instance.
Any pointers would be appreciated.
 
Old 04-15-2015, 02:25 PM   #2
Pearlseattle
Member
 
Registered: Aug 2007
Location: Zurich, Switzerland
Distribution: Gentoo
Posts: 999

Rep: Reputation: 142Reputation: 142
It would probably be more reliable if you would ask Amazon directly - tested there once an EC2 instance and their support had always been very quick and precise (maybe things have changed now ).
Saying this because there might be multiple factors involved - maybe the geographic location in which your instance is based has some problems or limitations, maybe the way that you're running the test hits some other limitations (CPU/disk/RAM), etc... or maybe your expectations are just too high.
 
Old 04-15-2015, 02:40 PM   #3
usao
Member
 
Registered: Dec 2011
Location: Chandler, AZ
Posts: 286

Original Poster
Rep: Reputation: Disabled
Quote:
Originally Posted by Pearlseattle View Post
It would probably be more reliable if you would ask Amazon directly - tested there once an EC2 instance and their support had always been very quick and precise (maybe things have changed now ).
Saying this because there might be multiple factors involved - maybe the geographic location in which your instance is based has some problems or limitations, maybe the way that you're running the test hits some other limitations (CPU/disk/RAM), etc... or maybe your expectations are just too high.
Yes, we did ask amazon support, but never got a response. We fully understand that we are at the mercy of any networking equipment between the source and target sites and can't do anything about that, but as for expectations, I think our goal is to try and find out what kind of cost would meet our performance needs. That said, 7MB/sec is just too slow, but we don't need full gigabit connectivity either. The goal would be to be able to take backups over several hours, so something in the neighborhood of 100-200 MB/sec is closer to what we need.
 
Old 04-15-2015, 03:04 PM   #4
Pearlseattle
Member
 
Registered: Aug 2007
Location: Zurich, Switzerland
Distribution: Gentoo
Posts: 999

Rep: Reputation: 142Reputation: 142
Ok, well that's weird that you never got any response.
In any case if I remember correctly, when testing the bandwidth of amazon EC2 vs. "ovh.de" (I used to have a VM there), I used to get 25MB/s.
That was great for me so I did not investigate if the 25MB/s were limited by amazon or by ovh.de.
 
Old 04-15-2015, 03:08 PM   #5
Pearlseattle
Member
 
Registered: Aug 2007
Location: Zurich, Switzerland
Distribution: Gentoo
Posts: 999

Rep: Reputation: 142Reputation: 142
Quote:
...our goal is to try and find out what kind of cost would meet our performance needs
You want some kind of Service Level Agreement => really really wrong to define it here => again, you (your company or whatever) should ask Amazon.
 
Old 04-15-2015, 03:47 PM   #6
Habitual
LQ Veteran
 
Registered: Jan 2011
Location: Abingdon, VA
Distribution: Catalina
Posts: 9,374
Blog Entries: 37

Rep: Reputation: Disabled
Quote:
Originally Posted by usao View Post
I can't seem to locate any documentation on network bandwidth as it relates to the "price" and "size" of the instance.
Any pointers would be appreciated.
Free Tier* says
Code:
As part of AWS’s Free Tier, new AWS customers can get started with Amazon EC2 for free. Upon sign-up, new AWS customers receive the following EC2 services each month for one year:

    750 hours of EC2 running Linux, RHEL, or SLES t2.micro instance usage
    750 hours of EC2 running Microsoft Windows Server t2.micro instance usage
    750 hours of Elastic Load Balancing plus 15 GB data processing
    30 GB of Amazon Elastic Block Storage in any combination of General Purpose (SSD) or Magnetic, plus 2 million I/Os (with Magnetic) and 1 GB of snapshot storage
    15 GB of bandwidth out aggregated across all AWS services
    1 GB of Regional Data Transfer
Documentation
 
1 members found this post helpful.
Old 04-16-2015, 09:47 AM   #7
kpt65
LQ Newbie
 
Registered: Mar 2015
Posts: 8

Rep: Reputation: Disabled
t2.micro not really for anything but testing and casual use

Even if you got good network performance out of one, it is temporary. t2.micros are alloted "credits" for cpu useage and a I guarantee they get lowest priority on the network. They're really for just testing.


google "amazon ec2 instance types" for more info on t2 instances.

If you can still launch an m1.small, that's about as low as you want to go, but they're being phased out. Other than that, m3.medium, and those are about $100/mo; additional storage extra. You could use s3, but if you already have an instance, you may as well use EBS.
 
Old 04-16-2015, 10:03 AM   #8
usao
Member
 
Registered: Dec 2011
Location: Chandler, AZ
Posts: 286

Original Poster
Rep: Reputation: Disabled
One of the basic isses is that I don't fully understand all the different services and how they interact with each other and with my hosts at the data center.
Ive tried several times to get hold of someone at Amazon, but they are not very responsive.
Ideally, I would just prefer to be able to access a cloud filesystem or cloud iSCSI storage directly from my hosts, as that would seem to be the simplest approach.
Using iSCSI would also allow me to perform block-level incremental dumps from the database, meaning I would only update changed blocks when re-syncing the primary to the cloud. That should minimize the amount of traffic generated. Using a filesystem, I can still perform incremental dumps, but would need a periodic full-dump. The incremental dumps to filesystem would also be additive (requiring additional storage on top of the full dump) where-as iSCSI would allow me to "replace" the existing changed blocks thus keeping the iSCSI luns consistent.
 
Old 04-16-2015, 10:22 AM   #9
usao
Member
 
Registered: Dec 2011
Location: Chandler, AZ
Posts: 286

Original Poster
Rep: Reputation: Disabled
Finally got hold of Sales team at Amazon. Getting them to forward some details on how AWS works and what my storage options may be.
Im not sure that iSCSI will work though, it sounds like the interface may be a bit different than im use to from a SAN storage background.

Anyhow, if anyone knows of any iSCSI cloud providers, that would be good to get as a fall-back option.
 
Old 04-16-2015, 11:40 AM   #10
kpt65
LQ Newbie
 
Registered: Mar 2015
Posts: 8

Rep: Reputation: Disabled
@usao, Amazon doesn't really fit in this case. It's fine for integrating certain kinds of resources into your local environment, but it doesn't give any way to directly interface with arbitrary storage other than S3 (possibly glacier). And S3 has voodoo involved with regard to it's pricing; better to find someone who'll give you plain storage with an iscsi interface to connect to. Costs will be more deterministic as well, and fixed price usually better than "should be cheaper". But you might do better looking at storage services rather than specifically cloud services.
 
1 members found this post helpful.
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
AWS Amazon randomly breaks routing sparc86 Linux - Virtualization and Cloud 3 09-05-2014 09:26 AM
Amazon's AWS/EC2 CentOS instances cannot talk to each other ronbarak Linux - Networking 3 05-05-2013 04:27 AM
Is it possible to create Slackware AMI image for amazon AWS? kite Slackware 4 02-19-2013 02:19 PM
LXer: Amazon resets AWS's PHP SDK LXer Syndicated Linux News 0 11-05-2012 09:50 PM
Amazon AWS windows instance backups linuxlover.chaitanya General 0 05-17-2011 12:15 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Virtualization and Cloud

All times are GMT -5. The time now is 01:21 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration