LinuxQuestions.org
Share your knowledge at the LQ Wiki.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Enterprise Linux Forums > Linux - Enterprise
User Name
Password
Linux - Enterprise This forum is for all items relating to using Linux in the Enterprise.

Notices


Reply
  Search this Thread
Old 09-27-2018, 10:57 AM   #1
IT Bard
LQ Newbie
 
Registered: Sep 2018
Posts: 1

Rep: Reputation: Disabled
What is the best practice for dist-upgrading a very large production server?


I've been given a server running Ubuntu 12.04 LTS and I would like to bring it up to at least the next version 14.04 LTS, or preferably the current version 18.04 LTS. The server has ~ 32 TB of data spread out over several Linux volume groups mounted to the filesystem, with /var taking up nearly 10 TB and backups from other servers being kept on /mnt and consuming 22 TB. It's a bare metal server, not a virtual machine, and it's also in production so the upgrade process needs to go smoothly so that our code repository and also our ticketing system remain available with minimal downtime. Removing the backups mounted to the filesystem would trim the overall filesystem down to ~ 10 TB. Most of our applications and the usual system stuff are resident in /var however so I cannot simply unmount it in order to shrink the filesystem any further. The LVGs are carved out of a single RAID 5 array. (I'm aware that RAID 6 or RAID 10 would be preferable but I was recently handed the machine and did not design or build it.)

Ideally, when doing an upgrade to a server, I like to duplicate the environment as closely as possible and test the process in order to make sure that there's no issue with either upgrading the kernel or especially the applications. In this particular case, I don't have TBs of space anywhere to either clone the machine for a VM or have the resources to create a duplicate bare metal server. As 12.04 has now reached EOL, and the server has not had security updates in a long time, it is imperative to upgrade the server as soon as possible to at least 14.04 LTS. I've done *nix upgrades before in my career, but I'm not a Linux specialist, and I don't have any experience with a server this large.

I've googled for the best practices for testing and dist-upgrading a large production server but I'm not getting anything particularly useful. Does anyone have any resources that they could point me to or have any advice for the best way to tackle this beast? Thank you in advance for your assistance.
 
Old 09-27-2018, 08:16 PM   #2
Ztcoracat
LQ Guru
 
Registered: Dec 2011
Distribution: Slackware, MX 18
Posts: 9,484
Blog Entries: 15

Rep: Reputation: 1176Reputation: 1176Reputation: 1176Reputation: 1176Reputation: 1176Reputation: 1176Reputation: 1176Reputation: 1176Reputation: 1176
Hi & Welcome to LQ-

Congrads on getting a server.

I can't walk you through the upgrade but I did find some good links for you to start reading at the very least.

-:::-Best to wait for members here with Ubuntu server experience.-:::-

To cleanly upgrade from 12.04 to 16.04, you must first upgrade the system to 14.04, then to 16.04:
http://robots.mobilerobots.com/wiki/..._16.04_(xenial)

https://www.digitalocean.com/communi...untu-14-04-lts

Ubuntu Server Guide

https://help.ubuntu.com/lts/serverguide/

Good Luck:-
 
Old 09-27-2018, 09:18 PM   #3
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,142

Rep: Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123Reputation: 4123
In future it would be better to not respond like this as it stops the thread from being reposted automatically as a zero-reply.

@IT Bard, this sounds like there is no backups of this system - RAID is not a substitute for backups. You may not have designed it, but if it's now your neck on the chopping block, you need to make your line manager(s) aware of the risks.

Is the system itself on a lv ?. Boot doesn't really matter if it's not, so long as the rest is. If so snapshot is a good option, although the roll-back if needed could cause a bit of an outage. For a system update (or worse two) you'll need a bit of space, but nothing like 10T. And it can be easily reclaimed later.
 
Old 02-20-2019, 05:31 AM   #4
Linux-cipher
LQ Newbie
 
Registered: Aug 2018
Posts: 8

Rep: Reputation: Disabled
Hi Chaps,

I would strongly recommend you speak to the managers and advise to migrate to a new hardware!
That way you can maybe go for a VMware Suite Solution and gives you more times to install and configure the new environment and migrate the data over slowly.
If you go with VMware Suite you will be able to create snapshots which will allow you to revert back and try again.

Best to leave the current environment in place. The engineer before your time should of done his job by updating the server.

Good luck and let us know how you get on.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Setting up tune2fs on production servers with long uptimes - is there a best practice? JockVSJock Linux - Newbie 7 03-08-2017 02:23 PM
[SOLVED] Problems dist-upgrading thanks to WINE. 273 Debian 14 01-05-2014 11:55 AM
32bit Test Server for 64bit Production Server jmxfield Linux - Newbie 4 03-21-2011 06:50 PM
LXer: Upgrading a production Debian Lenny desktop to Squeeze? LXer Syndicated Linux News 0 03-18-2010 08:30 AM
Serious problem with apt-get dist-upgrade - encoutered fatal errors while upgrading! DarkLight Debian 3 08-06-2004 02:22 PM

LinuxQuestions.org > Forums > Enterprise Linux Forums > Linux - Enterprise

All times are GMT -5. The time now is 01:30 PM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration