Badcaps.net Forum
Go Back   Badcaps Forums > Welcome to the Badcaps.net Tech Forum! > Announcements & Related News
Register FAQ Calendar Search Today's Posts Mark Forums Read

 
Thread Tools Display Modes
Old 01-17-2016, 05:58 AM   #1
shovenose
Send Doge Memes
 
shovenose's Avatar
 
Join Date: Aug 2010
City & State: Fairfax, California
My Country: USA
I'm a: Forum Junkie
Posts: 6,128
Default Migration Complete, everything is working....post here if you think it isn't

Hello everybody! The website has been moved to the new server. The only way we could get this done in a reasonable amount of time was to move everything except the attachments and worry about them later. It's going to be days to a week before those are done, so we appreciate your patience. In the mean time, no attachments will load, and we have disabled the uploading of attachments. While they're typically annoying because they slow down page loads, use of an image host like http://imgur.com/ is suggested at this time. Sorry for any frustrations, but if we had not made that choice you'd be sitting here staring at an error message for another decade.

Please report any problems you experience with the forum (besides the lack of attachments, obviously), or give your feedback for performance, or anything else, in this thread. We have done minimal optimization and wanted to get it up as far as possible so there is room for improvement, but your preliminary thoughts are much appreciated.
__________________
1995 Chevy Silverado ~276K.
2010 Ford Escape ~90K.
shovenose is offline   Reply With Quote
Old 01-17-2016, 06:35 AM   #2
mariushm
Badcaps Veteran
 
Join Date: May 2011
City & State: Romania
Line Voltage: 230VAC 50Hz
I'm a: Hobbyist Tech
Posts: 3,662
Default Re: Site is back, attachments aren't yet. Read this please!

somewhat off topic... this whole upgrade/migration looks like it was handled very poorly but it's free so I shouldn't really complain.

Seriously, how slow is the server's internet connection?

Even with just 10mbps upload, it would have taken less than 24 hours to upload those 70 GB.. unless rsync or some other crap like that was used.

I typically use 7zip with ultra fast compression or rar with none/very fast to compress tons of small files (like the thumbnails and images) into 100MB - 1 GB files which I can then transfer through ftp to other servers (downloading several files concurrently) to saturate the uplink.

The packing + simultaneous transfers usually saves a huge amount of time.

I guess I'm just too used to European datacenters with good peerings that allow me to saturate 100mbps upload to US or anywhere in Europe.
mariushm is offline   Reply With Quote
Old 01-17-2016, 06:39 AM   #3
shovenose
Send Doge Memes
 
shovenose's Avatar
 
Join Date: Aug 2010
City & State: Fairfax, California
My Country: USA
I'm a: Forum Junkie
Posts: 6,128
Default Re: Site is back, attachments aren't yet. Read this please!

Quote:
Originally Posted by mariushm View Post
somewhat off topic... this whole upgrade/migration looks like it was handled very poorly but it's free so I shouldn't really complain.

Seriously, how slow is the server's internet connection?

Even with just 10mbps upload, it would have taken less than 24 hours to upload those 70 GB.. unless rsync or some other crap like that was used.

I typically use 7zip with ultra fast compression or rar with none/very fast to compress tons of small files (like the thumbnails and images) into 100MB - 1 GB files which I can then transfer through ftp to other servers (downloading several files concurrently) to saturate the uplink.

The packing + simultaneous transfers usually saves a huge amount of time.

I guess I'm just too used to European datacenters with good peerings that allow me to saturate 100mbps upload to US or anywhere in Europe.
The old server was moving data at about 70KB/s. There was not sufficient space on the old servers (disks were almost completely full) so zipping stuff up was not an option. Also, the old server went down twice for what was apparently RAID array rebuilds during the download process. Quite frustrating, and made the migration infinitely more complex.
shovenose is offline   Reply With Quote
Old 01-17-2016, 06:41 AM   #4
diif
Badcaps Veteran
 
Join Date: Feb 2014
City & State: Midlands
My Country: England
I'm a: Professional Tech
Posts: 3,717
Default Re: Site is back, attachments aren't yet. Read this please!

I'm definitely noticing the speed increase.
diif is offline   Reply With Quote
Old 01-17-2016, 06:44 AM   #5
ReeceyBurger123
Never Give Up !
 
ReeceyBurger123's Avatar
 
Join Date: May 2014
City & State: Telford
My Country: Britain
Line Voltage: 240 VAC 50Hz
I'm a: Student Tech
Posts: 7,118
Default Re: Site is back, attachments aren't yet. Read this please!

Quote:
Originally Posted by diif View Post
I'm definitely noticing the speed increase.
Same here instant loading
__________________
Please Do Not PM My Page Asking For Help Badcaps Is The Place For Advise, Page Linked For Business Reasons Only. Anyone Doing So Will Be Banned Instantly !

https://www.facebook.com/Telford-Tel...7894576335359/
ReeceyBurger123 is offline   Reply With Quote
Old 01-17-2016, 07:21 AM   #6
TechGeek
Computer Geek
 
TechGeek's Avatar
 
Join Date: Jan 2015
City & State: Texas
My Country: USA
Line Voltage: 122.5VAC@60hZ/200A
I'm a: Hardcore Geek
Posts: 1,412
Default Re: Site is back, attachments aren't yet. Read this please!

WOOHOO! How's the store?
__________________
Don't buy those $10 PSU "specials". They fail, and they have taken whole computers with them.

For computer parts, go to Newegg
OR
Amazon.

For electrical stuff(pushbuttons, capacitors, etc), use Digikey
OR
Mouser.

Windows 10!? Oh yeah, that sorry excuse of an operating system that spies on you 24/7/365!

Samsung = Seagate = Seatrash = Trashgate
Don't buy Seagate drives. Don't use Seagate drives. If you have any in service right now, make plans to replace them ASAP.

TVs repaired: Toshiba 32AV500U
Stereo Receivers brought back to life: 1(Fisher RS-1056)
Stereos/Stereo receivers to recap: Fisher RS-1056


TechGeek is offline   Reply With Quote
Old 01-17-2016, 07:23 AM   #7
ratdude747
Black Sheep
 
ratdude747's Avatar
 
Join Date: Nov 2008
City & State: Madison, IN
My Country: USA
Line Voltage: 120VAC 60Hz
I'm a: Professional Tech
Posts: 15,825
Default Re: Site is back, attachments aren't yet. Read this please!

Hell at this rate, if anybody has access to the servers directly, I wonder if copying them to an external HDD and mailing it to the new server would be faster. No joke, even if it was a backup plan alone.
__________________


(Insert witty quote here)
ratdude747 is offline   Reply With Quote
Old 01-17-2016, 07:33 AM   #8
TechGeek
Computer Geek
 
TechGeek's Avatar
 
Join Date: Jan 2015
City & State: Texas
My Country: USA
Line Voltage: 122.5VAC@60hZ/200A
I'm a: Hardcore Geek
Posts: 1,412
Default Re: Site is back, attachments aren't yet. Read this please!

What happened to the epic thread "the gutless, bloated power supply hall of fame"? I can't find it.
TechGeek is offline   Reply With Quote
Old 01-17-2016, 07:34 AM   #9
ratdude747
Black Sheep
 
ratdude747's Avatar
 
Join Date: Nov 2008
City & State: Madison, IN
My Country: USA
Line Voltage: 120VAC 60Hz
I'm a: Professional Tech
Posts: 15,825
Default Re: Site is back, attachments aren't yet. Read this please!

Quote:
Originally Posted by shovenose View Post
The old server was moving data at about 70KB/s. There was not sufficient space on the old servers (disks were almost completely full) so zipping stuff up was not an option. Also, the old server went down twice for what was apparently RAID array rebuilds during the download process. Quite frustrating, and made the migration infinitely more complex.
For those who want a little more on this, here was some test data Shovenose had me run on the old server (since I have a different ISP and happened to be on Skype at the right time, I was the guinea pig):

Code:
 [larry@larry-e6430 ~]$ traceroute badcaps.net
traceroute to badcaps.net (199.68.189.233), 30 hops max, 60 byte packets
 1  DD-WRT (192.168.1.1)  4.746 ms  4.726 ms  4.726 ms
 2  192.168.0.1 (192.168.0.1)  7.007 ms  7.011 ms  7.083 ms
 3  * * *
 4  xe-0-0-6.nwalinco02h.midwest.rr.com (74.128.45.41)  38.191 ms  38.189 ms  40.395 ms
 5  be29.lsvmkyzo01r.midwest.rr.com (65.29.27.156)  30.105 ms  30.110 ms  30.108 ms
 6  be24.clmkohpe01r.midwest.rr.com (65.189.140.162)  38.133 ms  28.129 ms  31.754 ms
 7  bu-ether35.chctilwc00w-bcr00.tbone.rr.com (107.14.19.60)  43.095 ms  43.104 ms  43.101 ms
 8  0.ae1.pr0.chi30.tbone.rr.com (66.109.1.78)  43.055 ms 0.ae0.pr0.chi30.tbone.rr.com (66.109.1.76)  43.058 ms 0.ae1.pr0.chi30.tbone.rr.com (66.109.1.78)  43.048 ms
 9  * * *
10  ae-2-3513.edge1.Atlanta4.Level3.net (4.69.150.161)  61.664 ms  61.675 ms  61.672 ms
11  64.209.110.102 (64.209.110.102)  53.001 ms  55.660 ms  57.842 ms
12  r03.crtga.11.fogodc.net (199.68.188.2)  57.870 ms  57.859 ms  57.861 ms
13  r04.crtga.13.fogodc.net (199.68.188.22)  57.851 ms  59.655 ms  59.649 ms
14  * * *
15  * * *
16  * * *
17  * * *
18  * * *
19  * * *
20  * * *
21  * * *
22  * * *
23  * * *
24  * * *
25  * * *
26  * * *
27  * * *
28  * * *
29  * * *
30  * * *
My DL speed from the old server about 20 minutes before ^ was run was 72Kb/s. Poor server

Last edited by ratdude747; 01-17-2016 at 07:36 AM..
ratdude747 is offline   Reply With Quote
Old 01-17-2016, 07:40 AM   #10
kevin!
recapping PCB.
 
kevin!'s Avatar
 
Join Date: Jul 2013
City & State: Gerona
My Country: España
Line Voltage: 230VAC 49Hz, 2 Ph
I'm a: Hobbyist Tech
Posts: 131
Default Re: Site is back, attachments aren't yet. Read this please!

Thank you for moving the forum to a new server.
We are grateful, because to load attachments took more than 5 minutes.
Now go faster to load.
Bye
__________________
Gaming pc:
Gigabyte RTX 2070, Corsair RM750I.
Server:

HTPC:
Intel Xeon X3460, 8GB DDR3, MSI ms-7316, case hp pro mt3133, liteon 300w (recapped), nvidia gt 1030, samsung spinpoint 500GB.
kevin! is offline   Reply With Quote
Old 01-17-2016, 08:36 AM   #11
mariushm
Badcaps Veteran
 
Join Date: May 2011
City & State: Romania
Line Voltage: 230VAC 50Hz
I'm a: Hobbyist Tech
Posts: 3,662
Default Re: Site is back, attachments aren't yet. Read this please!

Quote:
Originally Posted by shovenose View Post
The old server was moving data at about 70KB/s. There was not sufficient space on the old servers (disks were almost completely full) so zipping stuff up was not an option. Also, the old server went down twice for what was apparently RAID array rebuilds during the download process. Quite frustrating, and made the migration infinitely more complex.
Well, I think it's just sad that the server got so bad, got to this point.

In any case, any sane person would have backups.. if it was my forum, i would have made a backup of the static files (attachments etc) every 2-3 months or so, and a backup of the database at least every month. Honestly, it only takes a few minutes to perform such a task.

New server? migration? messed up server? .... I'd upload the latest backup from home computer to the new server, then ftp from old server to new server with option to skip/resume existing files (to refresh and get the more recently uploaded files) and job's done.

Alternatively, torrents can do wonders (as a sort of sync mechanism between servers) but in this particular case the messed up raid would have caused huge delays due to the hashing required to build the torrent .
mariushm is offline   Reply With Quote
Old 01-17-2016, 10:03 AM   #12
Topcat
The Boss Stooge
 
Topcat's Avatar
 
Join Date: Oct 2003
City & State: Salem, MO
My Country: United States
Line Voltage: 120VAC 60Hz
I'm a: Professional Tech
Posts: 12,037
Default Re: Site is back, attachments aren't yet. Read this please!

Quote:
Originally Posted by mariushm View Post
Well, I think it's just sad that the server got so bad, got to this point.

In any case, any sane person would have backups.. if it was my forum, i would have made a backup of the static files (attachments etc) every 2-3 months or so, and a backup of the database at least every month. Honestly, it only takes a few minutes to perform such a task.

New server? migration? messed up server? .... I'd upload the latest backup from home computer to the new server, then ftp from old server to new server with option to skip/resume existing files (to refresh and get the more recently uploaded files) and job's done.

Alternatively, torrents can do wonders (as a sort of sync mechanism between servers) but in this particular case the messed up raid would have caused huge delays due to the hashing required to build the torrent .
Glad you have such wisdom.....but unfortunately you have no knowledge of the very bad situation that I didn't have a lot of control over....so those things were a lot easier monday-morning-quarterbacked than actually done.....I'll just leave it at that.
__________________
<--- Badcaps.net Founder & Owner

Badcaps.net Services:

Premade Capacitor Kits
Badcaps.net Capacitor Master List


Motherboard Repair Services


If you've come here in search of replacement capacitors or repair services, please use the links above.
----------------------------------------------
Badcaps.net Forum Members Folding Team
http://folding.stanford.edu/
Team : 49813
Join in!!
Team Stats
Topcat is offline   Reply With Quote
Old 01-17-2016, 10:40 AM   #13
Stefan Payne
Badcaps Veteran
 
Join Date: Dec 2009
City & State: Northern Germany
My Country: Germany
Line Voltage: 230VAC/50Hz or 400VAC/3P/50Hz
I'm a: Knowledge Seeker
Posts: 1,110
Default Re: Site is back, attachments aren't yet. Read this please!

Any chance the attachments will be back?
Stefan Payne is offline   Reply With Quote
Old 01-17-2016, 10:50 AM   #14
whiz62
whiz62
 
Join Date: Dec 2013
City & State: sand springs, oklahoma
My Country: usa
Line Voltage: 120vac 60hz
I'm a: Knowledge Seeker
Posts: 183
Default Re: Site is back, attachments aren't yet. Read this please!

So glad your back! I know it all will get sorted out. Thanks for hanging there.
whiz62 is offline   Reply With Quote
Old 01-17-2016, 11:21 AM   #15
kazia
Senior Member
 
kazia's Avatar
 
Join Date: May 2015
City & State: depok
My Country: indonesia
I'm a: Knowledge Seeker
Posts: 136
Default Re: Site is back, attachments aren't yet. Read this please!

Quote:
Originally Posted by Stefan Payne View Post
Any chance the attachments will be back?
yea, does any chance?
kazia is offline   Reply With Quote
Old 01-17-2016, 11:28 AM   #16
shovenose
Send Doge Memes
 
shovenose's Avatar
 
Join Date: Aug 2010
City & State: Fairfax, California
My Country: USA
I'm a: Forum Junkie
Posts: 6,128
Default Re: Site is back, attachments aren't yet. Read this please!

Attachments will be back within a few days to week.
shovenose is offline   Reply With Quote
Old 01-17-2016, 11:54 AM   #17
kazia
Senior Member
 
kazia's Avatar
 
Join Date: May 2015
City & State: depok
My Country: indonesia
I'm a: Knowledge Seeker
Posts: 136
Default Re: Site is back, attachments aren't yet. Read this please!

Quote:
Originally Posted by shovenose View Post
Attachments will be back within a few days to week.
Thanks, glad to hear that..
kazia is offline   Reply With Quote
Old 01-17-2016, 12:12 PM   #18
zx8401
Phantom Fiddler
 
Join Date: Aug 2013
City & State: coventry
My Country: uk
Line Voltage: 240VAC 50HZ
I'm a: Hobbyist Tech
Posts: 43
Smile Re: Site is back, attachments aren't yet. Read this please!

Thank you for all the trouble its caused you, it must have been a bloody pain :-(
People dont appreciate the work that goes into maintaining a server.
zx8401 is offline   Reply With Quote
Old 01-17-2016, 04:09 PM   #19
goodpsusearch
Badcaps Veteran
 
Join Date: Oct 2009
City & State: Thessaloniki, Greece
My Country: Greece
Line Voltage: 230VAC 50Hz
I'm a: Knowledge Seeker
Posts: 1,945
Default Re: Site is back, attachments aren't yet. Read this please!

I would like to thank Topcat, shovenose, ratdude747 and anybody else who took part at this project!

I hope that attachments will be restored soon!
goodpsusearch is offline   Reply With Quote
Old 01-17-2016, 04:14 PM   #20
TELVM
Badcaps Veteran
 
TELVM's Avatar
 
Join Date: Oct 2012
City & State: Madrid
My Country: Spain
Line Voltage: 230V 50Hz
I'm a: Knowledge Seeker
Posts: 534
Default Re: Site is back, attachments aren't yet. Read this please!

Thanks for your work preserving and improving this great forum!
TELVM is offline   Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump



Badcaps.net Technical Forums © 2003 - 2019
Powered by vBulletin ®
Copyright ©2000 - 2019, Jelsoft Enterprises Ltd.
All times are GMT -6. The time now is 05:21 PM.
Did you find this forum helpful?