Stats Server Down

Moderators: Site Moderators, PandeGroup

snapshot
Posts: 110
Joined: Thu Apr 09, 2009 7:25 pm
Location: Wiltshire, UK

Re: Stats Server Down

Post by snapshot » Fri Oct 26, 2018 8:18 pm

Thanks. Will do.

rafwiewiora
Posts: 111
Joined: Mon Aug 03, 2015 8:23 pm
Location: New York

Re: Stats Server Down

Post by rafwiewiora » Fri Oct 26, 2018 8:27 pm

Re: spikes in points - choderalab is all good, I had 150 GPUs on 11730 in internal testing.

EOC_Jason
Posts: 7
Joined: Wed Feb 10, 2010 3:15 pm
Location: USA
Contact:

Re: Stats Server Down

Post by EOC_Jason » Fri Oct 26, 2018 10:34 pm

Okay, I managed to finish (what I thought) was everything before the 3PM update so I let things run as scheduled. There looks to be a few names that are still duplicates due to some special character issues, but after the 6pm update I'm going to run a script that will find any users in the DB that aren't in the flat-file and remove them. It's probably going to be just a small handful of people (double digits at most), most aren't even active. There was one that had a lot of points and I fixed his account manually so he wouldn't lose all the historical data. Also I had a little oops in the Team 0 processing that wiped out & re-created some of those users, but I've fixed that bug. Can't do anything about that lost data...

I'm going to see what happens with the next update (in about 30 minutes) and tweak as necessary. But for the most part things should be back to normal.

I've got some other little code tweaks related to processing to do this weekend, but it shouldn't affect anything.

snapshot
Posts: 110
Joined: Thu Apr 09, 2009 7:25 pm
Location: Wiltshire, UK

Re: Stats Server Down

Post by snapshot » Sat Oct 27, 2018 8:32 am

rafwiewiora wrote:Re: spikes in points - choderalab is all good, I had 150 GPUs on 11730 in internal testing.
Thanks for the info. That must have been fun. :D
I can easily accept one team doing this but another one to the same extent plus the five lesser ones I've found in the same narrow window seems unlikely. It may just be that I'm paranoid but it still looks odd especially as Jason has finished his updates and nothing has changed.

DutchForce
Posts: 59
Joined: Sun Sep 08, 2013 12:43 pm
Location: Netherlands

Re: Stats Server Down

Post by DutchForce » Wed Nov 21, 2018 11:04 pm

It looks like the Stats server is not updating.

I'm also getting an "Error failed to get project data" when I go to the Project Summary and no servers are showing up on the Server Status page.
Image

gordonbb
Posts: 82
Joined: Mon May 21, 2018 4:12 pm
Hardware configuration: Acer AX3400 Motherboard nForce MCP78PV PCIe 2.0x16; AMD Athlon 64 XII 2.9GHz; 3GB DDR2 1333 (2GB, 1GB); Fractal Design Define R4 Chassis; Corsair 650W Gold PS; SanDisk 128GB SSD; Ubuntu 18.4; and a whole whack of 140mm Noctua iPPC Fans
Location: Great White North

Re: Stats Server Down

Post by gordonbb » Thu Nov 22, 2018 12:19 am

Ditto,

@bruce @sortofageek @Macaholic @susato @Ivoshiee @toTOW @Joe_H @ PantherX
The stats servers reported about 1/2 the expected points for both myself and my team at the 15:00PST Update and now at the 18:00PST update is reporting 0 points for both.

No servers are showing in in the Server Stats but the individual stats are still showing values they are just not current.
Image

JimboPalmer
Posts: 857
Joined: Mon Feb 16, 2009 4:12 am
Hardware configuration: Several dozen Core2duos and i3s at a Mental Health organization. About six i5 at home, including a GTX 1050ti GPU that does half the total points.
Location: Greenwood MS USA

Re: Stats Server Down

Post by JimboPalmer » Thu Nov 22, 2018 1:47 am

Just before a long holiday weekend in the US, that server has it down pat.
Tsar of all the Rushers
I tried to remain childlike, all I achieved was childish.
A friend to those who want no friends

gordonbb
Posts: 82
Joined: Mon May 21, 2018 4:12 pm
Hardware configuration: Acer AX3400 Motherboard nForce MCP78PV PCIe 2.0x16; AMD Athlon 64 XII 2.9GHz; 3GB DDR2 1333 (2GB, 1GB); Fractal Design Define R4 Chassis; Corsair 650W Gold PS; SanDisk 128GB SSD; Ubuntu 18.4; and a whole whack of 140mm Noctua iPPC Fans
Location: Great White North

Re: Stats Server Down

Post by gordonbb » Thu Nov 22, 2018 2:45 am

JimboPalmer wrote:Just before a long holiday weekend in the US, that server has it down pat.
its failure is exhibiting different behaviour though. It is still producing the flat files but those flat files are not being updates from the collection servers.

I’m still being assigned work units and the completd jobs are being accepted so it’s all good.

I’ve worked in academic environments for over twenty years and understand that support is, of necessity, “best effort and running code”

Perhaps the stats server just needs and extended long weekend before mid terms to spend some time chillin’ with family :D
Image

drougnor
Posts: 153
Joined: Tue Dec 29, 2009 2:21 am

Re: Stats Server Down

Post by drougnor » Thu Nov 22, 2018 3:45 am

It looks like the stats 'froze' starting at the 1PM EST update for Users flat file and 2PM EST for the Teams flat file. The time/date stamp is updating, but the numbers for both the individual users and teams have both frozen.

d

bruce
Posts: 22470
Joined: Thu Nov 29, 2007 10:13 pm
Location: So. Cal.

Re: Stats Server Down

Post by bruce » Thu Nov 22, 2018 6:03 pm

DutchForce wrote: I'm also getting an "Error failed to get project data" when I go to the Project Summary and no servers are showing up on the Server Status page.
Fixed.

goodyca
Posts: 141
Joined: Sun Dec 02, 2007 12:36 pm

Re: Stats Server Down

Post by goodyca » Mon Jan 21, 2019 11:24 am

The stats have stopped being updated. The last update occurred at 5:45 GMT today.

fluke76
Posts: 10
Joined: Wed Nov 22, 2017 10:33 am

Re: Stats Server Down

Post by fluke76 » Mon Jan 21, 2019 1:38 pm

goodyca wrote:The stats have stopped being updated. The last update occurred at 5:45 GMT today.
Yep. I noticed that, too. I have at least 1 WU that was successfully uploaded, but not updated on Stat server. It is a US holiday so that might have something to do with it. If you have been folding for a while, you probably know that the Stat server thinks it gets a day off for a holiday.

gordonbb
Posts: 82
Joined: Mon May 21, 2018 4:12 pm
Hardware configuration: Acer AX3400 Motherboard nForce MCP78PV PCIe 2.0x16; AMD Athlon 64 XII 2.9GHz; 3GB DDR2 1333 (2GB, 1GB); Fractal Design Define R4 Chassis; Corsair 650W Gold PS; SanDisk 128GB SSD; Ubuntu 18.4; and a whole whack of 140mm Noctua iPPC Fans
Location: Great White North

Re: Stats Server Down

Post by gordonbb » Mon Jan 21, 2019 9:09 pm

fluke76 wrote:
goodyca wrote:The stats have stopped being updated. The last update occurred at 5:45 GMT today.
Yep. I noticed that, too. I have at least 1 WU that was successfully uploaded, but not updated on Stat server. It is a US holiday so that might have something to do with it. If you have been folding for a while, you probably know that the Stat server thinks it gets a day off for a holiday.
LOL or the support folks (likely grad students) do
Image

Murford
Posts: 2
Joined: Fri Dec 07, 2018 8:41 am

Completed WUs not receiving credit

Post by Murford » Tue Jan 22, 2019 4:45 pm

Mod note: Moved to existing topic on stats being down, added Code tags to your log - j

I have been running F@H for about a week without issue. I noticed yesterday that I received no credit, but when I checked the log there were completed WUs with estimated credit listed. I restarted my computer to see if it was an issue on my end, but it seems to still be happening. Restarting reset the log so I don't have the logs from yesterday, but I do have a log of a completed WU from today that it looks like I haven't been credited with.
Last edited by Murford on Tue Jan 22, 2019 7:12 pm, edited 1 time in total.

Joe_H
Site Admin
Posts: 4482
Joined: Tue Apr 21, 2009 4:41 pm
Hardware configuration: iMac 2.8 i7 12 GB smp8
Mac Pro 2.8 quad 12 GB smp4
MacBook Pro 2.9 i7 8 GB smp3
Power Mac G4 dual 1.73 1.5 GB (retired)
Location: W. MA

Re: Stats Server Down

Post by Joe_H » Tue Jan 22, 2019 5:27 pm

As I posted here - viewtopic.php?f=16&t=31338&p=304877#p304877 - I have notified the stats site maintainer.
Image

iMac 2.8 i7 12 GB smp8, Mac Pro 2.8 quad 12 GB smp6
MacBook Pro 2.9 i7 8 GB smp3

Post Reply

Return to “Issues with a specific server”