Incident Report for Item Loss Bug

"
Malone wrote:
"
Hixxie wrote:
"
Toshis8 wrote:
Grinding Gear Games, maybe it is time to start making backups of data stored in your servers? Some other game companies do that in case something went horribly wrong, some do that even daily.

This.


Because you really want to rollback ALL the server on a db save older than 1 month ( yes this bug is 1 month old ) ? really ?

the only thing i heard of this being a month old is an acuity going missing

its quite known that there are duped acuities in std
"
Druga1757 wrote:
Again, there's a log for it. So people who didn't vaal, and items were deleted (ie., not sold to vendor) have a legit claim. It's only 300 cases, we're not talking thousands that have to be reviewed. All the obvious ones could be restored, the questionable ones could be investigated further to weed out scammers.


you don't seem to have a grasp as to how the GGG system works. Chris says: "We believe that less than 300 items were affected in total".

which means they do "not" have a log of which items went missing or were changed. He is stating that GGG "believes" it's approximately 300 items that were affected.

There is nothing that they can do, with the resources they have, to remedy this situation in an efficient manner. There is a reason that the ToU states that lost items will not be returned.

Perhaps in the future they will adopt a different system that indeed has these "magical logs" of which you speak... but for the moment they do not exist. Arguing, repeatedly I might add, using an invalid point (these "non-existent" logs) does not further your point. I agree that it would be nice if GGG had the ability to fix problems like this, in an efficient and timely manner, but until that option exists we are left to accept there explanation and their apology.

Whether we like it, or not.

But still one may ask why there was no warning at all ...
The Sirus fight is a disgrace.
They should not replace anything due to this bug. Anyone can say they had x item with x gems and x sockets x quality .
I lost 1000000 ex in gear like con guys it comes down to pixels. You lost pixels on a virtual game. However this game is 100% free . So in actuality you lost some time woohoo if you care about that time you should have been doing something else anyway.
You got think logically and realistically here. They can't just go handing out x 6L shave because of a bug.
Bugs happen and bugs will continue to happen even once they think they found them all. That is the nature of the beast.
Just my 2 cents a guy who lost 10000ex in gear due to the bug LOL

"
Sauronsatan wrote:
You lost pixels on a virtual game. However this game is 100% free . So in actuality you lost some time woohoo if you care about that time you should have been doing something else anyway.


so you're telling me you wouldn't be upset if you lost your legacy facebreakers & bringer of rain?
"Fixing the endgame was hard - No matter how hard we buffed red maps, people would keep spamming Gorges.
So we turned Gorge into a red map"
"
phlawski wrote:
"
TikoXi wrote:
"
phlawski wrote:
Actually if they'd be fair (I mean GGG) they would not post stupid excuses but they would just give those poor guys back items they lost. For instance those Shavs. Thats how it should work IMHO.


A) They have no means to verify that X person ever had a shavs.

B) They would have to traipse through terabytes of data manually to find and rectify the bug (because they don't have the means to create items on the live production realms)

I don't think you understand just what a titanic undertaking that would be. You're talking a team of 4-5 people working months to restore each of those items, and that's assuming that each and every complaint is legit (which everyone and their pet rocks knows will never be the case). It just ain't going to happen.

It's not a happy situation, but it's the only one that can happen. People are demanding the impossible.


Don't say that there is no way to grep (even terabytes) of logs they track for sure against existence of item named XYZ. In this case (as Chris said only about 300 accounts affected) even some small gift would do the trick. They need to keep the face imho, and again - that's how it should be if they want be really fair.


EDIT: And come'on - it's not 19 century - they have computers, you know, with computers you can search quite fast nowadays ;) No offence - just joking....


I'm not sure if you understand how this data is stored.(And even I'm assuming, given what we've been told in the past).
Item's don't exist like "This item, has these mods and these links and these values and exists at this point in this players stash. It actually exists more like Item 188822746126782428 has mods referencing table grid H128765, J12987243, Q9213746, S92329842, A1297728, and values 1-250, 1, 237, 1, 1 etc etc you get the idea.

When someone edits an item, the corrosponding reference grid is changed. Say you use a divine on your shavs. GGG possibly doesn't know that a divine was used looking at the item. They just saw that the ES granted from one server snapshot to another went from 237 to 158. or something like that. They can INFER that a divine orb was used, but there is no "X used divine orb."

Likewise, if the hypothetical "Item exists: 1" node was changed to "Item exists: 0", then GGG would have no idea how or why that item no longer exists. Maybe it was vendored. Maybe the character was deleted. Maybe it was corrupted. Maybe it was dropped in a zone and abandoned. Maybe it was /destroy ed. Maybe a server glitch set Item Exist to 0. They just can't know.




And this all assumes that you can even find Item 188822746126782428 in the mess of server data in the first place. You don't KNOW that Player X's borked shav's is Item 188822746126782428, you have to figure it out.

It's a gigantic pile of arse of a task with no guarentee of successful resolution. And when you're dealing with memory corruption, every single value is suspect. You have to screen it all manually. There's not really a way to CTRL C CTRL V into a search bar... :/
"If you’re incompetent, you can’t know you’re incompetent. […] the skills you need to produce a right answer are exactly the skills you need to recognize what a right answer is." ~David Dunning
Last edited by TikoXi#0194 on May 12, 2015, 11:54:40 AM
"
They should not replace anything due to this bug. Anyone can say they had x item with x gems and x sockets x quality .
I lost 1000000 ex in gear like con guys it comes down to pixels. You lost pixels on a virtual game. However this game is 100% free


i kinda agree.. i lost my 6 link chest WITH microtransactions on it. so it's pretty clear for them that i was not lying. but life goes on
I LOVE THIS GAAAAAME!!!!
"
Dissolator wrote:
"
legitimate item deletion is indistinguishable from loss due to this bug. We are unable to restore items lost in this way.

It is distinguishable by logic and reasonableness. No one will destroy (not vendor!) their (for example) 5-L chest, used on high-level character for a long time. I think there may be a workaround...


This, GGG you've shown a willingness in the past to listen to your fans and change course so I hope you listen now.

If you were to restore items to the people who lost items in this way the worst that could happen is a few people who accidentally deleted items get an unwarranted "free pass" for their stupidity (one time!).

If the reason you can't do this is technical then I really think it should be a priority to fix. This may have been only 300 items but if you can't distinguish between deletes and corruption with this error that estimate could have quite a large margin of error. Even if the fix isn't for this occurrence for future it really needs to be in place.

Just so everyone is aware I'm pretty sure this hasn't impacted me as I haven't played on the live realms for a while (nor much beta tbh) but I think it's important enough to require urgent attention. Not 100% on this but I don't think this is the first time something similar has happened?

"
Pes_Planus wrote:
"
Sauronsatan wrote:
You lost pixels on a virtual game. However this game is 100% free . So in actuality you lost some time woohoo if you care about that time you should have been doing something else anyway.


so you're telling me you wouldn't be upset if you lost your legacy facebreakers & bringer of rain?

everyone would be annoyed


sane people would say "bugs happen, no moar bugs ggg plox" thought, instead of saying "this company doesnt deserve shit"
"
FanatickDk wrote:
"
They should not replace anything due to this bug. Anyone can say they had x item with x gems and x sockets x quality .
I lost 1000000 ex in gear like con guys it comes down to pixels. You lost pixels on a virtual game. However this game is 100% free


i kinda agree.. i lost my 6 link chest WITH microtransactions on it. so it's pretty clear for them that i was not lying. but life goes on


This assumes that they know (via logging, obviously the system stores that data) which items had an mtx on it, and that that fact was recorded at the time of deletion.
Support a free Hong Kong.

I do not feel obliged to believe that the same God who has endowed us with
sense, reason, and intellect has intended us to forgo their use.
-Galileo Galilei

Report Forum Post

Report Account:

Report Type

Additional Info