Any ones else lose hours of gameplay

[steel scarab]

Hey there, hope you dont mind me asking, but would it be possible for you to tell me a few things?
-Were you playing with friends or solo?
-If with friends, were you the host or a guest?
-Do you have Cloud Saves on?

[quick copper]

@tepid latch sorry for the ping, I know discord can let some notifications go by sometimes

[pearl dome]

-i was playing with a group of friends

• i was aguest

• cloud saves on i believe

[calm edge]

-Playing with friends
-Dedicated Server (nitrado)
-Cloud saves was on for all of us
-Character and server went back about 6 hours
-We have since turned off cloud saves and have had no problems since

[steel scarab]

Did the rollback occur to everyone?

Were only the characters and whatever shroud roots you defeated rolled back? Or also recipes and world progress?

Could you please share with me the save states of your cloud save character?
-Go to: \Steam\userdata
-Search for a folder called "remote" that has a file called "3ad85aea" in it (use the Search Bar for this)
-Go in that folder, select all files and drag and drop them here, please.

If you can't find it, search for a file called "Characters"

[clever hill]

Same thing with us we lost 8 hours of gameplay, set us back to where we were about an 1 1/2 into our game, characters reset, all quests reset, all our bases were gone, everything.

We were on a Nitrado dedicated server

The logs actually show us unlocking all of this stuff as well, I spent a few hours looking through the logs

[calm edge]

Not sure if this is what you need, And everything was rolled back server and characters. i alos submitted a nitrado ticket if this was a them problem

[clever hill]

I did the same as far as the ticket

[steel scarab]

Bases were gone, you say? That's quite interesting. Thank you, I'll look into it

[clever hill]

Yep everything, however my character still had some of the stuff in inventory that it had about 1 1/2 into gameplay

[calm edge]

not gone just reset to a certain time pretty much it felt like a 6 hour roll back for characters and server

[clever hill]

The server also won't save the progress after a server restart, it puts me right back to this point

but like run said, it was like all progression from that point on just wasn't saved

[steel scarab]

Please keep an eye into this, I've heard also that the Dedicated servers have had some issues with people buying the same server at the same time and it may have caused the loss of data since despite you guys playing in a server, someone else had bought it and kinda "overwritten" your stuff. Feel free to ping me (or ping one of the mods to ping me) if this happens again.

[calm edge]

ok thanks for the help

[tepid latch]

• Playing solo
• Cloud Saves were on

Buildings, quests, bosses, inventory items were all reset and have to go get the alchemist and hunter again.

Did notice that it would properly save if you did Exit to Main Menu instead of Exit to Desktop

[south kindle]

I had the same issue. Hosted game, cloud saves are whatever the default is. Apparently, I'm just an idiot though and loaded the wrong world... Really freaked me out cause I though everything was gone.

[calm edge]

We just got rolled back again

and we were all local saves

when we quit to main menu the character isn't rolled back its not till we exit the game and then re join that we get wiped

were starting to think its the server not you guys

[still girder]

Got problem with "save data error" - screen.
Reinstalled game twice, reinstalled drivers for gpu.
Changed the steam cloud settings to "off" (anyway when i open game problem is still, when i close the steam cloud setting is "on".

Save data error showing after:

• click "Play" on main menu
• create character
• create world
• being in world

And I can't to play online 😦

[sinful merlin]

We started having character rollbacks last night on our G-Portal server (5 players) if we logged out and then back in, we'd get rolled back. Today our server crashed and when restarted it had lost 12+ hours of play time, everything we'd done had disappeared including 2 of the NPCs we had freed. It seems like the server/character saves aren't working correctly, when I looked at the server files a couple of hours before the crash, troubleshooting the character issue, I noticed the game save file timestamp had not changed in several hours, and every time our characters rolled back it was to the same point exactly.

We also tried doing a couple of hours of work on the base after the crash then restarted it to see what would happen and it rolled back to the same save point again.

So, we're stopping play until there's a fix.

And just as hearsay- as I've spent hours today researching this, there are a lot of people having the exact same issues, both on servers and in single player apparently.

[trail tusk]

we have the exact same problem

[sinful merlin]

I expect a lot of server/character wipes in EA games, been playing them for years, but every login/out and every restart is a bit much, lol.

[novel monolith]

Same problems yesterday/today on G Portal hosting servers. I don't know if people have a fix. Waiting for ticket response on my side too.

[steady aspen]

@obtuse aspen this was the person I told you about

[calm edge]

Hope it was good

At least not boring

[quaint moss]

Can confirm we just got rolled back to around 19:20-19:30 yesterday when restarting the server around 00:03 today. Both all our personal characters and the world itself. Nobody got a clue if its possible to restore somehow? The world i would understand, since its probably Nitrado(the host) who hasnt taken a backup of the world properly, but the personal characters should be local/cloud right..

[calm edge]

That's what we can't understand, we can blame nitrado for not backing up servers properly but why are our characters also being reset

[steady aspen]

If you look at the console you can see the server syncs character with the server when people join

[obtuse aspen]

me and my friends have exact the same Problem. We lost 6-7h of Gameplay. Game-Server-Hoster is Nitrado. Is it possible to get the data restored?

[steady aspen]

If you made no backup then no

[calm edge]

No we have tried everything, the second time it happened we actually knew it was coming we tried transferring stuff off the server didn't work, restoring back up didn't work. We made second characters to try and transfer stuff off and couldn't join the server. Once the server is "corrupted" it's gone

[quaint moss]

One person didnt even re-join the server and his personal character is 4 levels lower than what he was after quitting the server.

The server surely cant sync and overwrite his local files if he doesnt even re-join the server right?

[calm edge]

It seems like extended play time causes it, when we only play a hour or 2 it's fine. Once we do a 6 or 7 hour play session it resets back to when we started it

[steady aspen]

Yes it keeps syncing every 5 minutes I believe

When connected ofc

[calm edge]

The thing I am curious about is this only happening in dedicated servers or local ones too

[novel monolith]

On G Portal hosting, i just notice, rollback was related with this time. The save is no longer updated after a certain point (why, idk) for my pov

[calm edge]

This is why I don't blame the server hosters because all server hosters are having the same issue which means it's a game problem

[steady aspen]

Happens local aswell, but most of the times that steamcloud

[quaint moss]

So you are saying that if he quit my server and played locally on his own server, with his character, he would still be rollbacked because i restarted my server? That just doesnt make sense.

[calm edge]

The other thing is that this problem has been in the game since the demo in October, you can go back in the discord and see people complaining about the same thing then, which scares me that this might be a tough fix

And take a while

[steady aspen]

When playing it saves and syncs every 5 minutes, when joining and when leaving

That's what I have seen on Healthy server without issues.

[calm edge]

It's kind of crazy how little control you have over your server when renting (like no admin controls, save control, etc.) Not sure if that has anything to do with it, but at a minimum I would love to tell my server how often to save or create backups

It drives me nuts because the game is so freaking good I just want to get past copper armor lol. Everytime I get a set I get reset

[obtuse aspen]

the game is awesome ... but if i lost game-progress-data, it makes no sense to play ....

[calm edge]

Yeah this is our third time restarting, not sure if we will be able to handle a fourth

We disabled cloud and our playing local for now till hopefully a fix comes down for dedicated

[obtuse aspen]

sounds like the game is broken?

[steady aspen]

Little background, there was a closed beta in the summer of 2023, they told us we wouldn't get dedicated support yet, but they made it ready just before beta release. And it was not great. So seeing that the game is a long time in dev and the server only a few months im impressed in how good it is. Yes it lacks features but that will come, it works atm, except for you guys sadly

[calm edge]

Dude I love the game, I was a huge fan of portal knights, put so many hours into it. I just wish this one bug wasn't there cause it's game breaking for a lot of people

[grave locust]

Same problem here

• with 8 friends
• server host on docker using sknnr/enshrouded-dedicated-server
• all of us Cloud Saves enabled
• Game Version (SVN): 487046

Both the server and client sides have data saved only up to 01/25 22:00 (UTC+8). Logging in or out on the client side does not trigger a save on either the client or server.

When a character log into the server and places item A into a chest, then log out and log back in, item A rolls back to the character's inventory, while the item A in the chest still exists without rolling back.

After restarting the server

All progress rolled back to 01/25 22:00. However, logins and logouts on the client side were saved on both the client and server sides.

If the developer needs server logs, please dm

[I 15:37:02,183] [server] Start Saving
[I 15:37:02,189] [savedata] Compression of Blob 0x00000000::USER took 184.00 us
[I 15:37:02,194] MaxClientComponents: 4
[I 15:37:02,195] Snapshot took 6.48 ms:  Entities: 20,657 (8,464,768 bytes)  Storages: 361 (1,178,304 bytes)  Chunks: 684 (14,469,862 / 44,826,624 bytes)  ClientComps: 33,252 bytes  Templates: 12,544  TotalSize: ~54,589,732
[I 15:37:02,197] VoxelSaveSize: 679,207
[I 15:37:02,212] [savedata] Compression of Blob 0x00000000::KNOW took 101.00 us
[I 15:37:02,217] [ecss] writeEntitySerializationContext:
[I 15:37:02,217] [ecss]   Templates: 5 (488 bytes) Components: 184 (47,104 bytes)  Size: 47,592
[I 15:37:02,217] [ecss]   Entities: 24 (23 children)
[I 15:37:02,219] [Server] Send Character Savegame 'Zero'
[I 15:37:02,237] [ecss] writeEntitySerializationContext:
[I 15:37:02,237] [ecss]   Templates: 6 (581 bytes) Components: 185 (48,256 bytes)  Size: 48,837
[I 15:37:02,237] [ecss]   Entities: 20 (19 children)
[I 15:37:02,238] [Server] Send Character Savegame 'playerID'
[I 15:37:02,254] [ecss] writeEntitySerializationContext:
[I 15:37:02,254] [ecss]   Templates: 5 (488 bytes) Components: 184 (48,256 bytes)  Size: 48,744
[I 15:37:02,254] [ecss]   Entities: 23 (22 children)
[I 15:37:02,255] [Server] Send Character Savegame 'playerID'
[I 15:37:02,272] [ecss] writeEntitySerializationContext:
[I 15:37:02,272] [ecss]   Templates: 4 (391 bytes) Components: 174 (44,624 bytes)  Size: 45,015
[I 15:37:02,272] [ecss]   Entities: 20 (19 children)
[I 15:37:02,273] [Server] Send Character Savegame 'playerID'
[I 15:37:02,291] [ecss] writeEntitySerializationContext:
[I 15:37:02,291] [ecss]   Templates: 4 (393 bytes) Components: 183 (46,880 bytes)  Size: 47,273
[I 15:37:02,291] [ecss]   Entities: 13 (12 children)
[I 15:37:02,292] [Server] Send Character Savegame 'playerID'
[I 15:37:02,313] [ecss] writeEntitySerializationContext:
[I 15:37:02,314] [ecss]   Templates: 3 (296 bytes) Components: 174 (44,624 bytes)  Size: 44,920
[I 15:37:02,314] [ecss]   Entities: 16 (15 children)
[I 15:37:02,314] [Server] Send Character Savegame 'playerID'
[I 15:37:02,332] [ecss] writeEntitySerializationContext:
[I 15:37:02,332] [ecss]   Templates: 3 (289 bytes) Components: 178 (43,320 bytes)  Size: 43,609
[I 15:37:02,332] [ecss]   Entities: 12 (11 children)
[I 15:37:02,333] [Server] Send Character Savegame 'playerID'
[E 15:37:02,439] [server] Serialization of 'Entity' 213734 failed with out of memory.
[I 15:37:02,439] [server] Failed to save out of memory

after this error occurred, no further saving was done.

[woven ridge]

Had the rollback on solo local private. Weirdly it looks like the map fog of war did not roll back, though all the quests, progress, level, inventories etc did.

[calm edge]

man were starting to get a full party going in here

[sinful merlin]

Don't know how accurate this is, but I placed a support ticket with GPortal to eliminate any possible issues on their end. I figured since they are Keen's official server partners they might have insight either way. This was the reply-
"Hey there,

This is currently a game issue causing the game not to save progress. We are waiting for a patch to be released for these issues.

Kind regards,
robert.j"

So, take that for whatever it's worth, hopefully it's a good sign that it's being addressed.

[calm edge]

Well at least we know now it's a game issue not a server issue

[grave locust]

I plan to use a script to check the server log so that it can be immediately discovered when there is a failure to save files.

[tawny saffron]

Nitrado server restarted and rolledback to 12+hrs ago. I have not found a way to force a save. Our group is extremely frustrated!

[calm edge]

yup we have tried everything in the book, we got rolled back twice first time was 6 hours second time was 7 hours

[hexed sentinel]

Just lost hours of gameplay myself, after clicking "exit to desktop." Solo player, no dedicated server.

[lapis pelican]

Dedicated server setup with ~5 people.
Had one player log off and rejoin and they lost hours of character progress.
When trying to troubleshoot and restart server, after restart found that server had lost hours of progress. All other players lost progress at this point to the same point.
It seems like at a certain point all progress (both character and server) stopped being saved. This time seems to have been close to if not at the same time.
It seems odd that player character files aren't server side, yet seem to be impacted by whatever bug this is.

[grave locust]

It has happened again....
As soon as this error occurs, the server will stop executing the save.

[I 09:56:25,778] [server] Start Saving
[I 09:56:25,790] [savedata] Compression of Blob 0x00000000::USER took 187.00 us
[I 09:56:25,794] MaxClientComponents: 4
[I 09:56:25,794] Snapshot took 4.07 ms:  Entities: 13,187 (5,330,048 bytes)  Storages: 246 (802,944 bytes)  Chunks: 387 (10,004,292 / 25,362,432 bytes)  ClientComps: 19,236 bytes  Templates: 10,184  TotalSize: ~31,599,084
[I 09:56:25,796] VoxelSaveSize: 733,639
[I 09:56:25,808] [ecss] writeEntitySerializationContext:
[I 09:56:25,808] [ecss]   Templates: 5 (488 bytes) Components: 185 (48,256 bytes)  Size: 48,744
[I 09:56:25,808] [ecss]   Entities: 27 (26 children)
[I 09:56:25,809] [Server] Send Character Savegame 'playerID'
[I 09:56:25,816] [savedata] Compression of Blob 0x00000000::KNOW took 173.00 us
[I 09:56:25,824] [ecss] writeEntitySerializationContext:
[I 09:56:25,824] [ecss]   Templates: 6 (581 bytes) Components: 185 (48,256 bytes)  Size: 48,837
[I 09:56:25,824] [ecss]   Entities: 24 (23 children)
[I 09:56:25,825] [Server] Send Character Savegame 'playerID'
[I 09:56:25,840] [ecss] writeEntitySerializationContext:
[I 09:56:25,840] [ecss]   Templates: 5 (488 bytes) Components: 185 (48,256 bytes)  Size: 48,744
[I 09:56:25,840] [ecss]   Entities: 20 (19 children)
[I 09:56:25,841] [Server] Send Character Savegame 'playerID'
[E 09:56:25,926] [server] Serialization of 'Entity' 163508 failed with out of memory.
[I 09:56:25,926] [server] Failed to save out of memory

[obtuse aspen]

in which directory are these files located?

[grave locust]

logs/enshrouded_server.log

[steel scarab]

@here Thanks a lot for the information, everyone. For everyone playing with cloud saves and having rollback happening, could you please check on the amount that has been saved, please? Right click on Enshrouded in your Steam List, select "Properties..." and right in the first window there should be the information:

[steel scarab]

If I understand it correctly, it is inevitable that it would get wiped? As JohnnyLightning said, it seems like it properly saved if they exited to Main Menu first. If you do that, leave the game, then return, your save will be wiped?

[steel scarab]

This might be very important information. Thanks a lot, I'll keep an eye on it

To everyone else who is playing locally and hosting private sessions, have you also been having large play sessions?

[hidden fulcrum]

If i go back to main menu my character is also wiped, it doesnt change anything

[steel scarab]

For how long was your play session?

[hidden fulcrum]

3h

2x3h sessions, wiped both times

[steel scarab]

Are you playing with Steam Cloud on as well?

[hidden fulcrum]

I think so, i'm not at home rn so i cant verify

[hexed sentinel]

I'm not sure, maybe 2 or 3 hours

[obtuse aspen]

maybe an important info: i remember an steam cloud syn error after the first wipe

[steel scarab]

If you don't mind getting experimental, would it be possible to start a new character and a new world and play for 3h again?

Additionally, if you don't mind, I'd like to have your "characters" save data

[hidden fulcrum]

I will try that when i go back home and try to provide you datas

[steel scarab]

If you are on Steam Cloud, you'll find it here:
\Steam\userdata<YourID>\1203620\remote

If you have it locally saved, it will be here:
C:\Users\<yourUser>\Saved Games\Enshrouded

put it all on a zip folder and throw it here

that also is valid for everyone, put everything in that "remote" folder in a zip file and deluge it here

[obtuse aspen]

whats about the players that rent a server. did the serverdata also syn with the stamcloud?

[steel scarab]

I'm in talks with the guy responsible for how our save system works, I'll find out how it functions and see if I can get more info on that

There's no guarantee that it's all the same issue, sadly

it could be 2-3 different issues - The dedicated servers being problematic, the way the game saves stuff, the save files being corrupted, that sort of situation

For those playing on dedicated servers, is the rollback issue global? Are all players getting rolled back, no exceptions?

[obtuse aspen]

yes its global. we ( 3 players) on a nitrado server have the same incident

[novel monolith]

All players for my side on Gportal server

[steel scarab]

Ok, that excludes a few options at least

[quaint moss]

We were 4 players on a server hosted on Nitrado. We quit the server yesterday around 23:57 because one guy failed to connect, proceeded with restarting the server, i logged back in to the world together with one of the friends and we were rollbacked to around 19:25. Not only the world, that could be blamed on the server host at least, but the personal progress on every character as well, even for those 2 guys who didnt even re-connect to the server after we restarted it.

[steel scarab]

@here To anyone who has the time and patience to help me find the (shroud) root of this issue (hahaaah...) -

1. Please familiarize yourself with finding your save game data. It is in the pinned comment besides this one.
2. Please familiarize yourself with finding the "Enshrouded.log" file. You will find it here:

• \Steam\steamapps\common\Enshrouded - <- It's in this folder

3. If you play locally and you are getting reliably rolled back, please, attempt to see how short of a time you need to play for the rollback to occur. Start small, for example, by simply placing a few blocks in your base then quitting the game. When you return, are the blocks still there? If yes, go a bit beyond - defeat a shroud root, get a level up, do something for 15 minutes. Repeat the process until you suffer a rollback. Whenever you do get the rollback and feel it can be reproduced reliably, please play the game to a point you will feel the game will rollback and leave the game. Do not restart the game. Send me your Enshrouded.log and your save data (characters in the folder mentioned above).

4. If you play on a server and you feel the roll back is not reliable - Please play normally and once you are done playing, simply state for how long you played and post your Enshrouded.log here, as well as the "Characters" file in the save data.

5. If you play locally, are getting rollbacked and want to experiment, please create a new character and a new world and see if the issue occurs again.

We deeply apologize for this issue and are trying our best to solve it. No one needs to help, but the more people cooperate, the better, as it is an issue that we couldn't reproduce it locally.

[quaint moss]

If it matters, the server hosted on Nitrado ran for about exactly 12h from when it was restarted and the time of when it "stopped" saving. If it happens again i will save the logs and provide it if necessary

[steady aspen]

i have helped multiple people in #troubleshooting i moved them from steam cloud to local (solo players) and havent seen them come back

[steel scarab]

Please do, all information is helpful

[steel scarab]

I've seen some people losing progress on local saves and solo play. Like I said above, there might not be a single issue, but several, sadly.

[novel monolith]

And if i know my server (gportal)is right now on rollback mode because the savegame is not updated, a connection/unconnection logs can be interesting or not ? to know (need to make a restart to be able to play few minutes/hours)

[steel scarab]

huh.
@wide jasper @quaint moss You say you can pinpoint the time that the server did the rollback?

[quaint moss]

Didnt check local files, but on the server side it had stopped saving. From this morning i have been keeping tabs on the savegame directory on the server, and it has been updating the "last edit" every 15min. (Picture below)

Yesterday when i pressed restart at 23:57(when the rollback happened) the latest entry in the savegame directory was at 19:25

[grave locust]

Every time "[server] Failed to save out of memory" occurs, the server and client will not save again.
#1200110943414272171 message

[steel scarab]

What's your timezone if I may ask?

[quaint moss]

CET

[steel scarab]

Could you please drag and drop the logs here, please?

[grave locust]

the server logs or client?

[steady aspen]

hom much ram does it use and how many ram do you have on ur server?

[grave locust]

64g ram on my server, the enshrouded only use about 2g~3g ram

[steel scarab]

both if you can

thank you very much

[grave locust]

After you have finished downloading, please let me know, as I would like to delete it from Discord.

[steel scarab]

ah sorry

you can delete it @grave locust

[steel scarab]

If anyone else wants to spare their logs (server and client, especially server) please notify me

[steady aspen]

kinda off-topic, but can we get server patch notes in #news aswell?

[steel scarab]

If there are server patch notes, I believe they will be written there

[steady aspen]

saw an update on steam, but cant find any patch notes thats why i asked

[steel scarab]

@grave locust do you have access to the server files, in particular the saved world data?

Should be a file with a string of letters and numbers, likely "3ad85aea"

[grave locust]

yes

[steel scarab]

Could you post it here? If you feel uncomfortable posting it publicly, I can DM you

[grave locust]

But I have already restarted the server and it has resumed saving files normally.

[steel scarab]

ack

next time then

[grave locust]

ok

[steel scarab]

... I mean, hopefully it doesn't happen ever again

but if it does, first, apologies

and second, give me that world data please

[grave locust]

Where can I find it?

[grave locust]

I have already written a script to monitor the modification time of '3ad85aea'. If the problem occurs again, I will post it here first.

[steel scarab]

It's the "3ad85aea" file. If you found it already, then that's the most important thing.

Thank you very much for your help

[grave locust]

oh! ok

[steel scarab]

It's very, very appreciated

[grave locust]

I also enjoy this game and hope it gets even better.

[steel scarab]

@steady aspen you deleted it?

I was just reading it

[steady aspen]

i just noticed it breached nda

[sinful merlin]

I tried exiting the game both ways after logging in to test yesterday, the character rollback happened either way.

[steel scarab]

Could you please follow these instructions? #1200110943414272171 message

[novel monolith]

Well on my side, i can't play even few minutes now, i come back at old save of my character. Do you need some files ?

[steel scarab]

Yes please

are you playing locally/privately? are you hosting?

solo, multiplayer?

[novel monolith]

G Portal server, multiplayers

[steel scarab]

Do you have access to the server?

[novel monolith]

yep

[steel scarab]

Ok, wrong question from my end - Do you have access to the server files?

[novel monolith]

yep, owner of account

Say me which file do you want

[steel scarab]

Perfect. If you want we can do this per DM, but I need both a server log and the world save. The world save looks like a string of numbers like "3ad85aea"

[novel monolith]

DM me, i send you it

[weary crow]

Some things i foun out about this issue, the server no longer saves character/world progress after this messag in the log file:

[I 03:50:23,979] [server] Failed to save out of memory

After this message the server no longer prints these save messages like

[I 03:45:24,061] [server] Save Serialization took 251.43 ms over 15 Ticks
[I 03:45:24,061] [server] Saved

So if your sever no longer prints these message every 5 minutes its no longer saving progress. If you restart the server and load the save file it works again (until this happens again) and you are rolebacked to the last time the Saved message was printed. I seems the happen faster if there are more players on the server.

[steel scarab]

Is that info you found on your server log or Enshrouded.log?

[weary crow]

yes i can send you the complete log and save files

i have a backup from the time it happend.

[steel scarab]

Please do, I can DM you if you prefer

[weary crow]

but i doubt the file is corrupted because after a restart it works fine

[steel scarab]

Also the world save data would be desired

A restart of the server?

Or a new world?

[real maple]

It happens to my local save every time I close out of the game and the log shows the failed save messages about two minutes into a game. I have noticed that FoW information is still saved but everything else is lost.

[tepid latch]

Hey @steel scarab, wanted to follow up on my "Exit to Main Menu" comment. The first time I tested the exit to main menu, i was in game less then 5 min. I played another 3-3.5 hours afterwards and tried the exit to main menu, when I logged back in to check. My character, quests, world was rolled back but any updates done to my buildings were intact.

I was still using the Steam Cloud during this playthrough. Attached are the files after this incident.

Also noticed the 3ad85aea and 3ad85aea_info files stopped being modified 1.5 hours before my characters last modification. (see screenshot)

[rose bison]

Hello there @steel scarab
Her hare the data from my test world, where i played for around 1h-30min and the logs. The progress vanished 5times just today. (From defeating a small boss, crafting gear or just xp progress. Everything just rolls back currently.)
Im using Steam Cloud.

i hope my data can help you out!

[steel scarab]

Thank you very very much for this. May I ask you that next time that you play for a longer period of time, you make a backup of "Enshrouded.log"? Info on how to obtain it is in the pinned comment.
Make a backup of it (name it differently, copypaste it elsewhere) and enter the game. If there was rollback, please send me the log as well.

[steel scarab]

hey there, thank you very much for this info. Are you playing privately?

[deep hamlet]

would you be more interested in data from server play or private? I am willing to dedicate a majority of playtime today to gather information. So I'd like to know if you'd prefer it on a server or private play. either is fine with me

[real maple]

@steel scarab here is a log file from a 12-hour local session.

[steel scarab]

I fear that we have two different issues - each pertraining to each type of play.
At the moment we are getting quite a lot of info on the dedicated servers, so if you can find out stuff from private games, that would be very appreciated

[deep hamlet]

how long of a session would you like?

[steel scarab]

Please do the following:

1. a 30 min session. Save a backup of savestate (characters, world data) and Enshrouded.log. Check pinged comments for the placement of these files.
2. 1h session. Save a new backup of the aforementioned things.
3. 1h30min session, same backup deal
4. 2h
5. 3h
6. 4h

If at any of these points the game stops saving, you don't need to press further. Just say "hey, on this point forward it stopped saving", and send me all files in a zip file

No need to try to break stuff, just play normally, but feel free to get creative

[real maple]

@steel scarab I know where to find the backup log file data, but where do the files for characters, world data etc save to?

[steel scarab]

I have pinned a comment with that info, see if you can find it under the pins. If not, ping me back please

@here

crap, sorry - wanted to write the rest of the message

anyway we are working on a fix for the dedicated server thing

we found hte issue

once it is pushed, I'd like to ask you all to keep an eye on your servers and such

[deep hamlet]

would you like to continue the private play

[steel scarab]

Yes please

private play issues are different from the server ones

[novel monolith]

Let us know, and we'll follow it

[steel scarab]

will do

[sinful merlin]

Okay before and after of the server rolling back on reboot after about a 40 min session, though you may not need it now. GPortal server for reference.

Also, it seemed like the rollbacks didn't start happening until after a second player joined the session, I tried repeating it by myself, prior to them joining, and it seemed to be actually saving my character correctly until then.

[silver lintel]

@tawny lichen can we add this to the Known Issues channel (if it's not already there)

[forest sable]

it appears to be the server losing connection to output save character

[tawny lichen]

checking with productiong and adding

[tawny saffron]

Please keep this thread updated on a fix! Our group is halting play until we know we won’t lose 12+hrs again.

[tawny lichen]

that's definitely not going to be this side of the week-end for sure

[steel scarab]

@tawny lichen User @weary crow has apparently avoided the save data gobbler monster by rebooting the server every so often

Perhaps a feasible workaround, but if z0Kng could elaborate how often the server is rebooted, it could be a feasible workaround

[tawny saffron]

We attempted that last night and it rolled back to the only save available. There is no way to force save or backup that I have found.

[graceful wolf]

That's correct, at this time there is no in-game or remote command to issue a save to the server, if there is then its not currently documented.

[sinful merlin]

When we reboot the server then the server rolls back.

[steel scarab]

It might be needed to restart the world itself then

I believe the charaters are ok, the world itself is having an issue

[sinful merlin]

So, the server overwrites our characters when we log into it, back to their earlier state?

[abstract mango]

It overwrites even when you don’t log back in

[weary crow]

if the Server was running less then 3 hours it worked fine. But maybe it is just luck.

[steel scarab]

Create a new world (private) and attempt to do something minimal there to save your character there. I believe the character will save properly then - proving the issue is on the map file

There's a chance we will actually push the fix

At a meeting atm

[sinful merlin]

Here's what's happening to us- if we log in and out of the server we rollback to an earlier point on the characters, if we reboot the server the server itself rolls back, and related or not, the save game file on the server never seems to update, that is the timestamp on it remains hours old, even with people logging in and out.

[graceful wolf]

I've noticed some poeple have _info files and others do not by the way. (in their savegame dir.. Not sure if that's helpful or useful... I for example do not have that in my server files, but Vapok does.

[silver lintel]

So I have info on that.

Info files are an artifact from Closed Beta something to do with UI. Maybe only relevant for clients.

[steel scarab]

Not quite

'parently it's something about UI, but ech

not too important

[graceful wolf]

kk, thanks!

[lapis pelican]

Just caught up on the thread again.
Sounds like the dedicated server save issue has been found. For those saying they lose progress multiple times logging in/out, if you haven’t restarted your server that’s why.
The server is the issue where it stops processing saves. You will logout, lose progress and log back in. While the server appears healthy, I assure you it’s not. You need to restart that ASAP, there is no known way to force a save before restarting the server. If you keep playing, you’re just delaying the inevitable rollback. Don’t do this to yourself cause you’ll just be even more frustrated because your server progress loss will be even greater.

@steel scarab - Seeing some info from people saying server update is available. Can we get a confirmation that this includes the fix to this rollback issue?

[tawny saffron]

Once the initial crash that caused the rollback occurred yesterday. We tested and restarted server multiple times, no back up was made. Before I left to work this morning I restarted the server and it rolled back to my initial point 24hrs ago. So restarting the server is not a fix that works for us. The server is just in limbo with no way to save, and our character data gets rolled back as well.

[sinful merlin]

No, we've rebooted the server several times, it rolls back every time we do, it doesn't save the state prior to the reboot, it rolls back to whatever time the saves stopped working.

We've got people that have been running servers since there have been servers, we're not that thick.

[abstract mango]

He's saying we are old

[sinful merlin]

That too.

[steel scarab]

No, not yet

We will make an official announcement if it happens

If it happens

There's also a chance that the issue with the servers is not a single one

[steel scarab]

we have to make sure that the update doesn't break stuff for everyone else

[lapis pelican]

That info wasn’t necessarily directed at anyone specifically. If you’re as able as you state, I’m sure you can also imagine that there will be players that don’t think to restart their server and just keep retrying to log in and progress and have multiple instances of roll back but since the server remains “up to date” they keep thinking it’s fine.
I’ve already seen suggestions that people just dump gear on the server to keep it safe. With this bug, those people are in for a bad time if they keep playing on a broken server.

[abstract mango]

the only way to win this game of losing your data is to not play til its fixed

[graceful wolf]

Kall we are getting REAL close to finding the source of "Game Creation Failed" too, I know its not related to the #1200110943414272171 but it may be worth looking at if a new build is being attempted or baked.

It looks like there could be a character, or potential character length issue in the config.json #1199817236140003530 message

That thread may interest you.

[tawny saffron]

Issues currently:
No way to force save or backup.
Server roll back after restart.
Character data roll back with server.

If it gets fixed? This has rendered us unable to play sadly. Hope it gets fixed asap for the weekend! Good luck.

[steel scarab]

It's not an "If it gets fixed", it is being fixed

It's a "when it gets pushed"

[lapis pelican]

I’m sure that was an attempt at humor

[steel scarab]

If we just send it over without testing and it breaks more than it helps, it's a big problem than what we currently have

[tawny saffron]

Ya completely understood, and it’s EA so this stuff is expected.

[graceful wolf]

(it's also friday...)

Pushing to prod on friday = massive guts*. 🙂 (if it were to even happen today)

[abstract mango]

Jokes aside i'm not sure there is a worst problem then losing all of your data/time especially for people who aren't aware of this issue. Game crashes or not even working atleast people know theres a major problem and aren't playing to lose dozens of hours of progress.

[tawny saffron]

Bro the silence in the discord last night after we all realized we lost 12hrs of progress lmao. It was sad.

[calm edge]

Honestly for all you dedicated servers users out there, I highly recommend biting the bullet and just disable cloud and play local till it's fixed, it sucks but at least you're not getting rolled back. We haven't been rolled back at all since disabling clouds and just playing a friend's private lobby. And when the dedicated stuff is fixed just move over to that.

[abstract mango]

We lost about 6 hours of progress the first night, then we restarted the server yesterday, played about 9 hours and the server crashed then it reverted to where it was that morning. Immediately every dropped and played something else. It was that kind of anger that everyone was just quiet lol

[steel scarab]

I can understand the pain of losing progress.
It's no way a justification, it's just that we are limited in our resources. It's not feasible for us to check absolutely everything, sadly. So these kind of issues will happen, and I ask for patience.

[tawny saffron]

No problem, we got that. I’m glad there is an open dialogue at least and the issue is known.

[calm edge]

This is pretty much exactly what happened to us, lucky for us though we are all pretty big fans of the game though so we decided to give it one more chance local instead of dedicated and been smooth sailing since

[graceful wolf]

It's day 3 of Early Access guys, you all knew what you were getting when you opted in to this - they've been very transparent about it. Just have some patience with them, they are workin on it.

[lapis pelican]

As someone running steamcmd locally without steam installed at all, I don’t think it’s isolated to cloud saves.
Unless the server config itself has a config that needs to changed to disable cloud save?

[steel scarab]

I think there are different issues going on, that's all

the fix we're pushing for has nothing to do with cloud save for example

[calm edge]

Yeah 2 guys in my group refuse to turn of cloud and they have been fine on local with us too, so no clue lol

[lapis pelican]

Pushing to prod on Friday when things are working is scary. Pushing to prod when triaging a game breaking issue is necessary.

[abstract mango]

We can feel annoyed and upset while still understanding this.

[sinful merlin]

In the case of my guild, we understand, and appreciate your working on the problem. We have combined probably 10s of thousands of hours (not a joke) in early access and alphas and betas, so we know the drill. Still makes you want to scream sometimes though, when things just disappear 🙂 .

[steel scarab]

oh yeah, please scream, vent and complain. If you feel it goes too far, then feel free to refund it as well. We're not saying you shouldn't do any of those

[lapis pelican]

Good confirmation, I’m fairly sure this nailed down at least our issue.
Do we know if single player saves and dedicated server saves leverage the same process with the same OOM condition?

[abstract mango]

We scream vent and complain because we like the game

[calm edge]

Game is to damn good for that lol, just need this one thing fixed.

[steel scarab]

this and several others, let's be real

[lapis pelican]

Oh I hope people don’t refund. This game has been awesome minus the hiccups.

[calm edge]

Some of them are funny though

[steel scarab]

I think they do but I am not an expert on it

[calm edge]

My buddy takes 4 DMG Everytime he farms a node, we can't stop laughing Everytime he goes to farm copper he just dies

[steel scarab]

What the hell

You've reported it, right?

[calm edge]

Yeah it's the funniest bug

[steel scarab]

With F1?

[abstract mango]

Sounds like a personal problem to me lol

[calm edge]

I think he did I'll make sure today

[steel scarab]

Does he have some sort of Life Leech ring?

ack, not the topic for this

sorry

we'll check the bug record

[lapis pelican]

The temptation to go down the rabbit hole of issues is strong with this one

[sinful merlin]

I've seen chatter in the channels about people taking damage while mining too. Haven't had that happen yet.

[steel scarab]

way too long in this profession, it's just instinct now

[verbal violet]

Somehow when i moved the savegame from WindowsGSM folder to SteamCMD server folder, my character lost some gear and quest completions, but base did have all new items still installed.

[steel scarab]

You kept the character, correct?

[verbal violet]

Yes

But character did have something like 30-60mins rollback

[steel scarab]

This will be my personal hydra

[silver lintel]

As a 25 year long developer, going down rabbit holes comes as second nature as breathing oxygen

[calm edge]

I'll take a new portal knights dlc while we wait

[silver lintel]

Hey Folks, quick update here on the World Save Dedicated Server Issue, otherwise known as Hotfix #5...

I've been told that, barring any last minute shenanigans or jack-in-the-boxes in the regression testing, this should get released in about 10 Minutes

Obviously keep patient, and know the teams are working hard on this.

[tawny lichen]

I need to print and frame this

[icy blaze]

Will Hotfix #5 include any changes for the cloud save issue? I don't anticipate it based on earlier comments, but wanted to gauge if it would be safer to switch to local saves for clients instead of cloud when #5 deploys?

[tawny lichen]

the hotfix will only address the particular issue mentioned above, so no

however, local saving is what we recommend, so definitely worth a try

if only because you can make back ups

[icy blaze]

Thank you

[lavish locust]

Sorry trying to catch up. Are we also seeing an issue with dedicated servers rolling back automatically after a reboot, much like character progress after exiting the game and reopening?
I can reproduce my character roll back on demand right now it seems. I just deleted my inventory, logged out and back in and my whole inventory was back.

[silver lintel]

The server roll back, saving issues is what is being fixed in Hotfix #5. Not the Character save issue htough.

[lapis pelican]

Sounds like there are likely a couple different issues depending if saving locally or to cloud.
Recommendation as noted is to save locally.
If saving locally, the problem is server side for both client and server rollback. The issue has to do with the server not processing save data after an out of memory condition (or that's the general jist)
Once the server stops processing saves, no further progress will be retained and the server stops sending client updates so your character gets stuck at that same point and will revert when you logout.

Barring issues discovered during their testing, fix for that issue is due soon™

[lavish locust]

So basically, both the client and the server are experiencing issues where saves stop processing, so in this current state, it is very likely our dedicated has also stopped processing saves so upon reboot it will also revert back

[silver lintel]

I don't know for sure, but what I'm seeing on my servers is that while the server is on, the backup and world save files, look like they are growing. So, this might be a restart issue. If you are overly concerned, copy your world files out before you restart your server.

[lavish locust]

Ok I will tell my friend to copy that stuff out before hand just to be sure, maybe even turn on shadow copies haha. Unfortunately the box is not at my place.

[silver lintel]

Sounds good!

[tawny lichen]

Hotfix 5 was deployed moments ago see #news

[lavish locust]

As far as the out of memory condition that was mentioned, I would assume that is what the client is able to make use of, not necessarily what the server has in it. IIRC the box we are running our dedicated on is dual 8c/16t and 128GB RAM. Probably should have spun up a VM in my lab and hosted it myself....

[tawny saffron]

Chad Hotfix. Can we get some testers in and restarting their servers to see if this helps?

My dedi server host still has no way to make a backup for save so hopefully this alleviates that issue.

[lapis pelican]

Based on what I saw in our server logs, this would be accurate. There isn't a way to prevent a rollback server side because the server has already stopped processing saves at the point of failure.
There is no known manual way to trigger a new save so the data is lost. You can try making a backup, but I did that before restart and there was no success.
From everything I've read, the progress is lost unless the devs can provide a way to manually trigger a save or restart the save process while keeping the server online.

As far as client side, it appears the transaction is roughly
On logging in Client sends Server the Character details (gear/level/etc)
Throughout play, these facts should be saved back to the client periodically.
On logging out Server sends Client the Character details (gear/level/etc)
Because the server stops saving progress, the client side progress gets hung at that point and no further update gets sent to client side resulting in a reset to the last update.

You can see this in the server logs and the live CLI feed where login/logout isn't being processed.

[lavish locust]

I wish I could review the logs, next time I am going to host so I can lol. Ok so basically theres a problem with the client not receiving any progress from the server once it hits that save failure stage. So server is reliant on client to send initial details from last log out, then the client is reliant on the server to deliver any progress that has been made throughout the day upon log out.

[keen flower]

when does the dedi server stops the saving process? I looked into my dedi server logs (gportal) and the 5 minute save still happens even if im not connected

maximum I lost was 5 minutes of progress because I restarted the server before the save happened

[lapis pelican]

Pretty much sums it up based on my understanding. Obviously that's with limited confirmation from devs so could be off base. Just thinking logically through the issue based on everyone's feedback and our own server logs.
Fix was just pushed and I'm getting our server updated. Will probably throw together a quick script to monitor the enshrouded_server.log file to confirm the saves are taking place and restart the server if that doesn't happen for more than 10 minutes.

[keen flower]

but the saves already took place before the update

but just updatet my client and restarted the server, will take a look as well

[stone pebble]

After i teleport back to house, i lost 2 medium magic chest full of items and i got some random small chests around house.... please fix this, i lost so good items(sparks, legendary weapons etc...)

[lapis pelican]

Right, the update is only to fix the problem where the server stops saving. With the caveat that it sounds like there are potentially a couple of different save issues and devs recommend not using cloud saves cause that seems to cause other problems.
Since updating the server requires bringing it down, if you have a server that stopped saving files (essentially in the bugged state) there isn't a way to prevent a loss of progress.
Ideally the update will prevent this from happening after the restart

[stone pebble]

local saved - solo play

[modest panther]

So, I am noticing that while the character and anything placed, quests, chests, inventory and such are all reset. Map fog is not reset.

[stone pebble]

this is not rollback, this is losing chests and got random small chests around house

prove

[sinful merlin]

Then this is not the thread for that 🙂

[stone pebble]

i reported bug on website

[modest panther]

okay cool, this thread is for the game not saving.

[stone pebble]

also requested refund, because i think they cannot fix this and i dont want to start over

[lapis pelican]

What cord is saying is this thread is specifically focused on game files rolling back causing loss of progression. Not something as specific as losing items

[sinful merlin]

For the servers rolling back and to a lesser extent some people having characters rolled back.

[lapis pelican]

Okay, cool I guess. Why are you here if you're going to quit playing?
The game is early access, there are going to be some bugs. As frustrating as that can be, if you can't handle that you probably shouldn't be playing an early access game during launch week.

[keen flower]

did the not saving error happend on gportal servers as well? or was it more a p2p thing?

[lapis pelican]

Any hosted server from what I've seen. Same issue could potentially also be impacting the single player with a hard maybe on that aspect. There are likely some similar processes used for saving game state and if there is an underlying memory issue interrupting save process then that will impact multiple play styles.

[keen flower]

maybe I should implement some monitoring script as well to keep an eye on that.

[modest panther]

it is effecting singleplayer games

[keen flower]

currently the server is saving every 5 minutes... will go scripting now and get some monitoring up and running 🙂

[lapis pelican]

Single player games are affected a bug. We don't know that it's the same bug.

[lapis pelican]

This is my plan. Worst case is we lose 5 minutes of progress. Can still be unfortunate but better than numerous hours.

[keen flower]

yeah but I just figured out, that the server will do a save command, if a player leaves the server and will start counting the 5 minutes from that point

just tested it

[lapis pelican]

My thoughts are setup a script to watch for a save and if not seen for >10 minutes restart.

[keen flower]

so if it works like that in the future at least there should be no server progress loss.

cant tell yet if it affects the player progress as well

[sinful merlin]

In a server first for us, the saved game file actually just updated without rebooting (though before it was saving on reboot but apparently saving the old file over again). So, progress it looks like.

[lapis pelican]

Once it's in a broken state, you'll see a lack of updates and saves being sent on logout.

[sinful merlin]

Now updating every 5 minutes, as designed. So, we'll play a while and see what happens after a restart.

[keen flower]

they also changed, that the player name is shown and not the SteamID.
Makes it easier to search for saving events.

but as I said, if a player leaves the server, it saves also and starts counting the 5 minutes from that moment.

[tawny saffron]

Nice, keep us posted! I’ll have updates in a few hours when I get home.

[stone pebble]

they patched something and mass started 🙂

[trail tusk]

So I have a question now since we should not use steam cloud save anymore. Can I somehow download the steam cloud save file and transfer it to my local files so I can continue with my Level 7 char? Otherwise I have to start from scratch right?

[stone pebble]

i lost so many items on local save

its not rollback its just missing items in chests

[lapis pelican]

@stone pebble - Please report the bug and discuss in the #troubleshooting channel. This thread is specifically for progression losses due to faulty saving process. Not losing items in chests.

[lavish locust]

Just wanted to let you know, we tried copying our server files out but they basically hadn't been updated since the issues began. Server has been rebooted, our progress reverted about 7 hours. Apparently the logs had errors and stuff but I can't review any of it, friend is like halfway MIA and hes the host.......

[stone pebble]

@lapis pelican already did and nothing

[lapis pelican]

This is early access Edit: and first 24 hours of launch. It's not going to be an instant fix or answer. Just because there is lack of progress on that aspect doesn't mean this is the right channel just because people are talking.

[lapis pelican]

Yup, unfortunately this is the same as we saw. Errors preceeded a failure in the save process and then just nothing saved.

[stone pebble]

im stack on proggresion because i lost spark and another huge items

i must start over on 8 lvl character

[woven ridge]

Fired up again today local play w/ cloud saves. No rollback, log showed 2:58 session time and no obvious errors. In that session I quit to main menu, waited about 5 min, then quit the game entirely.

[tepid latch]

Just played for 4 hours on private with Steam Cloud and didn't have a rollback after using Exit to Desktop.

Things I did differently this time around

• explore different areas
• did 2 Elixir Wells (one being the journal task with boss)
• only acquired the Alchemist

Before I has getting the Alchemist (1st) and the Hunter (2nd) then placing them in my base. Don't think I had done the first Elixir Well with boss after the first few roll backs before acquiring the Alch & Hunter

[sinful merlin]

Mini-update, characters logging into and out of the server are no longer rolling back (we turned off cloud saves too, fyi). Will update a final time when we reboot the server later, and see if it saves/reloads properly, or if anything new happens. Good luck, everyone!

[tawny saffron]

Thanks for the updates. For cloud saves, did you need to restart your character or is there a way to backup cloud to local files to avoid this?

Have you tried to restart the server yet or are you playing locally?

[sinful merlin]

We're playing/testing on the GPortal server, we just started new toons, I assume you can back up/transfer the cloud files though, and I think I saw that discussed elsewhere, but for myself I was only level 2 anyway. Haven't restarted the server yet, were going to let it play awhile then bravely rip the Band-Aid off.

[icy blaze]

Looking forward to when you restart the server, Cord. My group is still hesitant. 😄

[stone pebble]

@sinful merlin What about losing item from chests?

[sinful merlin]

We haven't had anything disappear since the patch, the only thing we haven't done yet is a server reboot, but the server is saving every 5 minutes now where it wasn't prior to the patch, so we are hopeful it's fixed for us at least. If you're playing solo though, today's patch wasn't for the issue with solo games. They are still working on that and suggest turning off cloud saves until they can address it, that seems to fix the issue for most with the solo problem.

And understand, we weren't having a "disappearing" problem, we were having a rollback problem. Where if we logged out and back in the character's experience and equipment would be lost, and if we restarted the server the server would rollback, and everything gathered, built, killed, NPC freed, etc would be gone, because the server was back to an earlier state.

[calm edge]

I bet you anything the dude had an open server and a troll just came in and stole all his stuff lol

[stone pebble]

i had x4 Sparks in chest, now 0, how i can progress with altar? i cannot pick same spark again?

[sinful merlin]

They should respawn after 2 hours, but be aware if you go into the terrain "chunk" where the flames are, it will reset the 2 hour timer.

Update- we just restarted our server after 4 hours, it did NOT roll back this time (for the first time), so hopefully we're in the clear for this issue. I hope you all have the same results. 💥 @tawny saffron

[sinful merlin]

Ours just worked, so good luck with yours.

[rose bison]

I will test it out now too

lets pray together

[stone pebble]

@sinful merlin Is it possible that someone stole my items?

[desert mica]

crash game for me

[civic belfry]

for solo player games that lost progress, is there any way to force load the save from last night, or is that just lost to the void now

didn't know that this was an issue and logged in today to realize i lost like 7 hours of progress from last night :/

had cloud saves on like normal so have no idea if anything is salvagable

[spring axle]

solo games cloud save, couldn't find anything local at least for me

[sinful merlin]

Yes if someone can get on your server they can take/break anything

[stone pebble]

omg, why is that allowed?

how to get sparks again?

so now i have to raid all opened servers and take items for me and that is legit

[civic belfry]

yeah, i wonder if theyll be able to recover those cloud saves or if theyre just gone, i know i can just do that stuff again but i of course would rather not

also it seemed like from reading that they only fixed the issue with dedicated servers, not from solo play, so im not even sure replaying it will fix anything

[obtuse aspen]

did the lates fix, fix this savegame problematic?

[sinful merlin]

Again, the sparks should respawn after 2 hours, if no one is in the area close to where they spawn, otherwise the 2 hour timer starts over. You can start a local game, get the sparks then go to your server as well.

[sinful merlin]

The #5 hotfix was for server saves, not solo character issues, but it seems to have fixed the server issue so far. For solo issues they suggest disabling cloud saves until that issue is patched.

[civic belfry]

my hope is that it was still cloud saving, and just for some reason its just not pulling from those cloud saves, and that hopefully they can fix those, i just dont want to do the exact same 7 hours again personally 😛

[obtuse aspen]

THX . Great Work from the RND Team !

[low vault]

My character resets to this time everytime i log out and come back in. I make no character progression anymore and always default back to this after a crash where i made it to level 18. Any help that can get me playing again would be appreciated

[icy blaze]

^

[lavish locust]

Just wanted to update, since the patch the server has remained way more stable and it appears as though saves are still occurring without issue, no server reboots yet, but any changes i make to my character persists upon exiting and entering the game again

[sacred peak]

Just been playing for about 4-5 hours with a few friends... The whole thing got rolled back about 3 hours...

[calm edge]

local or dedicated

[sacred peak]

Local

[calm edge]

yeah local i dont think have been fixed yet, best thing you can do is disbale cloud saves

but thats a fresh start

[sacred peak]

Yeah I figured it would be

Is that definitely working? by not using cloud saves?

[calm edge]

has been for us at least and most that i see that disable it dont get roll backs

[sacred peak]

Okay that's good to know..Thanks, I appreciate it. 🙂 Hopefully local can get fixed soon

[calm edge]

yeah they got dedicated fixed pretty fast so shouldnt be to much longer for local saves

[quaint moss]

Server been running super fine for 10h, tried restarting a couple of times without issues and none of our 4 players lost progress, so far so good 🙂

[whole forge]

damn logged on now lost around 4 hours of progerss from lastnight

[half yew]

me too -.- but the items in storages are save only character progress is buggy

[whole forge]

its affected both for me

[slow basalt]

Logged in this morning onto our Nitrado server, looks like we lost about 2-3 hours of progress from last night as well

[whole forge]

did it affect you character and server too?

[slow basalt]

yes, both 😦

[weary holly]

After the patch, half the house disappears. Well, at least not full, as before.🥹
P.S.
Conclusion: it is better to build a house only in the location where it is marked in the quest (at the very beginning). In other places there is a chance of a wipe.

[rose bison]

Well, testet around today with cloud and local saving.
Both saves get roll back.

[sinful merlin]

Just to be certain, for anyone having server rollback issues, did you actually patch your server yesterday after the hotfix, or did you continue running, and the rollback happened after the server auto restarted overnight? If that's the case, and the server didn't get shutdown/patched prior, that would most likely be why it still happened to you. So, if you didn't shutdown yesterday, and it happened to you overnight, you should validate the files on your server, to make sure it's actually patched now, before going forward.

[rose bison]

will do that immediately

[slow basalt]

Do you know what's the version number that includes hotfix 5? My Nitrado sever currently says the version of the game is v0.0.15.0.

seems like hotfix 5 steam post says the version number is 487903, not sure how these numbers correlate..

[sinful merlin]

Unfortunately, GPortal doesn't seem to share that info. Can't say I've been real happy with their interface, their customer service is okay, but their server tools are crap compared to other hosts I've used. Maybe one of the others here that have had the fix work for them can help.

[tawny lichen]

LOST SAVES FILES REQUEST

#common-issues message

[graceful wolf]

[icy blaze]

I never did follow up on my scenario. I have a Nitrado server and after patching it + setting our clients to local saves for characters — it’s been smooth sailing for us. No rollbacks finally!

[frozen holly]

When you say local saves, do you mean turning off steam cloud save? If you end up experiencing it again, try and keep track of how long the server has been up/ gap since it didn't occur. After updating, we had it re-occur on ours this morning

[tawny saffron]

Quick update.
We are on Nitrado (sadly) updated server yesterday. Had several friends in server, character data was saved for everyone upon returning to main menu. Server was restarted 3 times throughout our session last night and it backed up and saved each time. No roll backs on our end. We are all still on cloud saves.

[icy blaze]

Yes, turned off Steam cloud saves for players after the new hotfix has fixed it for us so far. I'll let you know if it changes.

[lavish locust]

Our dedicated has been running fine, but its been about 24h and its started to lag really bad (literally about the 24 hour mark for the lag). BUT the good news is the saves are still syncing. Does anyone know what all needs to be moved and configured if moving to a different dedicated server? I am looking to move ours to a much better box. I was thinking its just the save game folder on the server?

[icy blaze]

@lavish locust Are you on Nitrado and lagging? I have a couple people complaining about that.

[lavish locust]

No, its a server at my friends house.

[sinful merlin]

If you check the server faq I believe it has instructions for migrating worlds.
https://discord.com/channels/1046840540550942720/1195385300676005958

[dull island]

How did you patch your Nitrado server? Manually or eventually it just happened?

[icy blaze]

I restarted it and it applied it before coming back online.

[dull island]

Ok!

[lavish locust]

Yeah I found a random post about it and got it transferred over. New server has been performing WAY better.

[deep hamlet]

what are you using now

[lavish locust]

Went from a dual E5-2600 series R620 with 48GB DDR3 to a Ryzen 3600 OC to 4.3ghz all core and 16GB DDR4 3400mhz with an SSD. One thing that is odd is it hammers one core pretty hard for like 6 hours then eventually the usage goes down and the server starts to throw the server load errors. But within that time my 4 friends and I can be anywhere doing anything and its smooth as butter. Also noticed once those messages pop up and we enter the town way in the east region it goes down hill real fast. But we went back after fresh reboot and its fine. With all this progress is still being sent to clients, no lost saves at all since that patch.

[steady aspen]

ye seems to be a leak somewhere in the server, I got around it by using a cronjob to reboot every 12 hours, wasnt happening before hotfix #4 tho

[lavish locust]

Yeah I couldn't tell before hand because that R620 was throwing that message pretty consistently even upon fresh reboots. Figure it was the dedicated server client not being very efficient or needing optimization. What is weird is when it started to lag, the other cores on my 3600 started getting more busy, but that one core settled down to like 40-55% usage. Physical resources were all in check, memory grew by 600MB from initial startup to 1.5GB total.

But idk anything about the workings of the server clients themselves, i just do server/storage stuff haha

[steady aspen]

the usage itself wasnt alarming, but it got pretty laggy

[lavish locust]

Yeah thats what mine did, physical usage was fine

but game lagged anyways and said heavy load, but there was no actual load lol, there was actually less on the most active core..

[steady aspen]

you might want to try to host on windows 11 or 10 instead of linux or windows server, less cpu usages by quite a bit from what i have heard

[lavish locust]

its on W10

I almost threw it in a VM in my lab, but i had my old gaming pc sitting around so repurposed it instead of having a noisey C series M5 down here lol

[steady aspen]

how many cores are you using? for me its about 5 cores idle and 7-8 cores with 4 people

on linux tho

[lavish locust]

Thats what the dedicated looks like very consistently, then when the lag happens that busy core is less busy and everythign else rises ever so slightly

[steady aspen]

idle here

[lavish locust]

like no one playing idle?

[steady aspen]

yes

[lavish locust]

mine is with 4 people in it including myself lol

[steady aspen]

told you linux cpu usage is higher then win11 xd

[lavish locust]

yeah no kidding lol

[left roost]

Is there a workaround for characters not saving any progress? I tried disabling steam cloud but that didnt help either

[frozen holly]

Just had it occur to our group again after it worked fine all day yesterday. Gonna have the server owner submit the files.

Only thing I can think of is that the majority of our players were spending today clearing old map notifications. E.G. Wailing Blade, first flame obelisk, etc.

[icy blaze]

Yep, just coming back now to report this

Local character saves + hotfix #5 on server -- we just lost 3 hours of progress

Unfortunately, taking a break from this game until it's fixed, so much wasted time

here's the server log associated with it, if this is the specific .log you need

[left roost]

same for me and my buddy, had to stop playing until its fixed :/

[neat mirage]

We are three on m'y server Nitrado, we play saturday and we loose all progression... so we stop planning... It's a shame because the game is great...

[graceful wolf]

Remember, please that we’re trying to collect logs for incidents like this

#common-issues and use #discord-support to submit them

[untold vapor]

Had this happen today. Also hosting with Nitrado. Already send in log files and made a ticket. But damn shame, we're hoping a fix can be found soon as there is no way to play right now. (maybe building your base i guess)

[frozen holly]

Considering the bug seems to be associated with server uptime, in our experience, we’ve set ours to restart multiple times a day to see if it changes anything. Hopefully it will at least lessen the impact for progress loss if it does occur. Will report back

[neat mirage]

Do you think this is mainly linked to Nitrado? I feel like every time I hear "Nitrado"

[untold vapor]

🟧 = Nitrado
🟩 = Other

Let's try it out this way then

[frozen holly]

Anecdotally, have seen other threads and places mention it occurring with self hosting via Steam and some other providers. It may just be because they’re being used more currently by the player base.

[untold vapor]

it's a cheap host that does what it needs to do so, i get it.

Also, my server seems to be running an update? I restarted 3 hours ago and it didn't back then'

[tropic patrol]

16 Cores, 32GB RAM own VM having issues as well. Server restarts once a day.

[tawny lichen]

This is not a Nitrado, nor is it a dedicated server-only issue. Please check the latest post on #common-issues and ensure you send us server-side files, as these will be crucial in investigating the issue. Thank you

[neat mirage]

Hm.. so why lot of player don't have issue ?

[frozen holly]

Just had another rollback occur, I've been logging out and in frequently to ensure items saving to the character.
In the 30 minute window before my last log and the save error occurring to the server none of us were doing anything particularly special. Lots of mining, tree chopping, seed growing, and planting.

[tawny saffron]

aaaand its rolling back again

Our characters and dedicated server got rolled back about 12hrs upon logging in and restarting the server. Still no manual save or back up. RIP.

The update on Hotfix 5 seems to fixed our issue. But the last update has made the server roll backs reappear again

[steel scarab]

Hey there, may I ask for some info?
-Dedicated server or hosted by someone?
-Players are saving on Cloud Save or Locally?

[frozen holly]

Dedicated Nitrado server. I save locally because I’ve been messing with troubleshooting, submitting tickets etc. server owner and others use cloud still.

I’ll check to see if the server owner submitted the files or not in a separate ticket (soon) and update my own

[night hornet]

Noticed whenever I create a second flame altar next to (slightly west) the Ancient Vault - Farmer and I restart my dedicated server, the flame altar there will be removed. I've tested this and it consistently occurs. I tried doing the same thing but much more south and the 2nd flame altar remained post dedicated server restart. Attempted another 2nd flame altar slightly southeast of the same ancient vault and it worked. The locations are marked on the map in the screenshot.

Red flag = base will be deleted upon dedicated server restart
Green flag = base remains post dedicated server restart
Character marker = base remains post dedicated server restart

I should mention, my character doesn't lose progress as I keep everything my character had in the inventory but anything that was put into the 2nd flame altar's base will be deleted.

Are there maybe hidden zones where bases aren't allowed to be built too close to other camps? ie: Ancient Vaults, Withered Encampments, Abandoned Hunter Camp, Westcott?

[frozen holly]

This seems extremely interesting if you were able to get it to repeat. I'd definitely submit the logs and files to a ticket if you can.

[night hornet]

didn't realize they had a ticket system. I submitted it and hope it gets fixed eventually

[desert mica]

PRIVATE SERVER - issue #1 last night, ive built a second shrine and placed it across the bridge near the scavenger camp (wheres there is a useful repair table) i reloged this morning and half house walls and roof were gone plus 2 crafting stations and my tiny chests - and issue #2 this afternoon was that on relogin, i lost my shrine #1 near cave and pod and now im rebuilding everything as a quest i already did... funny that the quests and 3 npc crafters are still updated as im lvl 6

[steady aspen]

late response, but the game checks if the altars are place at a valid spot when starting the server/save.
If you spam alt + left mouse while holding an altar you can place it down before the game can validate the spot, i guess you were quicker with placing it then the server could check if the spot was valid or not, so you placed it in a invalid spot and got erased when you restarted the server

[steady aspen]

/\

[night hornet]

I appreicate the response however I took my time lining up the spot so I can't imagine I placed it too fast

[steady aspen]

then i said nothing :P

[night hornet]

lol

[desert mica]

thanks @steady aspen ...i forgot to mention when this server crash happened - i had placed a shrine #2 other that the #1 existing at my base house (initial quest coming out of pod) then i went to that house shrine #1 and extinguished the flame so that i would have only one house near an enemy camp over at blacksmith pod across braelyn bridge (because theres a repair table very useful).

[steady aspen]

Workbench repairs tools aswell