We are using Wwise 2024.1.8 and 5.6.1 and ever since we switched to wwise 2024.1 version and started using multi process cook we have been experience a quite random
crash all of the time while cooking ONLY in wwise external sources cooking.
It looks like what is happening is that one of the processes is trying to delete a file while it is being read from another process.
The call stack and error is like this:
LogFileManager: Warning: Error deleting file: T:/Horde/branchName/Sync/ProjectName/Saved/Cooked/PS5/ProjectName/Content/ExternalSources/xyz_1_name.wem (Error Code 32)
LogFileManager: Warning: Error deleting file: T:/Horde/branchName/Sync/ProjectName/Saved/Cooked/PS5/ProjectName/Content/ExternalSources/xyz_1_name.wem (Error Code 32)
LogFileManager: Warning: Error deleting file: T:/Horde/branchName/Sync/ProjectName/Saved/Cooked/PS5/ProjectName/Content/ExternalSources/xyz_1_name.wem (Error Code 32)
In here i'm using PS5 in the logs but this happens across all 3 platforms, win64, ps5 and xsx
and sometimes the crash is slightly different:
LogOutputDevice: Error: begin: stack for UAT
LogOutputDevice: Error: Fatal error: [File:T:/Horde/branchName\Sync\Engine\Source\Editor\UnrealEd\Private\Serialization\FilePackageWriterUtil.cpp] [Line: 79]
SavePackage Async write T:/Horde/branchName/Sync/ProjectName/Saved/Cooked/PS5/ProjectName/Content/ExternalSources/xyz_1_name.wem failed: Unexpected file size. Tried to write 140971 but
resultant size was 0. Another operation is modifying the file, or the write operation failed to write completely.
LogOutputDevice: Error: [Callstack] 0x00007ffc53758e0d UnrealEditor-UnrealEd.dll!FFilePackageWriterUtil::FWriteFileData::HashAndWrite() [T:\Horde\branchName\Sync\Engine\Source\Editor\UnrealEd\Private\Serialization\FilePackageWriterUtil.cpp:130]
LogOutputDevice: Error: [Callstack] 0x00007ffc536e0a20 UnrealEditor-UnrealEd.dll!`FFilePackageWriterUtil::AsyncSaveOutputFiles'::`2'::<lambda_1>::operator()() [T:\Horde\branchName\Sync\Engine\Source\Editor\UnrealEd\Private\Serialization\FilePackageWriterUtil.cpp:373]
LogOutputDevice: Error: [Callstack] 0x00007ffc5373ad95 UnrealEditor-UnrealEd.dll!UE::Tasks::Private::TExecutableTaskBase<`FFilePackageWriterUtil::AsyncSaveOutputFiles'::`2'::<lambda_1>,void,void>::ExecuteTask() [T:\Horde\branchName\Sync\Engine\Source\Runtime\Core\Public\Tasks\TaskPrivate.h:907]
LogOutputDevice: Error: [Callstack] 0x00007ffc52744380 UnrealEditor-UnrealEd.dll!UE::Tasks::Private::FTaskBase::TryExecuteTask() [T:\Horde\branchName\Sync\Engine\Source\Runtime\Core\Public\Tasks\TaskPrivate.h:527]
LogOutputDevice: Error: [Callstack] 0x00007ffc526c6634 UnrealEditor-UnrealEd.dll!LowLevelTasks::TTaskDelegate<LowLevelTasks::FTask * __cdecl(bool),48>::TTaskDelegateImpl<`LowLevelTasks::FTask::Init<`UE::Tasks::Private::FTaskBase::Init'::`2'::<lambda_1> >'::`13'::<lambda_1>,0>::CallAndMove() [T:\Horde\branchName\Sync\Engine\Source\Runtime\Core\Public\Async\Fundamental\TaskDelegate.h:171]
LogOutputDevice: Error: [Callstack] 0x00007ffc5cebd165 UnrealEditor-Core.dll!LowLevelTasks::FTask::ExecuteTask() [T:\Horde\branchName\Sync\Engine\Source\Runtime\Core\Public\Async\Fundamental\Task.h:627]
LogOutputDevice: Error: [Callstack] 0x00007ffc5cebd03e UnrealEditor-Core.dll!LowLevelTasks::FScheduler::ExecuteTask() [T:\Horde\branchName\Sync\Engine\Source\Runtime\Core\Private\Async\Fundamental\Scheduler.cpp:387]
LogOutputDevice: Error: [Callstack] 0x00007ffc5cee2c21 UnrealEditor-Core.dll!LowLevelTasks::FScheduler::WorkerLoop() [T:\Horde\branchName\Sync\Engine\Source\Runtime\Core\Private\Async\Fundamental\Scheduler.cpp:724]
LogOutputDevice: Error: [Callstack] 0x00007ffc5cea5835 UnrealEditor-Core.dll!`LowLevelTasks::FScheduler::CreateWorker'::`2'::<lambda_1>::operator()() [T:\Horde\branchName\Sync\Engine\Source\Runtime\Core\Private\Async\Fundamental\Scheduler.cpp:188]
LogOutputDevice: Error: [Callstack] 0x00007ffc5d0c0e33 UnrealEditor-Core.dll!FThreadImpl::Run() [T:\Horde\branchName\Sync\Engine\Source\Runtime\Core\Private\HAL\Thread.cpp:69]
LogOutputDevice: Error: [Callstack] 0x00007ffc5d5636ed UnrealEditor-Core.dll!FRunnableThreadWin::Run() [T:\Horde\branchName\Sync\Engine\Source\Runtime\Core\Private\Windows\WindowsRunnableThread.cpp:159]
LogOutputDevice: Error: [Callstack] 0x00007ffc5d55c6ef UnrealEditor-Core.dll!FRunnableThreadWin::GuardedRun() [T:\Horde\branchName\Sync\Engine\Source\Runtime\Core\Private\Windows\WindowsRunnableThread.cpp:79]
LogOutputDevice: Error: [Callstack] 0x00007ffcdb257374 KERNEL32.DLL!UnknownFunction []
LogOutputDevice: Error: [Callstack] 0x00007ffcdb3bcc91 ntdll.dll!UnknownFunction []
LogOutputDevice: Error
LogOutputDevice: Error: end: stack for UAT
Does anyone know if this is a known issue? It's quite annoying to constantly re-run jobs on horde because this keeps randomly crashing and I cant imagine we are the only people having this issue.
It seems to only happen when wem files are being cooked so might be something in the code for cooking wem files has some issues