[1] Register OctaneLive [0] Loaded Octane DLL:OctaneRender 4.05 version:4050000 SDK:4.05 [0] Octane Render for Cinema 4D V4.05-R7 built for:180 C4D vers:18057 [0] C4D:18057 comp:[DESKTOP-G66TDFO] OS:[WINDOWS 64 BIT] Windows 10, 64 Bit, Core (build 18362) opengl:460 sysInfo:32 versType:2 [0] CPU:[G, stepping 10, model 14, instruction family 6] speed:3.7 GHz numOfCpu:12 [0] Plugins:[addons advanced render alembic archigrass bitmapfilter bpexchange browser ca ca2 cineman clothilde collada14 collada15 colorchoosergui compositing dwg dwgobjects dynamics exchanges expressiontag fbx hair houdiniconfig houdiniengine iges io_obj i_skp licenseserver metrics mocca model mograph motioncam motiontracker newman objects okino onlinehelp onlineupdater openexr python relaxuv sculpt sculptbrushes shader sketch sky sla spacemouse substance teamrender texturemanager thinking particles tpoperators walkthrough xpressocore xtensions c4dOctane-R18 DropToFloor 3dquakers Forester ] [1] LoadOslScripts() [1] LoadCustomLuts() [1] [1] [1] [1] [1] checkPathTracing() [1] use active PathTracing [1] applyPTParams:0x000002AED067AA30 [1] >> ProcessUpdate(flags=C cAsyn=0 dDelay=1 [1] checkAllUpdates(flags=C updFlags=) [1] checkDocs() [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:2.911ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] checkPathTracing() [1] use active PathTracing [1] applyPTParams:0x000002AED067AA30 [1] >> ProcessUpdate(flags=C cAsyn=0 dDelay=1 [1] checkAllUpdates(flags=C updFlags=) [1] checkDocs() [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:2.801ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] checkPathTracing() [1] use active PathTracing [1] applyPTParams:0x000002AED067AA30 [1] >> ProcessUpdate(flags=C cAsyn=0 dDelay=1 [1] checkAllUpdates(flags=C updFlags=) [1] checkDocs() [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:2.703ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] checkPathTracing() [1] use active PathTracing [1] applyPTParams:0x000002AED067AA30 [1] >> ProcessUpdate(flags=C cAsyn=0 dDelay=1 [1] checkAllUpdates(flags=C updFlags=) [1] checkDocs() [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:3.653ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] checkPathTracing() [1] use active PathTracing [1] applyPTParams:0x000002AED067AA30 [1] >> ProcessUpdate(flags=C cAsyn=0 dDelay=1 [1] checkAllUpdates(flags=C updFlags=) [1] checkDocs() [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:3.752ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] checkPathTracing() [1] use active PathTracing [1] applyPTParams:0x000002AED067AA30 [1] >> ProcessUpdate(flags=C cAsyn=0 dDelay=1 [1] checkAllUpdates(flags=C updFlags=) [1] checkDocs() [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:3.753ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] checkPathTracing() [1] use active PathTracing [1] applyPTParams:0x000002AED067AA30 [1] >> ProcessUpdate(flags=C cAsyn=0 dDelay=1 [1] checkAllUpdates(flags=C updFlags=) [1] checkDocs() [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:3.041ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] checkPathTracing() [1] use active PathTracing [1] applyPTParams:0x000002AED067AA30 [1] >> ProcessUpdate(flags=C cAsyn=0 dDelay=1 [1] checkAllUpdates(flags=C updFlags=) [1] checkDocs() [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:3.793ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] setExportStatus(st=3, flg=0, thr=0) [1] setInteractive(0)[OK] [1] restoreDeviceStates status:4[1] setDevicesActivity rDevices:0 nDevices:0[1] SendAndStartRender(aDoc=437fe240, cDoc=437fe240, renderMode=1, fullSend=0, rendSettings=0) [1] initOctaneLive() [1] processRegions() [1] sendSceneToOctaneRender(renderMode=1, fullSend=0, settings=40f9bb40) [0] --------------------------- EXPORT LOG --------------------------- [1] ResetAndInit 1 [16] LightCollector::clear() -> cnt=0 [1] createOctaneDefaults OK [1] ResetCaches[16] LightCollector::clear() -> cnt=0 [OK] [1] ResetAndInit [OK] [1] readParamsFromBC krnl=2 [OK] [1] readParamsFromBC krnl=2 [OK] [1] checkPathTracing() [1] create PathTracing [1] use active CameraImager [1] checkPathTracing() [1] use active PathTracing [1] applyPTParams:0x000002AE44204A60 [1] ApplyCImager enDenoise:0 [1] ******* createMaterials ******* [1] setExportStatus(st=5, flg=0, thr=0) [1] convert mat:[OctGlossy] tip:1029501 [4] convert done in:4.218ms. [0] Export materials time= 33.854 ms [1] setExportStatus(st=4, flg=0, thr=0) [0] Collect objects time= 17.556 ms [1] setExportStatus(st=7, flg=0, thr=0) [1] octaneLive::exportObjectToSingleMesh(fullSend=0) [8] checkObjects() [8] collectTimer:3.696ms. chkTimer:61.809ms. chkCnt:0 instUpd:1 cnt:1000 [8] SendThread::GenerateObjectsNEW[8] MESH MATRIX UPDATED grp:1 cnt:1000 UPD:1 [0] Mesh creation time = 126.667 ms. [1] setExportStatus(st=6, flg=0, thr=0) [1] setExportStatus(st=8, flg=0, thr=0) [1] updateCamera() [1] calculateCamera(c4dCam=459d3080,set=40f9bb40,full=0) [1] ApplyCImager enDenoise:0 [2] Env.Update() SUN=0x000002AE64586D40 SKY:0x0000000000000000 envNode:0x0000000000000000 mainNG=0x0000000000000000 [2] ENV CALC=3 force=0 updated=4 [2] Env.Update() SUN=0x0000000000000000 SKY:0x0000000000000000 envNode:0x0000000000000000 mainNG=0x0000000000000000 [1] loadBackandForeBitmaps() [1] ImageObject::reload() [1] ImageObject::reload() [1] updateCamera() [1] calculateCamera(c4dCam=459d3080,set=40f9bb40,full=1) [1] ApplyCImager enDenoise:0 [1] Total export Time = 369.577 ms [1] ApiUpdate Wait:0 Caller:STARTRENDER tm:17.705ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] setInteractive(1)[OK] [0] VRAM used/free/max:663Mb/5.667Gb/8Gb Out-of-core used:0Kb RAM used:6.059Gb total:31.915Gb OpenGL free/total:0/0 [4] OctaneMat Init:0x000002AF6AEB2F40 OctGlossy ID:0 time:2210770 doc: [1] [1] >> ProcessUpdate(flags=CO cAsyn=0 dDelay=0 [1] checkAllUpdates(flags=CO updFlags=CLOG) [1] checkDocs() [2] SET SKY=0x0000000000000000 [2] SET SKY=0x0000000000000000 [2] Env.Update() SUN=0x000002AE64586D40 SKY:0x0000000000000000 envNode:0x000002AF669966E0 mainNG=0x000002AEC156DC30 [2] ENV CALC=0 force=0 updated=0 [2] Env.Update() SUN=0x0000000000000000 SKY:0x0000000000000000 envNode:0x0000000000000000 mainNG=0x0000000000000000 [1] ImageObject::isUpdated() [1] ImageObject::isUpdated() [1] >> ProcessUpdate(flags=CM cAsyn=0 dDelay=1 [1] checkAllUpdates(flags=CM updFlags=) [1] checkDocs() [1] checkMaterialUpdates() [1] <<< Mat checkAndUpdate STARTED >>> [4] Material check/update finished in:3.043ms. [4] OctaneMat Init:0x000002AF6AEB2F40 OctGlossy ID:0 time:2225167 doc: [1] readParamsFromBC krnl=2 [OK] [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [0] ------- VP START:0x000002AE575B7280 VPS:0x000000D1E68FEDB0 ----------- [1] initVpRender(....) [1] setInteractive(0)[1] ERR: -> failed to wait for event [1] ERR:device 0: path tracing kernel failed [OK] [1] ---------------------------------------------------------------------------------------- [1] <<< Render failure detected!!! >>> Please check render statistics to solve the problem. [1] initOctaneLive() [1] Device:0 [GeForce RTX 2080][DT][7.5] Memory used/free/total:663Mb/5.667Gb/8Gb outOfCoreMem:0Kb p2pBytesUsed:0 runtimeDataSize:650Mb temperature:61 [0] Check geometry subdivisons. Picture viewer uses 'Render' subdivisions. But Live Viewer uses 'Editor' subdivision values. Try to decrease 'render/editor' subdivison values. [0] Break rendering... [0] **** RENDER FINISHED **** stat=5 [1] VpRenderFinished() [1] resetOrbxRootGraphs() [1] ResetCaches [OK] [1] readParamsFromBC krnl=2 [OK] [1] ResetAndInit 0 [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to unregister pinned memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to unregister pinned memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ResetCaches[1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to destroy CUDA event [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [OK] [1] ResetAndInit [OK] [1] ERR: -> failed to destroy CUDA event [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate pinned memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device array [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate pinned memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to deallocate device memory [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> could not get memory info [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to unload module [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered [1] ERR: -> failed to unload module [1] setExportStatus(st=3, flg=0, thr=0) [1] setInteractive(0)[OK] [1] readParamsFromBC [OK] [1] restoreDeviceStates status:4[1] setDevicesActivity rDevices:0 nDevices:0[1] SendAndStartRender(aDoc=437fe240, cDoc=437fe240, renderMode=1, fullSend=0, rendSettings=0) [1] initOctaneLive() [1] processRegions() [1] sendSceneToOctaneRender(renderMode=1, fullSend=0, settings=40f9bb40) [0] --------------------------- EXPORT LOG --------------------------- [1] ResetAndInit 1 [16] LightCollector::clear() -> cnt=0 [1] createOctaneDefaults [1] ERR:CUDA error 715 on device 0: an illegal instruction was encountered OK [1] ResetCaches[16] LightCollector::clear() -> cnt=0 [1] ERR: -> failed to bind device to current thread [1] ERR:device 0: failed to initialize context [OK] [1] ResetAndInit [OK] [1] ERR:CUDA error 201 on device 0: invalid device context [1] ERR: -> failed to create link [1] ERR:device 0: failed to create OSL compile context: [1] readParamsFromBC krnl=2[1] ERR:device 0: failed to compile module 0 [OK] [1] ---------------------------------------------------------------------------------------- [1] <<< Render failure detected!!! >>> Please check render statistics to solve the problem. [0] MB:0/0 ST/MOV:0/1000 Nodes:2013 Tris:0 DispTris:0 Hairs:0 Meshes:0 [0] Textures Grey8/16:0/0 Rgb32/64:0/0 [1] readParamsFromBC krnl=2 [OK] [1] checkPathTracing() [1] Device:0 [GeForce RTX 2080][DT][7.5] Memory used/free/total:0Kb/5.667Gb/8Gb outOfCoreMem:0Kb p2pBytesUsed:0 runtimeDataSize:0Kb temperature:52 [1] create PathTracing [1] use active CameraImager [1] checkPathTracing() [1] use active PathTracing [1] applyPTParams:0x000002AF3D7087C0 [1] ApplyCImager enDenoise:0 [1] ******* createMaterials ******* [1] setExportStatus(st=5, flg=0, thr=0) [1] convert mat:[OctGlossy] tip:1029501 [4] convert done in:4.29ms. [0] Export materials time= 30.605 ms [1] setExportStatus(st=4, flg=0, thr=0) [0] Collect objects time= 16.675 ms [1] setExportStatus(st=7, flg=0, thr=0) [1] octaneLive::exportObjectToSingleMesh(fullSend=0) [8] checkObjects() [8] collectTimer:4.041ms. chkTimer:100.025ms. chkCnt:0 instUpd:1 cnt:1000 [8] SendThread::GenerateObjectsNEW[8] MESH MATRIX UPDATED grp:1 cnt:1000 UPD:1 [0] Mesh creation time = 166.128 ms. [1] setExportStatus(st=6, flg=0, thr=0) [1] setExportStatus(st=8, flg=0, thr=0) [1] updateCamera() [1] calculateCamera(c4dCam=459d3080,set=40f9bb40,full=0) [1] ApplyCImager enDenoise:0 [2] Env.Update() SUN=0x000002AE64586D40 SKY:0x0000000000000000 envNode:0x0000000000000000 mainNG=0x0000000000000000 [2] ENV CALC=3 force=0 updated=4 [2] Env.Update() SUN=0x0000000000000000 SKY:0x0000000000000000 envNode:0x0000000000000000 mainNG=0x0000000000000000 [1] loadBackandForeBitmaps() [1] ImageObject::reload() [1] ImageObject::reload() [1] updateCamera() [1] calculateCamera(c4dCam=459d3080,set=40f9bb40,full=1) [1] ApplyCImager enDenoise:0 [1] Total export Time = 419.18 ms [1] ApiUpdate Wait:0 Caller:STARTRENDER tm:17.451ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] setInteractive(1)[OK] [1] getPickIntersection() [1] ERR:could not pick materials, because the geometry has changed and rendering is paused [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:6.042ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.064ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.15ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.128ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.431ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.695ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.711ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.48ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.752ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.001ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.015ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.022ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:5.444ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] closeRenderDialog[1] setInteractive(0)[OK] [OK] [1] ResetAndInit 0 [16] LightCollector::clear() -> cnt=0 [1] ResetCaches[16] LightCollector::clear() -> cnt=0 [OK] [1] ResetAndInit [OK] krnl=2 [OK] [1] readParamsFromBC krnl=2 [OK] [1] processRegions() [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.559ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0) [1] restoreDeviceStates status:7[1] Set gpu priority to:0[1] setDevicesActivity rDevices:0 nDevices:0[1] restoreDeviceStates status:7[1] setDevicesActivity rDevices:0 nDevices:0[1] RestoreLayout(secret=cfafbf08) [1] readParamsFromBC krnl=2 [OK] [1] readParamsFromBC krnl=2 [OK] [1] restoreDeviceStates status:7[1] setDevicesActivity rDevices:0 nDevices:0[1] readParamsFromBC krnl=2 [OK] [1] >> ProcessUpdate(flags=C cAsyn=0 dDelay=1 [1] ApiUpdate Wait:0 Caller:needApiUpdate tm:4.488ms. [OK] [1] setExportStatus(st=9, flg=0, thr=0)