fix hot update issue. #2312

xianyinchen · 2020-03-19T13:52:34Z

添加获取更新包大小接口

https://forum.cocos.org/t/topic/89221

提升对 CDN 更新的友好度，对链接添加MD5参数

http://forum.cocos.com/t/cdn/52995

更新过程中断导致的问题

热更新下载启动时，会立即删除旧版本文件问题
~~热更新下载完成后，文件复制操作可能被中断，导致更新后资源丢失或混乱(移动到JS层处理)~~

Perform delete operation after merge temporary storage.

…e size.

…w version found.

…date operate. need add a calling code to main.js, see tutorial-hot-update repository.

holycanvas · 2020-03-20T02:52:05Z

热更新文档里面要更新一下么？

xianyinchen · 2020-03-20T05:17:34Z

原生层的修改不涉及到热更新流程改动，可以兼容旧版本的，这个PR可以保持文档不变。

热更新测试例的改动，需要更新文档
cocos-creator/cocos-tutorial-hot-update#31

pandamicro · 2020-03-27T06:21:58Z

cocos/scripting/js-bindings/auto/jsb_cocos2dx_extension_auto.cpp

@@ -1215,6 +1232,7 @@ bool js_register_extension_AssetsManagerEx(se::Object* obj)
    cls->defineFunction("downloadFailedAssets", _SE(js_extension_AssetsManagerEx_downloadFailedAssets));
    cls->defineFunction("isResuming", _SE(js_extension_AssetsManagerEx_isResuming));
    cls->defineStaticFunction("create", _SE(js_extension_AssetsManagerEx_create));
+    cls->defineStaticFunction("checkFinish", _SE(js_extension_AssetsManagerEx_checkFinish));


不需要更新自动绑定代码

这是因为添加了静态函数，可以在引擎启动前，修复热更新中断的问题，比如热更新完成后，从_tempStoragePath拷贝文件到_storagePath的操作被中断，导致_storagePath出现新旧文件混合，这种情况需要在引擎启动前把_tempStoragePath未拷贝的文件移动到_storagePath。

pandamicro · 2020-03-27T06:34:44Z

extensions/assets-manager/AssetsManagerEx.cpp

@@ -176,6 +176,79 @@ AssetsManagerEx* AssetsManagerEx::create(const std::string& manifestUrl, const s
    return ret;
 }

+void AssetsManagerEx::checkFinish(const std::string &storagePath) {
+    AssetsManagerEx* mgr = new (std::nothrow) AssetsManagerEx("", storagePath);


这个 API 居然设计为 static ？不是很能理解，这应该是一个成员属性，检查自身状态才对啊

这个接口不是给用户调用的，而是用于在启动引擎前，检查热更新是否存在问题，并修复问题。

pandamicro · 2020-03-27T06:39:51Z

extensions/assets-manager/AssetsManagerEx.cpp

+            // this is the safest.
+            if (_tempManifest != nullptr
+                && _tempManifest->isLoaded()
+                && _remoteManifest->versionGreater(_tempManifest, _versionCompareHandle)) {


这里似乎不用对比 version，既然已经在 if (_localManifest->versionGreaterOrEquals(_remoteManifest, _versionCompareHandle)) 的 else 中，那么这个 version 判断自然是成立的

这个修复，是为了考虑一种特殊情况：
用户下载A版本未完成，然后发现B版本，开启新的热更新，但是这时候_tempStoragePath里面是有A版本的缓存文件的，这里做了清除的A版本资源的操作。

我知道，我的意思是从逻辑上来说

if (_tempManifest != nullptr && _tempManifest->isLoaded()) { }

就足够了

我重新确认下代码，加这个代码是多余了的，原始代码下载version.manifest后会下载project.manifest，然后做了类似的操作，我移除添加的这个代码块。

void AssetsManagerEx::prepareUpdate() { if (_updateState != State::NEED_UPDATE) return; // Clean up before update _failedUnits.clear(); _downloadUnits.clear(); _totalWaitToDownload = _totalToDownload = 0; _nextSavePoint = 0; _percent = _percentByFile = _sizeCollected = _totalDownloaded = _totalSize = 0; _downloadResumed = false; _downloadedSize.clear(); _totalEnabled = false; // Temporary manifest exists, previously updating and equals to the remote version, resuming previous download if (_tempManifest && _tempManifest->isLoaded() && _tempManifest->isUpdating() && _tempManifest->versionEquals(_remoteManifest)) { _tempManifest->saveToFile(_tempManifestPath); _tempManifest->genResumeAssetsList(&_downloadUnits); _totalWaitToDownload = _totalToDownload = (int)_downloadUnits.size(); _downloadResumed = true; // Collect total size for(auto iter : _downloadUnits) { const DownloadUnit& unit = iter.second; if (unit.size > 0) { _totalSize += unit.size; } } } else { // Temporary manifest exists, but can't be parsed or version doesn't equals remote manifest (out of date) if (_tempManifest) { // Remove all temp files _fileUtils->removeDirectory(_tempStoragePath); CC_SAFE_RELEASE(_tempManifest); // Recreate temp storage path and save remote manifest _fileUtils->createDirectory(_tempStoragePath); _remoteManifest->saveToFile(_tempManifestPath); }

pandamicro · 2020-03-27T06:51:45Z

extensions/assets-manager/AssetsManagerEx.cpp

-                    std::string exsitedPath = _storagePath + diff.asset.path;
-                    _fileUtils->removeFile(exsitedPath);
+                    // std::string exsitedPath = _storagePath + diff.asset.path;
+                    // _fileUtils->removeFile(exsitedPath);


为什么这部分逻辑删除了？

理解了，判断条件取反只保留 else 分支把

是的，我这边没有移除，只是注释掉，这部分代码移动了 AssetsManagerEx::updateSucceed 里面完成了，保证热更新未完成前，原有_storagePath里面的资源是完整的。

代码整理干净一些，没必要保留这个判断分支

if (diff.type != Manifest::DiffType::DELETED) { ... }

…o the new version found." This reverts commit 1276212.

… when update operate." This reverts commit 6a67027.

zPiggy · 2020-05-12T02:07:58Z

下载完成后，文件从临时目录拷贝的时候会造成卡顿现象，放到线程中执行会不会更好些

zPiggy · 2020-05-12T02:33:21Z

extensions/assets-manager/AssetsManagerEx.cpp

@@ -885,7 +885,7 @@ void AssetsManagerEx::prepareUpdate()
                    std::string path = diff.asset.path;
                    DownloadUnit unit;
                    unit.customId = it->first;
-                    unit.srcUrl = packageUrl + path;
+                    unit.srcUrl = packageUrl + path + "?md5=" + diff.asset.md5;


由于 md5 通常以 ‘==’ 结尾或含有其他多义字符，是否encode更安全些

md5值是hex字符串，其计算方式是下面这样的，你是怎么遇到你描述的情况的，有测试工程吗？
crypto.createHash('md5').update(fs.readFileSync(subpath)).digest('hex');

那没有问题了

https://docs.cocos.com/creator/manual/zh/advanced-topics/assets-manager.html#manifest-%E6%A0%BC%E5%BC%8F

按照上述文档，

md5 信息可以不是文件的 md5 码，也可以是某个版本号，这完全是由用户决定的，本地和远程 manifest 对比时，只要 md5 信息不同，我们就认为这个文件有改动。

所以encode还是更安全的选择。

xianyinchen added 5 commits March 19, 2020 18:13

Avoid delete local files before download success.

15c1242

Perform delete operation after merge temporary storage.

add the MD5 string to URL to force CDN content to be refresh.

b849a7c

load project.manifest on version check, and collect the update packag…

10a858f

…e size.

Remove _tempStoragePath when the temporary version no equal to the ne…

1276212

…w version found.

add Integrity check function, and avoid lost file in any case when up…

6a67027

…date operate. need add a calling code to main.js, see tutorial-hot-update repository.

holycanvas requested a review from pandamicro March 20, 2020 02:10

holycanvas closed this Mar 20, 2020

holycanvas reopened this Mar 20, 2020

holycanvas closed this Mar 20, 2020

holycanvas reopened this Mar 20, 2020

holycanvas requested review from PPpro and removed request for PPpro March 20, 2020 08:24

pandamicro reviewed Mar 27, 2020

View reviewed changes

xianyinchen added 3 commits March 31, 2020 12:20

Revert "Remove _tempStoragePath when the temporary version no equal t…

11f7eea

…o the new version found." This reverts commit 1276212.

optimize the code.

bec657c

Revert "add Integrity check function, and avoid lost file in any case…

4ebeab5

… when update operate." This reverts commit 6a67027.

pandamicro approved these changes Apr 5, 2020

View reviewed changes

holycanvas changed the base branch from v2.3.3-release to v2.4.0 April 22, 2020 13:19

holycanvas merged commit 4a08745 into cocos:v2.4.0 Apr 22, 2020

zPiggy reviewed May 12, 2020

View reviewed changes

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

fix hot update issue. #2312

fix hot update issue. #2312

xianyinchen commented Mar 19, 2020 •

edited

holycanvas commented Mar 20, 2020

xianyinchen commented Mar 20, 2020 •

edited

pandamicro Mar 27, 2020

xianyinchen Mar 30, 2020 •

edited

pandamicro Mar 27, 2020

xianyinchen Mar 30, 2020

pandamicro Mar 27, 2020

xianyinchen Mar 30, 2020

pandamicro Mar 30, 2020

xianyinchen Mar 31, 2020

pandamicro Mar 27, 2020

pandamicro Mar 27, 2020

xianyinchen Mar 30, 2020

pandamicro Mar 30, 2020

xianyinchen Mar 31, 2020

zPiggy commented May 12, 2020

zPiggy May 12, 2020

xianyinchen May 15, 2020

zPiggy May 15, 2020

gregwym Jun 12, 2020

fix hot update issue. #2312

fix hot update issue. #2312

Conversation

xianyinchen commented Mar 19, 2020 • edited

holycanvas commented Mar 20, 2020

xianyinchen commented Mar 20, 2020 • edited

Choose a reason for hiding this comment

xianyinchen Mar 30, 2020 • edited

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

zPiggy commented May 12, 2020

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

xianyinchen commented Mar 19, 2020 •

edited

xianyinchen commented Mar 20, 2020 •

edited

xianyinchen Mar 30, 2020 •

edited