問題描述

來自SavedModel Docs，

SavedModel，TensorFlow 模型的通用序列化格式.

SavedModel, the universal serialization format for TensorFlow models.

和

SavedModel 包裝了一個(gè) TensorFlow Saver.Saver 主要用于生成變量檢查點(diǎn).

SavedModel wraps a TensorFlow Saver. The Saver is primarily used to generate the variable checkpoints.

根據(jù)我的理解，如果有人想使用 TensorFlow Serving，SavedModel 是必須的.但是，我可以在沒有 SavedModel 的情況下將 Tensorflow 模型部署到服務(wù)服務(wù)器:凍結(jié)圖形并將其導(dǎo)出為 GraphDef，并使用 ReadBinaryProto 和創(chuàng)建在 C++ 或 在 Go 中導(dǎo)入.

From my understanding, SavedModel is must if someone wants use TensorFlow Serving. However, I can deploy Tensorflow Model to service server without SavedModel: Freeze graph and export it as GraphDef, and load graph into Session using ReadBinaryProto and Create in C++ or Import in Go.

SavedModel 的目的是什么?用戶是否應(yīng)該更喜歡 SavedModel 而非 Checkpoint 或 GraphDef 來聚合更多與模型相關(guān)的數(shù)據(jù)?

What is the purpose of SavedModel? Should users prefer SavedModel over Checkpoint or GraphDef to aggregate more data related to the model?

推薦答案

檢查點(diǎn)包含 TensorFlow 模型中(部分)變量的值.它由 Saver 創(chuàng)建，其中要么指定要保存的特定 Variable ，要么默認(rèn)保存所有(非本地)變量.

A checkpoint contains the value of (some of the) variables in a TensorFlow model. It is created by a Saver, which is either given specific Variables to save, or by default saves all (non-local) Variables.

要使用檢查點(diǎn)，您需要有一個(gè)兼容的 TensorFlow Graph，其 Variable 與 Variable 的名稱相同檢查站.(如果您沒有兼容的 Graph，您仍然可以使用 init_from_checkpoint contrib 中的實(shí)用程序.)

To use a checkpoint, you need to have a compatible TensorFlow Graph, whose Variables have the same names as the Variables in the checkpoint. (If you don't have a compatible Graph, you can still load the values stored in a checkpoint into selected Variables using the init_from_checkpoint utilities in contrib.)

SavedModel 更加全面:它包含一組 Graph (MetaGraphs，實(shí)際上，保存集合等)，以及應(yīng)該與這些Graphs兼容的檢查點(diǎn)，以及運(yùn)行模型所需的任何資產(chǎn)文件(例如詞匯文件).對于它包含的每個(gè) MetaGraph，它還存儲一組簽名.簽名定義(命名)輸入和輸出張量.

SavedModel is much more comprehensive: It contains a set of Graphs (MetaGraphs, in fact, saving collections and such), as well as a checkpoint which is supposed to be compatible with these Graphs, and any asset files that are needed to run the model (e.g. Vocabulary files). For each MetaGraph it contains, it also stores a set of signatures. Signatures define (named) input and output tensors.

這意味著只要給定一個(gè) SavedModel，您就可以編寫工具(例如 tensorflow/serving，或?qū)⒊霈F(xiàn)在 中的新 saved_model 命令行實(shí)用程序工具/ 很快)解釋或執(zhí)行里面的圖形.您只需要提供數(shù)據(jù)即可.

This means that given only a SavedModel, you can write tools (such as tensorflow/serving, or the new saved_model command line utility that will appear in tools/ shortly) that interpret or execute the graphs inside. All you have to provide is the data.

如果有疑問，我總是會在編寫 SavedModel 方面犯錯(cuò)，而不僅僅是一個(gè)檢查點(diǎn).這不僅允許您使用 tensorflow/serving(以及其他數(shù)量會增加的簡潔實(shí)用程序)，它還確保您擁有運(yùn)行模型所需的所有信息.沒有什么比檢查點(diǎn)更令人沮喪的了，您無法再使用它，因?yàn)槟薷牧四Ｐ停F(xiàn)在它與檢查點(diǎn)文件不兼容，您要做的就是通過它運(yùn)行一些預(yù)測以進(jìn)行比較.

If in doubt, I would always err on the side of writing a SavedModel, not just a checkpoint. Not only does this allow you to use tensorflow/serving (and other neat utilities that will grow in number), it makes sure that you have all the information necessary to run the model. Nothing is more frustrating than a checkpoint you cannot use any more because you modified your model and now it is incompatible with checkpoint files and all you want to do is run some predictions through it for comparison.

這篇關(guān)于TensorFlow 用戶是否應(yīng)該更喜歡 SavedModel 而不是 Checkpoint 或 GraphDef?的文章就介紹到這了，希望我們推薦的答案對大家有所幫助，也希望大家多多支持html5模板網(wǎng)！