Interface PartialBatchDeployment

Code configuration for the endpoint deployment.

Compute binding definition.

Description of the endpoint deployment.

ARM resource ID of the environment specification for the endpoint deployment.

Environment variables configuration for the deployment.

Error threshold, if the error count for the entire input goes above this value, the batch inference will be aborted. Range is [-1, int.MaxValue]. For FileDataset, this value is the count of file failures. For TabularDataset, this value is the count of record failures. If set to -1 (the lower bound), all failures during batch inference will be ignored.

Logging level for batch inference operation.

Indicates number of processes per instance

Size of the mini-batch passed to each batch invocation. For FileDataset, this is the number of files per mini-batch. For TabularDataset, this is the size of the records in bytes, per mini-batch.

Reference to the model asset for the endpoint deployment.

Indicates how the output will be organized.

Customized output file name for append_row output action.

Property dictionary. Properties can be added, but not removed or altered.

Retry Settings for the batch inference operation.