Options
All
  • Public
  • Public/Protected
  • All
Menu

Interface OnlineRequestSettings

Package version

Online deployment scoring requests configuration.

Hierarchy

  • OnlineRequestSettings

Index

Properties

Properties

Optional maxConcurrentRequestsPerInstance

maxConcurrentRequestsPerInstance: undefined | number

The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.

Optional maxQueueWait

maxQueueWait: undefined | string

The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms.

Optional requestTimeout

requestTimeout: undefined | string

The scoring timeout in ISO 8601 format. Defaults to 5000ms.

Generated using TypeDoc