Class OnlineRequestSettings


  • public final class OnlineRequestSettings
    extends Object
    Online deployment scoring requests configuration.
    • Constructor Detail

      • OnlineRequestSettings

        public OnlineRequestSettings()
    • Method Detail

      • maxConcurrentRequestsPerInstance

        public Integer maxConcurrentRequestsPerInstance()
        Get the maxConcurrentRequestsPerInstance property: The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.
        Returns:
        the maxConcurrentRequestsPerInstance value.
      • withMaxConcurrentRequestsPerInstance

        public OnlineRequestSettings withMaxConcurrentRequestsPerInstance​(Integer maxConcurrentRequestsPerInstance)
        Set the maxConcurrentRequestsPerInstance property: The number of maximum concurrent requests per node allowed per deployment. Defaults to 1.
        Parameters:
        maxConcurrentRequestsPerInstance - the maxConcurrentRequestsPerInstance value to set.
        Returns:
        the OnlineRequestSettings object itself.
      • maxQueueWait

        public Duration maxQueueWait()
        Get the maxQueueWait property: The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms.
        Returns:
        the maxQueueWait value.
      • withMaxQueueWait

        public OnlineRequestSettings withMaxQueueWait​(Duration maxQueueWait)
        Set the maxQueueWait property: The maximum amount of time a request will stay in the queue in ISO 8601 format. Defaults to 500ms.
        Parameters:
        maxQueueWait - the maxQueueWait value to set.
        Returns:
        the OnlineRequestSettings object itself.
      • requestTimeout

        public Duration requestTimeout()
        Get the requestTimeout property: The scoring timeout in ISO 8601 format. Defaults to 5000ms.
        Returns:
        the requestTimeout value.
      • withRequestTimeout

        public OnlineRequestSettings withRequestTimeout​(Duration requestTimeout)
        Set the requestTimeout property: The scoring timeout in ISO 8601 format. Defaults to 5000ms.
        Parameters:
        requestTimeout - the requestTimeout value to set.
        Returns:
        the OnlineRequestSettings object itself.
      • validate

        public void validate()
        Validates the instance.
        Throws:
        IllegalArgumentException - thrown if the instance is not valid.