skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: A sequential estimation problem with control and discretionary stopping
We show that “full-bang” control is optimal in a problem which combines features of (i) sequential least-squares estimation with Bayesian updating, for a random quantity observed in a bath of white noise; (ii) bounded control of the rate at which observations are received, with a superquadratic cost per unit time; and (iii) “fast” discretionary stopping. We develop also the optimal filtering and stopping rules in this context.  more » « less
Award ID(s):
2004997
PAR ID:
10498260
Author(s) / Creator(s):
;
Publisher / Repository:
AIMS, LLC
Date Published:
Journal Name:
Probability, Uncertainty and Quantitative Risk
Volume:
7
Issue:
3
ISSN:
2095-9672
Page Range / eLocation ID:
151
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract For an infinite‐horizon continuous‐time optimal stopping problem under nonexponential discounting, we look for anoptimal equilibrium, which generates larger values than any other equilibrium does on theentirestate space. When the discount function is log subadditive and the state process is one‐dimensional, an optimal equilibrium is constructed in a specific form, under appropriate regularity and integrability conditions. Although there may exist other optimal equilibria, we show that they can differ from the constructed one in very limited ways. This leads to a sufficient condition for the uniqueness of optimal equilibria, up to some closedness condition. To illustrate our theoretic results, a comprehensive analysis is carried out for three specific stopping problems, concerning asset liquidation and real options valuation. For each one of them, an optimal equilibrium is characterized through an explicit formula. 
    more » « less
  2. The stopping rule for a sequential experiment is the rule or procedure for determining when that experiment should end. Accordingly, the stopping rule principle (SRP) states that the evidential relationship between the final data from a sequential experiment and a hypothesis under consideration does not depend on the stopping rule: the same data should yield the same evidence, regardless of which stopping rule was used. I clarify and provide a novel defense of two interpretations of the main argument against the SRP, the foregone conclusion argument. According to the first, the SRP allows for highly confirmationally unreliable experiments, which concept I make precise, to confirm highly. According to the second, it entails the evidential equivalence of experiments differing significantly in their confirmational reliability. I rebut several attempts to deflate or deflect the foregone conclusion argument, drawing connections with replication in science and the likelihood principle. 
    more » « less
  3. We analyze an optimal stopping problem with a series of inequality-type and equality-type expectation constraints in a general non-Markovian framework. We show that the optimal stopping problem with expectation constraints (OSEC) in an arbitrary probability setting is equivalent to the constrained problem in weak formulation (an optimization over joint laws of stopping rules with Brownian motion and state dynamics on an enlarged canonical space), and thus the OSEC value is independent of a specific probabilistic setup. Using a martingale-problem formulation, we make an equivalent characterization of the probability classes in weak formulation, which implies that the OSEC value function is upper semianalytic. Then we exploit a measurable selection argument to establish a dynamic programming principle in weak formulation for the OSEC value function, in which the conditional expected costs act as additional states for constraint levels at the intermediate horizon. 
    more » « less
  4. In this paper, we study a sampling problem where a source takes samples from a Wiener process and transmits them through a wireless channel to a remote estimator. Due to channel fading, interference, and potential collisions, the packet transmissions are unreliable and could take random time durations. Our objective is to devise an optimal causal sampling policy that minimizes the long-term average mean square estimation error. This optimal sampling problem is a recursive optimal stopping problem, which is generally quite difficult to solve. However, we prove that the optimal sampling strategy is, in fact, a simple threshold policy where a new sample is taken whenever the instantaneous estimation error exceeds a threshold. This threshold remains a constant value that does not vary over time. By exploring the structure properties of the recursive optimal stopping problem, a low-complexity iterative algorithm is developed to compute the optimal threshold. This work generalizes previous research by incorporating both transmission errors and random transmission times into remote estimation. Numerical simulations are provided to compare our optimal policy with the zero-wait and age-optimal policies. 
    more » « less
  5. We study a stochastic control/stopping problem with a series of inequality-type and equality-type expectation constraints in a general non-Markovian framework. We demonstrate that the stochastic control/stopping problem with expectation constraints (CSEC) is independent of a specific probability setting and is equivalent to the constrained stochastic control/stopping problem in weak formulation (an optimization over joint laws of Brownian motion, state dynamics, diffusion controls and stopping rules on an enlarged canonical space). Using a martingale-problem formulation of controlled SDEs in spirit of Stroock and Varadhan (2006), we characterize the probability classes in weak formulation by countably many actions of canonical processes, and thus obtain the upper semi-analyticity of the CSEC value function. Then we employ a measurable selection argument to establish a dynamic programming principle (DPP) in weak formulation for the CSEC value function, in which the conditional expected costs act as additional states for constraint levels at the intermediate horizon. This article extends (El Karoui and Tan, 2013) to the expectation-constraint case. We extend our previous work (Bayraktar and Yao, 2024) to the more complicated setting where the diffusion is controlled. Compared to that paper the topological properties of diffusion-control spaces and the corresponding measurability are more technically involved which complicate the arguments especially for the measurable selection for the super-solution side of DPP in the weak formulation. 
    more » « less