Abstract: This paper is concerned with the problem of policy evaluation with linear function approximation in discounted infinite horizon Markov decision processes ...

Despite the popularity of the general linear mixed model for data analysis, power and sample size methods and software are not generally available for commonly used test statistics and reference ...

Abstract: In this paper, we present necessary and sufficient stability tests for two classes of linear delay systems: neutral-type linear time-delay systems and linear time-delay systems with ...

Reduced rank approximation of matrices by Householder-Young methods is shown to be equivalent to fitting of a bilinear (multiplicative) model and to projection onto an optimally chosen subspace. The ...

We design a new provably efficient algorithm for episodic reinforcement learning with generalized linear function approximation. We analyze the algorithm under a new expressivity assumption that we ...