Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.
26,356 characters · 9 sections · 30 citation commands
Dynamics of a Binary Option Market with Exogenous Information and Price Sensitivity
\email{[email removed]} \email{[email removed]}
Market models have been studied extensively both through simulation and in theory in the econophysics literature CS01,BVS06,SZSL07,S01,SP08,RP03,MZ08,CS01a,HP02,TFM18. In contrast to traditional stock or bond markets, prediction markets have assets corresponding to future events (e.g., elections BFR97, sports outcomes TZ88 etc.) that can be bought and sold causing changes in the underlying asset prices. Asset prices may be interpreted as probabilities M06,WZ06. Prediction markets were first studied by Hanson H90,H91,H95,R97. Since this initial work, they have been studied extensively WZ04,SWPG04,M06,BR03,WZ06,DJK20,CD16. For a survey of work in this area through 2007 see TT07. These prediction markets are archetypical examples of binary option markets (in the two outcome case) BL78. Their use on Wall Street dates to the 1800's RS04. Artificial prediction markets were first explored by Chen et al. CFLP08,CV10,ACW11. This work shows a connection between learning and the prediction market showing that if a prediction market has a cost function with bounded loss, then it has an interpretation as a no-regret learning algorithm CV10. This work is generalized in ACW11. In the finance literature, binary options are usually used as a theoretical construct since they have a particularly simple Black-Scholes formulation H03.
In this paper, we study the potential dynamics of prediction markets under continuum limits. In particular, we generalize and then extend the market model described in NMGR21 to a continuous time dynamic. The results of this paper are:
The remainder of the paper is organized as follows: We show the model derivation in (ref). In (ref) we show that with constant information, all binary prediction markets converge to a constant price. In (ref), we study the numerical results of a non-constant information. We conclude and present future directions in (ref).
Assume $\mathbf{q}_t = \langle{q^0(t),q^1(t)}\rangle$ units of Asset 0 and Asset 1 at time $t$ have been sold. We assume the market is composed of a collection of agents with infinite cash and that the market price is fixed by a logarithmic market scoring rule (LMSR) so that the spot prices are given by:
Notice because a Boltzmann distribution is being used we have $p^0(t) + p^1(t) = 1$ for all time. Here, $\beta$ term is a liquidity factor LS18 that adjusts the amount the price will increase or decrease given a change in the asset quantities. We denote the spot-price vector $\mathbf{p}(t) = \langle{p^0(t),p^1(t)}\rangle$. Assume that $\mathbf{p}(0) = \langle{p^0_0,p^1_0}\rangle$.
In general, trade costs are not given by $\mathbf{p}_t$, since LMSR incorporates a market maker cost. The trade costs are given by:
where $\Delta q^i$ is the change in the quantify of Asset $i$ as a result of purchases by an agent. For mathematical simplicity we will assume agents purchase one share at a time so that $\Delta q^i \in \{0,1\}$. Let:
be the price of single share purchase of Asset $i$.
Following NMGR21, we assume agents specialize in the purchase of a specific asset class (either $0$ or $1$) and that there is some (possibly time-varying) external information $\mathbf{x}(t) \in \mathbb{R}^n$ that will inform this purchase decision.
Assume agents are indexed in $\{1,\dots,N\}$ and suppose that agent $i$ purchases only assets in class $y_i \in \{0,1\}$. We assume agents have an infinite cash reserve and do not sell assets back to the market maker. Following NMGR21, we assume that each agent uses a characteristic function $\psi_i:\mathbb{R}^n \times \mathbb{R}^2 \to \mathbb{R}$ to reason about information $\mathbf{x}$ so that its decision to buy an asset in class $y_i$ is governed by:
Here $\sigma:\mathbb{R}\to[0,1]$. In NMGR21, this is assumed to be a logistic sigmoid function:
and $H(x)$ is the unit step function defined as $0$ at $x = 0$. We note that any mapping $\sigma:\mathbb{R}\to[0,1]$ can be used in the remainder of this paper. The expression $\sigma[\psi_i(\mathbf{x},\mathbf{p})]$ defines the value Agent $i$ places on Asset $y_i$ as a function of the current asset price(s) and the information $\mathbf{x}$. Thus $\Delta q^{y_i}_i = 1$ just in case:
NMGR21 assumes that $\mathbf{x}$ is a vector in an appropriate feature space and for some scalar $R$ proposes that $\psi(\mathbf{x},\mathbf{p}) \geq R$ should define a convex region in $\mathbb{R}^n \times \mathbb{R}^2$. Thus, a collection of (price sensitive) agents encode a set of time-varying sets in feature space and an agent purchases a share of a relevant asset if and only if the information encoded in the (constant) feature and price vector $(\mathbf{x},\mathbf{p})$ is an element of the region defined by $\sigma[\psi(\mathbf{x},\mathbf{p})]$. NMGR21 shows that price insensitive agents can be used to define an arbitrary covering region to encode a binary classification problem but observes in discrete time that minor oscillations can occur in the price. We show that this cannot happen in continuous time assuming a constant feature vector and then explore the affects of a non-constant feature vector.
Consider $\kappa^1_t(\Delta q^1)$. We can rewrite this as:
We know that $p^0(t) + p^1(t) = 1$, so we have:
For $\beta \ll 1$, we can approximate the exponential and logarithmic functions with a Taylor series: $e^x \approx 1 + x + O(x^2)$ and $\log(1+x) \approx x$ to see:
Since we assume $\Delta q^1 \in \{0,1\}$, we may assume $\kappa_t^1 \approx p^1(t)$.
Following NMGR21, let $C_1 \subset \{1,\dots,N\}$ be the set of agents that buy only Asset $1$ and let $C_0 \subset \{1,\dots,N\}$ be the set of agents that buy only Assert $0$. Using our approximation from (ref) we have:
If we assume that transaction times are proportional to a time slice so that:
then, taking the limit as $\epsilon \to 0$, we obtain the non-linear differential equation:
Using (ref) and the quotient rule we can compute:
These results are consistent with TVL03,BCFG22 for multi-agent systems using a Boltzmann (soft-max) learning rule assuming a two-class outcome.
Using the fact that $p^0(t) + p^1(t) = 1$ for all time and substituting in our expressions for $\dot{q}^1$ and $\dot{q}^0$, we obtain a single ODE in terms of $p^1(t)$, which we now write simply as $p(t)$:
Notice unlike the work in TVL03,BCFG22, this ODE has a piecewise smooth and bounded right-hand-side with jump discontinuities. Therefore it is a Filippov system F67,F13. Moreover, this system can be described by a continuous time recurrent neural network, shown in (ref).
The step function $H$ acts as an activation function for the non-linear neurons computing:
Thus, the dynamics of the neural network can be completely determined the exogenously specified dynamics of $\mathbf{x}(t)$ and (ref).
Assume $\mathbf{x}(t)$ is constant so that $\psi_i[\mathbf{x}(t)] = L_i + f_i(p)$ where $L_i \in \mathbb{R}$. The dynamics of $p(t)$ are then:
The right-hand-side is piecewise smooth and bounded and therefore a solution to this ODE exists F13. It is clear that $p^* = 0$ and $p^* = 1$ are fixed points of (ref). Therefore, for $p_0 \in [0,1]$, if (ref) if $p(t)$ is a solution, then $p(t) \in [0,1]$ for all time.
We have just shown that the dynamics of $p(t)$ are contained entirely in the smooth manifold $M = [0,1]$. Thus the flow at any point $M$ is defined by a scalar (since the dimension of $M$ is 1). By convention positive flow moves toward $p^* = 1$. A sliding mode fixed point or fixed point on a Filippov surface is a point $p^* \in \mathrm{int}(M)$ (a zero dimensional manifold) where the flow to the left of $p^*$ is positive and the flow to the right of $p^*$ is negative and the flow at $p^*$ may take either a positive or negative or zero value F13. That is, the flow around this point is moving in opposite directions. Naturally, this definition can be extended to higher dimensional flows (see F13) but we do not require this level of complexity.
Let:
This is a discontinuous integer valued function with maximum value $|C_1|$ and minimum value $-|C_0|$. We can re-write (ref) as:
From this, we see that for any fixed integer $N(p)$, (ref) is just a logistic differential equation, which has a global solution. We deduce at once that (ref) has a global continuous solution composed of piecewise smooth solutions to the individual logistic differential equations.
We now show that these solutions are monotonic and either asymptotically approach a value as time goes to infinity or reach a fixed point in finite time.
If $N(p_0)=0$, then $p=p_0$ is the solution for all time. On the other hand, suppose $N(p_0) < 0$, then $p(t)$ is initially decreasing and we have three possibilities.
The argument for the case when $N(p_0) > 0$ is symmetric. Thus, we have shown that: (i) Every instance of (ref) has a global continuous and piecewise smooth solution. (ii) Solutions are monotonic. (iii) Every solution either asymptotically approach $p^* = 0$ or $p^* = 1$ or reaches a constant value infinite time.
When $\mathbf{x}(t)$ is non-constant, the market will track the function $\psi(\mathbf{x},p)$ through the function:
If there is some time $T \geq 0$ so that for all $t \geq T$ we have $N[\mathbf{x}(t),p(t)] \geq 0$ ($N[\mathbf{x}(t),p(t)] \leq 0$, respectively) then clearly $p(t)$ must converge.
When $N(\mathbf{x},p)$ remains above (or below) $0$, the market will lag the information content in the $\mathbf{x}(t)$ and the market will smooth the information in the signal $\mathbf{x}(t)$. By way of example, let $\mathbf{x}(t)$ be a solution to the Lorenz system and define:
where $\mathbf{x}_1$ is the first dimension of the three dimensional curve $\mathbf{x}(t)$. Then:
The dynamics are shown in (ref) for two different initial conditions.
This shows that the market preserves the sensitive dependence on initial conditions (as expected) and smooths the dynamics of the Lorenz system. Numerical solution of the differential equation systems is described in (ref).
There is a lag in the market price as new information is assimilated into the asset price. To study this lag and the effect of various market conditions, we assume that $x = A \sin(\omega t)$. For our experiments, we set $A = 1$ and $\omega = 2\pi/25000$. Define a set of agents by random intervals $\{(a_i,b_i)\}_{i=1}^N$ where if $i \in C_1$, then $a_i \geq 0$ and $b_i \leq 1$ and if $i \in C_0$, then $b_i \leq 0$ and $a_i \geq -1$. When $N$ is large, with high probability these intervals cover the $[-1,1]$. Assume:
Then the market will classify $x(t)$ as it moves from $+1$ to $-1$ over time. This is illustrated in (ref) for two different agent sizes.
The market with smaller numbers of agents tracks the information but there are times when $x(t)$ is not in any interval defining an agent and so buying stops. This leads to plateaus in the data.
Introduce two parameters $\alpha\geq 1$ and $\nu \in \{-1,0,1\}$ so that:
we can examine the effect asset price sensitivity ($\nu$) and input gain ($\alpha$) have on the lag in information uptake in the market. To do this, we use the measured phase difference between $p(t)$ and $x(t)$ using the argument of the Fourier transform of the solutions at the fundamental frequency $\omega$. The ratio of the two phases provides a measure of the speed with which information is taken up by the market. We used markets with 250 agents (125 agents per class) and allows $\alpha$ to vary from $1$ to $15$ and $\nu$ to vary in the set $\{-1,0,1\}$. For all experiments $\beta = 0.01$. When $\nu = 0$, there is no price sensitivity. When $\nu = -1$, agents are more sensitive to price and higher prices make them value the asset lower. Effectively, this creates additional friction in purchasing. When $\nu =1$, agents are price sensitive and higher prices causes them to value an asset more. This creates additional force in the the market to purchase even at higher prices. We used 5 replications of each condition to construct confidence intervals on the mean of the phase ratios. Agent intervals were randomized in each replication. Throughout all experiments, $x(t)$ was held constant with $A = 1$ and $\omega = 2\pi/25000$. Results are shown in (ref).
We conclude that agents with positive price sensitivity resulted in a higher phase ratio while agents with a negative price sensitivity had a lesser phase ratio for varying input gain ($\alpha$). Price insensitive agents' phase ratio fell between the positive and negative price sensitive agents. Hence, when $\nu = -1$, information is taken up by the market faster than when $\nu =0$ and when $\nu = 1$. We also note that the phase ratio appears to exhibit saturation in the positive price sensitive agents, which should be expected.
Generalizing the dynamics of (ref) to $M>2$ assets is straightforward. We obtain:
where:
Here $C_j$ is the group of agents who specialize in purchasing assets in class $j$ and $p_j$ is the price of asset class $j$. This equation is consistent with TVL03,BCFG22. The dynamics effectively describe a recurrent neural network with an embedded softmax layer (generalizing (ref)). We conjecture that with constant information, the resulting dynamics always converge, fully generalizing the result in (ref). We illustrate this conjecture in (ref) for a three asset market simulated with over 3000 variations on the dynamics assuming:
where $L_k$ is randomly drawn from either $[-2,2]$ or $[-5,5]$ - see (ref)(left) or (ref)(right), respectively. The cardinality $|C_j|$ is randomly drawn from $1$ to $10$, simulating a small market.
The figures show that oscillation is not present when information is held constant. In particular, our conjecture implies that the dynamics quickly reach an $k < M$ dimensional Filippov surface and then slide along it until they reach a fixed point (a zero dimensional subset of the Filippov surface) thus ensuring convergence of the system. Assuming this conjecture is correct, then synthetic prediction markets (of the type discussed in NMGR21) can be extended to arbitrary prediction classes and the use of continuous time markets will eliminate oscillations observed in the discrete time algorithm. In addition to the open question of the convergence of $M$-array option markets with $M>2$, we leave as an area of future research how best to design functions $\sigma$ and $\psi_i$ ($i=1,\dots,N$) to recover desired market output values given input data $\{\mathbf{x}_j\}_j$.
In this paper, we have prove the convergence of price in a continuous binary option market with constant external information. This is proved by showing that the right-hand-side of the dynamics are piecewise smooth and bounded allowing us to reason about the Filippov surface on which the dynamics come to rest. Consequently, the price dynamics are always monotonic, continuous, and piecewise smooth and always converge. In the presence of non-constant external information, we show empirically that a positive price sensitivity (i.e., purchases increase in response to higher prices) causes larger market lags to external information change while negative price sensitivity (i.e., purchases decrease in response to higher prices) decrease market lag to external information.
Results discussed in this paper can be extended in several ways. We have left an open conjecture on the generalization of the market convergence result to markets with $M>2$ asset classes. We assert that under constant external information these markets also converge. If this is true, then the use of continuous time $M$-array asset markets as an approach to machine learning would be sensible. In this case, since we have shown $M$-array option markets describe a recurrent neural network, investigating how to fit exogenous parameters defining the functions $\varphi_i$ to build a classifier is an interesting and open question, especially considering the recurrent aspect of the neural structure. Finally further analysis in the case when the exogenous signal $\mathbf{x}(t)$ is non-constant may provide further insight into the behavior of these simple options markets.
Portions of this work were sponsored by the DARPA SCORE Program under Cooperative Agreement W911NF-19-2-0272.