Hidden Geometry of Bidirectional Grid-Constrained Stochastic Processes
Bidirectional Grid Constrained (BGC) stochastic processes (BGCSPs) are constrained Itô diffusions with the property that the further they drift away from the origin, the more the resistance to movement in that direction they undergo. The underlying characteristics of the BGC parameter are investigated by examining its geometric properties. The most appropriate convex form for , that is, the parabolic cylinder is identified after extensive simulation of various possible forms. The formula for the resulting hidden reflective barrier(s) is determined by comparing it with the simpler Ornstein–Uhlenbeck process (OUP). Applications of BGCSP arise when a series of semipermeable barriers are present, such as regulating interest rates and chemical reactions under concentration gradients, which gives rise to two hidden reflective barriers.
In the work of Taranto et al. , the concept of Bidirectional Grid Constrained (BGC) stochastic processes (BGCSPs) was described as a general Itô diffusion, in which the further it drifts away from the origin, the more constrained the Itô diffusion(s) becomes. In this paper, we extend that research by geometrically examining various potential forms of and showing that the parabolic cylinder is the ideal form for BGCSP. All other researches on BGCSPs examine the application of BGSCPs to algorithmic trading, so this paper extends the probability theory aspects of BGCSP. We note that, for an arbitrary stochastic function , the following notations are equivalent:and the last of these is adopted here. We will also interchange betweendepending on the specific context. The stochastic differential equation (SDE) of BGC stochastic processes was defined as follows.
Definition 1. (Definition I of BGC Stochastic Processes). For a complete filtered probability space and a BGC function , , the corresponding BGC Itô diffusion is expressed as where is the sign function defined in the usual sense, is the drift term, is the constraining term, is the diffusion term, and , , and are convex functions.
To visualize the impact of BGC stochastic processes, 1000 Itô diffusions were simulated both with and without BGC, with unit diffusion coefficient for negative, zero, and positive drift coefficients. Figure 1 shows this when , , and is the parabolic cylinder, so that one can see the hidden upper barrier and hidden lower barrier emerge more clearly than is the case when using other coefficients.
Remark 1. From Figure 1, we immediately see the significance and applications of this research by being able to constrain stochastic processes within two reflective barriers. However, unlike the existing research in this established field, BGCSPs do not specify the barriers upfront, only the constraining mechanism of . So, for a rough example, rather than central banks constraining their interest rates directly between two predefined (and sometimes ill-advised) levels, BGCSPs just require how the constraining is to occur. The barriers emerge as the extremes of where the process can drift towards with increasing resistance.
Remark 2. The drift and diffusion (or volatility) terms reflect the instantaneous mean and standard deviation, respectively. It must also be noted from Figure 1 that even when a generalized Itô diffusion is reduced to a single Wiener process by setting and , BGC still impacts the stochastic process.
It is from these observations that an alternative definition to (3) can be stated as follows.
Definition 2. (Definition II of BGC Stochastic Processes). For a complete filtered probability space and a BGC function , , the corresponding BGC Itô diffusion can be expressed aswhere is defined in the usual sense, is the drift term, is the diffusion term, is the constraining term, and , , and are convex functions.
Remark 3. In the work of Taranto et al. , only 2 decimal places were used, and some readers may argue that this is a low level of precision for simulation results to be robust. To show that the discretization effect present in BGC stochastic processes is not due to such rounding errors, all our simulations were rerun to ten times more precision (i.e., to 20 decimal places), and it was found that the discretization or banding effect of BGC was still present, so it is a real phenomenon. More shall be discussed about this in the Results and Discussion section.
This paper will answer two main objectives:(1)What are the key properties of which are relevant in BGC stochastic processes?(2)What is the formula for the hidden reflective lower barrier and the hidden reflective upper barrier in relation to ?Before these objectives are addressed in the Methodology section, the relevant research is examined.
2. Literature Review
Constraining Discrete Random Walks. Constrained stochastic processes have been applied to game theory (Feller ) and conditional Markov chains of this type have also been applied to biology, branching processes (Ferrari et al. ), molecular physics (Novikov et al. ), medicine (Bell ), and queuing theory (Böhm and Gopal ) to name a few. Weesakul  discussed the classical problem of random walks restricted between a reflecting barrier and an absorbing barrier. Lehner  studied 1-dimensional random walks with a partially reflecting barrier using combinatorial methods. Gupta  introduced the concept of a multiple function barrier (MFB), where a state can either absorb, reflect, let through (transmit), or hold for a moment along with its corresponding probabilities. Dua et al.  found the bivariate generating functions of the probabilities of a random variable reaching a certain state under different conditions. Percus  considered asymmetric random walks, with one or two boundaries, on a 1-dimensional lattice. El-Shehawey  obtained absorption probabilities at the boundaries for random walks between one or two partially absorbing boundaries, using conditional probabilities.
Constraining Continuous Wiener Processes. Dirichlet studied the first boundary value problem, for the Laplace equation, proving the uniqueness of the solution and this type of problem in the theory of partial differential equations (PDEs). This was later named the Dirichlet problem after him (Gowers et al. ). Problems expressed within this framework were studied as early as 1840 by C.F. Gauss and then by Dirichlet . Kurtz  formulated a means for constraining Markov processes. L’epingle  expanded upon previous research on barriers, which included boundary behavior of constrained Wiener processes between reflecting and repellent barriers. Majumdar et al.  derived the time taken to reach the maximum for a variety of constrained Wiener processes. Ormeci et al.  examined the constraining of Wiener processes via impulse control. Budhiraja and Dupuis  added necessary and sufficient conditions for the stability of such constrained processes. The same authors studied large deviations for various metrics of reflecting Wiener processes under constraining (Budhiraja and Dupuis ). Kharroubi et al.  constrained the jumps of Backward SDEs.
Whilst BGCSPs are relatively new, they do have applications in many areas, the most prominent being mathematical finance, investment algorithms, and quantitative trading (Taranto and Khan [22–25]). These have so far been defined in terms of 1-dimensional discrete random walks and continuous Itô diffusions but extend to the n-dimensional space . The constraining of such complex processes under multiple dimensions, variables, features, attributes, or columns in the context of machine learning (ML) essentially can be reduced to stochastic optimization. For example, under ML techniques such as Artificial Neural Networks (ANN), Deep Learning (DL), and Artificial Intelligence (AI), which have been extensively used in algorithmic trading, they essentially boiled down to finding the global maximum or global minimum of an n-dimensional surface. The geometry of such surfaces is thus not just an academic mathematical exercise but one that can shed light on when such algorithms can work and also when they can suddenly become ineffective.
We are now in a position to examine the geometry of the random variable as constrained by and its ramifications for BGCSP.
3.1. Convexity of BGC
From (4), we know that needs to be a convex function and, specifically, centered about the origin. This is to ensure that the constraining applies increasing monotonic resistance to the Itô diffusion in both directions (i.e., bidirectionally). For example, would not be sufficient because whilst is convex (as shown by having a line bisecting any two points on its curve), does not increase as as it does when . This gives rise to the need for the following classification of convexity.
Definition 3. (types of convexity). If and , then we can characterize (Zalinescu , Bauschke and Combettes ) its convexity as follows:(1) is convex if and only if , (2) is strictly convex if and only if , (3) is strongly convex if and only if , .We will require a new type of (subset) convexity for BGCSP.
Definition 4. (bidirectional convexity). If and , then we can characterize its convexity as follows:
is bidirectionally convex if and only if and , .
To establish some use cases to explore the convex geometry of potential BGC functions for , we plot their surfaces in Figures 2 and 3 and deduce which specific type of convexity definition is required for BGCSP.
We examine five main types of bidirectionally convex functions in , as shown in Figures 2 and 3:(1)Use Case I was not adopted because it constrains the Itô diffusion evenly and uniformly but not rapidly enough with the unconstrained Itô diffusions’ iterated logarithm bounds growth rate. This is to the point that the before and after BGC plots (see Figure 4(a)) look very similar and do not constitute a practical and worthwhile BGC process.(2)Use Case II is definitely the ideal function for BGC and so we will dedicate much of the Methodology section and the Results and Discussion section to the parabolic cylinder.(3)Use Case III examines how the standard convex will not suffice because needs to be “Bidirectional”; that is, it must be a mirror reflection about the origin all the time. Hence, was used, yet, due to the fast growing nature of the exponential function, it constrains the Itô process too much for it to be a useful function for BGC (even when it is scaled down by a constant or many other possible variations of ), as will be elaborated further in the Results and Discussion section (Figure 4(b)).(4)Use Case IV was also presented here because it is a transition from no constraining to a gradual parabolic cylinder. Such a surface was proposed for applications in which Itô diffusions not constrained so much initially and which become increasingly more constrained over time are required. However, as will be detailed further in the Results and Discussion section (Figure 4(c)), this did not produce the hidden barriers that bound an Itô diffusion from both above and below.(5)Use Case V is the final example that is worth discussing, as shown in Figure 3.From Figure 3, we note that , , will always result in a polynomial cylinder as will always be an even exponent. For odd exponents , , one can simply replace this with . In general, will be a polynomial cylinder that will always be convex and “Bidirectional,” . As will be elaborated in the Results and Discussion section in Figure 4(d), the polynomial cylinder was not suitable as a BGC function for general unconstrained Itô diffusions but can be scaled to suit one’s specific unconstrained Itô diffusion.
Remark 4. It is clear by now that not any convex function can be appropriate for BGC. An example of this would be , where it is clearly and bidirectionally convex but not constant or “cylindrical” over time and does not resemble any natural regime to constrain the stochastic processes uniformly over time. It is thus clear now that BGC requires the bidirectionally convex definition and, in particular, bidirectionally convex cylinders.
Having explored the nature of as determined by which lies in , we notice that our Itô process in is a 1-dimensional stochastic process in , where when it propagates over time, it does so in . The way we can see how the 3D constrains the 1D Itô process in 2D is via the projection of onto the plane via contour plots, as shown in Figures 5 and 6.
From Figure 5, it is much clearer to see how constrains the Itô process as propagates over time, where the lighter the colour, the greater the resistance and hence the greater the constraining impact due to BGC. This is also shown in the contour plots of Figure 6.
From these contour plots, we see how the convexity forms a series of decreasing semipermeable barriers (i.e., increasing reflection) on the Itô process. We now examine the effect that this has on the actual hidden reflective barriers, and .
Remark 5. Note that an alternative to the 3D surface inducing the 2D contours is the 3D surface inducing the 3D and 2D vector fields, as shown in Figure 7.
From Figure 7, we see that the constraining on (specifically ) can also be induced by the parabolic cylinder of and its associated vector field. As the Itô process propagates through the vector field, the greater the vector magnitudes, the greater the resistance force of reflection back to the origin.
This novel concept has been researched recently but in reverse by Simpson and Kuske , by modelling a constant variable into a random vector field to induce a stochastic process. Specifically, they show how a Flippov system near a switching manifold (due to the meeting of vector fields) attracts orbits or constant variables in the absence of randomness to create stochastic flow within the field.
3.2. Hidden Barriers of BGC Stochastic Processes
From Figure 8, we see that the BGC hidden reflective barriers are regulated to one’s desired distance from the origin by altering the parameter and are regulated in their climb rate from the origin to the barrier by altering the parameter.
Remark 6. Note that these barriers are not the traditional constant reflective barriers such as or because the BGC Itô diffusions are bounded within these nonconstant barriers even as they depart from the origin (i.e., the unconstrained Itô diffusions exceed these barriers, even near the origin), hence the initial curvature in the barriers. This is generalized in the following theorem.
Theorem 1 (Hidden Barriers of BGC Stochastic Processes). For a complete filtered probability space and a BGC function , , the corresponding BGC Itô diffusion is expressed asfor , where is the sign function defined in the usual sense, is a drift term, is the BGC term, is the diffusion term, and , , and are bidirectionally convex functions. Then the hidden lower barrier and hidden upper barrier are defined asand they are estimated bywhere are constants, is the distance from the origin to the barrier(s), and is the rate of growth towards the barrier(s).
Proof. To some readers, (7) is obvious just by looking at Figure 8(a) simply because the function must asymptote horizontally (exponentially) towards the barrier(s). However, this does not constitute a proof because we have a stochastic (and not a deterministic) process. Assume for a moment that the above BGC SDE is a simpler object in which and are constant, where the drift function and the diffusion function , , in the limit approach the typical constant expressions for the drift and diffusion coefficients, , and . We now start to see the resemblance between our BGC Itô process and the simpler Ornstein–Uhlenbeck process (OUP):where is the long-term mean and is the “attraction rate” or speed of mean-reversion, both of which are constants, as depicted in Figure 9.
From Figure 9, we can see that the total number of paths (as shown in blue and red) is preserved in each of the three schemes. (4) is (3) repeated for convenience and (4) is similar to (7), where in OUP is replaced by in BGCSP (with and ), which caters for a much wider set of possible paths than is possible with OPU and yet BGCSP has instead of . Multiplying (7) by and expanding givesHaving solved the OUP SDE, we wish to determine where is most likely to be for . Taking the expectation of both sides,as is deterministic. Since for all BGCSPs, we will set all OUPs to start from the origin, givingWe now have a stochastic argument that is a basis to justify (6). Assume that, for greatest generality,We know that since is Bidirectional, it is symmetric about the origin and so . By comparing (12) with (11), we can see thatwhere signifies a weak association. Since BGCSPs do not “force” the Itô diffusion to the long-term mean , the time taken to reach or under BGC would be greater than for OUP. Hence, in terms of distance,
Remark 7. is intuitive because the greater the drift , the greater and hence , that is, and . We also notice that the diffusion term does not contribute as much to . We also know by some experimentation that .
To extend  further, the BGCSP algorithm (Section 3.2) is derived and simulated in the Results and Discussion section, in Figures 4, 10, and 11 (Algorithm 1).
4. Results and Discussion
At this stage, we know that Use Cases I, III, IV, and V are not valid candidates for the correct type of convexity for general , but, for various exotic forms of Itô diffusions, such as the Cox-Ingersoll-Ross (CIR) process, these use cases that may be sufficient to BGC the Itô process within two hidden barriers. We also have a theoretical appreciation of what other forms of are valid and invalid candidates.
On the other hand, we also know that Use Case II, the parabolic cylinder, is the ideal type of convexity for general Itô diffusions. To confirm this and further eliminate any remaining use cases, we simulate them in Figure 4.
From Figure 4, in (b) and (d), we see that a certain amount of constraining is occurring and that the BGC never exceeds the original simulation paths. However, we also see in (d) that whilst there is some BGC initially, after some time the hidden barriers are unstable.
In (a) and (c), there is no real effective constraining, since the BGCSP is now hyperextended from the original simulation paths and so there are no hidden reflective barriers either. When (where is the unconstrained Ito diffusion and signifies domination), there will be a point in time where will flip over the origin and the contribution from the drift will be eclipsed by the term. We thus have becoming the dominant drift term that will explode the Itô diffusion beyond where the unconstrained Itô diffusion would reach, away from the origin.
We now examine the parabolic cylinder in far greater detail, as shown in Figure 10.
From Figure 10, we see that the hidden reflective BGC barriers can constrain the Itô diffusion(s) indefinitely as it is “trapped” within the barriers. This assumes that there are no sudden jumps (as is the case in jump-diffusion models) or changes in or in . To examine this in even further detail, we simulate again for different parameters, as shown in Figure 11.
From Figure 11, there is a region about the time axis that not many simulation paths visit, supporting the notion that as the paths approach the hidden barriers, they end up being “trapped” near that boundary. Also notice how there is banding or discretization about various local times which get compressed the further they are from the origin. The local times seem to coincide or line up most near the time axis regardless of .
This paper has extended the available research on BGCSPs by investigating the hidden geometry of the constraining BGC function(s). The parabolic cylinder was found to be the ideal constraining mechanism for the parameter , for the most general unconstrained Itô diffusions. The constraining geometry must be convex but not any ordinary convex function will suffice. The novel “bidirectionally convex” definition was defined and adopted. The formulas for the lower hidden reflective barrier and the upper hidden reflective barrier were derived. This helps establish a linkage between of the form and the resulting and . By solving the Ornstein-Uhlenbeck process (OUP), we have been able to show the linkage between OUP and the Langevin SDE, in relation to BGCSP’s hidden barriers.
This research has applications in many fields, such as in finance where exchange rates can be constrained by “parabolic cylinder” monetary policies, such as “keep the AUD/NZD exchange rate within a range by regulating the amount of Government debt, the more it approaches the range boundaries.” Rather than prespecifying the boundaries, one can now specify just the transitions towards the unknown boundaries that can be estimated in advance. How the transition occurs is thus more important than what the final extremes (barriers) are. Future research in BGC can involve BGC of other important Itô diffusions from other research fields and finding estimates for the distribution of the first passage time (FPT) for when and are most likely to be first hit.
The simulated data used to support the findings of this study are available from the corresponding author upon request.
Conflicts of Interest
The authors declare that they have no conflicts of interest.
The first author was supported by an Australian Government Research Training Program (RTP) Scholarship. The authors would like to thank A/Professor Ron Addie of University of Southern Queensland for advice on refining this paper.
W. Feller, An Introduction to Probability Theory and Its Applications, Wiley International Publishing, Hoboken, NJ, USA, 3rd edition, 1968.
W. Böhm and M. Gopal, On Random Walks with Barriers and Their Application to Queues, Forschungsberichte/Institut für Statistik, Vienna, Austria, 1991.
H. Gupta, “Random walk in the presence of a multiple function barrier,” Journal of Mathematical Sciences, vol. 1, pp. 18–29, 1966.View at: Google Scholar
M. El-Shehawey, “Absorption probabilities for a random walk between two partially absorbing boundaries: I,” Journal of Physics A: Mathematical and General, vol. 34, no. 49, pp. 9005–9013, 2000.View at: Google Scholar
T. Gowers, J. Barrow-Green, and I. Leader, The Princeton Companion to Mathematics, Princeton University Press, Princeton, NJ, USA, 2008.
P. Dirichlet, Abhandlungen der königlich preussischen akademie der wissenschaften, Königlich Preussische Akademie der Wissenschaften zu Berlin, Berlin, Germany, 1850, https://www.biodiversitylibrary.org/bibliography/42156.
T. Kurtz, “A control formulation for constrained markov processes,” Mathematics of Random Media, vol. 27, pp. 139–150, 1991.View at: Google Scholar
D. L’epingle, Boundary Behavior of a Constrained Brownian Motion between Reflecting-Repellent Walls, University of Wrocław, Wrocław, Poland, 2009, https://www.math.uni.wroc.pl/~pms/files/30.2/Article/30.2.7.pdf.
C. Zalinescu, Convex Analysis in General Vector Spaces, Singapore, 2002.
H. Bauschke and P. Combettes, Convex Analysis and Monotone Operator Theory in Hilbert Spaces, Springer International Publishing, Berlin, Germany, 2nd edition, 2011.
D. Simpson and R. Kuske, Stochastically Perturbed Sliding Motion in Piecewise-Smooth Systems, 2018, https://arxiv.org/abs/1204.5792.