AQAI QuantAI research lab for systematic strategies

Automated analysis

This analysis was drafted by our research engine and has not been checked by a human editor. It may contain errors. It separates the paper’s own results from our tests, and any figures called ours come from our own backtest.

Our automated analysisOur backtest

Habibi's VaR recursion repeats Robbins-Monro; its promised validation is missing

The author acknowledges Bardou and Hong-Liu; the Langevin proposal leaves its target unrecoverable.

2026-10-29 · 5 min read · Tail-Risk Management · US ETFs

Reviewing: Estimation VaR and CVaR by Gradient and Langevin MC Methods · Reza Habibi · Read it on openalex

Our backtest of this idea

Our automated quick test, not the paper's

SPY CVaR Exposure Control: Paired Stochastic Gradient and Historical Simulation

Backtest period 2020-01-01 to 2024-07-01 · hypothetical, net of modelled costs

Why these figures are not the paper's (3)

The paper reports no results of its own

This is a theoretical paper — derivations and proofs, with no measurement on market data. The backtest below is a strategy we built from its idea, not a test of anything the authors claimed.

This is not a replication of the paper (2)

  • Many equations are missing from the supplied text, and the Langevin target distribution and implementation settings are insufficiently specified. A reconstructed stochastic-gradient implementation and explicitly specified Langevin variant would test those implementations, not establish exact replication of the author's method.
  • The body supplies no empirical accuracy or computational-efficiency benchmark against which to validate the abstract's claimed improvements.

The figures below measure what we could run, not the paper's own method, so they are not evidence for or against its claim.

Our own audit found this run does not follow the paper faithfully

  • Additional platform initial-capital leverage ceiling: Apply the required max_leverage=4.0 initial-capital ceiling in addition to the task's stricter no-borrowing, current-NAV exposure bounds. (invalidates: If the platform ceiling binds after capital appreciation, executed weights need not equal the task's CVaR-derived target; exact portfolio-performance replication of the unconstrained task exposure rule no longer applies on those dates)

These are our findings about our own implementation, not criticisms of the paper. Read the figures below as a description of what we ran.

Jan 2020Total 39.4%Jul 2024
Sharpe
0.64
Total Return
39.4%
Max Drawdown
-29.1%
CAGR
7.7%
Volatility
13.7%
Beta vs SPY
0.62
Trades
1,131

Habibi's headline estimator gives a risk desk a familiar recursion for estimating VaR, with no empirical evidence that it improves the job. The update is a stochastic-gradient quantile recursion in the Robbins-Monro style. Remark 2 acknowledges that Hong and Liu (2021) and Bardou et al. (2020) already supply the same recursion. The remaining question is practical: do the pages that follow, numbered 220 to 227 in the running header, change how you would estimate a 95% one-day tail on a real book?

Following the exceedances

Begin with a guess for the loss quantile at confidence level α, then draw a simulated loss. A loss below the guess nudges it down. A loss above it pushes it up by a much larger amount. Those relative adjustments make the guess settle where exceedances occur at a rate of 1-α. With α = 0.95, drift stops when losses exceed the guess exactly 5% of the time. This fixed point gives VaR. A positive step-size sequence makes the adjustments shrink, though the conditions imposed on that sequence are missing from the text available to us.

The same draws also supply CVaR. Habibi uses the Knight identity to express CVaR through VaR and the loss survival function, then differentiates with respect to the VaR level. The resulting first-order differential equation ties the movement in CVaR to the hazard rate at VaR. An exponential loss has a constant hazard, leaving a fixed gap between CVaR and VaR. The paper also derives closed forms for Pareto and for a Weibull with shape parameter 2. The latter expresses CVaR using the CDF and density of a zero-mean normal.

Several brief extensions surround this core. The paper compares a CLT for the recursion with the Bahadur representation of the empirical quantile. Proposition 2 supplies a continuous-time limit on Brownian motion over [0,1]; Proposition 3 introduces an importance-sampling likelihood ratio. Randomized step sizes appear as bootstrap or uniform weights, and a Newton-Raphson interpretation addresses sensitivity. A translated gamma, matched on 3 moments (mean, standard deviation, skew), then yields VaR from chi-squared quantiles.

The body reports no empirical result of its own.

We found no dataset or sample period, nor any simulation table or runtime figure. What the paper supplies is a numerical estimator for a quantile that could otherwise be read from a sorted vector.

Where was accuracy measured?

The abstract promises to "demonstrate their advantages over conventional methods through extensive empirical validation". It also says the methods "enhance computational efficiency" and "improve the accuracy of VaR and CVaR estimates, particularly in tail regions". The body supplies 3 distributional examples instead, each deriving a closed form for a single parametric loss. Such a formula establishes the correct answer. It cannot establish whether the recursion gets there faster, or closer, than the empirical quantile.

A convergence-rate ratio and a variance ratio are stated for the recursion relative to the Bahadur quantile. Neither expression survived extraction; the paper gives no numerical value. The Bahadur variance depends on the density at VaR. That density is thin in precisely the tails singled out in the abstract.

Three other restrictions affect desk use. The derivation relies on "L is a positive variable", whereas daily P&L losses are signed. The translated gamma requires skew to be "strictly positive". For Proposition 1, Habibi says "the proof is omitted". Sourcing slips further weaken confidence: Sun and Hong (2019) appears as the 2011 Winter Simulation Conference, while the header lists pages 1-15 against the running header's 220-227.

The Langevin target remains unrecoverable

The gradient recursion moves an estimate toward a root. The Langevin proposal adds a standard normal innovation, making the iterate sample a density rather than settle at a point. Adding that noise to a VaR point estimator calls for a reason, starting with a target density and an ergodicity condition. We cannot recover the target density from the available text. We found a discretized update, but no convergence statement or comparison against the plain recursion it would need to beat. Barbu and Zhu (2025), whose work Habibi says he extends, place these samplers within Bayesian learning. Habibi does not identify the posterior that would apply to a single portfolio's VaR.

Our SPY reconstruction

We could not implement the author's method. Many equations are absent from the extracted text, and the Langevin target and settings lack enough detail. We therefore built a reconstructed stochastic-gradient estimator alongside a historical-simulation comparator. All our figures refer only to those constructions. The body provides no benchmark against which to assess the paper's claims of accuracy and efficiency.

We made the construction ourselves. At each SPY close, it uses the trailing 750 signed daily losses and draws 20,000 bootstrap scenarios. The recursion runs for 10,000 steps, using step 0.1/(k+100)^0.6. We average iterates 5,001 to 10,000, then estimate CVaR from the other 10,000 draws. Exposure follows min(1, 0.02/CVaR), targeting 2% estimated daily tail risk without leverage. The book trades at the next open and pays $0.004 a share in commissions; cash earns zero. The window covers 2020-01-01 to 2024-07-01. We use no Langevin noise.

Our gradient-sized SPY book returned 39.44% in total over 2020-01-01 to 2024-07-01. Sharpe was 0.64 and Sortino was 0.75. Volatility came to 13.70%, with a max drawdown of -29.15% and Calmar of 0.26. These results test our substitute construction only. For a book intended to cap tail risk at 2% a day, a 0.64 Sharpe alongside a drawdown of almost 30% is weak.

The paper reports no performance of its own for comparison. Our exposure cap is 100%, and idle cash earns zero, so this book can only hold less exposure than SPY. Its 13.70% volatility should be read before its 39.44% return. We report only the gradient book's figures here.

A single table would change our view of the paper: tail RMSE against draw count, comparing the gradient and Langevin estimators with the plain empirical quantile at equal budgets. Habibi's Pareto case already provides the closed-form answer needed for that comparison.

Our backtest stops at 2024-07-01, and everything after that date is deliberately left untouched so the same strategy can be checked out of sample later.

How our backtest worked

The steps the code we ran actually executed, from its strategy card. Ours, not the paper's — it is one automated implementation of the idea, not the authors' own.

After each completed session t close:
  Require 751 valid adjusted closes producing 750 signed losses:
    L_j = -(close_j / close_{j-1} - 1).
  Compute window mean mu and sample standard deviation s (ddof=1).
  Generate 20,000 replacement draws using the date-specific seeded RNG.

  Gradient estimator, reset independently each date:
    Standardize the first 10,000 draws: X_k = (L*_k - mu) / s.
    z_0 = 0
    For k = 1,...,10,000:
      gamma_k = 0.1 / (k+100)^0.6
      z_k = z_{k-1} - gamma_k * (1 - 1{X_k > z_{k-1}}/0.05)
    q = mu + s * mean(z_5001,...,z_10000)
    e = q + sum(max(L*_k-q,0), k=10001,...,20000)/(0.05*10000)

  Matched historical simulation, using all identical 20,000 draws:
    q_HS = left-inverse empirical 95% quantile
    e_HS = q_HS + sum(max(L*_k-q_HS,0))/(0.05*20000)

  For each estimator independently:
    If inputs are invalid, or q/e is nonfinite, or e <= 0: target w = 0.
    Otherwise: target w = min(1, max(0, 0.02/e)).

At next session t+1 adjusted open:
  Retain existing holdings through the overnight gap.
  Rebalance to the pending target with cost-inclusive affordable sizing.
  Enforce nonnegative cash, no shorts, <=100% current-NAV exposure,
    and the additional 4x initial-capital platform ceiling.
  If the open is invalid, skip the trade; do not invent a fill.
  Mark holdings at observed adjusted close; cash earns zero.

Enter, resize or exit solely through the daily target; there are no discretionary stops or holding-period exits. Use separate ledgers for the funded gradient strategy, the HS comparator and cost sensitivities. Do not force liquidation at the endpoint. Exact-window HS is a numerical diagnostic, not another traded strategy.