Documentation

FormalSLT.PACBayes.ContinuousSingularFractionBesselPACBayes

Continuous-posterior singular-fraction PAC-Bayes bounds #

This module mixes the actual lower-tail predictable-mean empirical-Bernstein processes jointly over an arbitrary measurable hypothesis prior and the singular fraction family u ↦ exp (-1 / u). One Ville event then controls every reporting time, every eligible posterior chosen after observing the path, and every admissible target fraction.

The final corollary is an observable one-sided LIL-order bound for the posterior-averaged conditional prefix mean encountered along the monitored stream. It is not a population, future, deployment, or stationary-risk statement. The scalar fraction mixture is not a posterior over arbitrary predictable betting strategies, and no such strategy-uniform claim is made.

The two joint-measurability arguments are a deliberate caller interface. hjoint_ambient n must establish strong measurability of the actual process on the ambient product sigma algebra of paths, fractions, and hypotheses; hjoint_filtered n must establish the corresponding fact using F n on the path coordinate. Per-hypothesis adaptedness does not imply either joint fact for an arbitrary measurable hypothesis space. Concrete callers are responsible for deriving them from their jointly measurable observation and conditional-mean families. The measurable singular-fraction map is already composed into the exact function displayed in both hypotheses.

noncomputable def FormalSLT.PACBayes.ContinuousSingularFractionBesselPACBayes.continuousSingularFractionBesselMasterProcess {Theta : Type u_1} {Omega : Type u_2} [MeasurableSpace Theta] (prior : MeasureTheory.Measure Theta) (X mean : Theta → ℕ → Omega → ℝ) :
ℕ → Omega → ℝ

Joint hypothesis--fraction prior mixture of the actual lower-tail predictable-mean empirical-Bernstein processes.

Equations
  • One or more equations did not get rendered due to their size.
Instances For
    def FormalSLT.PACBayes.ContinuousSingularFractionBesselPACBayes.continuousSingularFractionBesselExceptionalEvent {Theta : Type u_1} {Omega : Type u_2} [MeasurableSpace Theta] (prior : MeasureTheory.Measure Theta) (X mean : Theta → ℕ → Omega → ℝ) (delta : ℝ) :
    Set Omega

    The one Ville crossing event for the joint hypothesis--fraction mixture.

    Equations
    • One or more equations did not get rendered due to their size.
    Instances For
      noncomputable def FormalSLT.PACBayes.ContinuousSingularFractionBesselPACBayes.continuousSingularFractionBesselBoundary {Theta : Type u_1} {Omega : Type u_2} [MeasurableSpace Theta] (prior : MeasureTheory.Measure Theta) (X : Theta → ℕ → Omega → ℝ) (posterior : MeasureTheory.Measure Theta) (delta lam : ℝ) (n : ℕ) (omega : Omega) :

      Explicit posterior deviation boundary at one target fraction. The hypothesis KL cost and the log price of the positive-mass singular window are both paid inside the continuous mixture.

      Equations
      • One or more equations did not get rendered due to their size.
      Instances For

        Confidence level obtained by absorbing the posterior KL cost into the confidence parameter of the scalar singular-fraction boundary.

        Equations
        • One or more equations did not get rendered due to their size.
        Instances For

          The KL-adjusted confidence level remains positive.

          A probability-level confidence budget remains at most one after the KL adjustment.

          Absorbing KL into the confidence level exactly reproduces the PAC-Bayes logarithmic price.

          theorem FormalSLT.PACBayes.ContinuousSingularFractionBesselPACBayes.continuousSingularFractionBesselMasterProcess_eProcess {Theta : Type u_1} {Omega : Type u_2} [MeasurableSpace Theta] {mOmega : MeasurableSpace Omega} {mu : MeasureTheory.Measure Omega} {F : MeasureTheory.Filtration ℕ mOmega} [MeasureTheory.IsProbabilityMeasure mu] (prior : MeasureTheory.Measure Theta) [MeasureTheory.IsProbabilityMeasure prior] {X mean : Theta → ℕ → Omega → ℝ} (hX_adapted : ∀ (theta : Theta), AnytimeValid.IncrementAdapted F (X theta)) (hmean_adapted : ∀ (theta : Theta), MeasureTheory.StronglyAdapted F (mean theta)) (hX_unit : ∀ (theta : Theta) (k : ℕ) (omega : Omega), X theta k omega ∈ Set.Icc 0 1) (hmean_unit : ∀ (theta : Theta) (k : ℕ) (omega : Omega), mean theta k omega ∈ Set.Icc 0 1) (hmean : ∀ (theta : Theta) (k : ℕ), mu[X theta k | ↑F k] =ᵐ[mu] mean theta k) (hjoint_ambient : ∀ (n : ℕ), MeasureTheory.StronglyMeasurable fun (q : Omega × ℝ × Theta) => AnytimeValid.forwardPredictableMeanEmpiricalBernsteinLowerProcess (X q.2.2) (mean q.2.2) (AnytimeValid.singularFraction q.2.1) n q.1) (hjoint_filtered : ∀ (n : ℕ), MeasureTheory.StronglyMeasurable fun (q : Omega × ℝ × Theta) => AnytimeValid.forwardPredictableMeanEmpiricalBernsteinLowerProcess (X q.2.2) (mean q.2.2) (AnytimeValid.singularFraction q.2.1) n q.1) :

          Bounded adapted observations and explicit joint measurability make the joint hypothesis--fraction prior mixture an actual e-process.

          The caller supplies both product-space obligations: hjoint_ambient for the ambient path sigma algebra and hjoint_filtered for F n. These assumptions refer to the actual process after composition with singularFraction; they are not inferred from separate per-hypothesis measurability claims.

          theorem FormalSLT.PACBayes.ContinuousSingularFractionBesselPACBayes.continuousSingularFractionBesselExceptionalEvent_mass_le_delta {Theta : Type u_1} {Omega : Type u_2} [MeasurableSpace Theta] {mOmega : MeasurableSpace Omega} {mu : MeasureTheory.Measure Omega} {F : MeasureTheory.Filtration ℕ mOmega} [MeasureTheory.IsProbabilityMeasure mu] (prior : MeasureTheory.Measure Theta) [MeasureTheory.IsProbabilityMeasure prior] {X mean : Theta → ℕ → Omega → ℝ} {delta : ℝ} (hdelta : 0 < delta) (hX_adapted : ∀ (theta : Theta), AnytimeValid.IncrementAdapted F (X theta)) (hmean_adapted : ∀ (theta : Theta), MeasureTheory.StronglyAdapted F (mean theta)) (hX_unit : ∀ (theta : Theta) (k : ℕ) (omega : Omega), X theta k omega ∈ Set.Icc 0 1) (hmean_unit : ∀ (theta : Theta) (k : ℕ) (omega : Omega), mean theta k omega ∈ Set.Icc 0 1) (hmean : ∀ (theta : Theta) (k : ℕ), mu[X theta k | ↑F k] =ᵐ[mu] mean theta k) (hjoint_ambient : ∀ (n : ℕ), MeasureTheory.StronglyMeasurable fun (q : Omega × ℝ × Theta) => AnytimeValid.forwardPredictableMeanEmpiricalBernsteinLowerProcess (X q.2.2) (mean q.2.2) (AnytimeValid.singularFraction q.2.1) n q.1) (hjoint_filtered : ∀ (n : ℕ), MeasureTheory.StronglyMeasurable fun (q : Omega × ℝ × Theta) => AnytimeValid.forwardPredictableMeanEmpiricalBernsteinLowerProcess (X q.2.2) (mean q.2.2) (AnytimeValid.singularFraction q.2.1) n q.1) :

          The joint hypothesis--fraction mixture has one exceptional event of outer mass at most delta. Its joint-measurability arguments are exactly the two caller-supplied obligations consumed by continuousSingularFractionBesselMasterProcess_eProcess.

          theorem FormalSLT.PACBayes.ContinuousSingularFractionBesselPACBayes.continuousSingularFractionBessel_boundaryFailure_mem_exceptionalEvent {Theta : Type u_1} {Omega : Type u_2} [MeasurableSpace Theta] {mOmega : MeasurableSpace Omega} (prior : MeasureTheory.Measure Theta) [MeasureTheory.IsProbabilityMeasure prior] {X mean : Theta → ℕ → Omega → ℝ} {delta lam : ℝ} (hdelta : 0 < delta) (hdelta_one : delta ≤ 1) (hlam : 0 < lam) (hlam_exp : lam ≤ Real.exp (-1)) (hX_unit : ∀ (theta : Theta) (k : ℕ) (omega : Omega), X theta k omega ∈ Set.Icc 0 1) (hmean_unit : ∀ (theta : Theta) (k : ℕ) (omega : Omega), mean theta k omega ∈ Set.Icc 0 1) (hX_parameter : ∀ (k : ℕ) (omega : Omega), MeasureTheory.StronglyMeasurable fun (theta : Theta) => X theta k omega) (hmean_parameter : ∀ (k : ℕ) (omega : Omega), MeasureTheory.StronglyMeasurable fun (theta : Theta) => mean theta k omega) (hjoint_ambient : ∀ (n : ℕ), MeasureTheory.StronglyMeasurable fun (q : Omega × ℝ × Theta) => AnytimeValid.forwardPredictableMeanEmpiricalBernsteinLowerProcess (X q.2.2) (mean q.2.2) (AnytimeValid.singularFraction q.2.1) n q.1) (posterior : MeasureTheory.Measure Theta) [MeasureTheory.IsProbabilityMeasure posterior] (hposterior_prior : posterior.AbsolutelyContinuous prior) (hllr : MeasureTheory.Integrable (MeasureTheory.llr posterior prior) posterior) {n : ℕ} {omega : Omega} (hn : 2 ≤ n) (hfail : continuousSingularFractionBesselBoundary prior X posterior delta lam n omega ≤ ∫ (theta : Theta), AnytimeValid.forwardPrefixMean (fun (k : ℕ) => mean theta k omega) n ∂posterior - ∫ (theta : Theta), AnytimeValid.forwardPrefixMean (fun (k : ℕ) => X theta k omega) n ∂posterior) :

          A failure of one posterior boundary forces the single joint hypothesis--fraction mixture across its Ville threshold.

          theorem FormalSLT.PACBayes.ContinuousSingularFractionBesselPACBayes.continuousSingularFractionBessel_allPosteriors_allFractions_of_not_mem {Theta : Type u_1} {Omega : Type u_2} [MeasurableSpace Theta] {mOmega : MeasurableSpace Omega} (prior : MeasureTheory.Measure Theta) [MeasureTheory.IsProbabilityMeasure prior] {X mean : Theta → ℕ → Omega → ℝ} {delta : ℝ} (hdelta : 0 < delta) (hdelta_one : delta ≤ 1) (hX_unit : ∀ (theta : Theta) (k : ℕ) (omega : Omega), X theta k omega ∈ Set.Icc 0 1) (hmean_unit : ∀ (theta : Theta) (k : ℕ) (omega : Omega), mean theta k omega ∈ Set.Icc 0 1) (hX_parameter : ∀ (k : ℕ) (omega : Omega), MeasureTheory.StronglyMeasurable fun (theta : Theta) => X theta k omega) (hmean_parameter : ∀ (k : ℕ) (omega : Omega), MeasureTheory.StronglyMeasurable fun (theta : Theta) => mean theta k omega) (hjoint_ambient : ∀ (n : ℕ), MeasureTheory.StronglyMeasurable fun (q : Omega × ℝ × Theta) => AnytimeValid.forwardPredictableMeanEmpiricalBernsteinLowerProcess (X q.2.2) (mean q.2.2) (AnytimeValid.singularFraction q.2.1) n q.1) {omega : Omega} (homega : omega ∉ continuousSingularFractionBesselExceptionalEvent prior X mean delta) (posterior : MeasureTheory.Measure Theta) :
          MeasureTheory.IsProbabilityMeasure posterior → posterior.AbsolutelyContinuous prior → MeasureTheory.Integrable (MeasureTheory.llr posterior prior) posterior → ∀ (n : ℕ), 2 ≤ n → ∀ (lam : ℝ), 0 < lam → lam ≤ Real.exp (-1) → ∫ (theta : Theta), AnytimeValid.forwardPrefixMean (fun (k : ℕ) => mean theta k omega) n ∂posterior < ∫ (theta : Theta), AnytimeValid.forwardPrefixMean (fun (k : ℕ) => X theta k omega) n ∂posterior + continuousSingularFractionBesselBoundary prior X posterior delta lam n omega

          Outside the one joint crossing event, every eligible posterior satisfies the explicit singular-fraction boundary at every time and every admissible target fraction. The posterior is quantified after the path is observed.

          theorem FormalSLT.PACBayes.ContinuousSingularFractionBesselPACBayes.continuousSingularFractionBessel_allPosteriors_observableLIL_of_not_mem {Theta : Type u_1} {Omega : Type u_2} [MeasurableSpace Theta] {mOmega : MeasurableSpace Omega} (prior : MeasureTheory.Measure Theta) [MeasureTheory.IsProbabilityMeasure prior] {X mean : Theta → ℕ → Omega → ℝ} {delta : ℝ} (hdelta : 0 < delta) (hdelta_one : delta ≤ 1) (hX_unit : ∀ (theta : Theta) (k : ℕ) (omega : Omega), X theta k omega ∈ Set.Icc 0 1) (hmean_unit : ∀ (theta : Theta) (k : ℕ) (omega : Omega), mean theta k omega ∈ Set.Icc 0 1) (hX_parameter : ∀ (k : ℕ) (omega : Omega), MeasureTheory.StronglyMeasurable fun (theta : Theta) => X theta k omega) (hmean_parameter : ∀ (k : ℕ) (omega : Omega), MeasureTheory.StronglyMeasurable fun (theta : Theta) => mean theta k omega) (hjoint_ambient : ∀ (n : ℕ), MeasureTheory.StronglyMeasurable fun (q : Omega × ℝ × Theta) => AnytimeValid.forwardPredictableMeanEmpiricalBernsteinLowerProcess (X q.2.2) (mean q.2.2) (AnytimeValid.singularFraction q.2.1) n q.1) {omega : Omega} (homega : omega ∉ continuousSingularFractionBesselExceptionalEvent prior X mean delta) (posterior : MeasureTheory.Measure Theta) :
          MeasureTheory.IsProbabilityMeasure posterior → posterior.AbsolutelyContinuous prior → MeasureTheory.Integrable (MeasureTheory.llr posterior prior) posterior → ∀ (n : ℕ), 2 ≤ n → ∫ (theta : Theta), AnytimeValid.forwardPrefixMean (fun (k : ℕ) => mean theta k omega) n ∂posterior < ∫ (theta : Theta), AnytimeValid.forwardPrefixMean (fun (k : ℕ) => X theta k omega) n ∂posterior + AnytimeValid.singularFractionObservableLILBoundary (ContinuousForwardPredictableMeanBesselPACBayes.continuousForwardPosteriorHybridBesselPenalty posterior X n omega) (continuousSingularFractionBesselEffectiveConfidence prior posterior delta) / ↑n

          Outside the joint crossing event, substituting the observable tuned fraction gives a one-sided LIL-order bound for every posterior selected from the observed path and every reporting time.

          theorem FormalSLT.PACBayes.ContinuousSingularFractionBesselPACBayes.exists_continuousSingularFractionBesselPACBayesLIL_event {Theta : Type u_1} {Omega : Type u_2} [MeasurableSpace Theta] {mOmega : MeasurableSpace Omega} {mu : MeasureTheory.Measure Omega} {F : MeasureTheory.Filtration ℕ mOmega} [MeasureTheory.IsProbabilityMeasure mu] (prior : MeasureTheory.Measure Theta) [MeasureTheory.IsProbabilityMeasure prior] {X mean : Theta → ℕ → Omega → ℝ} {delta : ℝ} (hdelta : 0 < delta) (hdelta_one : delta ≤ 1) (hX_adapted : ∀ (theta : Theta), AnytimeValid.IncrementAdapted F (X theta)) (hmean_adapted : ∀ (theta : Theta), MeasureTheory.StronglyAdapted F (mean theta)) (hX_unit : ∀ (theta : Theta) (k : ℕ) (omega : Omega), X theta k omega ∈ Set.Icc 0 1) (hmean_unit : ∀ (theta : Theta) (k : ℕ) (omega : Omega), mean theta k omega ∈ Set.Icc 0 1) (hmean : ∀ (theta : Theta) (k : ℕ), mu[X theta k | ↑F k] =ᵐ[mu] mean theta k) (hX_parameter : ∀ (k : ℕ) (omega : Omega), MeasureTheory.StronglyMeasurable fun (theta : Theta) => X theta k omega) (hmean_parameter : ∀ (k : ℕ) (omega : Omega), MeasureTheory.StronglyMeasurable fun (theta : Theta) => mean theta k omega) (hjoint_ambient : ∀ (n : ℕ), MeasureTheory.StronglyMeasurable fun (q : Omega × ℝ × Theta) => AnytimeValid.forwardPredictableMeanEmpiricalBernsteinLowerProcess (X q.2.2) (mean q.2.2) (AnytimeValid.singularFraction q.2.1) n q.1) (hjoint_filtered : ∀ (n : ℕ), MeasureTheory.StronglyMeasurable fun (q : Omega × ℝ × Theta) => AnytimeValid.forwardPredictableMeanEmpiricalBernsteinLowerProcess (X q.2.2) (mean q.2.2) (AnytimeValid.singularFraction q.2.1) n q.1) :
          ∃ (goodEvent : Set Omega), mu.real goodEventᶜ ≤ delta ∧ ∀ omega ∈ goodEvent, ∀ (posterior : MeasureTheory.Measure Theta), MeasureTheory.IsProbabilityMeasure posterior → posterior.AbsolutelyContinuous prior → MeasureTheory.Integrable (MeasureTheory.llr posterior prior) posterior → ∀ (n : ℕ), 2 ≤ n → ∫ (theta : Theta), AnytimeValid.forwardPrefixMean (fun (k : ℕ) => mean theta k omega) n ∂posterior < ∫ (theta : Theta), AnytimeValid.forwardPrefixMean (fun (k : ℕ) => X theta k omega) n ∂posterior + AnytimeValid.singularFractionObservableLILBoundary (ContinuousForwardPredictableMeanBesselPACBayes.continuousForwardPosteriorHybridBesselPenalty posterior X n omega) (continuousSingularFractionBesselEffectiveConfidence prior posterior delta) / ↑n

          One outer-probability event controls the monitored posterior-averaged conditional prefix mean for every observed path in the event, every eligible path-selected posterior, and every reporting time n >= 2. The radius is one-sided and LIL-order; the claim does not identify the conditional prefix mean with population, future, deployment, or stationary risk.

          The final two hypotheses remain explicit because arbitrary measurable hypothesis spaces need not turn separate section measurability into joint measurability. They are propagated unchanged to the master e-process and its exceptional-event bound.