Dual-Scale Fuzzy Boundary Abstention for Selective Prototype
Classification
Ajoy Kanti1,* Das Suman Das2
1 Associate Professor, Department of Mathematics, Tripura University, Agartala-799022, Tripura, India
2 Assistant Professor Grade II (Mathematics), Department of Education, National Institute of Technology Calicut, Kozhikode-673601,
Kerala, India
Emails: ajoykantidas@gmail.com · dr.sumandas1995@gmail.com
Received: November 20, 2025 Revised: January 22, 2026 Accepted: March 01, 2026 ⋆ Corresponding author
ABSTRACT
A classifier can be accurate on average and still be unreliable near regions in which competing classes overlap.
We study this problem as selective fuzzy classification: for x ∈ Rd, the decision is either a label by(x) ∈ {1, . . . ,K}
or abstention ⊥. The proposed dual-scale fuzzy boundary index (DFBI) decomposes local ambiguity into a
distributed term Bmass(x) and an extremal term Bpress(x). The former quantifies similarity-weighted contradictory
neighborhood mass, whereas the latter compares the strongest opposing and supporting fuzzy relations. Their
geometric fusion qDFBI(x) = {Bmass(x)Bpress(x)}1/2 ∈ [0,1] induces the selective map gθc (x) = 1{qDFBI(x) ≤ θc},
where the empirical validation quantile θc targets coverage c. The analysis is entirely numerical rather than graphical
and uses repeated stratified splits, selective accuracy, macro-F1, error capture, relative risk reduction, AURC, AUGRC,
paired bootstrap intervals, ablation, neighborhood sensitivity, and a nonlinear stress test. At nominal c = 0.90, the
mean selective-accuracy vector is ¯a = (0.9354,0.9882,0.9847,0.9744) for Iris, Wine, Breast Cancer, and Digits,
while the corresponding error-capture vector is ¯e=(0.5726,0.7528,0.8093,0.7937). Relative to membership-margin
uncertainty, Δa = (0.0211,0.0022,0.0194,0.0446). Thus the gain is not obtained by changing the base classifier
f ; it follows from a local fuzzy acceptance policy ( f ,gθc ) whose uncertainty ordering is informed by boundary
geometry.
Keywords: Fuzzy rough sets Selective classification Reject option Uncertainty Fuzzy neighborhood Prototype
classification Risk–coverage analysis
1. INTRODUCTION
Fuzzy set theory replaces a binary membership statement
x ∈ A with a grade μA(x) ∈ [0,1] [1]. Rough sets express a
different form of uncertainty through lower and upper approximations,
customarily satisfying A ⊆ A ⊆ A under a crisp
indiscernibility relation [2]. Fuzzy–rough models combine
these ideas by allowing the relation and/or the approximation
grades to be valued in [0,1] [3, 4]. For classification, this
boundary perspective motivates a decision problem beyond
ordinary error Pr[ f (X) ̸= Y]: when the evidence around a
query x is locally contradictory, should the system expose
f (x) = by(x) at all?
The reject-option formulation enlarges the action space from
Y to Y ∪{⊥}, where ⊥ denotes abstention. Classical analysis
characterizes recognition error against rejection under
posterior and cost assumptions [5], whereas modern selective
classification couples a classifier f with a selector g : Rd →
{0,1} [6, 7]. Writing ℓ( f (X),Y) = 1{ f (X) ̸=Y}, coverage
and selective risk may be summarized as C (g) = E[g(X)]
1