Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.
32,889 characters · 14 sections · 26 citation commands
Sufficient conditions for a Heuristic Rating Estimation Method application
Pairwise comparison (PC) methods constitute a well-established class of decision-making tools used to derive priorities or rankings of alternatives based on relative judgments. Among the most prominent representatives of this family are methods such as the Analytic Hierarchy Process (AHP), ELECTRE, PROMETHEE, MACBETH, TOPSIS, PAPRIKA, or the Best--Worst Method BanaECosta1994baip,Brans2005pm,Figueira2005em,Hansen2008anmf,Rezaei2015bwmc,Saaty1977asmfSIMPL,Saaty1980tahp,Yoon1987arad.
According to the classic work Miller1956tmns, humans are able to process only $7\pm2$ "pieces" of information at a time. The fundamental advantage of pairwise comparisons lies in their ability to reduce this cognitive burden, as decision-makers are required to compare only two alternatives at a time rather than evaluate all options simultaneously.
The origins of pairwise comparisons can be traced back to the 13th century, when Ramon Llull applied comparative judgments to select a prelate from a group of candidates Colomer2011rlfa. The method was later formalized in the early 20th century by L. L. Thurstone in his Law of Comparative Judgment Thurstone1927tmop, and gained widespread popularity following the introduction of AHP by T. L. Saaty in the late 1970sSaaty1977asmfSIMPL. Since then, PC methods have been successfully applied across a broad range of disciplines, including engineering, economics, management, and social sciences.
The Heuristic Rating Estimation (HRE) method, proposed in the mid-2010s Kulakowski2014hrea,Kulakowski2015hreg,Kulakowski2016note, represents a modification of classical pairwise comparison techniques. Its distinctive feature is the explicit differentiation between two categories of alternatives: those with known preference values (reference alternatives) and those whose preferences are unknown. The objective of HRE is to estimate the unknown priorities by exploiting pairwise comparisons both among unknown alternatives and between unknown and reference alternatives. This structure makes HRE particularly suitable for decision problems in which partial, yet reliable, preference information is available in advance. Typical situations where this setting occurs include an introduction of a new product on the market while performance of previous products is known, elections where a performance of previous candidates is known, etc.
Two main variants of the HRE method have been developed: the arithmetic and the geometric approaches Kulakowski2014hrea, Kulakowski2016note Kulakowski2015hreg. In the arithmetic version of the HRE, the priority of an alternative is computed as an arithmetic mean of its evaluations relative to other alternatives, whereas the geometric version relies on geometric aggregation. Existing research on HRE has primarily focused on issues related to solution existence Kulakowski2016note, inconsistency assessment Kulakowski2020iifi, and methodological extensions, including multiple-criteria, incomplete or fuzzy pairwise comparison matrices, see also Kedzior2023mchr,Kulakowski2026mbip.
In practical applications, however, decision-makers often face incomplete pairwise comparison data, which raises fundamental questions regarding the solvability and uniqueness of the resulting estimation problem. The aim of this paper is to address this gap by providing sufficient conditions for the applicability of the HRE method in the case of incomplete pairwise comparison matrices. Using tools from linear algebra and spectral theory, we establish conditions under which the arithmetic and geometric HRE formulations admit unique solutions.
While Kulakowski2026mbip shares a common methodological background with studies on mean-based incomplete pairwise comparison methods with reference values, its contribution addresses a distinct and previously underexplored problem. Existing mean-based approaches focus on extending the HRE method by modifying aggregation rules and broadening admissible comparison structures. In contrast, the present study adopts a theoretical perspective and asks under what conditions the standard arithmetic and geometric HRE methods are well-defined. By deriving sufficient conditions for invertibility and uniqueness using spectral radius arguments and matrix theory, this paper fills a theoretical gap by establishing formal guarantees for HRE applicability, independent of any particular extension or optimization-based reformulation.
The remainder of the paper is organized as follows. Section (ref) introduces preliminary concepts related to pairwise comparisons and selected results from linear algebra. Section (ref) discusses the arithmetic and geometric HRE methods in the complete case and derives conditions ensuring solution existence. Section (ref) extends the analysis to incomplete pairwise comparison matrices and presents sufficient conditions for solvability in both arithmetic and geometric HRE variants. The paper concludes with a summary of the main results.
The pairwise comparisons (PC) method is the process designed to transform the set of comparisons into a ranking of alternatives. Let $A=\{a_{1},\ldots,a_{n}\}$ denote a set of alternatives while $C=[c_{ij}]$ means set of comparisons in the form of $n\times n$ matrix, where $c_{ij}\in\mathbb{R}_{+}$ for $i,j=1,\ldots,n$. Each $c_{ij}$ means the result of direct comparison between $a_{i}$ and $a_{j}$. When the result of the given comparison $c_{ij}$ is unknown we write that $c_{ij}=c_{ji}=?$.
The purpose of PC method is to calculate the ranking.
The above function prioritizes the various alternatives. The more preferred alternatives have higher weights. The function $w$ is usually represented as a priority vector in the form:
The fact that $c_{ij}$ corresponds to the ratio of the preferential strength of alternatives $a_{i}$ and $a_{j}$ implies that one may expect that $c_{ij}=w(a_{i})/w(a_{j})$. This in turn results in a postulate of transitivity\footnote{As $c_{ik}=w(a_{i})/w(a_{k})$ and $c_{kj}=w(a_{k})/w(a_{j})$.} i.e. $c_{ij}=c_{ik}c_{kj}$ for every triad $i,j,k=1,\ldots,n$. Unfortunately, because the vector $w$ is computed based on all pairwise comparisons, in practice we may expect only that $c_{ij}\approx w(a_{i})/w(a_{j})$, thus $c_{ij}\approx c_{ik}c_{kj}$.
Now we recall the general definition of a consistent PC matrix, which is valid both in a complete and incomplete case.
It is easy to prove that if $c_{ij}=c_{ik}c_{kj}$ then $c_{ij}=w(a_{i})/w(a_{j})$ Kulakowski2020utahp regardless of the prioritization method providing of course that $c_{ij}$ means the ratio between preferential strength of $a_{i}$ and $a_{j}$.
There are at least a dozen methods for computing a vector $w$ Choo2004acff,Kulakowski2020utahp. The two most popular are the Eigenvalue Method (EVM) and Geometric Mean Method (GMM). The first one was originally proposed by Saaty in his seminal paper Saaty1977asmf is based on the concept of a vector and the eigenvalue of the matrix $C$. So, let $C=[c_{ij}]$ be a PC matrix containing expert judgments for $n$ alternatives, and $w_{\textit{max}}$ be a principal eigenvector of $C$ i.e. \[ Cw_{\textit{max}}=\lambda_{\textit{max}}w_{\textit{max}}, \] where $\lambda_{\textit{max}}$ is a principal eigenvalue (spectral radius) of $C$. Thus, the priority vector $w_{\textit{ev}}$ is a rescaled version of $w_{\textit{max}}$ i.e. \[ w_{\textit{ev}}=\frac{1}{\sum^{n}_{i=1}w_{\textit{max}}(a_{i})}w_{\textit{max}}. \] The second method, although it is based on similar premises Kulakowski2016srot, is easier to calculate. In GMM the priority of the $i$-th alternative is the appropriately rescaled geometric mean of all its direct comparisons. I.e. \[ w_{\textit{gm}}(a_{i})=\alpha\left(\prod^{n}_{j=1}c_{ij}\right)^{1/n}, \]
where \[ \alpha=\left(\sum^{n}_{i=1}\left(\prod^{n}_{j=1}c_{ij}\right)^{1/n}\right)^{-1}. \] Both methods EVM and GMM have their incomplete counterparts. Extending the EVM to incomplete matrices was proposed by Harker Harker1987amoq. Similar extension of GMM for incomplete PC matrices can be found in kulakowski2020otgm or equivalently for Logarithmic Least-Squares method in Bozoki2010ooco,Tone1993llsm.
In the literature we can find a lot of inconsistency indices for complete matrices, however the first one and probably the most popular one is consistency index CI introduced by Saaty Saaty1977asmf. For a given $n\times n$ PC matrix $C$ Consistency Index is defined as \[ CI(C)=\frac{\rho(C)-n}{n-1}, \] where $\rho(C)$ is a spectral radius of $C$, which is also its eigenvalue.
Following the idea of Saaty in Harker1987amoq Harker defined the Consistency Index for incomplete PCMs as \[ \overline{CI}(C)=\frac{\rho(H)-n}{n-1}, \] where $H$ is an auxiliary matrix resulting from $C$:
and $s_{i}$ denotes the number of ? in the $i$-th row.
Let us recall some useful definitions and theorems from the linear algebra.
For two matrices $A=[a_{ij}]$ and $B=[b_{ij}]$ we will write $A\leq B$ if for each $i,j$ the inequalty $a_{ij}\leq b_{ij}$ holds. Similarly, the notation $A<B$ means that $A\leq B$ and there exist $i,j$ such that $a_{ij}<b_{ij}$.
The next corollary follows immediately from Theorems (ref) and (ref).
For a $k\times k$ matrix we put \[ r_{i}=\sum_{j\neq i}|a_{ij}|. \] and for $i\in\{1,\ldots,k\}$ we define a Gersgorin disc as \[ D_{i}=\{z\in\mathbb{C}:\ |z-a_{ii}|\leq r_{i}\}. \]
We assume that the set of alternatives consists of two disjoint subsets: the alternatives with unknown preferential values $A_{U}=\{a_{1},\ldots,a_{k}\}$ where $1\leq k<n$, and the reference alternatives for which the preferences are known $A_{K}=\{a_{k+1},\ldots,a_{n}\}$. The ranking value $w(a_{l})\in\mathbb{R}_{+}$ for each $l\in\{k+1,\ldots,n\}$ is known from the very beginning. The aim of the HRE process is to derive the unknown priorities of the alternatives from $A_{U}$.
Let \[ C_{k}=\left[
\right] \] be a $k\times k$ submatrix of an $n\times n$ PC matrix $C$.
The arithmetic HRE procedure has been introduced in Kulakowski2014hrea. The ranking can be found by solving the equation
where \[ A_{k}=\left[
\right] \] is a $k\times k$ auxiliary matrix and
\[ b=\left[
\right] \] is a constant term vector.
We can formulate sufficient conditions for $A_{k}$ to be invertible by means of Saaty consistency index CI of the matrix $C_{k}$.
Theorem (ref) implies the following corollary:
In particular, if $C$ is consistent then for each $k<n$ matrices $C_{k}$ are consistent, too.
Notice that hardly ever $A_{k}$ is singular, but the following example shows that it is possible.
According to Kulakowski2015hreg, to calculate the ranking in the case of a geometric approach the equation
must be solved, where
\[ {A}_{k}=\left[
\right] \] and \[ {b}=\left[
\right]. \] Since $\widehat{w}(a_{i})$ is the logarithmized value of $w(a_{i})$ i.e. $\widehat{w}(a_{i})=\log_{e}w(a_{i})$ then the final ranking vector is obtained from $\widehat{w}$ by the exponential transformation $w(a_{i})=e^{\widehat{w}(a_{i})}$ for $i=1,\ldots,k$. The solution to a geometric HRE always exists and is optimal Kulakowski2015hreg.
We will show it once more by means of the spectral radius.
In practice it may happen that not all comparisons between alternatives are made, so a PC matrix may be incomplete. Of course, the necessary condition for an incomplete PC matrix to induce a ranking is that it is irreducible (see Koczkodaj2015pcs). From now on we assume that the considered PC matrix $C$ is irreducible. We also assume that \[ c_{pq}=\frac{w(p)}{w(q)}, \] for each $p,q\in\{k+1,\ldots,n\}$.
Let us denote the number of undefined comparisons in the $i$-th row of a PC matrix $C$ by $s_{i}$. The weights we want to determine are denoted as:
The original method's idea is to find the unknown weights of alternatives satisfying the system of linear equations:
Let us define the following matrix $k\times k$ matrix $D_{k}$:
The arithmetic procedure ((ref)) can be rewritten in the form of the matrix equation:
where
and
If $C$ is irreducible and consistent we may properly define a complete and consistent matrix $\hat{C}$, whose elements are given as follows: \[ \hat{c}_{ij}=
. \]
Similarly to the complete case let us define a $k\times k$ submatrix of $C$: \[ C_{k}=\left[
\right]. \]
For each $j\in{1,\ldots,k}$ let $s_{j}$ denote the number of missing entries in the $j$-th row of $C_{k}$. Let \[ s_{\mathrm{MAX}}=\max_{j\in\{1,\ldots,k\}}s_{j} \] and \[ s_{\mathrm{MIN}}=\min_{j\in\{1,\ldots,k\}}s_{j}. \]
Now we are ready to formulate a result similar to Theorem (ref).
Unlike in the case of Theorem (ref), the right side of the inequality in Theorem (ref) does not have to be positive, so Theorem (ref) not always follows from Theorem (ref). However we can formulate the following corollaries, whose assumptions are sufficient to apply HRE to a consistent incomplete PC matrix.
The next example shows that, similarly to the complete case, the incomplete arithmetic HRE procedure in very special cases may not work. On the other hand, it proves that the inconsistency threshold in Theorem (ref) is optimal.
The geometric procedure for incomplete PC matrices comes down to the solution of the following matrix equation:
where \[ {A}_{k}=\left[
\right], \] with \[ q_{ij}=
, \] and \[ b=\left[
\right] \] is a vector depending on the known comparisons $c_{ij}$ and the weights of the reference alternatives.
In the paper we have provided sufficient conditions for a Heuristic Rating Estimation method to be used. For the arithmetic HRE we have estimated the inconsistency thresholds which guarantee that the method will work. In the case of a complete PCM it depends only on the total number of alternatives and the number of non-referential ones. In the case of incomplete PCMs also the minimum and maximum numbers of missing entries in rows matters. The estimations of inconsistency which imply the possibility of HRE procedure application are optimal, which has been shown by appropriate examples. As far as the geometric HRE is concerned, both algorithms for complete and incomplete PCMs produce rankings for each input.
The research has been supported by the National Science Centre, Poland within the grant VIRGO 2024/55/B/HS4/00860. Jacek Szybowski was also supported by AGH University of Krakow (task no. 11.11.420.004).
\addcontentsline{toc}{section}{\refname}