Alternative k-nearest neighbour rules in supervised pattern recognition : Part 1. k-Nearest neighbour classification by using alternative voting rules

doi:10.1016/S0003-2670(01)95359-0

Analytica Chimica Acta

Volume 136, 1982, Pages 15-27

https://doi.org/10.1016/S0003-2670(01)95359-0 Get rights and content

Abstract

This paper discusses an extension of the well known k-nearest neighbour method. The majority voting procedure is replaced by an alternative voting method. This alternative kNN method is approached from both probabilistic and non-probabilistic points of view. On the basis of an example of differentiation between EU thyroid function and HYPER thyroid function, it is shown that alternative votes can give rise to better classification results than the majority vote.

References (16)

B.E.H. Saxberg et al.
Anal. Chim. Acta
(1978)
D.L. Duewer et al.
Comp. Biomed. Res.
(1978)
M. Sjöström et al.
Anal. Chim. Acta
(1979)
D. Coomans et al.
Anal. Chim. Acta
(1978)
D. Coomans et al.
Anal. Chim. Acta
(1981)
D. Coomans et al.
Anal. Chim. Acta
(1982)
C. Albano et al.
Anal. Chim. Acta
(1978)
B.R. Kowalski et al.
Anal. Chem.
(1972)

There are more references available in the full text version of this article.

Cited by (231)

Non-destructive assessment of hens' eggs quality using image analysis and machine learning
2023, Smart Agricultural Technology
Eggs are an essential source of inexpensive protein. Due to their oval shape, eggs can be efficiently handled, transported, and packed. The geometric description of the egg shape has been used as another parameter to evaluate the quality. Egg quality traits are related to several variables, such as the rearing environment, nutrition, breed, and age of the hen. We hypothesize that the shape index is associated with egg quality traits and that its isolated analysis can be used in the egg classification process. Given the complexity of variables affecting egg quality traits, we believe that knowing how the internal and eggshell quality relates to its shape may favor the classification process. Our study analyzed the associations between egg shape (using Shape Index, SI) and quality traits. We tested several machine-learning models to establish a relationship between shape and egg quality traits. From the images of 6,378 eggs, we found rounder eggs (SI ≥ 76) to have internal and eggshell quality higher than more elongated eggs (SI < 72). The best fit model was the Random Forest, with an accuracy of 97.9%. Assessing egg quality using a non-destructive method based on image analysis of egg shape can improve the grading process of commercial eggs in the processing industry.
Automatic recognition of food bacteria using Raman spectroscopy and chemometrics: A comparative study of multivariate models
2023, Vibrational Spectroscopy
Food safety is the foundation of trust for food stakeholders. Contamination, especially from biological sources, at food processing plants can threaten this foundation, resulting in negative impacts on consumer health and substantial economic losses. Therefore, a rapid, effective, and noninvasive method for detecting bacteria in the food industry is essential. In this study, Raman micro-spectroscopy with advanced statistical tools is proposed as a mean of detecting and differentiating between various types of bacteria. This approach circumvents the complexities of traditional culture-based detection methods. Specifically, fifty-two bacterial strains of 39 different genera were analyzed using Raman spectroscopy. As a result, about 2563 Raman spectra were generated and integrated into the database. This huge amount of spectral data was analyzed using several chemometric tools, including principal component analysis (PCA), factorial discriminant analysis (FDA) k-nearest neighbors’ algorithm (KNN), and convolutional neural network (CNN). Our multivariate data analysis showed that the developed method is rapid and capable of distinguishing several strains. While, FDA models showed mediocre performances, KNN models provided good bacterial classification for most of the analyzed strains (average correct classification 90–95%). In comparison, CNN achieved a higher classification accuracy, of 97%, compared with other models. Combining Raman spectroscopy with chemometric tools yields a robust bacterial assessment method that is simple, rapid, and efficient.
Deep learning combined with Balance Mixup for the detection of pine wilt disease using multispectral imagery
2023, Computers and Electronics in Agriculture
Pine wilt disease (PWD) is one of the most destructive infectious diseases affecting coniferous forests. This research proposes a detection method based on deep learning combined with Balance Mixup. At the beginning, regions of interest (ROIs) on multispectral images are automatically generated using normalized difference vegetation index threshold segmentation algorithm. Multispectral data of these ROIs are extracted and labeled as positive (represented by 1) or negative (represented by 0) depending on whether they contained infected trees. During training, the Balance Mixup algorithm selects two multispectral data from a batch of training data according to a certain random strategy. The two data will be mixed into a new multispectral data whose label is the maximum value of the labels (0 or 1) of the original data. The above process will be repeated many times until a new batch of data is generated. A one-dimensional convolutional neural network called pine wilt disease net (PWDNet) is trained by the mixed data and output feature vectors, which are used as input data by a logistic model to determine whether there are PWD in mixed data. By combining Balance Mixup and PWDNet, our method achieved a recall of 1.00 and a precision of 0.90 in testing set. The satisfactory results indicates that the method can provide technical support for the prevention and control of PWD.
Hyperparameter optimized classification pipeline for handling unbalanced urban and rural energy consumption patterns
2023, Expert Systems with Applications
Energy consumer locations are required for framing effective energy policies. However, due to privacy concerns, it is becoming increasingly difficult to obtain the locational data of the consumers. Machine learning (ML) based classification strategies can be used to find the locational information of the consumers based on their historical energy consumption patterns. The ML methods in this paper are applied to the Residential Energy Consumption Survey 2009 dataset. In this dataset, the number of consumers in the urban area is higher than the rural area, thus making the classification problem unbalanced. The unbalanced classification problem has been solved in original and transformed or reduced feature space using Monte Carlo based under-sampling of the majority class datapoints. The hyperparameters for each classification algorithm family is represented as an optimized pipeline, obtained using the genetic programming (GP) optimizer. The classification performance metrics are then obtained for different algorithm families on the original and transformed feature spaces. Performance comparisons have been reported using univariate and bivariate distributions of the classification metrics viz. accuracy, geometric mean score (GMS), F₁ score, precision, area under the curve (AUC) of receiver operator characteristics (ROC). The energy policy aspects for the urban and rural residential consumers based on the classification results have also been discussed.
The applications of Machine learning (ML) in designing dry powder for inhalation by using thin-film-freezing technology
2022, International Journal of Pharmaceutics
Dry powder inhalers (DPIs) are one of the most widely used devices for treating respiratory diseases. Thin--film--freezing (TFF) is a particle engineering technology that has been demonstrated to prepare dry powder for inhalation with enhanced physicochemical properties. Aerosol performance, which is indicated by fine particle fraction (FPF) and mass median aerodynamic diameter (MMAD), is an important consideration during the product development process. However, the conventional approach for formulation development requires many trial-and-error experiments, which is both laborious and time consuming. As a state-of-the art technique, machine learning has gained more attention in pharmaceutical science and has been widely applied in different settings. In this study, we have successfully built a prediction model for aerosol performance by using both tabular data and scanning electron microscopy (SEM) images. TFF technology was used to prepare 134 dry powder formulations which were collected as a tabular dataset. After testing many machine learning models, we determined that the Random Forest (RF) model was best for FPF prediction with a mean absolute error of ± 7.251%, and artificial neural networks (ANNs) performed the best in estimating MMAD with a mean absolute error of ± 0.393 μm. In addition, a convolutional neural network was employed for SEM image classification and has demonstrated high accuracy (>83.86%) and adaptability in predicting 316 SEM images of three different drug formulations. In conclusion, the machine learning models using both tabular data and image classification were successfully established to evaluate the aerosol performance of dry powder for inhalation. These machine learning models facilitate the product development process of dry powder for inhalation manufactured by TFF technology and have the potential to significantly reduce the product development workload. The machine learning methodology can also be applied to other formulation design and development processes in the future.
Machine Learning-Based ECG Signal Classification for Enhanced Early Detection of Doxorubicin-Induced Cardiotoxicity in Rats
2024, Research Square

View all citing articles on Scopus

View full text

Alternative k-nearest neighbour rules in supervised pattern recognition : Part 1. k-Nearest neighbour classification by using alternative voting rules

Abstract

Anal. Chim. Acta

Comp. Biomed. Res.

Anal. Chim. Acta

Anal. Chim. Acta

Anal. Chim. Acta

Anal. Chim. Acta

Anal. Chim. Acta

Anal. Chem.