Dissertations / Theses on the topic 'Hellinger's distance'

Recommender systems are used in online sales and e-commerce for recommending potential items/products for customers to buy based on their previous buying preferences and related behaviours. Collaborative filtering is a popular computational technique that has been used worldwide for such personalized recommendations. Among two forms of collaborative filtering, neighbourhood and model-based, the neighbourhood-based collaborative filtering is more popular yet relatively simple. It relies on the concept that a certain item might be of interest to a given customer (active user) if, either he appreciated similar items in the buying space, or if the item is appreciated by similar users (neighbours). To implement this concept different kinds of similarity measures are used. This thesis is set to compare different user-based similarity measures along with defining meaningful measures based on Hellinger distance that is a metric in the space of probability distributions. Data from a popular database MovieLens will be used to show the effectiveness of dierent Hellinger distance-based measures compared to other popular measures such as Pearson correlation (PC), cosine similarity, constrained PC and JMSD. The performance of dierent similarity measures will then be evaluated with the help of mean absolute error, root mean squared error and F-score. From the results, no evidence were found to claim that Hellinger distance-based measures performed better than more popular similarity measures for the given dataset.

Master of Science
Department of Statistics
Weixin Yao
In this report, we introduce the minimum Hellinger distance (MHD) estimation method and review its history. We examine the use of Hellinger distance to obtain a new efficient and robust estimator for a class of semiparametric mixture models where one component has known distribution while the other component and the mixing proportion are unknown. Such semiparametric mixture models have been used in biology and the sequential clustering algorithm. Our new estimate is based on the MHD, which has been shown to have good efficiency and robustness properties. We use simulation studies to illustrate the finite sample performance of the proposed estimate and compare it to some other existing approaches. Our empirical studies demonstrate that the proposed minimum Hellinger distance estimator (MHDE) works at least as well as some existing estimators for most of the examples considered and outperforms the existing estimators when the data are under contamination. A real data set application is also provided to illustrate the effectiveness of our proposed methodology.

Orientador : Jose Antonio Cordeiro
Dissertação (mestrado) - Universidade Estadual de Campinas, Instituto de Matematica, Estatistica e Ciencia da Computação
Made available in DSpace on 2018-07-14T18:46:42Z (GMT). No. of bitstreams: 1 Dias_Ronaldo_M.pdf: 681214 bytes, checksum: d58913b4baf740c4de007fb27ed3257f (MD5) Previous issue date: 1988
Resumo: Não informado
Abstract: Not informed
Mestrado
Mestre em Estatística

Many minimum distance estimators have the potential to provide parameter estimates which are both robust and efficient and yet, despite these highly desirable theoretical properties, they are rarely used in practice. This is because the performance of these estimators is rarely guaranteed per se but obtained by placing a suitable value on some tuning parameter. Hence there is a risk involved in implementing these methods because if the value chosen for the tuning parameter is inappropriate for the data to which the method is applied, the resulting estimators may not have the desired theoretical properties and could even perform less well than one of the simpler, more widely used alternatives. There are currently no data-based methods available for deciding what value one should place on these tuning parameters hence the primary aim of this research is to develop an objective way of selecting values for the tuning parameters in minimum distance estimators so that the full potential of these estimators might be realised. This new method was initially developed to optimise the performance of the density power divergence estimator, which was proposed by Basu, Harris, Hjort and Jones [3]. The results were very promising so the method was then applied to two other minimum distance estimators and the results compared.

In this dissertation, robust and efficient alternatives to quasi-likelihood estimation and likelihood ratio tests are developed for discrete generalized linear models. The estimation method considered is a penalized minimum Hellinger distance procedure that generalizes a procedure developed by Harris and Basu for estimating parameters of a single discrete probability distribution from a random sample. A bootstrap algorithm is proposed to select the weight of the penalty term. Simulations are carried out to compare the new estimators with quasi-likelihood estimation. The robustness of the estimation procedure is demonstrated by simulation work and by Hapel's α-influence curve. Penalized minimum Hellinger deviance tests for goodness-of-fit and for testing nested linear hypotheses are proposed and simulated. A nonparametric bootstrap algorithm is proposed to obtain critical values for the testing procedure.

Robust estimation of statistical parameters is traditionally believed to exist in a trade space between robustness and efficiency. This thesis examines the Minimum Hellinger Distance Estimator (MHDE), which is known to have desirable robustness properties as well as desirable efficiency properties. This thesis confirms that the MHDE is simultaneously robust against outliers and asymptotically efficient in the univariate location case. Robustness results are then extended to the case of simple linear regression, where the MHDE is shown empirically to have a breakdown point of 50%. A geometric algorithm for solution of the MHDE is developed and implemented. The algorithm utilizes the Riemannian manifold properties of the statistical model to achieve an algorithmic speedup. The MHDE is then applied to an illustrative problem in power system state estimation. The power system is modeled as a structured linear regression problem via a linearized direct current model; robustness results in this context have been investigated and future research areas have been identified from both a statistical perspective as well as an algorithm design standpoint.
Master of Science

Ever since the pioneering work of Parzen the mean square error( MSE) and its integrated form (MISE) have been used as the error criteria in choosing the bandwidth matrix for multivariate kernel density estimation. More recently other criteria have been advocated as competitors to the MISE, such as the mean absolute error. In this study we define a weighted version of the Hellinger distance for multivariate densities and show that it has an asymptotic form, which is one-fourth the asymptotic MISE under weak smoothness conditions on the multivariate density f. In addition the proposed criteria give rise to a new data-dependent bandwidth matrix selector. The performance of the new data-dependent bandwidth matrix selector is compared with other well known bandwidth matrix selectors such as the least squared cross validation (LSCV) and the plug-in (HPI) through simulation. We derived a closed form formula for the mean Hellinger distance (MHD) in the univariate case. We also compared via simulation mean weighted Hellinger distance (MWHD) and the asymptotic MWHD, and the MISE and the asymptotic MISE for both univariate and bivariate cases for various densities and sample sizes.

Thesis (Ph. D.)--Ohio State University, 2005.
Title from first page of PDF file. Document formatted into pages; contains xi, 124 p.; also includes graphics. Includes bibliographical references (p. 121-124). Available online via OhioLINK's ETD Center

Nowadays, a significant proportion of the population in the world is affected by cerebral diseases like epilepsy. In this study, frequency domain features of electroencephalography (EEG) signals were studied and analyzed, with a view being able to detect epileptic seizures more easily. The power spectrum and spectrogram were determined by using fast fourier transform (FFT) and the scalogram was found by performing continuous wavelet transform (CWT) on the testing EEG signal. In addition, two schemes, i.e. method 1 and method 2, were implemented for detecting epileptic seizures and the applicability of the two methods to electrocardiogram (ECG) signals were tested. A third method for anomaly detection in ECG signals was tested.
En signifikant del av population påverkas idag av neurala sjukdomar som epilepsi. I denna studie studerades och analyserades egenskaper inom frekvensdomänen av elektroencefalografi (EEG), med sikte på att lättare kunna upptäcka epileptiska anfall. Effektspektrumet och spektrogramet bestämdes med hjälp av en snabb fouriertransform och skalogrammet hittades genom att genomföra en kontinuerlig wavelet transform (CWT) på testsignalen från EEGsignalen. I addition till detta skapades två system, metod 1 och metod 2, som implementerades för att upptäcka epileptiska anfall. Användbarheten av dessa två metoder inom elektrokardiogramsignaler (ECG) testades. En tredje metod för anomalidetektering i ECGsignaler testades.

O objetivo deste trabalho é investigar o desempenho de estimadores baseados em momentos das famílias verossimilhança empírica generalizada (GEL) e mínimo contraste generalizado (GMC) na estimação de modelos de equilíbrio geral dinâmico e estocástico (DSGE), com enfoque na análise de robustez sob má-especificação, recorrente neste tipo de modelo. Como benchmark utilizamos método do momentos generalizado (GMM), máxima verossimilhança (ML) e inferência bayesiana (BI). Trabalhamos com um modelo de ciclos reais de negócios (RBC) que pode ser considerado o núcleo de modelos DSGE, apresenta dificuldades similares e facilita a análise dos resultados devido ao menor número de parâmetros. Verificamos por meio de experimentos de Monte Carlo se os estimadores estudados entregam resultados satisfatórios em termos de média, mediana, viés, erro quadrático médio, erro absoluto médio e verificamos a distribuição das estimativas geradas por cada estimador. Dentre os principais resultados estão: (i) o estimador verossimilhança empírica (EL) - assim como sua versão com condições de momento suavizadas (SEL) - e a inferência bayesiana (BI) foram, nesta ordem, os que obtiveram os melhores desempenhos, inclusive nos casos de especificação incorreta; (ii) os estimadores continous updating empirical likelihood (CUE), mínima distância de Hellinger (HD), exponential tilting (ET) e suas versões suavizadas apresentaram desempenho comparativo intermediário; (iii) o desempenho dos estimadores exponentially tilted empirical likelihood (ETEL), exponential tilting Hellinger distance (ETHD) e suas versões suavizadas foi bastante comprometido pela ocorrência de estimativas atípicas; (iv) as versões com e sem suavização das condições de momento dos estimadores das famílias GEL/GMC apresentaram desempenhos muito similares; (v) os estimadores GMM, principalmente no caso sobreidentificado, e ML apresentaram desempenhos consideravelmente abaixo de boa parte de seus concorrentes
The objective of this work is to investigate the performance of moment-based estimators of the generalized empirical likelihood (GEL) and generalized minimum contrast (GMC) families in the estimation of dynamic stochastic general equilibrium (DSGE) models, focusing on the robustness analysis under misspecification, recurrent in this model. As benchmark we used generalized method of moments (GMM), maximum likelihood (ML) and Bayesian inference (BI). We work with a real business cycle (RBC) model that can be considered the core of DSGE models, presents similar difficulties and facilitates the analysis of results due to lower number of parameters. We verified, via Monte Carlo experiments, whether the studied estimators presented satisfactory results in terms of mean, median, bias, mean square error, mean absolute error and we verified the distribution of the estimates generated by each estimator. Among the main results are: (i) empirical likelihood (EL) estimator - as well as its version with smoothed moment conditions (SEL) - and Bayesian inference (BI) were, in that order, the ones that obtained the best performances, even in misspecification cases; (ii) continuous updating empirical likelihood (CUE), minimum Hellinger distance (HD), exponential tilting (ET) estimators and their smoothed versions exhibit intermediate comparative performance; (iii) performance of exponentially tilted empirical likelihood (ETEL), exponential tilting Hellinger distance (ETHD) and its smoothed versions was seriously compromised by atypical estimates; (iv) smoothed and non-smoothed GEL/GMC estimators exhibit very similar performances; (v) GMM, especially in the over-identified case, and ML estimators had lower performance than their competitors

The thesis focuses on the development of statistical theory in experimental design with applications in global optimization. It consists of four parts. In the first part, a criterion of design efficiency, under model uncertainty, is studied with reference to possibly nonregular fractions of general factorials. The results are followed by a numerical study and the findings are compared with those based on other design criteria. In the second part, optimal designs are dentified using Bayesian methods. This work is linked with response surface methodology where the first step is to perform factor screening, followed by response surface exploration using different experiment plans. A Bayesian analysis approach is used that aims to achieve both goals using one experiment design. In addition we use a Bayesian design criterion, based on the priors for the analysis approach. This creates an integrated design and analysis framework. To distinguish between competing models, the HD criterion is used, which is based on the pairwise Hellinger distance between predictive densities. Mixed-level fractional factorial designs are commonly used in practice but its aliasing relations have not been studied in full rigor. These designs take the form of a product array. Aliasing patterns of mixed level factorial designs are discussed in the third part. In the fourth part, design of experiment ideas are used to introduce a new global optimization technique called SELC (Sequential Elimination of Level Combinations), which is motivated by genetic algorithms but finds the optimum faster. The two key features of the SELC algorithm, namely, forbidden array and weighted mutation, enhance the performance of the search procedure. Illustration is given with the optimization of three functions, one of which is from Shekel's family. A real example on compound optimization is also given.

Dans cette thèse, nous proposons un nouvel algorithme de séparation aveugle de sources, basé sur l'optimisation de l'information mutuelle sous contraintes. Le problème d'optimisation sous contraintes est résolu par passage au problème dual. L'estimateur proposé du gradient stochastique utilise l'estimation des densités par maximum de vraisemblance dans des modèles de lois exponentielles choisis par mi- nimisation du critère AIC. Ensuite, la méthode a été généralisée à l'ensemble des divergences entre densités de probabilité. Nous avons montré que l'algorithme uti- lisant la divergence particulière de Hellinger a de bonnes propriétés d'efficacité et robustesse en présence du bruit en comparaison avec l'information mutuelle. Dans le cadre de signaux cyclostationnaires, les méthodes précédentes de séparation ont été adaptées en utilisant des statistiques du second ordre. Nous illustrons les per- formances des algorithmes proposés pour des signaux simulés et pour des signaux réels issus de machines tournantes
In this thesis, we propose a new blind source separation algorithm based on the optimization of mutual information under constraints. The optimization problem is solved by using the dual problem. The estimator of stochastic gradient is based on the estimation of the densities by maximum likelihood method. The densities are chosen from exponential families using the AIC criterion. Then, we propose a new al- gorithm for blind source separation based on the minimization of divergences witch generalizes the Mutual Information (MI) approach. We show that the algorithm using Hellinger's divergence has better properties in terms of effciency-robustness, for noisy data. In the context of cyclostationary signals, the above methods of sepa- ration were adapted using second order statistics. We illustrate the performances of the proposed algorithms through simulations and on real rotating machine vibration signals

Le but de la these est d'effectuer l'inference statistique d'une classe generale de modeles de series temporelles non lineaires. Notre contribution consiste d'abord a determiner des conditions assurant l'existence d'une loi stationnaire, l'existence des moments de cette loi stationnaire et la forte melangeance de tels modeles. Nous etablissons ensuite les proprietes asymptotiques de l'estimateur du minimum de distance d'hellinger du parametre d'interet. La robustesse de cet estimateur est egalement envisagee. Nous examinons aussi, via la methode des moindres carres, les proprietes asymptotiques des estimateurs des coefficients des modeles autoregressifs a seuils

Ce mémoire a pour objectif de déterminer si les précipitations convectives estivales simulées par le modèle régional canadien du climat (MRCC) sont stationnaires ou non à travers le temps. Pour répondre à cette question, nous proposons une méthodologie statistique de type fréquentiste et une de type bayésien. Pour l'approche fréquentiste, nous avons utilisé le contrôle de qualité standard ainsi que le CUSUM afin de déterminer si la moyenne a augmenté à travers les années. Pour l'approche bayésienne, nous avons comparé la distribution a posteriori des précipitations dans le temps. Pour ce faire, nous avons modélisé la densité \emph{a posteriori} d'une période donnée et nous l'avons comparée à la densité a posteriori d'une autre période plus éloignée dans le temps. Pour faire la comparaison, nous avons utilisé une statistique basée sur la distance d'Hellinger, la J-divergence ainsi que la norme L2. Au cours de ce mémoire, nous avons utilisé l'ARL (longueur moyenne de la séquence) pour calibrer et pour comparer chacun de nos outils. Une grande partie de ce mémoire sera donc dédiée à l'étude de l'ARL. Une fois nos outils bien calibrés, nous avons utilisé les simulations pour les comparer. Finalement, nous avons analysé les données du MRCC pour déterminer si elles sont stationnaires ou non.
The main goal of this master's thesis is to find whether the summer convective precipitations simulated by the Canadian Regional Climate Model (CRCM) are stationary over time or not. In order to answer that question, we propose both a frequentist and Bayesian statistical methodology. For the frequentist approach, we used standard quality control and the CUSUM to determine if the mean has increased over the years. For the Bayesian approach, we compared the posterior distributions of the precipitations over time. In order to do the comparison, we used a statistic based on the Hellinger's distance, the J-divergence and the L2 norm. In this master's thesis, we used the ARL (average run length) to calibrate each of our methods. Therefore, a big part of this thesis is about studying the actual property of the ARL. Once our tools are well calibrated, we used the simulation to compare them together. Finally, we studied the data from the CRCM to decide, whether or not, the data are stationary.

碩士
淡江大學
管理科學研究所碩士班
97
Weibull distribution has been widely applied in many areas and estimations of its parameters are an important issue. Thus are let of literature. Consider the estimation problem; however, when the data is contaminated most of the proposed estimations do not possess the property of robustness. In this thesis, we apply minimum Hellinger distance estimate (MHDE) for this problem. As is well-known, MHDE provides not only the first order efficiency, but also robustness, we have also provided numerical simulations based on MLE and MHDE and its comparisons have been made. Finally, some extension of the Weibull model has also been proposed.

碩士
國立嘉義大學
應用數學系研究所
99
In environmental ecology, the ecologists often use similarity index to explore the species structure of two communities. But some ecologists think that the similarity index is not the only feasible way, using the difference between the two communities is also available to explore the of species structure. So the distance index can be derived from this idea. In this thesis, we discusses the index of Hellinger distance from the distance index, and find its estimator by the method of moments. From the simulation results can be found the estimation is overestimated, so we need to correct the estimation by Cubic Spline Interpolation, and use condition number of matrix to analyze the approach. We evaluated the performance of corrected estimation by changing the sample size and the number of shared species in the simulation result. Finally, we will use the estimation to analysis the marine organism in Haomei Village, Chiayi County, Taiwan.

碩士
國立成功大學
統計學系碩博士班
94
In molecular biology, the issue of quantifying the similarity between two biological sequences is very important. Several measures of DNA sequence dissimilarity have been developed in the past. The purpose of this thesis is twofold. Firstly, we use large scale simulation to compare the performance of Hellinger distance (HD) and symmetric Kullback-Leibler discrepancy (SK-LD). Secondly, we compare the actual CPU time and memory space required on a PC in computing HD and SK-LD. Our simulation study and real data analysis show that (1) the performance of HD is almost as good as SK-LD and (2) the computational efficiency of HD, in terms of CPU time and memory space required, is significantly better than those of SK-LD.