Dissertations / Theses on the topic 'Sequential Monte Carlo methods'
Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles
Consult the top 50 dissertations / theses for your research on the topic 'Sequential Monte Carlo methods.'
Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.
You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.
Browse dissertations / theses on a wide variety of disciplines and organise your bibliography correctly.
Fearnhead, Paul. "Sequential Monte Carlo methods in filter theory." Thesis, University of Oxford, 1998. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.299043.
Full textPunskaya, Elena. "Sequential Monte Carlo methods for digital communications." Thesis, University of Cambridge, 2003. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.620013.
Full textHenderson, Donna. "Sequential Monte Carlo methods for demographic inference." Thesis, University of Oxford, 2017. http://ora.ox.ac.uk/objects/uuid:a3516e76-ac95-4efc-9d57-53092ca4c8f3.
Full textLi, Jun Feng. "Sequential Monte Carlo methods for multiple target tracking." Thesis, University of Cambridge, 2008. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.612269.
Full textDias, Stiven Schwanz. "Collaborative emitter tracking using distributed sequential Monte Carlo methods." Instituto Tecnológico de Aeronáutica, 2014. http://www.bd.bibl.ita.br/tde_busca/arquivo.php?codArquivo=3137.
Full textCreal, Drew D. "Essays in sequential Monte Carlo methods for economics and finance /." Thesis, Connect to this title online; UW restricted, 2007. http://hdl.handle.net/1773/7444.
Full textPetrov, Nikolay. "Sequential Monte Carlo methods for extended and group object tracking." Thesis, Lancaster University, 2013. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.658087.
Full textJohansen, Adam Michael. "Some non-standard sequential Monte Carlo methods and their applications." Thesis, University of Cambridge, 2007. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.612877.
Full textArnold, Andrea. "Sequential Monte Carlo Parameter Estimation for Differential Equations." Case Western Reserve University School of Graduate Studies / OhioLINK, 2014. http://rave.ohiolink.edu/etdc/view?acc_num=case1396617699.
Full textBrasnett, Paul. "Sequential Monte-Carlo methods for object tracking and replacement in video." Thesis, University of Bristol, 2007. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.442196.
Full textKuhlenschmidt, Bernd. "On the stability of sequential Monte Carlo methods for parameter estimation." Thesis, University of Cambridge, 2015. https://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.709098.
Full textSpengler, Martin Spengler Martin. "On the applicability of sequential Monte Carlo methods to multiple target tracking /." [S.l.] : [s.n.], 2005. http://e-collection.ethbib.ethz.ch/show?type=diss&nr=16112.
Full textOzgur, Soner. "Reduced Complexity Sequential Monte Carlo Algorithms for Blind Receivers." Diss., Georgia Institute of Technology, 2006. http://hdl.handle.net/1853/10518.
Full textNoh, Seong Jin. "Sequential Monte Carlo methods for probabilistic forecasts and uncertainty assessment in hydrologic modeling." 京都大学 (Kyoto University), 2013. http://hdl.handle.net/2433/170084.
Full textSchäfer, Christian. "Monte Carlo methods for sampling high-dimensional binary vectors." Phd thesis, Université Paris Dauphine - Paris IX, 2012. http://tel.archives-ouvertes.fr/tel-00767163.
Full textEvers, Christine. "Blind dereverberation of speech from moving and stationary speakers using sequential Monte Carlo methods." Thesis, University of Edinburgh, 2010. http://hdl.handle.net/1842/4761.
Full textMiryusupov, Shohruh. "Particle methods in finance." Thesis, Paris 1, 2017. http://www.theses.fr/2017PA01E069.
Full textThe thesis introduces simulation techniques that are based on particle methods and it consists of two parts, namely rare event simulation and a homotopy transport for stochastic volatility model estimation. Particle methods, that generalize hidden Markov models, are widely used in different fields such as signal processing, biology, rare events estimation, finance, etc. There are a number of approaches that are based on Monte Carlo methods that allow to approximate a target density such as Markov Chain Monte Carlo (MCMC), sequential Monte Carlo (SMC). We apply SMC algorithms to estimate default probabilities in a stable process based intensity process to compute a credit value adjustment (CV A) with a wrong way risk (WWR). We propose a novel approach to estimate rare events, which is based on the generation of Markov Chains by simulating the Hamiltonian system. We demonstrate the properties, that allows us to have ergodic Markov Chain and show the performance of our approach on the example that we encounter in option pricing.In the second part, we aim at numerically estimating a stochastic volatility model, and consider it in the context of a transportation problem, when we would like to find "an optimal transport map" that pushes forward the measure. In a filtering context, we understand it as the transportation of particles from a prior to a posterior distribution in pseudotime. We also proposed to reweight transported particles, so as we can direct to the area, where particles with high weights are concentrated. We showed the application of our method on the example of option pricing with SteinStein stochastic volatility model and illustrated the bias and variance
De, Freitas Allan. "Sequential Monte Carlo methods for crowd and extended object tracking and dealing with tall data." Thesis, University of Sheffield, 2017. http://etheses.whiterose.ac.uk/16743/.
Full textChen, Wen-shiang. "Bayesian estimation by sequential Monte Carlo sampling for nonlinear dynamic systems." Connect to this title online, 2004. http://rave.ohiolink.edu/etdc/view?acc%5Fnum=osu1086146309.
Full textTitle from first page of PDF file. Document formatted into pages; contains xiv, 117 p. : ill. (some col.). Advisors: Bhavik R. Bakshi and Prem K. Goel, Department of Chemical Engineering. Includes bibliographical references (p. 114-117).
Skrivanek, Zachary. "Sequential Imputation and Linkage Analysis." The Ohio State University, 2002. http://rave.ohiolink.edu/etdc/view?acc_num=osu1039121487.
Full textValdes, LeRoy I. "Analysis Of Sequential Barycenter Random Probability Measures via Discrete Constructions." Thesis, University of North Texas, 2002. https://digital.library.unt.edu/ark:/67531/metadc3304/.
Full textHeng, Jeremy. "On the use of transport and optimal control methods for Monte Carlo simulation." Thesis, University of Oxford, 2016. https://ora.ox.ac.uk/objects/uuid:6cbc7690-ac54-4a6a-b235-57fa62e5b2fc.
Full textChen, Yuting. "Inférence bayésienne dans les modèles de croissance de plantes pour la prévision et la caractérisation des incertitudes." Thesis, Châtenay-Malabry, Ecole centrale de Paris, 2014. http://www.theses.fr/2014ECAP0040/document.
Full textPlant growth models aim to describe plant development and functional processes in interaction with the environment. They offer promising perspectives for many applications, such as yield prediction for decision support or virtual experimentation inthe context of breeding. This PhD focuses on the solutions to enhance plant growth model predictive capacity with an emphasis on advanced statistical methods. Our contributions can be summarized in four parts. Firstly, from a model design perspective, the Log-Normal Allocation and Senescence (LNAS) crop model is proposed. It describes only the essential ecophysiological processes for biomass budget in a probabilistic framework, so as to avoid identification problems and to accentuate uncertainty assessment in model prediction. Secondly, a thorough research is conducted regarding model parameterization. In a Bayesian framework, both Sequential Monte Carlo (SMC) methods and Markov chain Monte Carlo (MCMC) based methods are investigated to address the parameterization issues in the context of plant growth models, which are frequently characterized by nonlinear dynamics, scarce data and a large number of parameters. Particularly, whenthe prior distribution is non-informative, with the objective to put more emphasis on the observation data while preserving the robustness of Bayesian methods, an iterative version of the SMC and MCMC methods is introduced. It can be regarded as a stochastic variant of an EM type algorithm. Thirdly, a three-step data assimilation approach is proposed to address model prediction issues. The most influential parameters are first identified by global sensitivity analysis and chosen by model selection. Subsequently, the model calibration is performed with special attention paid to the uncertainty assessment. The posterior distribution obtained from this estimation step is consequently considered as prior information for the prediction step, in which a SMC-based on-line estimation method such as Convolution Particle Filtering (CPF) is employed to perform data assimilation. Both state and parameter estimates are updated with the purpose of improving theprediction accuracy and reducing the associated uncertainty. Finally, from an application point of view, the proposed methodology is implemented and evaluated with two crop models, the LNAS model for sugar beet and the STICS model for winter wheat. Some indications are also given on the experimental design to optimize the quality of predictions. The applications to real case scenarios show encouraging predictive performances and open the way to potential tools for yield prediction in agriculture
Yildirim, Berkin. "A Comparative Evaluation Of Conventional And Particle Filter Based Radar Target Tracking." Master's thesis, METU, 2007. http://etd.lib.metu.edu.tr/upload/12609043/index.pdf.
Full textGu, Feng. "Dynamic Data Driven Application System for Wildfire Spread Simulation." Digital Archive @ GSU, 2010. http://digitalarchive.gsu.edu/cs_diss/57.
Full textAl-Saadony, Muhannad. "Bayesian stochastic differential equation modelling with application to finance." Thesis, University of Plymouth, 2013. http://hdl.handle.net/10026.1/1530.
Full textHol, Jeroen D. "Resampling in particle filters." Thesis, Linköping University, Department of Electrical Engineering, 2004. http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-2366.
Full textIn this report a comparison is made between four frequently encountered resampling algorithms for particle filters. A theoretical framework is introduced to be able to understand and explain the differences between the resampling algorithms. This facilitates a comparison of the algorithms based on resampling quality and on computational complexity. Using extensive Monte Carlo simulations the theoretical results are verified. It is found that systematic resampling is favourable, both in resampling quality and computational complexity.
Johansson, Anders. "Acoustic Sound Source Localisation and Tracking : in Indoor Environments." Doctoral thesis, Blekinge Tekniska Högskola [bth.se], School of Engineering - Dept. of Signal Processing, 2008. http://urn.kb.se/resolve?urn=urn:nbn:se:bth-00401.
Full textMontazeri, Shahtori Narges. "Quantifying the impact of contact tracing on ebola spreading." Thesis, Kansas State University, 2016. http://hdl.handle.net/2097/34540.
Full textDepartment of Electrical and Computer Engineering
Faryad Darabi Sahneh
Recent experience of Ebola outbreak of 2014 highlighted the importance of immediate response to impede Ebola transmission at its very early stage. To this aim, efficient and effective allocation of limited resources is crucial. Among standard interventions is the practice of following up with physical contacts of individuals diagnosed with Ebola virus disease -- known as contact tracing. In an effort to objectively understand the effect of possible contact tracing protocols, we explicitly develop a model of Ebola transmission incorporating contact tracing. Our modeling framework has several features to suit early–stage Ebola transmission: 1) the network model is patient–centric because when number of infected cases are small only the myopic networks of infected individuals matter and the rest of possible social contacts are irrelevant, 2) the Ebola disease model is individual–based and stochastic because at the early stages of spread, random fluctuations are significant and must be captured appropriately, 3) the contact tracing model is parameterizable to analyze the impact of critical aspects of contact tracing protocols. Notably, we propose an activity driven network approach to contact tracing, and develop a Monte-Carlo method to compute the basic reproductive number of the disease spread in different scenarios. Exhaustive simulation experiments suggest that while contact tracing is important in stopping the Ebola spread, it does not need to be done too urgently. This result is due to rather long incubation period of Ebola disease infection. However, immediate hospitalization of infected cases is crucial and requires the most attention and resource allocation. Moreover, to investigate the impact of mitigation strategies in the 2014 Ebola outbreak, we consider reported data in Guinea, one the three West Africa countries that had experienced the Ebola virus disease outbreak. We formulate a multivariate sequential Monte Carlo filter that utilizes mechanistic models for Ebola virus propagation to simultaneously estimate the disease progression states and the model parameters according to reported incidence data streams. This method has the advantage of performing the inference online as the new data becomes available and estimating the evolution of the basic reproductive ratio R₀(t) throughout the Ebola outbreak. Our analysis identifies a peak in the basic reproductive ratio close to the time of Ebola cases reports in Europe and the USA.
Allaya, Mouhamad M. "Méthodes de Monte-Carlo EM et approximations particulaires : application à la calibration d'un modèle de volatilité stochastique." Thesis, Paris 1, 2013. http://www.theses.fr/2013PA010072/document.
Full textThis thesis pursues a double perspective in the joint use of sequential Monte Carlo methods (SMC) and the Expectation-Maximization algorithm (EM) under hidden Markov models having a Markov dependence structure of order grater than one in the unobserved component signal. Firstly, we begin with a brief description of the theoretical basis of both statistical concepts through Chapters 1 and 2 that are devoted. In a second hand, we focus on the simultaneous implementation of both concepts in Chapter 3 in the usual setting where the dependence structure is of order 1. The contribution of SMC methods in this work lies in their ability to effectively approximate any bounded conditional functional in particular, those of filtering and smoothing quantities in a non-linear and non-Gaussian settings. The EM algorithm is itself motivated by the presence of both observable and unobservable ( or partially observed) variables in Hidden Markov Models and particularly the stochastic volatility models in study. Having presented the EM algorithm as well as the SMC methods and some of their properties in Chapters 1 and 2 respectively, we illustrate these two statistical tools through the calibration of a stochastic volatility model. This application is clone for exchange rates and for some stock indexes in Chapter 3. We conclude this chapter on a slight departure from canonical stochastic volatility model as well Monte Carlo simulations on the resulting model. Finally, we strive in Chapters 4 and 5 to provide the theoretical and practical foundation of sequential Monte Carlo methods extension including particle filtering and smoothing when the Markov structure is more pronounced. As an illustration, we give the example of a degenerate stochastic volatility model whose approximation has such a dependence property
Nguyen, Thi Ngoc Minh. "Lissage de modèles linéaires et gaussiens à régimes markoviens. : Applications à la modélisation de marchés de matières premières." Electronic Thesis or Diss., Paris, ENST, 2016. https://pastel.hal.science/tel-03689917.
Full textThe work presented in this thesis focuses on Sequential Monte Carlo methods for general state space models. These procedures are used to approximate any sequence of conditional distributions of some hidden state variables given a set observations. We are particularly interested in two-filter based methods to estimate the marginal smoothing distribution of a state variable given past and future observations. We first prove convergence results for the estimators produced by all two-filter based Sequential Monte Carlo methods under weak assumptions on the hidden Markov model. Under additional strong mixing assumptions which are more restrictive but still standard in this context, we show that the constants of the deviation inequalities and the asymptotic variances are uniformly bounded in time. Then, a Conditionally Linear and Gaussian hidden Markov model is introduced to explain commodity markets regime shifts. The markets are modeled by extending the Gibson-Schwartz model on the spot price and the convenience yield. It is assumed that the dynamics of these variables is controlled by a discrete hidden Markov chain identifying the regimes. Each regime corresponds to a set of parameters driving the state space model dynamics. We propose a Monte Carlo Expectation Maximization algorithm to estimate the parameters of the model based on a two-filter method to approximate the intermediate quantity. This algorithm uses explicit marginalization (Rao Blackwellisation) of the linear states to reduce Monte Carlo variance. The algorithm performance is illustrated using Chicago Mercantile Exchange (CME) crude oil data
Chen, Xi. "Sequential Monte Carlo radio-frequency tomographic tracking." Thesis, McGill University, 2011. http://digitool.Library.McGill.CA:80/R/?func=dbin-jump-full&object_id=104844.
Full textSuivi de cible dans la zone à petite échelle en utilisant les réseaux de capteurs sans fil est une technique qui peut être largement utilisé dans des applications telles que le sauvetage d'urgence après un tremblement de terre, ou la protection de la sécurité dans un bâtiment. Beaucoup de systèmes de poursuite de cibles nécessitent un dispositif électrique réalisée par l'objectif de faire rapport de ses localisation instantanée et le statut. L'inconvénient rend ces systèmes ne conviennent pas pour des applications nombreuses interventions d'urgence, dispositif sans systèmes de suivi qui ne les périphériques connectés sur les objectifs sont nécessaires. Radio-Fréquence (RF) suivi tomographique est l'une des techniques dispositif de suivi-libres. Il s'agit d'un processus de suivi des cibles mobiles en analysant l'évolution de l'atténuation dans les transmissions sans fil. La cible peut être suivi dans la zone de réseau de capteurs, tandis que les appareils électriques ne doivent être effectués. Cependant, certaines approches précédentes dispositif de suivi-libre nécessite une phase d'entraînement avant de suivi, ce qui prend beaucoup de temps. Autres effectuer un suivi par scarification partie de précision de l'estimation.Dans cette thèse, nous proposons une nouvelle Monte Carlo séquentielles (SMC) algorithme de suivi RF tomographique. Il peut suivre une cible unique sans formation du système dans un réseau de capteurs sans fil. L'algorithme de filtrage particulaire adopte la méthode pour estimer la position cible et intègre en ligne Expectation Maximization (EM) pour estimer les paramètres du modèle. Sur la base de mesures expérimentales, le travail introduit également un modèle de mesure de roman pour l'atténuation provoquée par une cible pour améliorer la précision d'estimation. La performance de l'algorithme est évaluée par des simulations numériques et expériences sur le terrain avec un réseau de capteurs sans fil banc d'essai. Les deux résultats simulés et expérimentaux démontrent que notre travail surpasse précédente approche RF suivi tomographique pour le suivi de cible unique.
Fallon, M. F. "Acoustic source tracking using sequential Monte Carlo." Thesis, University of Cambridge, 2008. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.598928.
Full textZhou, Yan. "Bayesian model comparison via sequential Monte Carlo." Thesis, University of Warwick, 2014. http://wrap.warwick.ac.uk/62064/.
Full textKostov, Svetoslav. "Hamiltonian sequential Monte Carlo and normalizing constants." Thesis, University of Bristol, 2016. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.702941.
Full textMartin, James Stewart. "Some new results in sequential Monte Carlo." Thesis, Imperial College London, 2012. http://hdl.handle.net/10044/1/11655.
Full textPace, Michele. "Stochastic models and methods for multi-object tracking." Phd thesis, Université Sciences et Technologies - Bordeaux I, 2011. http://tel.archives-ouvertes.fr/tel-00651396.
Full textJewell, Sean William. "Divide and conquer sequential Monte Carlo for phylogenetics." Thesis, University of British Columbia, 2015. http://hdl.handle.net/2429/54514.
Full textScience, Faculty of
Statistics, Department of
Graduate
Dickinson, Andrew Samuel. "On the analysis of Monte Carlo and quasi-Monte Carlo methods." Thesis, University of Oxford, 2004. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.409715.
Full textGöncü, Ahmet. "Monte Carlo and quasi-Monte Carlo methods in pricing financial derivatives." Tallahassee, Florida : Florida State University, 2009. http://etd.lib.fsu.edu/theses/available/etd-06232009-140439/.
Full textAdvisor: Giray Ökten, Florida State University, College of Arts and Sciences, Dept. of Mathematics. Title and description from dissertation home page (viewed on Oct. 5, 2009). Document formatted into pages; contains x, 105 pages. Includes bibliographical references.
Taft, Keith. "Monte Carlo methods for radiosity." Thesis, University of Liverpool, 2002. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.272796.
Full textStrathmann, Heiko. "Kernel methods for Monte Carlo." Thesis, University College London (University of London), 2018. http://discovery.ucl.ac.uk/10040707/.
Full textMaire, Florian. "Détection et classification de cibles multispectrales dans l'infrarouge." Thesis, Evry, Institut national des télécommunications, 2014. http://www.theses.fr/2014TELE0007/document.
Full textSurveillance systems should be able to detect potential threats far ahead in order to put forward a defence strategy. In this context, detection and recognition methods making use of multispectral infrared images should cope with low resolution signals and handle both spectral and spatial variability of the targets. We introduce in this PhD thesis a novel statistical methodology to perform aircraft detection and classification which take into account these constraints. We first propose an anomaly detection method designed for multispectral images, which combines a spectral likelihood measure and a level set study of the image Mahalanobis transform. This technique allows to identify images which feature an anomaly without any prior knowledge on the target. In a second time, these images are used as realizations of a statistical model in which the observations are described as random spectral and spatial deformation of prototype shapes. The model inference, and in particular the prototype shape estimation, is achieved through a novel unsupervised sequential learning algorithm designed for missing data models. This model allows to propose a classification algorithm based on maximum a posteriori probability Promising results in detection as well as in classification, justify the growing interest surrounding the development of multispectral imaging devices. These methods have also allowed us to identify the optimal infrared spectral band regroupments regarding the low resolution aircraft IRS detection and classification
Jonnavithula, Annapoorani. "Composite system reliability evaluation using sequential Monte Carlo simulation." Thesis, National Library of Canada = Bibliothèque nationale du Canada, 1997. http://www.collectionscanada.ca/obj/s4/f2/dsk3/ftp05/nq23941.pdf.
Full textDi, Caro Gianni. "Ant colony optimization and its application to adaptive routing in telecommunication networks." Doctoral thesis, Universite Libre de Bruxelles, 2004. http://hdl.handle.net/2013/ULB-DIPOT:oai:dipot.ulb.ac.be:2013/211149.
Full textThe simultaneous presence of these and other fascinating and unique characteristics have made ant societies an attractive and inspiring model for building new algorithms and new multi-agent systems. In the last decade, ant societies have been taken as a reference for an ever growing body of scientific work, mostly in the fields of robotics, operations research, and telecommunications.
Among the different works inspired by ant colonies, the Ant Colony Optimization metaheuristic (ACO) is probably the most successful and popular one. The ACO metaheuristic is a multi-agent framework for combinatorial optimization whose main components are: a set of ant-like agents, the use of memory and of stochastic decisions, and strategies of collective and distributed learning.
It finds its roots in the experimental observation of a specific foraging behavior of some ant colonies that, under appropriate conditions, are able to select the shortest path among few possible paths connecting their nest to a food site. The pheromone, a volatile chemical substance laid on the ground by the ants while walking and affecting in turn their moving decisions according to its local intensity, is the mediator of this behavior.
All the elements playing an essential role in the ant colony foraging behavior were understood, thoroughly reverse-engineered and put to work to solve problems of combinatorial optimization by Marco Dorigo and his co-workers at the beginning of the 1990's.
From that moment on it has been a flourishing of new combinatorial optimization algorithms designed after the first algorithms of Dorigo's et al. and of related scientific events.
In 1999 the ACO metaheuristic was defined by Dorigo, Di Caro and Gambardella with the purpose of providing a common framework for describing and analyzing all these algorithms inspired by the same ant colony behavior and by the same common process of reverse-engineering of this behavior. Therefore, the ACO metaheuristic was defined a posteriori, as the result of a synthesis effort effectuated on the study of the characteristics of all these ant-inspired algorithms and on the abstraction of their common traits.
The ACO's synthesis was also motivated by the usually good performance shown by the algorithms (e.g. for several important combinatorial problems like the quadratic assignment, vehicle routing and job shop scheduling, ACO implementations have outperformed state-of-the-art algorithms).
The definition and study of the ACO metaheuristic is one of the two fundamental goals of the thesis. The other one, strictly related to this former one, consists in the design, implementation, and testing of ACO instances for problems of adaptive routing in telecommunication networks.
This thesis is an in-depth journey through the ACO metaheuristic, during which we have (re)defined ACO and tried to get a clear understanding of its potentialities, limits, and relationships with other frameworks and with its biological background. The thesis takes into account all the developments that have followed the original 1999's definition, and provides a formal and comprehensive systematization of the subject, as well as an up-to-date and quite comprehensive review of current applications. We have also identified in dynamic problems in telecommunication networks the most appropriate domain of application for the ACO ideas. According to this understanding, in the most applicative part of the thesis we have focused on problems of adaptive routing in networks and we have developed and tested four new algorithms.
Adopting an original point of view with respect to the way ACO was firstly defined (but maintaining full conceptual and terminological consistency), ACO is here defined and mainly discussed in the terms of sequential decision processes and Monte Carlo sampling and learning.
More precisely, ACO is characterized as a policy search strategy aimed at learning the distributed parameters (called pheromone variables in accordance with the biological metaphor) of the stochastic decision policy which is used by so-called ant agents to generate solutions. Each ant represents in practice an independent sequential decision process aimed at constructing a possibly feasible solution for the optimization problem at hand by using only information local to the decision step.
Ants are repeatedly and concurrently generated in order to sample the solution set according to the current policy. The outcomes of the generated solutions are used to partially evaluate the current policy, spot the most promising search areas, and update the policy parameters in order to possibly focus the search in those promising areas while keeping a satisfactory level of overall exploration.
This way of looking at ACO has facilitated to disclose the strict relationships between ACO and other well-known frameworks, like dynamic programming, Markov and non-Markov decision processes, and reinforcement learning. In turn, this has favored reasoning on the general properties of ACO in terms of amount of complete state information which is used by the ACO's ants to take optimized decisions and to encode in pheromone variables memory of both the decisions that belonged to the sampled solutions and their quality.
The ACO's biological context of inspiration is fully acknowledged in the thesis. We report with extensive discussions on the shortest path behaviors of ant colonies and on the identification and analysis of the few nonlinear dynamics that are at the very core of self-organized behaviors in both the ants and other societal organizations. We discuss these dynamics in the general framework of stigmergic modeling, based on asynchronous environment-mediated communication protocols, and (pheromone) variables priming coordinated responses of a number of ``cheap' and concurrent agents.
The second half of the thesis is devoted to the study of the application of ACO to problems of online routing in telecommunication networks. This class of problems has been identified in the thesis as the most appropriate for the application of the multi-agent, distributed, and adaptive nature of the ACO architecture.
Four novel ACO algorithms for problems of adaptive routing in telecommunication networks are throughly described. The four algorithms cover a wide spectrum of possible types of network: two of them deliver best-effort traffic in wired IP networks, one is intended for quality-of-service (QoS) traffic in ATM networks, and the fourth is for best-effort traffic in mobile ad hoc networks.
The two algorithms for wired IP networks have been extensively tested by simulation studies and compared to state-of-the-art algorithms for a wide set of reference scenarios. The algorithm for mobile ad hoc networks is still under development, but quite extensive results and comparisons with a popular state-of-the-art algorithm are reported. No results are reported for the algorithm for QoS, which has not been fully tested. The observed experimental performance is excellent, especially for the case of wired IP networks: our algorithms always perform comparably or much better than the state-of-the-art competitors.
In the thesis we try to understand the rationale behind the brilliant performance obtained and the good level of popularity reached by our algorithms. More in general, we discuss the reasons of the general efficacy of the ACO approach for network routing problems compared to the characteristics of more classical approaches. Moving further, we also informally define Ant Colony Routing (ACR), a multi-agent framework explicitly integrating learning components into the ACO's design in order to define a general and in a sense futuristic architecture for autonomic network control.
Most of the material of the thesis comes from a re-elaboration of material co-authored and published in a number of books, journal papers, conference proceedings, and technical reports. The detailed list of references is provided in the Introduction.
Doctorat en sciences appliquées
info:eu-repo/semantics/nonPublished
Mandreoli, Lorenzo. "Density based Kinetic Monte Carlo Methods." [S.l.] : [s.n.], 2005. http://deposit.ddb.de/cgi-bin/dokserv?idn=975329111.
Full textZhang, Kai. "Monte Carlo methods in derivative modelling." Thesis, University of Warwick, 2011. http://wrap.warwick.ac.uk/35689/.
Full textMaggio, Emilio. "Monte Carlo methods for visual tracking." Thesis, Queen Mary, University of London, 2008. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.497791.
Full textCrosby, Richard S. "Monte Carlo methods for lattice fields." Thesis, Massachusetts Institute of Technology, 1989. http://hdl.handle.net/1721.1/77699.
Full textWang, Junxiong. "Option Pricing Using Monte Carlo Methods." Digital WPI, 2011. https://digitalcommons.wpi.edu/etd-theses/331.
Full text