Dissertations / Theses: 'Multi-layer neural networks'

7

Wang, Hao. "A new scheme for training ReLU-based multi-layer feedforward neural networks." Thesis, KTH, Skolan för datavetenskap och kommunikation (CSC), 2017. http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-217384.

Full text

Abstract:

A new scheme for training Rectified Linear Unit (ReLU) based feedforward neural networks is examined in this thesis. The project starts with the row-by-row updating strategy designed for Single-hidden Layer Feedforward neural Networks (SLFNs). This strategy exploits the properties held by ReLUs and optimizes each row in the input weight matrix individually, under the common optimization scheme. Then the Direct Updating Strategy (DUS), which has two different versions: Vector-Based Method (VBM) and Matrix-Based Method (MBM), is proposed to optimize the input weight matrix as a whole. Finally DUS is extended to Multi-hidden Layer Feedforward neural Networks (MLFNs). Since the extension, for general ReLU-based MLFNs, faces an initialization dilemma, a special structure MLFN is presented. Verification experiments are conducted on six benchmark multi-class classification datasets. The results confirm that MBM algorithm for SLFNs improves the performance of neural networks, compared to its competitor, regularized extreme learning machine. For most datasets involved, MLFNs with the proposed special structure perform better when adding extra hidden layers. Ett nytt schema för träning av rektifierad linjär enhet (ReLU)-baserade och framkopplade neurala nätverk undersöks i denna avhandling. Projektet börjar med en rad-för-rad-uppdateringsstrategi designad för framkopplade neurala nätverk med ett dolt lager (SLFNs). Denna strategi utnyttjar egenskaper i ReLUs och optimerar varje rad i inmatningsviktmatrisen individuellt, enligt en gemensam optimeringsmetod. Därefter föreslås den direkta uppdateringsstrategin (DUS), som har två olika versioner: vektorbaserad metod (VBM) respektive matrisbaserad metod (MBM), för att optimera ingångsviktmatrisen som helhet. Slutli- gen utvidgas DUS till framkopplade neurala nätverk med flera lager (MLFN). Eftersom utvidgningen för generella ReLU-baserade MLFN står inför ett initieringsdilemma presenteras därför en MLFN med en speciell struktur. Verifieringsexperiment utförs på sex datamängder för klassificering av flera klasser. Resultaten bekräftar att MBM-algoritmen för SLFN förbättrar prestanda hos neurala nätverk, jämfört med konkurrenten, den regulariserade extrema inlärningsmaskinen. För de flesta använda dataset, fungerar MLFNs med den föreslagna speciella strukturen bättre när man lägger till extra dolda lager.

APA, Harvard, Vancouver, ISO, and other styles

8

Penny, William Douglas. "The storage, training and generalization properties of multi-layer logical neural networks." Thesis, Brunel University, 1993. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.331996.

Full text

APA, Harvard, Vancouver, ISO, and other styles

9

McGarry, Kenneth J. "Rule extraction and knowledge transfer from radial basis function neural networks." Thesis, University of Sunderland, 2002. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.391744.

Full text

APA, Harvard, Vancouver, ISO, and other styles

10

Krasniewicz, Jan A. "The application and analysis of genetic algorithms to discover topological free parameters in multi-layer perceptions." Thesis, Birmingham City University, 2000. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.367474.

Full text

APA, Harvard, Vancouver, ISO, and other styles

11

Golmohammadi, Davood. "A decision making model for evaluating suppliers by multi-layer feed forward neural networks." Morgantown, W. Va. : [West Virginia University Libraries], 2007. https://eidr.wvu.edu/etd/documentdata.eTD?documentid=5455.

Full text

Abstract:

Thesis (Ph. D.)--West Virginia University, 2007. Title from document title page. Document formatted into pages; contains xiii, 200 p. : ill. (some col.). Includes abstract. Includes bibliographical references (p. 143-151).

APA, Harvard, Vancouver, ISO, and other styles

12

Aung, Min Soe Hane. "Multi layer perception and conic section function neural networks applied to breast cancer risk factors including asymmetry." Thesis, University of Liverpool, 2003. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.400194.

Full text

APA, Harvard, Vancouver, ISO, and other styles

13

Valmiki, Geetha Charan, and Akhil Santosh Tirupathi. "Performance Analysis Between Combinations of Optimization Algorithms and Activation Functions used in Multi-Layer Perceptron Neural Networks." Thesis, Blekinge Tekniska Högskola, Institutionen för datavetenskap, 2020. http://urn.kb.se/resolve?urn=urn:nbn:se:bth-20204.

Full text

Abstract:

Background:- Artificial Neural networks are motivated from biological nervous system and can be used for classification and forecasting the data. Each neural node contains activation function could be used for solving non-linear problems and optimization function to minimize the loss and give more accurate results. Neural networks are bustling in the field of machine learning, which inspired this study to analyse the performance variation based on the use of different combinations of the activation functions and optimization algorithms in terms of accuracy results and metrics recall and impact of data-set features on the performance of the neural networks. Objectives:- This study deals with an experiment to analyse the performance of the combinations are performing well and giving more results and to see impact of the feature segregation from data-set on the neural networks model performance. Methods:- The process involve the gathering of the data-sets, activation functions and optimization algorithm. Execute the network model using 7X5 different combinations of activation functions and optimization algorithm and analyse the performance of the neural networks. These models are tested upon the same data-set with some of the discarded features to know the effect on the performance of the neural networks. Results:- All the metrics for evaluating the neural networks presented in separate table and graphs are used to show growth and fall down of the activation function when associating with different optimization function. Impact of the individual feature on the performance of the neural network is also represented. Conclusions:- Out of 35 combinations, combinations made from optimizations algorithms Adam,RMSprop and Adagrad and activation functions ReLU,Softplus,Tanh Sigmoid and Hard_Sigmoid are selected based on the performance evaluation and data has impact on the performance of the combinations of the algorithms and activation functions which is also evaluated based on the experimentation. Individual features have their corresponding effect on the neural network.

APA, Harvard, Vancouver, ISO, and other styles

14

Coughlin, Michael J., and n/a. "Calibration of Two Dimensional Saccadic Electro-Oculograms Using Artificial Neural Networks." Griffith University. School of Applied Psychology, 2003. http://www4.gu.edu.au:8080/adt-root/public/adt-QGU20030409.110949.

Full text

Abstract:

The electro-oculogram (EOG) is the most widely used technique for recording eye movements in clinical settings. It is inexpensive, practical, and non-invasive. Use of EOG is usually restricted to horizontal recordings as vertical EOG contains eyelid artefact (Oster & Stern, 1980) and blinks. The ability to analyse two dimensional (2D) eye movements may provide additional diagnostic information on pathologies, and further insights into the nature of brain functioning. Simultaneous recording of both horizontal and vertical EOG also introduces other difficulties into calibration of the eye movements, such as different gains in the two signals, and misalignment of electrodes producing crosstalk. These transformations of the signals create problems in relating the two dimensional EOG to actual rotations of the eyes. The application of an artificial neural network (ANN) that could map 2D recordings into 2D eye positions would overcome this problem and improve the utility of EOG. To determine whether ANNs are capable of correctly calibrating the saccadic eye movement data from 2D EOG (i.e. performing the necessary inverse transformation), the ANNs were first tested on data generated from mathematical models of saccadic eye movements. Multi-layer perceptrons (MLPs) with non-linear activation functions and trained with back propagation proved to be capable of calibrating simulated EOG data to a mean accuracy of 0.33° of visual angle (SE = 0.01). Linear perceptrons (LPs) were only nearly half as accurate. For five subjects performing a saccadic eye movement task in the upper right quadrant of the visual field, the mean accuracy provided by the MLPs was 1.07° of visual angle (SE = 0.01) for EOG data, and 0.95° of visual angle (SE = 0.03) for infrared limbus reflection (IRIS®) data. MLPs enabled calibration of 2D saccadic EOG to an accuracy not significantly different to that obtained with the infrared limbus tracking data.

APA, Harvard, Vancouver, ISO, and other styles

15

Coughlin, Michael J. "Calibration of Two Dimensional Saccadic Electro-Oculograms Using Artificial Neural Networks." Thesis, Griffith University, 2003. http://hdl.handle.net/10072/365854.

Full text

Abstract:

The electro-oculogram (EOG) is the most widely used technique for recording eye movements in clinical settings. It is inexpensive, practical, and non-invasive. Use of EOG is usually restricted to horizontal recordings as vertical EOG contains eyelid artefact (Oster & Stern, 1980) and blinks. The ability to analyse two dimensional (2D) eye movements may provide additional diagnostic information on pathologies, and further insights into the nature of brain functioning. Simultaneous recording of both horizontal and vertical EOG also introduces other difficulties into calibration of the eye movements, such as different gains in the two signals, and misalignment of electrodes producing crosstalk. These transformations of the signals create problems in relating the two dimensional EOG to actual rotations of the eyes. The application of an artificial neural network (ANN) that could map 2D recordings into 2D eye positions would overcome this problem and improve the utility of EOG. To determine whether ANNs are capable of correctly calibrating the saccadic eye movement data from 2D EOG (i.e. performing the necessary inverse transformation), the ANNs were first tested on data generated from mathematical models of saccadic eye movements. Multi-layer perceptrons (MLPs) with non-linear activation functions and trained with back propagation proved to be capable of calibrating simulated EOG data to a mean accuracy of 0.33° of visual angle (SE = 0.01). Linear perceptrons (LPs) were only nearly half as accurate. For five subjects performing a saccadic eye movement task in the upper right quadrant of the visual field, the mean accuracy provided by the MLPs was 1.07° of visual angle (SE = 0.01) for EOG data, and 0.95° of visual angle (SE = 0.03) for infrared limbus reflection (IRIS®) data. MLPs enabled calibration of 2D saccadic EOG to an accuracy not significantly different to that obtained with the infrared limbus tracking data. Thesis (PhD Doctorate) Doctor of Philosophy (PhD) School of Applied Psychology Griffith Health Full Text

APA, Harvard, Vancouver, ISO, and other styles

16

Tran-Canh, Dung. "Simulating the flow of some non-Newtonian fluids with neural-like networks and stochastic processes." University of Southern Queensland, Faculty of Engineering and Surveying, 2004. http://eprints.usq.edu.au/archive/00001518/.

Full text

Abstract:

The thesis reports a contribution to the development of neural-like network- based element-free methods for the numerical simulation of some non-Newtonian fluid flow problems. The numerical approximation of functions and solution of the governing partial differential equations are mainly based on radial basis function networks. The resultant micro-macroscopic approaches do not require any element-based discretisation and only rely on a set of unstructured collocation points and hence are truly meshless or element-free. The development of the present methods begins with the use of the multi-layer perceptron networks (MLPNs) and radial basis function networks (RBFNs) to effectively eliminate the volume integrals in the integral formulation of fluid flow problems. An adaptive velocity gradient domain decomposition (AVGDD) scheme is incorporated into the computational algorithm. As a result, an improved feed forward neural network boundary-element-only method (FFNN- BEM) is created and verified. The present FFNN-BEM successfully simulates the flow of several Generalised Newtonian Fluids (GNFs), including the Carreau, Power-law and Cross models. To the best of the author's knowledge, the present FFNN-BEM is the first to achieve convergence for difficult flow situations when the power-law indices are very small (as small as 0.2). Although some elements are still used to discretise the governing equations, but only on the boundary of the analysis domain, the experience gained in the development of element-free approximation in the domain provides valuable skills for the progress towards an element-free approach. A least squares collocation RBFN-based mesh-free method is then developed for solving the governing PDEs. This method is coupled with the stochastic simulation technique (SST), forming the mesoscopic approach for analyzing viscoelastic flid flows. The velocity field is computed from the RBFN-based mesh-free method (macroscopic component) and the stress is determined by the SST (microscopic component). Thus the SST removes a limitation in traditional macroscopic approaches since closed form constitutive equations are not necessary in the SST. In this mesh-free method, each of the unknowns in the conservation equations is represented by a linear combination of weighted radial basis functions and hence the unknowns are converted from physical variables (e.g. velocity, stresses, etc) into network weights through the application of the general linear least squares principle and point collocation procedure. Depending on the type of RBFs used, a number of parameters will influence the performance of the method. These parameters include the centres in the case of thin plate spline RBFNs (TPS-RBFNs), and the centres and the widths in the case of multi-quadric RBFNs (MQ-RBFNs). A further improvement of the approach is achieved when the Eulerian SST is formulated via Brownian configuration fields (BCF) in place of the Lagrangian SST. The SST is made more efficient with the inclusion of the control variate variance reduction scheme, which allows for a reduction of the number of dumbbells used to model the fluid. A highly parallelised algorithm, at both macro and micro levels, incorporating a domain decomposition technique, is implemented to handle larger problems. The approach is verified and used to simulate the flow of several model dilute polymeric fluids (the Hookean, FENE and FENE-P models) in simple as well as non-trivial geometries, including shear flows (transient Couette, Poiseuille flows)), elongational flows (4:1 and 10:1 abrupt contraction flows) and lid-driven cavity flows.

APA, Harvard, Vancouver, ISO, and other styles

17

Ferreira, Ana Paula Carvalho da Silva. "Identificação do funcional da resposta aeroelástica via redes neurais artificiais." Universidade de São Paulo, 2005. http://www.teses.usp.br/teses/disponiveis/18/18135/tde-04022016-095107/.

Full text

Abstract:

Identificação e predição do comportamento aeroelástico representa um grande desafio para a análise e controle de fenômenos aeroelásticos adversos. A modelagem aeroelástica requer informações tanto sobre a dinâmica estrutural quanto sobre o comportamento aerodinâmico não estacionário. No entanto, a maioria das metodologias disponíveis atualmente são baseadas no desacoplamento entre o modelo estrutural e o modelo aerodinâmico não estacionário. Conseqüentemente, métodos alternativos são bem vindos na área de pesquisa aerolástica. Entre os métodos alternativos está o funcional multicamada, que fornece uma rigorosa representação matemática apropriada para modelagem aeroelástica e pode ser obtido através de redes neurais artificiais. Esse trabalho apresenta uma aplicação desse método, consistindo de um procedimento de identificação baseado em redes neurais artificiais que representam o funcional da resposta aeroelástica. O modelo neural foi treinado usando o algoritmo de Levenberg-Marquardt, o qual tem sido considerado um método de otimização muito eficiente. Ele combina a garantia de convergência do método do gradiente e o alto desempenho do método de Newton, sem a necessidade de calcular as derivadas de segunda ordem. Um modelo de asa ensaiado em túnel de vento foi usado para fornecer a resposta aeroelástica. A asa foi fixada a uma mesa giratória e um motor elétrico lhe fornecia o movimento de incidência. Essa representação aeroelástica funcional foi testada para diversas condições operacionais do túnel de vento. Os resultados mostraram que o uso de redes neurais na identificação da resposta aeroelástica é um método alternativo promissor, o qual permite uma rápida avaliação da resposta aerolástica do modelo. Identification and prediction of aeroelastic behavior presents a significant challenge for the analysis and control of adverse aeroelastic phenomena. Aeroelastic modeling requires information from both structural dynamics and unsteady aerodynamic behavior. However, the majority of methodologies available today are based on the decoupling of structural model from the unsteady aerodynamic model. Therefore, alternative methods are mostly welcome in the aeroelastic research field. Among the alternative methods there is the multi-layer functional (MLF), that allows a rigorous mathematical framework appropriate for aeroelastic modeling and can be realized by means of artificial neural networks. This work presents an identification procedure based on artificial neural networks to represent the motion-induced aeroelastic response functional. The neural network model has been trained using the Levenberg-Marquardt algorithm that has been considered a very efficient optimization method. It combines the guaranteed convergence of steepest descent and the higher performance of the Newton\'s method, without the necessity of second derivatives calculation. A wind tunnel aeroelastic wing model has been used to provide motion-induced aeroelastic responses. The wing has been fixed to a turntable, and an electrical motor provides the incidence motion to the wing. This aeroelastic functional representation is then tested for a range of the wind tunnel model operational boundaries. The results showed that the use of neural networks in the aeroelastic response identification is a promising alternative method, which allows fast evaluation of aeroelastic response model.

APA, Harvard, Vancouver, ISO, and other styles

18

Andrade, Kléber de Oliveira. "Sistema neural reativo para o estacionamento paralelo com uma única manobra em veículos de passeio." Universidade de São Paulo, 2011. http://www.teses.usp.br/teses/disponiveis/18/18149/tde-21112011-131734/.

Full text

Abstract:

Graças aos avanços tecnológicos nas áreas da computação, eletrônica embarcada e mecatrônica a robótica está cada vez mais presente no cotidiano da pessoas. Nessas últimas décadas, uma infinidade de ferramentas e métodos foram desenvolvidos no campo da Robótica Móvel. Um exemplo disso são os sistemas inteligentes embarcados nos veículos de passeio. Tais sistemas auxiliam na condução através de sensores que recebem informações do ambiente e algoritmos que analisam os dados e tomam decisões para realizar uma determinada tarefa, como por exemplo estacionar um carro. Este trabalho tem por objetivo apresentar estudos realizados no desenvolvimento de um controlador inteligente capaz de estacionar um veículo simulado em vagas paralelas, na qual seja possível entrar com uma única manobra. Para isso, foi necessário realizar estudos envolvendo a modelagem de ambientes, cinemática veicular e sensores, os quais foram implementados em um ambiente de simulação desenvolvido em C# com o Visual Studio 2008. Em seguida é realizado um estudo sobre as três etapas do estacionamento, que consistem em procurar uma vaga, posicionar o veículo e manobrá-lo. Para realizar a manobra foi adotada a trajetória em S desenvolvida e muito utilizada em outros trabalhos encontrados na literatura da área. A manobra consiste em posicionar corretamente duas circunferências com um raio de esterçamento do veículo. Sendo assim, foi utilizado um controlador robusto baseado em aprendizado supervisionado utilizando Redes Neurais Artificiais (RNA), pois esta abordagem apresenta grande robustez com relação à presença de ruídos no sistema. Este controlador recebe dados de dois sensores laser (um fixado na frente do veículo e o outro na parte traseira), da odometria e de orientação de um sensor inercial. Os dados adquiridos desses sensores e a etapa da manobra em que o veículo está, servem de entrada para o controlador. Este é capaz de interpretar tais dados e responder a esses estímulos de forma correta em aproximadamente 99% dos casos. Os resultados de treinamento e de simulação se mostraram muito satisfatórios, permitindo que o carro controlador pela RNA pudesse estacionar corretamente em uma vaga paralela. Thanks to technological advances in the fields of computer science, embedded electronics and mechatronics, robotics is increasingly more present in people\'s lives. On the past few decades a great variety of tools and methods were developed in the Mobile Robotics field, e.g. the passenger vehicles with smart embedded systems. Such systems help drivers through sensors that acquire information from the surrounding environment and algorithms which process this data and make decisions to perform a task, like parking a car. This work aims to present the studies performed on the development of a smart controller able to park a simulated vehicle in parallel parking spaces, where a single maneuver is enough to enter. To accomplish this, studies involving the modeling of environments, vehicle kinematics and sensors were conducted, which were implemented in a simulated environment developed in C# with Visual Studio 2008. Next, a study about the three stages of parking was carried out, which consists in looking for a slot, positioning the vehicle and maneuvering it. The \"S\" trajectory was adopted and developed to maneuver the vehicle, since it is well known and highly used in related works found in the literature of this field. The maneuver consists in the correct positioning of two circumferences with the possible steering radius of the vehicle. For this task, a robust controller based on supervised learning using Artificial Neural Networks (ANN) was employed, since this approach has great robustness regarding the presence of noise in the system. This controller receives data from two laser sensors (one attached on the front of the vehicle and the other on the rear), from the odometry and from the inertial orientation sensor. The data acquired from these sensors and the current maneuver stage of the vehicle are the inputs of the controller, which interprets these data and responds to these stimuli in a correct way in approximately 99% of the cases. The results of the training and simulation were satisfactory, allowing the car controlled by the ANN to correctly park in a parallel slot.

APA, Harvard, Vancouver, ISO, and other styles

19

Ak, Ronay. "Neural Network Modeling for Prediction under Uncertainty in Energy System Applications." Thesis, Supélec, 2014. http://www.theses.fr/2014SUPL0015/document.

Full text

Abstract:

Cette thèse s’intéresse à la problématique de la prédiction dans le cadre du design de systèmes énergétiques et des problèmes d’opération, et en particulier, à l’évaluation de l’adéquation de systèmes de production d’énergie renouvelables. L’objectif général est de développer une approche empirique pour générer des prédictions avec les incertitudes associées. En ce qui concerne cette direction de la recherche, une approche non paramétrique et empirique pour estimer les intervalles de prédiction (PIs) basés sur les réseaux de neurones (NNs) a été développée, quantifiant l’incertitude dans les prédictions due à la variabilité des données d’entrée et du comportement du système (i.e. due au comportement stochastique des sources renouvelables et de la demande d'énergie électrique), et des erreurs liées aux approximations faites pour établir le modèle de prédiction. Une nouvelle méthode basée sur l'optimisation multi-objectif pour estimer les PIs basée sur les réseaux de neurones et optimale à la fois en termes de précision (probabilité de couverture) et d’information (largeur d’intervalle) est proposée. L’ensemble de NN individuels par deux nouvelles approches est enfin présenté comme un moyen d’augmenter la performance des modèles. Des applications sur des études de cas réels démontrent la puissance de la méthode développée This Ph.D. work addresses the problem of prediction within energy systems design and operation problems, and particularly the adequacy assessment of renewable power generation systems. The general aim is to develop an empirical modeling framework for providing predictions with the associated uncertainties. Along this research direction, a non-parametric, empirical approach to estimate neural network (NN)-based prediction intervals (PIs) has been developed, accounting for the uncertainty in the predictions due to the variability in the input data and the system behavior (e.g. due to the stochastic behavior of the renewable sources and of the energy demand by the loads), and to model approximation errors. A novel multi-objective framework for estimating NN-based PIs, optimal in terms of both accuracy (coverage probability) and informativeness (interval width) is proposed. Ensembling of individual NNs via two novel approaches is proposed as a way to increase the performance of the models. Applications on real case studies demonstrate the power of the proposed framework

APA, Harvard, Vancouver, ISO, and other styles

20

Bhat, Chandrashekhar. "Artificial Neural Network Approach For Characterization Of Acoustic Emission Sources From Complex Noisy Data." Thesis, Indian Institute of Science, 2001. https://etd.iisc.ac.in/handle/2005/251.

Full text

Abstract:

Safety and reliability are prime concerns in aircraft performance due to the involved costs and risk to lives. Despite the best efforts in design methodology, quality evaluation in production and structural integrity assessment in-service, attainment of one hundred percent safety through development and use of a suitable in-flight health monitoring system is still a farfetched goal. And, evolution of such a system requires, first, identification of an appropriate Technique and next its adoption to meet the challenges posed by newer materials (advanced composites), complex structures and the flight environment. In fact, a quick survey of the available Non-Destructive Evaluation (NDE) techniques suggests Acoustic Emission (AE) as the only available method. High merit in itself could be a weakness - Noise is the worst enemy of AE. So, while difficulties are posed due to the insufficient understanding of the basic behavior of composites, growth and interaction of defects and damage under a specified load condition, high in-flight noise further complicates the issue making the developmental task apparently formidable and challenging. Development of an in-flight monitoring system based on AE to function as an early warning system needs addressing three aspects, viz., the first, discrimination of AE signals from noise data, the second, extraction of required information from AE signals for identification of sources (source characterization) and quantification of its growth, and the third, automation of the entire process. And, a quick assessment of the aspects involved suggests that Artificial Neural Networks (ANN) are ideally suited for solving such a complex problem. A review of the available open literature while indicates a number of investigations carried out using noise elimination and source characterization methods such as frequency filtering and statistical pattern recognition but shows only sporadic attempts using ANN. This may probably be due to the complex nature of the problem involving investigation of a large number of influencing parameters, amount of effort and time to be invested, and facilities required and multi-disciplinary nature of the problem. Hence as stated in the foregoing, the need for such a study cannot be over emphasized. Thus, this thesis is an attempt addressing the issue of analysis and automation of complex sets of AE data such as AE signals mixed with in-flight noise thus forming the first step towards in-flight monitoring using AE. An ANN can in fact replace the traditional algorithmic approaches used in the past. ANN in general are model free estimators and derive their computational efficiency due to large connectivity, massive parallelism, non-linear analog response and learning capabilities. They are better suited than the conventional methods (statistical pattern recognition methods) due to their characteristics such as classification, pattern matching, learning, generalization, fault tolerance and distributed memory and their ability to process unstructured data sets which may be carrying incomplete information at times and hence chosen as the tool. Further, in the current context, the set of investigations undertaken were in the absence of sufficient a priori information and hence clustering of signals generated by AE sources through self-organizing maps is more appropriate. Thus, in the investigations carried out under the scope of this thesis, at first a hybrid network named "NAEDA" (Neural network for Acoustic Emission Data Analysis) using Kohonen self-organizing feature map (KSOM) and multi-layer perceptron (MLP) that learns on back propagation learning rule was specifically developed with innovative data processing techniques built into the network. However, for accurate pattern recognition, multi-layer back propagation NN needed to be trained with source and noise clusters as input data. Thus, in addition to optimizing the network architecture and training parameters, preprocessing of input data to the network and multi-class clustering and classification proved to be the corner stones in obtaining excellent identification accuracy. Next, in-flight noise environment of an aircraft was generated off line through carefully designed simulation experiments carried out in the laboratory (Ex: EMI, friction, fretting and other mechanical and hydraulic phenomena) based on the in-flight noise survey carried out by earlier investigators. From these experiments data was acquired and classified into their respective classes through MLP. Further, these noises were mixed together and clustered through KSOM and then classified into their respective clusters through MLP resulting in an accuracy of 95%- 100% Subsequently, to evaluate the utility of NAEDA for source classification and characterization, carbon fiber reinforced plastic (CFRP) specimens were subjected to spectrum loading simulating typical in-flight load and AE signals were acquired continuously up to a maximum of three designed lives and in some cases up to failure. Further, AE signals with similar characteristics were grouped into individual clusters through self-organizing map and labeled as belonging to appropriate failure modes, there by generating the class configuration. Then MLP was trained with this class information, which resulted in automatic identification and classification of failure modes with an accuracy of 95% - 100%. In addition, extraneous noise generated during the experiments was acquired and classified so as to evaluate the presence or absence of such data in the AE data acquired from the CFRP specimens. In the next stage, noise and signals were mixed together at random and were reclassified into their respective classes through supervised training of multi-layer back propagation NN. Initially only noise was discriminated from the AE signals from CFRP failure modes and subsequently both noise discrimination and failure mode identification and classification was carried out resulting in an accuracy of 95% - 100% in most of the cases. Further, extraneous signals mentioned above were classified which indicated the presence of such signals in the AE signals obtained from the CFRP specimen. Thus, having established the basis for noise identification and AE source classification and characterization, two specific examples were considered to evaluate the utility and efficiency of NAEDA. In the first, with the postulation that different basic failure modes in composites have unique AE signatures, the difference in damage generation and progression can be clearly characterized under different loading conditions. To examine this, static compression tests were conducted on a different set of CFRP specimens till failure with continuous AE monitoring and the resulting AE signals were classified through already trained NAEDA. The results obtained shows that the total number of signals obtained were very less when compared to fatigue tests and the specimens failed with hardly any damage growth. Further, NAEDA was able to discriminate the"noise and failure modes in CFRP specimen with the same degree of accuracy with which it has classified such signals obtained from fatigue tests. In the second example, with the same postulate of unique AE signatures for different failure modes, the differences in the complexion of the damage growth and progression should become clearly evident when one considers specimens with different lay up sequences. To examine this, the data was reclassified on the basis of differences in lay up sequences from specimens subjected to fatigue. The results obtained clearly confirmed the postulation. As can be seen from the summary of the work presented in the foregoing paragraphs, the investigations undertaken within the scope of this thesis involve elaborate experimentation, development of tools, acquisition of extensive data and analysis. Never the less, the results obtained were commensurate with the efforts and have been fruitful. Of the useful results that have been obtained, to state in specific, the first is, discrimination of simulated noise sources achieved with significant success but for some overlapping which is not of major concern as far as noises are concerned. Therefore they are grouped into required number of clusters so as to achieve better classification through supervised NN. This proved to be an innovative measure in supervised classification through back propagation NN. The second is the damage characterization in CFRP specimens, which involved imaginative data processing techniques that proved their worth in terms of optimization of various training parameters and resulted in accurate identification through clustering. Labeling of clusters is made possible by marking each signal starting from clustering to final classification through supervised neural network and is achieved through phenomenological correlation combined with ultrasonic imaging. Most rewarding of all is the identification of failure modes (AE signals) mixed in noise into their respective classes. This is a direct consequence of innovative data processing, multi-class clustering and flexibility of grouping various noise signals into suitable number of clusters. Thus, the results obtained and presented in this thesis on NN approach to AE signal analysis clearly establishes the fact that methods and procedures developed can automate detection and identification of failure modes in CFRP composites under hostile environment, which could lead to the development of an in-flight monitoring system.

APA, Harvard, Vancouver, ISO, and other styles

21

Bhat, Chandrashekhar. "Artificial Neural Network Approach For Characterization Of Acoustic Emission Sources From Complex Noisy Data." Thesis, Indian Institute of Science, 2001. http://hdl.handle.net/2005/251.

Full text

Abstract:

Safety and reliability are prime concerns in aircraft performance due to the involved costs and risk to lives. Despite the best efforts in design methodology, quality evaluation in production and structural integrity assessment in-service, attainment of one hundred percent safety through development and use of a suitable in-flight health monitoring system is still a farfetched goal. And, evolution of such a system requires, first, identification of an appropriate Technique and next its adoption to meet the challenges posed by newer materials (advanced composites), complex structures and the flight environment. In fact, a quick survey of the available Non-Destructive Evaluation (NDE) techniques suggests Acoustic Emission (AE) as the only available method. High merit in itself could be a weakness - Noise is the worst enemy of AE. So, while difficulties are posed due to the insufficient understanding of the basic behavior of composites, growth and interaction of defects and damage under a specified load condition, high in-flight noise further complicates the issue making the developmental task apparently formidable and challenging. Development of an in-flight monitoring system based on AE to function as an early warning system needs addressing three aspects, viz., the first, discrimination of AE signals from noise data, the second, extraction of required information from AE signals for identification of sources (source characterization) and quantification of its growth, and the third, automation of the entire process. And, a quick assessment of the aspects involved suggests that Artificial Neural Networks (ANN) are ideally suited for solving such a complex problem. A review of the available open literature while indicates a number of investigations carried out using noise elimination and source characterization methods such as frequency filtering and statistical pattern recognition but shows only sporadic attempts using ANN. This may probably be due to the complex nature of the problem involving investigation of a large number of influencing parameters, amount of effort and time to be invested, and facilities required and multi-disciplinary nature of the problem. Hence as stated in the foregoing, the need for such a study cannot be over emphasized. Thus, this thesis is an attempt addressing the issue of analysis and automation of complex sets of AE data such as AE signals mixed with in-flight noise thus forming the first step towards in-flight monitoring using AE. An ANN can in fact replace the traditional algorithmic approaches used in the past. ANN in general are model free estimators and derive their computational efficiency due to large connectivity, massive parallelism, non-linear analog response and learning capabilities. They are better suited than the conventional methods (statistical pattern recognition methods) due to their characteristics such as classification, pattern matching, learning, generalization, fault tolerance and distributed memory and their ability to process unstructured data sets which may be carrying incomplete information at times and hence chosen as the tool. Further, in the current context, the set of investigations undertaken were in the absence of sufficient a priori information and hence clustering of signals generated by AE sources through self-organizing maps is more appropriate. Thus, in the investigations carried out under the scope of this thesis, at first a hybrid network named "NAEDA" (Neural network for Acoustic Emission Data Analysis) using Kohonen self-organizing feature map (KSOM) and multi-layer perceptron (MLP) that learns on back propagation learning rule was specifically developed with innovative data processing techniques built into the network. However, for accurate pattern recognition, multi-layer back propagation NN needed to be trained with source and noise clusters as input data. Thus, in addition to optimizing the network architecture and training parameters, preprocessing of input data to the network and multi-class clustering and classification proved to be the corner stones in obtaining excellent identification accuracy. Next, in-flight noise environment of an aircraft was generated off line through carefully designed simulation experiments carried out in the laboratory (Ex: EMI, friction, fretting and other mechanical and hydraulic phenomena) based on the in-flight noise survey carried out by earlier investigators. From these experiments data was acquired and classified into their respective classes through MLP. Further, these noises were mixed together and clustered through KSOM and then classified into their respective clusters through MLP resulting in an accuracy of 95%- 100% Subsequently, to evaluate the utility of NAEDA for source classification and characterization, carbon fiber reinforced plastic (CFRP) specimens were subjected to spectrum loading simulating typical in-flight load and AE signals were acquired continuously up to a maximum of three designed lives and in some cases up to failure. Further, AE signals with similar characteristics were grouped into individual clusters through self-organizing map and labeled as belonging to appropriate failure modes, there by generating the class configuration. Then MLP was trained with this class information, which resulted in automatic identification and classification of failure modes with an accuracy of 95% - 100%. In addition, extraneous noise generated during the experiments was acquired and classified so as to evaluate the presence or absence of such data in the AE data acquired from the CFRP specimens. In the next stage, noise and signals were mixed together at random and were reclassified into their respective classes through supervised training of multi-layer back propagation NN. Initially only noise was discriminated from the AE signals from CFRP failure modes and subsequently both noise discrimination and failure mode identification and classification was carried out resulting in an accuracy of 95% - 100% in most of the cases. Further, extraneous signals mentioned above were classified which indicated the presence of such signals in the AE signals obtained from the CFRP specimen. Thus, having established the basis for noise identification and AE source classification and characterization, two specific examples were considered to evaluate the utility and efficiency of NAEDA. In the first, with the postulation that different basic failure modes in composites have unique AE signatures, the difference in damage generation and progression can be clearly characterized under different loading conditions. To examine this, static compression tests were conducted on a different set of CFRP specimens till failure with continuous AE monitoring and the resulting AE signals were classified through already trained NAEDA. The results obtained shows that the total number of signals obtained were very less when compared to fatigue tests and the specimens failed with hardly any damage growth. Further, NAEDA was able to discriminate the"noise and failure modes in CFRP specimen with the same degree of accuracy with which it has classified such signals obtained from fatigue tests. In the second example, with the same postulate of unique AE signatures for different failure modes, the differences in the complexion of the damage growth and progression should become clearly evident when one considers specimens with different lay up sequences. To examine this, the data was reclassified on the basis of differences in lay up sequences from specimens subjected to fatigue. The results obtained clearly confirmed the postulation. As can be seen from the summary of the work presented in the foregoing paragraphs, the investigations undertaken within the scope of this thesis involve elaborate experimentation, development of tools, acquisition of extensive data and analysis. Never the less, the results obtained were commensurate with the efforts and have been fruitful. Of the useful results that have been obtained, to state in specific, the first is, discrimination of simulated noise sources achieved with significant success but for some overlapping which is not of major concern as far as noises are concerned. Therefore they are grouped into required number of clusters so as to achieve better classification through supervised NN. This proved to be an innovative measure in supervised classification through back propagation NN. The second is the damage characterization in CFRP specimens, which involved imaginative data processing techniques that proved their worth in terms of optimization of various training parameters and resulted in accurate identification through clustering. Labeling of clusters is made possible by marking each signal starting from clustering to final classification through supervised neural network and is achieved through phenomenological correlation combined with ultrasonic imaging. Most rewarding of all is the identification of failure modes (AE signals) mixed in noise into their respective classes. This is a direct consequence of innovative data processing, multi-class clustering and flexibility of grouping various noise signals into suitable number of clusters. Thus, the results obtained and presented in this thesis on NN approach to AE signal analysis clearly establishes the fact that methods and procedures developed can automate detection and identification of failure modes in CFRP composites under hostile environment, which could lead to the development of an in-flight monitoring system.

APA, Harvard, Vancouver, ISO, and other styles

22

Cherif, Aymen. "Réseaux de neurones, SVM et approches locales pour la prévision de séries temporelles." Thesis, Tours, 2013. http://www.theses.fr/2013TOUR4003/document.

Full text

Abstract:

La prévision des séries temporelles est un problème qui est traité depuis de nombreuses années. On y trouve des applications dans différents domaines tels que : la finance, la médecine, le transport, etc. Dans cette thèse, on s’est intéressé aux méthodes issues de l’apprentissage artificiel : les réseaux de neurones et les SVM. On s’est également intéressé à l’intérêt des méta-méthodes pour améliorer les performances des prédicteurs, notamment l’approche locale. Dans une optique de diviser pour régner, les approches locales effectuent le clustering des données avant d’affecter les prédicteurs aux sous ensembles obtenus. Nous présentons une modification dans l’algorithme d’apprentissage des réseaux de neurones récurrents afin de les adapter à cette approche. Nous proposons également deux nouvelles techniques de clustering, la première basée sur les cartes de Kohonen et la seconde sur les arbres binaires Time series forecasting is a widely discussed issue for many years. Researchers from various disciplines have addressed it in several application areas : finance, medical, transportation, etc. In this thesis, we focused on machine learning methods : neural networks and SVM. We have also been interested in the meta-methods to push up the predictor performances, and more specifically the local models. In a divide and conquer strategy, the local models perform a clustering over the data sets before different predictors are affected into each obtained subset. We present in this thesis a new algorithm for recurrent neural networks to use them as local predictors. We also propose two novel clustering techniques suitable for local models. The first is based on Kohonen maps, and the second is based on binary trees

APA, Harvard, Vancouver, ISO, and other styles

23

Buttar, Sarpreet Singh. "Applying Artificial Neural Networks to Reduce the Adaptation Space in Self-Adaptive Systems : an exploratory work." Thesis, Linnéuniversitetet, Institutionen för datavetenskap och medieteknik (DM), 2019. http://urn.kb.se/resolve?urn=urn:nbn:se:lnu:diva-87117.

Full text

Abstract:

Self-adaptive systems have limited time to adjust their configurations whenever their adaptation goals, i.e., quality requirements, are violated due to some runtime uncertainties. Within the available time, they need to analyze their adaptation space, i.e., a set of configurations, to find the best adaptation option, i.e., configuration, that can achieve their adaptation goals. Existing formal analysis approaches find the best adaptation option by analyzing the entire adaptation space. However, exhaustive analysis requires time and resources and is therefore only efficient when the adaptation space is small. The size of the adaptation space is often in hundreds or thousands, which makes formal analysis approaches inefficient in large-scale self-adaptive systems. In this thesis, we tackle this problem by presenting an online learning approach that enables formal analysis approaches to analyze large adaptation spaces efficiently. The approach integrates with the standard feedback loop and reduces the adaptation space to a subset of adaptation options that are relevant to the current runtime uncertainties. The subset is then analyzed by the formal analysis approaches, which allows them to complete the analysis faster and efficiently within the available time. We evaluate our approach on two different instances of an Internet of Things application. The evaluation shows that our approach dramatically reduces the adaptation space and analysis time without compromising the adaptation goals.

APA, Harvard, Vancouver, ISO, and other styles

24

Börthas, Lovisa, and Sjölander Jessica Krange. "Machine Learning Based Prediction and Classification for Uplift Modeling." Thesis, KTH, Matematisk statistik, 2020. http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-266379.

Full text

Abstract:

The desire to model the true gain from targeting an individual in marketing purposes has lead to the common use of uplift modeling. Uplift modeling requires the existence of a treatment group as well as a control group and the objective hence becomes estimating the difference between the success probabilities in the two groups. Efficient methods for estimating the probabilities in uplift models are statistical machine learning methods. In this project the different uplift modeling approaches Subtraction of Two Models, Modeling Uplift Directly and the Class Variable Transformation are investigated. The statistical machine learning methods applied are Random Forests and Neural Networks along with the standard method Logistic Regression. The data is collected from a well established retail company and the purpose of the project is thus to investigate which uplift modeling approach and statistical machine learning method that yields in the best performance given the data used in this project. The variable selection step was shown to be a crucial component in the modeling processes as so was the amount of control data in each data set. For the uplift to be successful, the method of choice should be either the Modeling Uplift Directly using Random Forests, or the Class Variable Transformation using Logistic Regression. Neural network - based approaches are sensitive to uneven class distributions and is hence not able to obtain stable models given the data used in this project. Furthermore, the Subtraction of Two Models did not perform well due to the fact that each model tended to focus too much on modeling the class in both data sets separately instead of modeling the difference between the class probabilities. The conclusion is hence to use an approach that models the uplift directly, and also to use a great amount of control data in each data set. Behovet av att kunna modellera den verkliga vinsten av riktad marknadsföring har lett till den idag vanligt förekommande metoden inkrementell responsanalys. För att kunna utföra denna typ av metod krävs förekomsten av en existerande testgrupp samt kontrollgrupp och målet är således att beräkna differensen mellan de positiva utfallen i de två grupperna. Sannolikheten för de positiva utfallen för de två grupperna kan effektivt estimeras med statistiska maskininlärningsmetoder. De inkrementella responsanalysmetoderna som undersöks i detta projekt är subtraktion av två modeller, att modellera den inkrementella responsen direkt samt en klassvariabeltransformation. De statistiska maskininlärningsmetoderna som tillämpas är random forests och neurala nätverk samt standardmetoden logistisk regression. Datan är samlad från ett väletablerat detaljhandelsföretag och målet är därmed att undersöka vilken inkrementell responsanalysmetod och maskininlärningsmetod som presterar bäst givet datan i detta projekt. De mest avgörande aspekterna för att få ett bra resultat visade sig vara variabelselektionen och mängden kontrolldata i varje dataset. För att få ett lyckat resultat bör valet av maskininlärningsmetod vara random forests vilken används för att modellera den inkrementella responsen direkt, eller logistisk regression tillsammans med en klassvariabeltransformation. Neurala nätverksmetoder är känsliga för ojämna klassfördelningar och klarar därmed inte av att erhålla stabila modeller med den givna datan. Vidare presterade subtraktion av två modeller dåligt på grund av att var modell tenderade att fokusera för mycket på att modellera klassen i båda dataseten separat, istället för att modellera differensen mellan dem. Slutsatsen är således att en metod som modellerar den inkrementella responsen direkt samt en relativt stor kontrollgrupp är att föredra för att få ett stabilt resultat.

APA, Harvard, Vancouver, ISO, and other styles

25

Bügner, Jörg. "Nichtlineare Methoden in der trainingswissenschaftlichen Diagnostik : mit Untersuchungen aus dem Schwimmsport." Phd thesis, Universität Potsdam, 2005. http://opus.kobv.de/ubp/volltexte/2005/550/.

Full text

Abstract:

Die trainingswissenschaftliche Diagnostik in den Kernbereichen Training, Wettkampf und Leistungsfähigkeit ist durch einen hohen Praxisbezug, eine ausgeprägte strukturelle Komplexität und vielseitige Wechselwirkungen der sportwissenschaftlichen Teilgebiete geprägt. Diese Eigenschaften haben in der Vergangenheit dazu geführt, dass zentrale Fragestellungen, wie beispielsweise die Maximierung der sportlichen Leistungsfähigkeit, eine ökonomische Trainingsgestaltung, eine effektive Talentauswahl und -sichtung oder die Modellbildung noch nicht vollständig gelöst werden konnten. Neben den bereits vorhandenen linearen Lösungsansätzen werden in dieser Arbeit Methoden aus dem Bereich der Neuronalen Netzwerke eingesetzt. Diese nichtlinearen Diagnoseverfahren sind besonders geeignet für die Analyse von Prozessabläufen, wie sie beispielsweise im Training vorliegen. Im theoretischen Teil werden zunächst Gemeinsamkeiten, Abhängigkeiten und Unterschiede in den Bereichen Training, Wettkampf und Leistungsfähigkeit untersucht sowie die Brücke zwischen trainingswissenschaftlicher Diagnostik und nichtlinearen Verfahren über die Begriffe der Interdisziplinarität und Integrativität geschlagen. Angelehnt an die Theorie der Neuronalen Netze werden anschließend die Grundlagenmodelle Perzeptron, Multilayer-Perzeptron und Selbstorganisierende Karten theoretisch erläutert. Im empirischen Teil stehen dann die nichtlineare Analyse von personalen Anforderungsstrukturen, Zustände der sportlichen Form und die Prognose sportlichen Talents - allesamt bei jugendlichen Leistungsschwimmerinnen und -schwimmern - im Mittelpunkt. Die nichtlinearen Methoden werden dabei einerseits auf ihre wissenschaftliche Aussagekraft überprüft, andererseits untereinander sowie mit linearen Verfahren verglichen. The diagnostic methods in training science concentrate on the core areas of training, competition, and performance. The methods commonly used are characterized by a high degree of practical applicability and distinct structural complexity. These characteristics have led to the question which scientific methods fit best for resolving problems like, for example, the optimization of athletic performance, efficient planning and monitoring of training processes, effective talent screening, selection and development, or the formation of analytical models. All these questions have not yet been answered sufficiently. Aside from the traditional mathematical approaches on the basis of the linear model, nonlinear methods in the field of neural networks are used in this dissertation. These nonlinear diagnostic methods are especially suitable for the analysis of coherent patterns in time series such as training processes. In the theoretical part of the dissertation, common aspects, mutual dependencies, and differences between training, competition, and performance are examined. In this context, a bridge is built between the diagnostic purposes in these fields and suitable nonlinear methods. Along the lines of the neural networks theory, the basic models Perceptron, Multilayer-Perceptron, and Self-Organizing Feature Maps are subsequently elucidated. In the empirical part of the thesis, three studies conducted with top level adolescent swimmers are presented that focus on the nonlinear analysis of personal athletic ability structures, different states of athletic shape, and the prognosis of athletic talent. The nonlinear methods are thus examined as to how worthwhile they are for analytical purposes in training science on the one hand, and they are compared to each other as well as to linear methods on the other hand.

APA, Harvard, Vancouver, ISO, and other styles

26

Oliveira, Rogério Campos de. "Aplicação de máquinas de comitê de redes neurais artificiais na solução de um problema inverso em transferência radiativa." Universidade do Estado do Rio de Janeiro, 2010. http://www.bdtd.uerj.br/tde_busca/arquivo.php?codArquivo=1732.

Full text

Abstract:

Este trabalho fundamenta-se no conceito de máquina de comitê de redes neurais artificiais e tem por objetivo resolver o problema inverso de transferência radiativa em um meio unidimensional, homogêneo, absorvedor e espalhador isotrópico. A máquina de comitê de redes neurais artificiais agrega e combina o conhecimento adquirido por um certo número de especialistas aqui representados, individualmente, por cada uma das redes neurais artificiais (RNA) que compõem a máquina de comitê de redes neurais artificiais. O objetivo é atingir um resultado final melhor do que o obtido por qualquer rede neural artificial separadamente, selecionando-se apenas àquelas redes neurais artificiais que apresentam os melhores resultados na fase de generalização descartando-se as demais, o que foi feito neste trabalho. Aqui são utilizados dois modelos estáticos de máquinas de comitê, usando a média aritmética de conjunto, que se diferenciam entre si apenas na composição do combinador de saída de cada máquina de comitê. São obtidas, usando-se máquinas de comitê de redes neurais artificiais, estimativas para os parâmetros de transferência radiativa, isto é, a espessura óptica do meio, o albedo de espalhamento simples e as refletividades difusas. Finalmente, os resultados obtidos com ambos os modelos de máquina de comitê são comparados entre si e com aqueles encontrados usando-se apenas redes neurais artificiais do tipo perceptrons de múltiplas camadas (MLP), isoladamente. Aqui essas redes neurais artificiais são denominadas redes neurais especialistas, mostrando que a técnica empregada traz melhorias de desempenho e resultados a um custo computacional relativamente baixo. This work is based on the concept of neural networks committee machine and has the objective to solve the inverse radiative transfer problem in one-dimensional, homogeneous, absorbing and isotropic scattering media. The artificial neural networks committee machine adds and combines the knowledge acquired by an exact number of specialists which are represented, individually, by each one of the artificial neural networks (ANN) that composes the artificial neural network committee machine. The aim is to reach a final result better than the one obtained by any of the artificial neural network separately, selecting only those artificial neural networks that presents the best results during the generalization phase and discarding the others, what was done in this present work. Here are used two static models of committee machines, using the ensemble arithmetic average, that differ between themselves only by the composition of the output combinator by each one of the committee machine. Are obtained, using artificial neural networks committee machines, estimates for the radiative transfer parameters, that is, medium optical thickness, single scattering albedo and diffuse reflectivities. Finally, the results obtained with both models of committee machine are compared between themselves and with those found using artificial neural networks type multi-layer perceptrons (MLP), isolated. Here that artificial neural networks are named as specialists neural networks, showing that the technique employed brings performance and results improvements with relatively low computational cost.

APA, Harvard, Vancouver, ISO, and other styles

27

Vaughn, Marilyn Lougher. "Interpretation and knowledge discovery from the multi-layer perceptron neural network." Thesis, Cranfield University, 2005. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.427505.

Full text

APA, Harvard, Vancouver, ISO, and other styles

28

Foxall, Robert John. "Likelihood analysis of the multi-layer perceptron and related latent variable models." Thesis, University of Newcastle Upon Tyne, 2001. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.327211.

Full text

APA, Harvard, Vancouver, ISO, and other styles

29

Sonnert, Adrian. "Predicting inter-frequency measurements in an LTE network using supervised machine learning : a comparative study of learning algorithms and data processing techniques." Thesis, Linköpings universitet, Institutionen för datavetenskap, 2018. http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-148553.

Full text

Abstract:

With increasing demands on network reliability and speed, network suppliers need to effectivize their communications algorithms. Frequency measurements are a core part of mobile network communications, increasing their effectiveness would increase the effectiveness of many network processes such as handovers, load balancing, and carrier aggregation. This study examines the possibility of using supervised learning to predict the signal of inter-frequency measurements by investigating various learning algorithms and pre-processing techniques. We found that random forests have the highest predictive performance on this data set, at 90.7\% accuracy. In addition, we have shown that undersampling and varying the discriminator are effective techniques for increasing the performance on the positive class on frequencies where the negative class is prevalent. Finally, we present hybrid algorithms in which the learning algorithm for each model depends on attributes of the training data set. These algorithms perform at a much higher efficiency in terms of memory and run-time without heavily sacrificing predictive performance.

APA, Harvard, Vancouver, ISO, and other styles

30

D'Alimonte, Davide. "Multi layer perceptron neural network algorithms for ocean colour applications in coastal waters." Thesis, University of Southampton, 2004. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.401830.

Full text

APA, Harvard, Vancouver, ISO, and other styles

31

Singh, Arvind. "A multi-layer neural network approach to identification of mechanical damage in power transformer windings." Thesis, University of British Columbia, 2009. http://hdl.handle.net/2429/5677.

Full text

Abstract:

Power transformers are among the most critical of assets for electric utilities, in the financial impact that their failure can bring. Asset Managers need to be able to determine the right time for replacement, refurbishment or relocation of these devices, with an increasing degree of confidence, in order to minimize the total cost of operation over the equipments’ life. This has brought a change from scheduled maintenance to condition based monitoring (CBM), where the state of the transformer is continuously monitored to evaluate its working condition. A key method of transformer CBM, which effectively detects mechanical damage to the structure of the transformer windings, is Frequency Response Analysis (FRA). FRA relies on comparison of electrical admittance signatures to determine if the winding has become deformed. One of the major problems it still faces is the interpretation of differences in the signatures. To date, experts are needed to analyse graphs, drawing from experience in order to produce educated guesses as to what the differences in admittance functions denote. However, in the recent past, there has been some headway in programming computer based solutions for the problem of interpretation. The use of Artificial Neural Networks (ANNs) has perhaps been the most promising in this respect. ANNs perform in the same way that human experts do, drawing upon experience to map a change in shape of a signature to a physical change in the winding system. However, one of the major drawbacks of these methods is the large training data-sets required for the neural network to learn. The work reported in this thesis seeks to address this problem by generating training datasets from analytical models of the transformer. Due to the large number of simulations that need to be performed a customized solution method was developed to speed up computations. A combination of back propagation and radial basis function networks were then used to classify the type, location and severity of winding movement. The results showed that the neural network approach was not only accurate but tolerant to high noise levels.

APA, Harvard, Vancouver, ISO, and other styles

32

Lancashire, Lee James. "Multi-layer perceptron artificial neural network predictive modelling of genomic and mass spectrometry data in bioinformatics." Thesis, Nottingham Trent University, 2006. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.442340.

Full text

APA, Harvard, Vancouver, ISO, and other styles

33

Helén, Ludvig. "Automating Text Categorization with Machine Learning : Error Responsibility in a multi-layer hierarchy." Thesis, Linköpings universitet, Programvara och system, 2017. http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-139204.

Full text

Abstract:

The company Ericsson is taking steps towards embracing automating techniques and applying them to their product development cycle. Ericsson wants to apply machine learning techniques to automate the evaluation of a text categorization problem of error reports, or trouble reports (TRs). An excess of 100,000 TRs are handled annually. This thesis presents two possible solutions for solving the routing problems where one technique uses traditional classifiers (Multinomial Naive Bayes and Support Vector Machines) for deciding the route through the company hierarchy where a specific TR belongs. The other solution utilizes a Convolutional Neural Network for translating the TRs into low-dimensional word vectors, or word embeddings, in order to be able to classify what group within the company should be responsible for the handling of the TR. The traditional classifiers achieve up to 83% accuracy and the Convolutional Neural Network achieve up to 71% accuracy in the task of predicting the correct class for a specific TR.

APA, Harvard, Vancouver, ISO, and other styles

34

Thorén, Daniel. "Radar based tank level measurement using machine learning : Agricultural machines." Thesis, Linköpings universitet, Programvara och system, 2021. http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-176259.

Full text

Abstract:

Agriculture is becoming more dependent on computerized solutions to make thefarmer’s job easier. The big step that many companies are working towards is fullyautonomous vehicles that work the fields. To that end, the equipment fitted to saidvehicles must also adapt and become autonomous. Making this equipment autonomoustakes many incremental steps, one of which is developing an accurate and reliable tanklevel measurement system. In this thesis, a system for tank level measurement in a seedplanting machine is evaluated. Traditional systems use load cells to measure the weightof the tank however, these types of systems are expensive to build and cumbersome torepair. They also add a lot of weight to the equipment which increases the fuel consump-tion of the tractor. Thus, this thesis investigates the use of radar sensors together witha number of Machine Learning algorithms. Fourteen radar sensors are fitted to a tankat different positions, data is collected, and a preprocessing method is developed. Then,the data is used to test the following Machine Learning algorithms: Bagged RegressionTrees (BG), Random Forest Regression (RF), Boosted Regression Trees (BRT), LinearRegression (LR), Linear Support Vector Machine (L-SVM), Multi-Layer Perceptron Re-gressor (MLPR). The model with the best 5-fold crossvalidation scores was Random For-est, closely followed by Boosted Regression Trees. A robustness test, using 5 previouslyunseen scenarios, revealed that the Boosted Regression Trees model was the most robust.The radar position analysis showed that 6 sensors together with the MLPR model gavethe best RMSE scores.In conclusion, the models performed well on this type of system which shows thatthey might be a competitive alternative to load cell based systems.

APA, Harvard, Vancouver, ISO, and other styles

35

Yoon, Moonyoung. "Developing basic soccer skills using reinforcement learning for the RoboCup small size league." Thesis, Stellenbosch : Stellenbosch University, 2015. http://hdl.handle.net/10019.1/96823.

Full text

Abstract:

Thesis (MSc)--Stellenbosch University, 2015. ENGLISH ABSTRACT: This study has started as part of a research project at Stellenbosch University (SU) that aims at building a team of soccer-playing robots for the RoboCup Small Size League (SSL). In the RoboCup SSL the Decision- Making Module (DMM) plays an important role for it makes all decisions for the robots in the team. This research focuses on the development of some parts of the DMM for the team at SU. A literature study showed that the DMM is typically developed in a hierarchical structure where basic soccer skills form the fundamental building blocks and high-level team behaviours are implemented using these basic soccer skills. The literature study also revealed that strategies in the DMM are usually developed using a hand-coded approach in the RoboCup SSL domain, i.e., a specific and fixed strategy is coded, while in other leagues a Machine Learning (ML) approach, Reinforcement Learning (RL) in particular, is widely used. This led to the following research objective of this thesis, namely to develop basic soccer skills using RL for the RoboCup Small Size League. A second objective of this research is to develop a simulation environment to facilitate the development of the DMM. A high-level simulator was developed and validated as a result. The temporal-difference value iteration algorithm with state-value functions was used for RL, along with a Multi-Layer Perceptron (MLP) as a function approximator. Two types of important soccer skills, namely shooting skills and passing skills were developed using the RL and MLP combination. Nine experiments were conducted to develop and evaluate these skills in various playing situations. The results showed that the learning was very effective, as the learning agent executed the shooting and passing tasks satisfactorily, and further refinement is thus possible. In conclusion, RL combined with MLP was successfully applied in this research to develop two important basic soccer skills for robots in the RoboCup SSL. These form a solid foundation for the development of a complete DMM along with the simulation environment established in this research. AFRIKAANSE OPSOMMING: Hierdie studie het ontstaan as deel van 'n navorsingsprojek by Stellenbosch Universiteit wat daarop gemik was om 'n span sokkerrobotte vir die RoboCup Small Size League (SSL) te ontwikkel. Die besluitnemingsmodule (BM) speel 'n belangrike rol in die RoboCup SSL, aangesien dit besluite vir die robotte in die span maak. Hierdie navorsing fokus op ontwikkeling van enkele komponente van die BM vir die span by SU. 'n Literatuurstudie het getoon dat die BM tipies ontwikkel word volgens 'n hiërargiese struktuur waarin basiese sokkervaardighede die fundamentele boublokke vorm en hoëvlak spangedrag word dan gerealiseer deur hierdie basiese vaardighede te gebruik. Die literatuur het ook getoon dat strategieë in die BM van die RoboCup SSL domein gewoonlik ontwikkel word deur 'n hand-gekodeerde benadering, dit wil s^e, 'n baie spesifieke en vaste strategie word gekodeer, terwyl masjienleer (ML) en versterkingsleer (VL) wyd in ander ligas gebruik word. Dit het gelei tot die navorsingsdoelwit in hierdie tesis, naamlik om basiese sokkervaardighede vir robotte in die RoboCup SSL te ontwikkel. 'n Tweede doelwit was om 'n simulasie-omgewing te ontwikkel wat weer die ontwikkeling van die BM sou fasiliteer. Hierdie simulator is suksesvol ontwikkel en gevalideer. Die tydwaarde-verskil iterariewe algoritme met toestandwaarde-funksies is gebruik vir VL saam met 'n multi-laag perseptron (MLP) vir funksiebenaderings. Twee belangrike sokkervaardighede, naamlik doelskop- en aangeevaardighede is met hierdie kombinasie van VL en MLP ontwikkel. Nege eksperimente is uitgevoer om hierdie vaardighede in verskillende speelsituasies te ontwikkel en te evalueer. Volgens die resultate was die leerproses baie effektief, aangesien die leer-agent die doelskiet- en aangeetake bevredigend uitgevoer het, en verdere verfyning is dus moontlik. Die gevolgtrekking is dat VL gekombineer met MLP suksesvol toegepas is in hierdie navorsingswerk om twee belangrike, basiese sokkervaardighede vir robotte in die RoboCup SSL te ontwikkel. Dit vorm 'n sterk fondament vir die ontwikkeling van 'n volledige BM tesame met die simulasie-omgewing wat in hierdie werk daargestel is.

APA, Harvard, Vancouver, ISO, and other styles

36

Hedström, Erik, and Philip Wang. "Anomaly Detection using a Deep Learning Multi-layer Perceptron to Mitigate the Risk of Rogue Trading." Thesis, KTH, Skolan för elektroteknik och datavetenskap (EECS), 2021. http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-301948.

Full text

Abstract:

The term Rogue Trading is defined as the activity of someone at a financial organisation losing a large amount of money in bad or illegal transactions and trying to hide this. The activity of Rogue traders exposes financial organisations to huge risks and may lead to the organisation collapsing, which will affect other stakeholders like, for example, the customers. In order to detect potential Rogue Trading cases, Control Systems that monitor the employees and the positions they take on financial markets must exist. In this study, a two-step control system is suggested to monitor the margins on Foreign exchange (FX) Forwards traded by employees at the Swedish bank Skandinaviska Enskilda Banken (SEB). The first step in the control system uses a Deep Learning neural network trained on transactional data to predict the margin. The errors of the predictions versus the actual values are then in the second step of the control system used to find outliers which should be flagged for further investigation due to a too high deviation. The results show that the model hopefully can decrease the number of false positives yielded by the current Control Systems at SEB and thus reduce manual inspection of flagged transactions. Termen Rouge Trading definieras som en aktivitet där någon på en finansiell institution förlorar stora mängder pengar i dåliga eller illegala transaktioner och försöker dölja detta. Detta är något som skapar enorma risker för finansiella institutioner och som kan förorsaka organisationens kollaps, som kan påverka intressenter som till exempel kunder. För att upptäcka potentiella företeelser av Rouge Trading så måste kontrollsystem som övervakar anställda och deras positioner existera. I denna studie föreslås och presenteras ett tvåstegs-system för att övervaka marginaler vid terminsaffärer i utländsk valuta vid Skandinaviska Enskilda Banken (SEB). Det första steget i kontrollsystemet använder ett neuralt närverk tränat på data från transaktioner för att prediktera en marginal. Differenserna mellan prediktionen och det faktiska värdet används för att finna outliers vilka borde flaggas för vidare undersökning. Resultaten visar att modellen förhoppningsvis kan minska antalet falska positiva som det nuvarande kontrollsystemet ger på SEB, något som således kan minska den manuella inspektionen av flaggade transaktioner.

APA, Harvard, Vancouver, ISO, and other styles

37

FERREIRA, Aida Araújo. "Comparação de arquiteturas de redes neurais para sistemas de reconheceimento de padrões em narizes artificiais." Universidade Federal de Pernambuco, 2004. https://repositorio.ufpe.br/handle/123456789/2465.

Full text

Abstract:

Made available in DSpace on 2014-06-12T15:58:28Z (GMT). No. of bitstreams: 2 arquivo4572_1.pdf: 1149011 bytes, checksum: 92aae8f6f9b5145bfcecb94d96dbbc0b (MD5) license.txt: 1748 bytes, checksum: 8a4605be74aa9ea9d79846c1fba20a33 (MD5) Previous issue date: 2004 Instituto Federal de Educação, Ciência e Tecnologia de Pernambuco Um nariz artificial é um sistema modular composto de duas partes principais: um sistema sensor, formado de elementos que detectam odores e um sistema de reconhecimento de padrões que classifica os odores detectados. Redes neurais artificiais têm sido utilizadas como sistema de reconhecimento de padrões para narizes artificiais e vêm apresentando resultados promissores. Desde os anos 80, pesquisas para criação de narizes artificiais, que permitam detectar e classificar odores, vapores e gases automaticamente, têm tido avanços significativos. Esses equipamentos podem ser utilizados no monitoramento ambiental para controlar a qualidade do ar, na área de saúde para realizar diagnóstico de doenças e nas indústrias de alimentos para o controle de qualidade e o monitoramento de processos de produção. Esta dissertação investiga a utilização de quatro técnicas diferentes de redes neurais para criação de sistemas de reconhecimento de padrões em narizes artificiais. O trabalho está dividido em quatro partes principais: (1) introdução aos narizes artificiais, (2) redes neurais artificiais para sistema de reconhecimento de padrões, (3) métodos para medir o desempenho de sistemas de reconhecimento de padrões e comparar os resultados e (4) estudo de caso. Os dados utilizados para o estudo de caso, foram obtidos por um protótipo de nariz artificial composto por um arranjo de oito sensores de polímeros condutores, expostos a nove tipos diferentes de aguarrás. Foram adotadas as técnicas Multi-Layer Perceptron (MLP), Radial Base Function (RBF), Probabilistic Neural Network (PNN) e Time Delay Neural Network (TDNN) para criar os sistemas de reconhecimento de padrões. A técnica PNN foi investigada em detalhes, por dois motivos principais: esta técnica é indicada para realização de tarefas de classificação e seu treinamento é feito em apenas um passo, o que torna a etapa de criação dessas redes muito rápida. Os resultados foram comparados através dos valores dos erros médios de classificação utilizando o método estatístico de Teste de Hipóteses. As redes PNN correspondem a uma nova abordagem para criação de sistemas de reconhecimento de padrões de odor. Estas redes tiveram um erro médio de classificação de 1.1574% no conjunto de teste. Este foi o menor erro obtido entre todos os sistemas criados, entretanto mesmo com o menor erro médio de classificação, os testes de hipóteses mostraram que os classificadores criados com PNN não eram melhores do que os classificadores criados com a arquitetura RBF, que obtiveram um erro médio de classificação de 1.3889%. A grande vantagem de criar classificadores com a arquitetura PNN foi o pequeno tempo de treinamento dos mesmos, chegando a ser quase imediato. Porém a quantidade de nodos na camada escondida foi muito grande, o que pode ser um problema, caso o sistema criado deva ser utilizado em equipamentos com poucos recursos computacionais. Outra vantagem de criar classificadores com redes PNN é relativa à quantidade reduzida de parâmetros que devem ser analisados, neste caso apenas o parâmetro relativo à largura da função Gaussiana precisou ser investigado

APA, Harvard, Vancouver, ISO, and other styles

38

Lamraoui, Mourad. "Surveillance des centres d'usinage grande vitesse par approche cyclostationnaire et vitesse instantanée." Phd thesis, Université Jean Monnet - Saint-Etienne, 2013. http://tel.archives-ouvertes.fr/tel-01001576.

Full text

Abstract:

Dans l'industrie de fabrication mécanique et notamment pour l'utilisation des centres d'usinage haute vitesse, la connaissance des propriétés dynamiques du système broche-outil-pièce en opération est d'une grande importance. L'accroissement des performances des machines-outils et des outils de coupe a œuvré au développement de ce procédé compétitif. D'innombrables travaux ont été menés pour accroître les performances et les remarquables avancées dans les matériaux, les revêtements des outils coupants et les lubrifiants ont permis d'accroître considérablement les vitesses de coupe tout en améliorant la qualité de la surface usinée. Cependant, l'utilisation rationnelle de cette technologie est encore fortement pénalisée par les lacunes dans la connaissance de la coupe, que ce soit au niveau microscopique des interactions fines entre l'outil et la matière coupée, aussi bien qu'au niveau macroscopique intégrant le comportement de la cellule élémentaire d'usinage, si bien que le comportement dynamique en coupe garde encore une grande part de questionnement et exige de l'utilisateur un bon niveau de savoir-faire et parfois d'empirisme pour exploiter au mieux les capacités des moyens de production. Le fonctionnement des machines d'usinage engendre des vibrations qui sont souvent la cause des dysfonctionnements et accélère l'usure des composantes mécaniques (roulements) et outils. Ces vibrations sont une image des efforts internes des systèmes, d'où l'intérêt d'analyser les grandeurs mécaniques vibratoires telle que la vitesse ou l'accélération vibratoire. Ces outils sont indispensables pour une maintenance moderne dont l'objectif est de réduire les coûts liés aux pannes

APA, Harvard, Vancouver, ISO, and other styles

39

SACHDEVA, NITIN. "CYBERBULLYING DETECTION ON SOCIAL MEDIA USING DEEP LEARNING MODELS." Thesis, DELHI TECHNOLOGICAL UNIVERSITY, 2021. http://dspace.dtu.ac.in:8080/jspui/handle/repository/18914.

Full text

Abstract:

Application of deep learning models for cyberbullying detection in social media is an upcoming area for both researchers and practitioners for finding, exploring and analysing the extensibility of human-based expressions. Automated cyberbullying detection is typically a classification problem in natural language processing where the intent is to classify each abusive or offensive comment or post or message or image as either bullying or non-bullying. It needs high-level semantic analysis as well. Most of the earlier attempts on cyberbullying detection rely on manual feature extraction methods. Such methods are not only time-consuming and cumbersome, but often fail to correctly capture the meaning of the sentence. This fosters the need to build an intelligent analytic paradigm for detecting cyberbullying in social media data to lower down its hazard with minimal human intervention. Motivated by it, this research utilizes deep learning models for cyberbullying detection in social media as they trivialize the need of explicit feature extraction and are highly skilful, fast and more efficient in retrieval of essential features and patterns by themselves. In our research, we have applied deep learning for cyberbullying detection on textual and non-textual social media content. With high volume and variety of user-generated content on complex social media platforms, the challenges to detect cyberbullying in real-time have amplified. The influx of content makes it challenging to timely regulate online expression. Moreover, the anonymity and context-independence of expressions in online posts can be ambiguous or misleading. Nowadays, cyberbullying, through varied content modalities is also very common. At the same time, cultural diversities, unconventional use of typographical resources and easy availability of native-language keyboards augment to the variety and volume of user- generated content compounding the linguistic challenges in detecting online bullying posts. In an effort to deal with this antagonistic online delinquency referred to as cyberbullying, this research computationally analysed the content, modality and language-use in social media using deep learning models. This research has shown that the use of embeddings with deep learning architectures show better representation learning capabilities and simplify the feature selection process with enhanced classification accuracy as compared to baseline machine learning methods. The goal of the research is to automatically detect cyberbullying on textual, multimodal and mash-up social media content using deep learning models. In our research, we build models for these using deep architectures including capsule network, convolution neural network, multi-layer perceptron, self-attention mechanism, bi-directional gated recurrent unit, long short-term memory & bi-directional long short-term memory using embeddings such as GloVe, fastText and ELMo on social media like Askfm.in, Formspring.me, MySpace, Twitter, YouTube, Instagram and Facebook. The results show superlative performance as compared to SOTA as well.

APA, Harvard, Vancouver, ISO, and other styles

40

Seselskis, Erikas. ": E-patarėjas galimybėms socialinės atskirties terpėje pasirinkti. Mašinos apsimokymo algoritmų pritaikymas." Master's thesis, Lithuanian Academic Libraries Network (LABT), 2006. http://vddb.library.lt/obj/LT-eLABa-0001:E.02~2006~D_20060622_150755-50866.

Full text

Abstract:

At the moment social exclusion is a topical problem in a whole Europe. That’s why innovative decisions are prompted for social exclusive group of people in order to facilitate their integration process into the labour market. The stepping-stone of this work is e-advisor for choosing possibilities within social isolation environment. This e-advisor is created in accordance with artificial neural network and considering to individual person’s features give suggestions for the most suitable professions. Also in this work is presented disease diagnostic model, which is defined by artificial neural network.

APA, Harvard, Vancouver, ISO, and other styles

41

Guo, Zhihao. "Intelligent multiple objective proactive routing in MANET with predictions on delay, energy, and link lifetime." online version, 2008. http://rave.ohiolink.edu/etdc/view?acc%5Fnum=case1195705509.

Full text

APA, Harvard, Vancouver, ISO, and other styles

42

Muñoz, Mas Rafael. "Multivariate approaches in species distribution modelling: Application to native fish species in Mediterranean Rivers." Doctoral thesis, Universitat Politècnica de València, 2018. http://hdl.handle.net/10251/76168.

Full text

Abstract:

This dissertation focused in the comprehensive analysis of the capabilities of some non-tested types of Artificial Neural Networks, specifically: the Probabilistic Neural Networks (PNN) and the Multi-Layer Perceptron (MLP) Ensembles. The analysis of the capabilities of these techniques was performed using the native brown trout (Salmo trutta; Linnaeus, 1758), the bermejuela (Achondrostoma arcasii; Robalo, Almada, Levy & Doadrio, 2006) and the redfin barbel (Barbus haasi; Mertens, 1925) as target species. The analyses focused in the predictive capabilities, the interpretability of the models and the effect of the excess of zeros in the training datasets, which for presence-absence models is directly related to the concept of data prevalence (i.e. proportion of presence instances in the training dataset). Finally, the effect of the spatial scale (i.e. micro-scale or microhabitat scale and meso-scale) in the habitat suitability models and consequently in the e-flow assessment was studied in the last chapter. Esta tesis se centra en el análisis comprensivo de las capacidades de algunos tipos de Red Neuronal Artificial aún no testados: las Redes Neuronales Probabilísticas (PNN) y los Conjuntos de Perceptrones Multicapa (MLP Ensembles). Los análisis sobre las capacidades de estas técnicas se desarrollaron utilizando la trucha común (Salmo trutta; Linnaeus, 1758), la bermejuela (Achondrostoma arcasii; Robalo, Almada, Levy & Doadrio, 2006) y el barbo colirrojo (Barbus haasi; Mertens, 1925) como especies nativas objetivo. Los análisis se centraron en la capacidad de predicción, la interpretabilidad de los modelos y el efecto del exceso de ceros en las bases de datos de entrenamiento, la así llamada prevalencia de los datos (i.e. la proporción de casos de presencia sobre el conjunto total). Finalmente, el efecto de la escala (micro-escala o escala de microhábitat y meso-escala) en los modelos de idoneidad del hábitat y consecuentemente en la evaluación de caudales ambientales se estudió en el último capítulo. Aquesta tesis se centra en l'anàlisi comprensiu de les capacitats d'alguns tipus de Xarxa Neuronal Artificial que encara no han estat testats: les Xarxes Neuronal Probabilístiques (PNN) i els Conjunts de Perceptrons Multicapa (MLP Ensembles). Les anàlisis sobre les capacitats d'aquestes tècniques es varen desenvolupar emprant la truita comuna (Salmo trutta; Linnaeus, 1758), la madrilla roja (Achondrostoma arcasii; Robalo, Almada, Levy & Doadrio, 2006) i el barb cua-roig (Barbus haasi; Mertens, 1925) com a especies objecte d'estudi. Les anàlisi se centraren en la capacitat predictiva, interpretabilitat dels models i en l'efecte de l'excés de zeros a la base de dades d'entrenament, l'anomenada prevalença de les dades (i.e. la proporció de casos de presència sobre el conjunt total). Finalment, l'efecte de la escala (micro-escala o microhàbitat i meso-escala) en els models d'idoneïtat de l'hàbitat i conseqüentment en l'avaluació de cabals ambientals es va estudiar a l'últim capítol. Muñoz Mas, R. (2016). Multivariate approaches in species distribution modelling: Application to native fish species in Mediterranean Rivers [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/76168 TESIS

APA, Harvard, Vancouver, ISO, and other styles

43

Silva, Rodrigo Dalvit Carvalho da. "Um estudo sobre a extraÃÃo de caracterÃsticas e a classificaÃÃo de imagens invariantes Ã rotaÃÃo extraÃdas de um sensor industrial 3D." Universidade Federal do CearÃ, 2014. http://www.teses.ufc.br/tde_busca/arquivo.php?codArquivo=12154.

Full text

Abstract:

CoordenaÃÃo de AperfeÃoamento de Pessoal de NÃvel Superior Neste trabalho, Ã discutido o problema de reconhecimento de objetos utilizando imagens extraÃdas de um sensor industrial 3D. NÃs nos concentramos em 9 extratores de caracterÃsticas, dos quais 7 sÃo baseados nos momentos invariantes (Hu, Zernike, Legendre, Fourier-Mellin, Tchebichef, Bessel-Fourier e Gaussian-Hermite), um outro Ã baseado na Transformada de Hough e o Ãltimo na anÃlise de componentes independentes, e, 4 classificadores, Naive Bayes, k-Vizinhos mais PrÃximos, MÃquina de Vetor de Suporte e Rede Neural Artificial-Perceptron Multi-Camadas. Para a escolha do melhor extrator de caracterÃsticas, foram comparados os seus desempenhos de classificaÃÃo em termos de taxa de acerto e de tempo de extraÃÃo, atravÃs do classificador k-Vizinhos mais PrÃximos utilizando distÃncia euclidiana. O extrator de caracterÃsticas baseado nos momentos de Zernike obteve as melhores taxas de acerto, 98.00%, e tempo relativamente baixo de extraÃÃo de caracterÃsticas, 0.3910 segundos. Os dados gerados a partir deste, foram apresentados a diferentes heurÃsticas de classificaÃÃo. Dentre os classificadores testados, o classificador k-Vizinhos mais PrÃximos, obteve a melhor taxa mÃdia de acerto, 98.00% e, tempo mÃdio de classificaÃÃo relativamente baixo, 0.0040 segundos, tornando-se o classificador mais adequado para a aplicaÃÃo deste estudo. In this work, the problem of recognition of objects using images extracted from a 3D industrial sensor is discussed. We focus in 9 feature extractors (where seven are based on invariant moments -Hu, Zernike, Legendre, Fourier-Mellin, Tchebichef, BesselâFourier and Gaussian-Hermite-, another is based on the Hough transform and the last one on independent component analysis), and 4 classifiers (Naive Bayes, k-Nearest Neighbor, Support Vector machines and Artificial Neural Network-Multi-Layer Perceptron). To choose the best feature extractor, their performance was compared in terms of classification accuracy rate and extraction time by the k-nearest neighbors classifier using euclidean distance. The feature extractor based on Zernike moments, got the best hit rates, 98.00 %, and relatively low time feature extraction, 0.3910 seconds. The data generated from this, were presented to different heuristic classification. Among the tested classifiers, the k-nearest neighbors classifier achieved the highest average hit rate, 98.00%, and average time of relatively low rank, 0.0040 seconds, thus making it the most suitable classifier for the implementation of this study.

APA, Harvard, Vancouver, ISO, and other styles

44

Correia, Mauro Vicentini. "Redes neurais e algoritmos genéticos no estudo quimiossistemático da família Asteraceae." Universidade de São Paulo, 2010. http://www.teses.usp.br/teses/disponiveis/46/46135/tde-12082013-153222/.

Full text

Abstract:

No presente trabalho duas metodologias da área de inteligência artificial (Redes Neurais e Algoritmos Genéticos) foram utilizadas para realizar um estudo Quimiossistemático da família Asteraceae. A família Asteraceae é uma das maiores famílias entre as Angiospermas, conta com aproximadamente 24.000 espécies. As espécies da família produzem grande diversidade de metabólitos secundários, entre os quais merecem destaque os terpenóides, poliacetilenos, flavonóides e cumarinas. Para um melhor entendimento da diversidade química da família construiu-se um Banco de Dados com as ocorrências de doze classes de metabólitos (monoterpenos, sesquiterpenos, sesquiterpenos lactonizados, diterpenos, triterpenos, cumarinas, flavonóides, poliacetilenos, benzofuranos, benzopiranos, acetofenonas e fenilpropanóides) produzidos pelas espécies da família. A partir desse banco três diferentes estudos foram realizados. No primeiro estudo, utilizando os mapas auto-organizáveis de Kohonen e o banco de dados químico classificado segundo duas das mais recentes filogenias da família foi possível realizar com sucesso separações de tribos e gêneros da família Asteraceae. Também foi possível indicar que a informação química concorda mais com a filogenia de Funk (Funk et al. 2009) do que com a filogenia de Bremer (Bremer 1994, 1996). No estudo seguinte, onde se objetivou a criação de modelos de previsão dos números de ocorrências das doze classes de metabólitos, utilizando o perceptron de múltiplas camadas com algoritmo de retropropagação de erro, o resultado foi insatisfatório. Apesar de em algumas classes de metabólitos a fase de treino da rede apresentar resultados satisfatórios, a fase de teste mostrou que os modelos criados não são capazes de realizar previsão para dados aos quais eles não foram submetidos na fase de treino, e portanto não são modelos adequados para realizar previsões. Finalmente, o terceiro estudo consistiu na criação de modelos de regressão linear utilizando como método de seleção de variáveis os algoritmos genéticos. Nesse estudo foi possível indicar que os monoterpenos e os sesquiterpenos são bastante relacionados biossinteticamente, também foi possível indicar que existem relações biossintéticas entre monoterpenos e diterpenos e entre sesquiterpenos e triterpenos In this study two methods of artificial intelligence (neural network and genetic algorithms) were used to work out a Chemosystematic study of the Asteraceae family. The family Asteraceae is one of the largest families among the Angiosperms, having about 24,000 species. The species of the family produce a large diversity of secondary metabolites, and some worth mentioning are the terpenoids, polyacetylenes, flavonoids and coumarins. For a better understanding of the chemical diversity of the family a database was built up with the occurrences of twelve classes of metabolites (monoterpenes, sesquiterpenes, lactonizadossesquiterpenes, diterpenes, triterpenes, coumarins, flavonoids, polyacetylenes, Benzofurans, benzopyrans, acetophenones and phenylpropanoids) produced by species of the family. From this database three different studies were conducted. In the first study, using the Kohonen self-organized map and the chemical data classified according to two of the most recent phylogenies of the family, it was possible to successfully separatethe tribes and genera of the Asteraceae family. It was also possible to indicate that the chemical information agrees with the phylogeny of Funk (Funk et al. 2009) than with the phylogeny of Bremer (Bremer 1994, 1996). In the next study, which aims at creating models to predict the number of occurrences of the twelve classes of metabolites using multi-layer perceptron with backpropagation algorithm error, the result was found unsatisfactory. Although in some classes of metabolites the training phase of the network has satisfactory results, the test phase showed that the models created are not able to make prevision for data to which they were submitted in the training phase and thus are not suitable models for predictions. Finally, the third study was the creation of linear regression models using a genetic algorithm method of variable selection. This study could indicate that the monoterpenes and sesquiterpenes are closely related biosynthetically, and was also possible to indicate that there are biosynthetic relations between monoterpenes and diterpenes and between sesquiterpenes and triterpenes

APA, Harvard, Vancouver, ISO, and other styles

45

Zdybek, Mia. "Evaluating deep learning models for electricity spot price forecasting." Thesis, KTH, Skolan för elektroteknik och datavetenskap (EECS), 2021. http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-302642.

Full text

Abstract:

Electricity spot prices are difficult to predict since they depend on different unstable and erratic parameters, and also due to the fact that electricity is a commodity that cannot be stored efficiently. This results in a volatile, highly fluctuating behavior of the prices, with many peaks. Machine learning algorithms have outperformed traditional methods in various areas due to their ability to learn complex patterns. In the last decade, deep learning approaches have been introduced in electricity spot price prediction problems, often exceeding their predecessors. In this thesis, several deep learning models were built and evaluated for their ability to predict the spot prices 10-days ahead. Several conclusions were made. Firstly, it was concluded that rather simple neural network architectures can predict prices with high accuracy, except for the most extreme sudden peaks. Secondly, all the deep networks outperformed the benchmark statistical model. Lastly, the proposed LSTM and CNN provided forecasts which were statistically, significantly superior and had the lowest errors, suggesting they are the most suitable for the prediction task. Elspotspriser är svåra att förutsäga eftersom de beror på olika instabila och oregelbundna faktorer, och också på grund av att elektricitet är en vara som inte kan lagras effektivt. Detta leder till ett volatilt, fluktuerande beteende hos priserna, med många plötsliga toppar. Maskininlärningsalgoritmer har överträffat traditionella metoder inom olika områden på grund av deras förmåga att lära sig komplexa mönster. Under det senaste decenniet har djupinlärningsmetoder introducerats till problem inom elprisprognostisering och ofta visat sig överlägsna sina föregångare. I denna avhandling konstruerades och utvärderades flera djupinlärningsmodeller på deras förmåga att förutsäga spotpriserna 10 dagar framåt. Den första slutsatsen är att relativt simpla nätverksarkitekturer kan förutsäga priser med hög noggrannhet, förutom för fallen med de mest extrema, plötsliga topparna. Vidare, så övertränade alla djupa neurala nätverken den statistiska modellen som användes som riktmärke. Slutligen, så gav de föreslagna LSTM- och CNN-modellerna prognoser som var statistiskt, signifikant överlägsna de andra och hade de lägsta felen, vilket tyder på att de är bäst lämpade för prognostiseringsuppgiften.

APA, Harvard, Vancouver, ISO, and other styles

46

SARCIA', SALVATORE ALESSANDRO. "An Approach to improving parametric estimation models in the case of violation of assumptions based upon risk analysis." Doctoral thesis, Università degli Studi di Roma "Tor Vergata", 2009. http://hdl.handle.net/2108/1048.

Full text

Abstract:

In this work, we show the mathematical reasons why parametric models fall short of providing correct estimates and define an approach that overcomes the causes of these shortfalls. The approach aims at improving parametric estimation models when any regression model assumption is violated for the data being analyzed. Violations can be that, the errors are x-correlated, the model is not linear, the sample is heteroscedastic, or the error probability distribution is not Gaussian. If data violates the regression assumptions and we do not deal with the consequences of these violations, we cannot improve the model and estimates will be incorrect forever. The novelty of this work is that we define and use a feed-forward multi-layer neural network for discrimination problems to calculate prediction intervals (i.e. evaluate uncertainty), make estimates, and detect improvement needs. The primary difference from traditional methodologies is that the proposed approach can deal with scope error, model error, and assumption error at the same time. The approach can be applied for prediction, inference, and model improvement over any situation and context without making specific assumptions. An important benefit of the approach is that, it can be completely automated as a stand-alone estimation methodology or used for supporting experts and organizations together with other estimation techniques (e.g., human judgment, parametric models). Unlike other methodologies, the proposed approach focuses on the model improvement by integrating the estimation activity into a wider process that we call the Estimation Improvement Process as an instantiation of the Quality Improvement Paradigm. This approach aids mature organizations in learning from their experience and improving their processes over time with respect to managing their estimation activities. To provide an exposition of the approach, we use an old NASA COCOMO data set to (1) build an evolvable neural network model and (2) show how a parametric model, e.g., a regression model, can be improved and evolved with the new project data.

APA, Harvard, Vancouver, ISO, and other styles

47

Hoskins, Bradley Graham. "The design and application of multi-layer neural networks." 1995. http://arrow.unisa.edu.au:8081/1959.8/84000.

Full text

APA, Harvard, Vancouver, ISO, and other styles

48

Muller, Salomon. "Learning in Multi-Layer Networks of the Brain." Thesis, 2021. https://doi.org/10.7916/d8-wh1n-c795.

Full text

Abstract:

Simple circuits perform simple tasks. Complex circuits can perform more complicated tasks. This is true for artificial circuits and for brain circuits. As is known from artificial networks, a complexity that makes circuits substantially more powerful is distributing learning across multiple layers. In fact, most brain circuits in vertebrate systems are multi-layer circuits (but for few that perform simple reflexes) in which learning is distributed across layers. Despite the crucial contribution of learning in middle layer neurons to the output of the circuits they are embedded in, there is little understanding of the principles defining this contribution. A very common feature in brain circuits is that middle layer neurons generate two types of signals, known as spikes. These middle layer neurons commonly have long dendrites where they generate dendritic spikes. As well, like most neurons, they generate axonal spikes near the cell body. Neurons exhibiting these two spike types include pyramidal cells in the neo-cortex and the hippocampus, the Purkinje cells in the cerebellum and many more. In this thesis I study another circuit that contains middle layer neurons, the electrosensory lateral lobe (ELL) of the mormyrid fish. The ELL is a tractable brain circuit in which the middle layer neurons generate dendritic and axonal spikes. In this thesis I show that these spike types are not two different expressions of the same inputs. Rather, they have a symbiotic relationship. Instead of all inputs triggering both spikes, some inputs can selectively drive dendritic spikes. The dendritic spikes in return modify the synaptic strength of another set of inputs. The modified inputs are then transmitted to downstream neurons via the axonal spikes, which contributes a desired signal to the output of the circuits. Effectively there is a separation of learning and signaling in the middle layer neurons through the two spike types. Having two types of spikes in the same neuron doing different computations enormously expands the computational power of the neuron. But, being in the same neuron means the separation of function is constrained and needs to be supported by biophysical principles. I have thus built a biophysical model to understand the biophysical principles underlying the separation of function. I show that in the middle layer neurons of the ELL, the axonal spikes are strongly reduced in amplitude as they backpropagate to the apical dendrites, yet they remain crucial in driving dendritic spikes. Critically, modulation of inhibitory inputs can selectively dial up or down the ability of the backpropagating axonal spikes to drive dendritic spikes. Thus, a set of inhibitory modulating inputs can selectively modulate dendritic spikes. Having learning in different layers contributing to the outcome of the circuit, naturally leads to asking how the work is divided across layers and neuron types within the circuit. In this thesis I answer this question in the context of the outcome of the ELL circuit. Finally, another signature of a complex circuit is the ability to integrate many different inputs, usually in middle layer neurons, to generate sophisticated outputs. A goal for scientists studying systems neuroscience is to understand how this integration works. In this thesis I provide a coherent model of a learning behavior called vestibulo occular reflex (VOR) adaptation, that depends on the integration of separate inputs to yield a learned behavior. The VOR is a simple reflex generated in the brain stem. Inputs from the brain stem are also sent to an area in the cerebellar cortex called the flocculus. The flocculus also receives another set of inputs that generate a different behavior, called smooth-pursuit. The integration of VOR inputs with smooth-pursuit inputs in the flocculus generate VOR adaptation. Understanding complex circuits is one of the greatest challenges for today's neuroscientists. In this thesis I tackle two such circuits and hope that through a better understandings of these circuits we gain principles that apply to other circuits and thereby advance our understanding of the brain.

APA, Harvard, Vancouver, ISO, and other styles

49

Yu, Wen-Jen, and 于文貞. "The Study of the Learning Ability of Multi-layer Neural Networks." Thesis, 1994. http://ndltd.ncl.edu.tw/handle/62408512533758493389.

Full text

Abstract:

碩士 國立臺灣大學 資訊工程研究所 82 The objective of this research is to propose methods on solving the learning problems of multi-layer neural networks. The most well-known and commonly used learning algorithm is Back Propagation (BP) algorithm. There are three main drawbacks of BP: 1. the slowness of the learning speed, 2. the convergence to local minima, and 3. the absence of any theoretical result, allowing for a priori determination of an optimal network architecture for a given task. To solve these problems, we propose three methods: The first is to initialize weights in multi-layer quadratic sigmoid networks; The second is to learn in successive residual space; The third is using the topology preserving maps formmed in MLPs. These methods can be applied to pattern recognition problems espically when the training patterns have lined structure.

APA, Harvard, Vancouver, ISO, and other styles

50

HOU-TE, CHIANG, and 江厚德. "Investigations and Implementations for Recur-rent Neural Networks and Feedforward Multi-ple-Layer Perceptron." Thesis, 2018. http://ndltd.ncl.edu.tw/handle/8up2fe.

Full text

Abstract:

碩士 亞洲大學 資訊工程學系碩士在職專班 106 In this thesis, a multiple layer perceptron (MLP) and a recurrent neural network (RNN) are proposed for investigation and comparison in the sense of learning performances. The proposed RNN is a local feedback network and is composed by a state space realization. By using back propagation learning algorithm, the learning performances of the proposed RNN is better than that of the conven-tional MLP. Finally, numerical examples are performed to illustrate the effec-tiveness of the proposed approach.

APA, Harvard, Vancouver, ISO, and other styles

Dissertations / Theses on the topic 'Multi-layer neural networks'

Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles