Academic literature on the topic 'L2 Normalization'

Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles

Select a source type:

Consult the lists of relevant articles, books, theses, conference reports, and other scholarly sources on the topic 'L2 Normalization.'

Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.

You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.

Journal articles on the topic "L2 Normalization"

1

Chen, Shuangshuang, Huiyi Liu, Xiaoqin Zeng, Subin Qian, Jianjiang Yu, and Wei Guo. "Image Classification Based on Convolutional Denoising Sparse Autoencoder." Mathematical Problems in Engineering 2017 (2017): 1–16. http://dx.doi.org/10.1155/2017/5218247.

Full text
Abstract:
Image classification aims to group images into corresponding semantic categories. Due to the difficulties of interclass similarity and intraclass variability, it is a challenging issue in computer vision. In this paper, an unsupervised feature learning approach called convolutional denoising sparse autoencoder (CDSAE) is proposed based on the theory of visual attention mechanism and deep learning methods. Firstly, saliency detection method is utilized to get training samples for unsupervised feature learning. Next, these samples are sent to the denoising sparse autoencoder (DSAE), followed by convolutional layer and local contrast normalization layer. Generally, prior in a specific task is helpful for the task solution. Therefore, a new pooling strategy—spatial pyramid pooling (SPP) fused with center-bias prior—is introduced into our approach. Experimental results on the common two image datasets (STL-10 and CIFAR-10) demonstrate that our approach is effective in image classification. They also demonstrate that none of these three components: local contrast normalization, SPP fused with center-prior, and l2 vector normalization can be excluded from our proposed approach. They jointly improve image representation and classification performance.
APA, Harvard, Vancouver, ISO, and other styles
2

Yoon, Bohan, Hyeonji So, and Jongtae Rhee. "A Methodology for Utilizing Vector Space to Improve the Performance of a Dog Face Identification Model." Applied Sciences 11, no. 5 (2021): 2074. http://dx.doi.org/10.3390/app11052074.

Full text
Abstract:
Recent improvements in the performance of the human face recognition model have led to the development of relevant products and services. However, research in the similar field of animal face identification has remained relatively limited due to the greater diversity and complexity in shape and the lack of relevant data for animal faces such as dogs. In the face identification model using triplet loss, the length of the embedding vector is normalized by adding an L2-normalization (L2-norm) layer for using cosine-similarity-based learning. As a result, object identification depends only on the angle, and the distribution of the embedding vector is limited to the surface of a sphere with a radius of 1. This study proposes training the model from which the L2-norm layer is removed by using the triplet loss to utilize a wide vector space beyond the surface of a sphere with a radius of 1, for which a novel loss function and its two-stage learning method. The proposed method classifies the embedding vector within a space rather than on the surface, and the model’s performance is also increased. The accuracy, one-shot identification performance, and distribution of the embedding vectors are compared between the existing learning method and the proposed learning method for verification. The verification was conducted using an open-set. The resulting accuracy of 97.33% for the proposed learning method is approximately 4% greater than that of the existing learning method.
APA, Harvard, Vancouver, ISO, and other styles
3

Zhang, Zongzhen, Shunming Li, Zenghui An, and Yu Xin. "Fast convolution sparse filtering and its application on gearbox fault diagnosis." Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering 234, no. 9 (2020): 2291–304. http://dx.doi.org/10.1177/0954407020907818.

Full text
Abstract:
Transmission, as a critical part of vehicles, is the hub of power transmission and the core of controlling speed change. Condition monitoring and diagnosis of transmissions have become an effective tool to ensure vehicle safety travelling. The intelligent fault diagnosis strategy using artificial intelligent methods has been studied and applied for gearbox fault diagnosis. However, most algorithms cannot guarantee both accuracy and training efficiency. In this paper, fast convolutional sparse filtering based on convolutional activation and feature normalization is proposed for gearbox fault diagnosis without any time-consuming preprocessing. In fast convolutional sparse filtering, the features of samples are optimized instead of local features, which could obviously reduce the dimension and construction time of the Hessian matrix. In addition, the output features are equally active to guarantee that all features have similar contributions. The l2-norm of the training features is recorded and used for pseudo-normalization of the test features. The proposed fast convolutional sparse filtering is validated by a bearing fault dataset and a planetary gear fault dataset. Verification results confirm that fast convolutional sparse filtering is a promising tool for fault diagnosis, which has obviously improved the diagnosis accuracy, training efficiency, and robustness and provides the greater advantage of handling large-scale datasets.
APA, Harvard, Vancouver, ISO, and other styles
4

Hong, Yong, Jin Liu, Zahid Jahangir, Sheng He, and Qing Zhang. "Estimation of 6D Object Pose Using a 2D Bounding Box." Sensors 21, no. 9 (2021): 2939. http://dx.doi.org/10.3390/s21092939.

Full text
Abstract:
This paper provides an efficient way of addressing the problem of detecting or estimating the 6-Dimensional (6D) pose of objects from an RGB image. A quaternion is used to define an object′s three-dimensional pose, but the pose represented by q and the pose represented by -q are equivalent, and the L2 loss between them is very large. Therefore, we define a new quaternion pose loss function to solve this problem. Based on this, we designed a new convolutional neural network named Q-Net to estimate an object’s pose. Considering that the quaternion′s output is a unit vector, a normalization layer is added in Q-Net to hold the output of pose on a four-dimensional unit sphere. We propose a new algorithm, called the Bounding Box Equation, to obtain 3D translation quickly and effectively from 2D bounding boxes. The algorithm uses an entirely new way of assessing the 3D rotation (R) and 3D translation rotation (t) in only one RGB image. This method can upgrade any traditional 2D-box prediction algorithm to a 3D prediction model. We evaluated our model using the LineMod dataset, and experiments have shown that our methodology is more acceptable and efficient in terms of L2 loss and computational time.
APA, Harvard, Vancouver, ISO, and other styles
5

McKinney, Caroline A., Daniela Bedenice, Ana P. Pacheco, et al. "Assessment of clinical and microbiota responses to fecal microbial transplantation in adult horses with diarrhea." PLOS ONE 16, no. 1 (2021): e0244381. http://dx.doi.org/10.1371/journal.pone.0244381.

Full text
Abstract:
Background and aims Fecal microbial transplantation (FMT) is empirically implemented in horses with colitis to facilitate resolution of diarrhea. The purpose of this study was to assess FMT as a clinical treatment and modulator of fecal microbiota in hospitalized horses with colitis. Methods A total of 22 horses with moderate to severe diarrhea, consistent with a diagnosis of colitis, were enrolled at two referral hospitals (L1: n = 12; L2: n = 10). FMT was performed in all 12 patients on 3 consecutive days at L1, while treatment at L2 consisted of standard care without FMT. Manure was collected once daily for 4 days from the rectum in all colitis horses, prior to FMT for horses at L1, and from each manure sample used for FMT. Fecal samples from 10 clinically healthy control horses housed at L2, and 30 healthy horses located at 5 barns in regional proximity to L1 were also obtained to characterize the regional healthy equine microbiome. All fecal microbiota were analyzed using 16S amplicon sequencing. Results and conclusions As expected, healthy horses at both locations showed a greater α-diversity and lower β-diversity compared to horses with colitis. The fecal microbiome of healthy horses clustered by location, with L1 horses showing a higher prevalence of Kiritimatiellaeota. Improved manure consistency (lower diarrhea score) was associated with a greater α-diversity in horses with colitis at both locations (L1: r = -0.385, P = 0.006; L2: r = -0.479, P = 0.002). Fecal transplant recipients demonstrated a greater overall reduction in diarrhea score (median: 4±3 grades), compared to untreated horses (median: 1.5±3 grades, P = 0.021), with a higher incidence in day-over-day improvement in diarrhea (22/36 (61%) vs. 10/28 (36%) instances, P = 0.011). When comparing microbiota of diseased horses at study conclusion to that of healthy controls, FMT-treated horses showed a lower mean UniFrac distance (0.53±0.27) than untreated horses (0.62±0.26, P<0.001), indicating greater normalization of the microbiome in FMT-treated patients.
APA, Harvard, Vancouver, ISO, and other styles
6

Prabowo, Yudhi, and Kenlo Nishida Nasahara. "DETECTING AND COUNTING COCONUT TREES IN PLEIADES SATELLITE IMAGERY USING HISTOGRAM OF ORIENTED GRADIENTS AND SUPPORT VECTOR MACHINE." International Journal of Remote Sensing and Earth Sciences (IJReSES) 16, no. 1 (2019): 87. http://dx.doi.org/10.30536/j.ijreses.2019.v16.a3089.

Full text
Abstract:
This paper describes the detection of coconut trees using very-high-resolution optical satellite imagery. The satellite imagery used in this study was a panchromatic band of Pleiades imagery with a spatial resolution of 0.5 metres. The authors proposed the use of a histogram of oriented gradients (HOG) algorithm as the feature extractor and a support vector machine (SVM) as the classifier for this detection. The main objective of this study is to find out the parameter combination for the HOG algorithm that could provide the best performance for coconut-tree detection. The study shows that the best parameter combination for the HOG algorithm is a configuration of 3 x 3 blocks, 9 orientation bins, and L2-norm block normalization. These parameters provide overall accuracy, precision and recall of approximately 80%, 73% and 87%, respectively.
APA, Harvard, Vancouver, ISO, and other styles
7

Zhu, Mingming, Yuelei Xu, Shiping Ma, Shuai Li, Hongqiang Ma, and Yongsai Han. "Effective Airplane Detection in Remote Sensing Images Based on Multilayer Feature Fusion and Improved Nonmaximal Suppression Algorithm." Remote Sensing 11, no. 9 (2019): 1062. http://dx.doi.org/10.3390/rs11091062.

Full text
Abstract:
Aiming at the problem of insufficient representation ability of weak and small objects and overlapping detection boxes in airplane object detection, an effective airplane detection method in remote sensing images based on multilayer feature fusion and an improved nonmaximal suppression algorithm is proposed. Firstly, based on the common low-level visual features of natural images and airport remote sensing images, region-based convolutional neural networks are chosen to conduct transfer learning for airplane images using a limited amount of data. Then, the L2 norm normalization, feature connection, scale scaling, and feature dimension reduction are introduced to achieve effective fusion of low- and high-level features. Finally, a nonmaximal suppression method based on a soft decision function is proposed to solve the overlap problem of detection boxes. The experimental results show that the proposed method can effectively improve the representation ability of weak and small objects, as well as quickly and accurately detect airplane objects in the airport area.
APA, Harvard, Vancouver, ISO, and other styles
8

Wang, Tian, Yang, Zhu, Jiang, and Cai. "Improved Deep CNN with Parameter Initialization for Data Analysis of Near-Infrared Spectroscopy Sensors." Sensors 20, no. 3 (2020): 874. http://dx.doi.org/10.3390/s20030874.

Full text
Abstract:
Near-infrared (NIR) spectral sensors can deliver the spectral response of light absorbed by materials. Data analysis technology based on NIR sensors has been a useful tool for quality identification. In this paper, an improved deep convolutional neural network (CNN) with batch normalization and MSRA (Microsoft Research Asia) initialization is proposed to discriminate the tobacco cultivation regions using data collected from NIR sensors. The network structure is created with six convolutional layers and three full connection layers, and the learning rate is controlled by exponential attenuation method. One-dimensional kernel is applied as the convolution kernel to extract features. Meanwhile, the methods of L2 regularization and dropout are used to avoid the overfitting problem, which improve the generalization ability of the network. Experimental results show that the proposed deep network structure can effectively extract the complex characteristics inside the spectrum, which proves that it has excellent recognition performance on tobacco cultivation region discrimination, and it also demonstrates that the deep CNN is more suitable for information mining and analysis of big data.
APA, Harvard, Vancouver, ISO, and other styles
9

Liu, Hengchang, Dechen Yao, Jianwei Yang, and Xi Li. "Lightweight Convolutional Neural Network and Its Application in Rolling Bearing Fault Diagnosis under Variable Working Conditions." Sensors 19, no. 22 (2019): 4827. http://dx.doi.org/10.3390/s19224827.

Full text
Abstract:
The rolling bearing is an important part of the train’s running gear, and its operating state determines the safety during the running of the train. Therefore, it is important to monitor and diagnose the health status of rolling bearings. A convolutional neural network is widely used in the field of fault diagnosis because it does not require feature extraction. Considering that the size of the network model is large and the requirements for monitoring equipment are high. This study proposes a novel bearing fault diagnosis method based on lightweight network ShuffleNet V2 with batch normalization and L2 regularization. In the experiment, the one-dimensional time-domain signal is converted into a two-dimensional Time-Frequency Graph (TFG) using a short-time Fourier transform, though the principle of graphics to enhance the TFG dataset. The model mainly consists of two units, one for extracting features and one for spatial down-sampling. The building units are repeatedly stacked to construct the whole model. By comparing the proposed method with the origin ShuffleNet V2, machine learning model and state-of-the-art fault diagnosis model, the generalization of the proposed method for bearing fault diagnosis is verified.
APA, Harvard, Vancouver, ISO, and other styles
10

Naralasetti, Veeranjaneyulu, Reshmi Khadherbhi Shaik, Gayatri Katepalli, and Jyostna Devi Bodapati. "Deep Learning Models for Pneumonia Identification and Classification Based on X-Ray Images." Traitement du Signal 38, no. 3 (2021): 903–9. http://dx.doi.org/10.18280/ts.380337.

Full text
Abstract:
Diagnosis based on chest X-rays is widely used and approved for the diagnosis of various diseases such as Pneumonia. Manually screening of theses X-ray images technician or radiologist involves expertise and time consuming. Addressing this, we propose an automated approach for the diagnosis of pneumonia by assisting doctors in spotting infected areas in the X-ray images. We propose a deep Convolutional Neural Network (CNN) model for efficiently detecting the presence of pneumonia in the X-ray images. The proposed CNN is designed with 5 convolution blocks followed by 4 fully connected layers. In order to boost the performance of the model, we incorporate batch normalization, dynamic dropout, learning rate decay, L2 regularization weight decay along with Adam optimizer and binary Cross-Entropy loss function while training the model using back propagating algorithm. The proposed model is validated on two publicly accessible benchmark datasets, and the experimental studies conducted on these datasets indicate that the proposed model is efficient. The suggested CNN architecture with specified hyper parameters allows the model to outperform several existing models by achieving accuracy of 97.73% and 91.17% respectively for binary and multi-class classification tasks of pneumonia disease.
APA, Harvard, Vancouver, ISO, and other styles
More sources

Dissertations / Theses on the topic "L2 Normalization"

1

Gaikwad, Akash S. "Pruning Convolution Neural Network (SqueezeNet) for Efficient Hardware Deployment." Thesis, 2018. http://hdl.handle.net/1805/17923.

Full text
Abstract:
Indiana University-Purdue University Indianapolis (IUPUI)<br>In recent years, deep learning models have become popular in the real-time embedded application, but there are many complexities for hardware deployment because of limited resources such as memory, computational power, and energy. Recent research in the field of deep learning focuses on reducing the model size of the Convolution Neural Network (CNN) by various compression techniques like Architectural compression, Pruning, Quantization, and Encoding (e.g., Huffman encoding). Network pruning is one of the promising technique to solve these problems. This thesis proposes methods to prune the convolution neural network (SqueezeNet) without introducing network sparsity in the pruned model. This thesis proposes three methods to prune the CNN to decrease the model size of CNN without a significant drop in the accuracy of the model. 1: Pruning based on Taylor expansion of change in cost function Delta C. 2: Pruning based on L2 normalization of activation maps. 3: Pruning based on a combination of method 1 and method 2. The proposed methods use various ranking methods to rank the convolution kernels and prune the lower ranked filters afterwards SqueezeNet model is fine-tuned by backpropagation. Transfer learning technique is used to train the SqueezeNet on the CIFAR-10 dataset. Results show that the proposed approach reduces the SqueezeNet model by 72% without a significant drop in the accuracy of the model (optimal pruning efficiency result). Results also show that Pruning based on a combination of Taylor expansion of the cost function and L2 normalization of activation maps achieves better pruning efficiency compared to other individual pruning criteria and most of the pruned kernels are from mid and high-level layers. The Pruned model is deployed on BlueBox 2.0 using RTMaps software and model performance was evaluated.
APA, Harvard, Vancouver, ISO, and other styles
2

(5931047), Akash Gaikwad. "Pruning Convolution Neural Network (SqueezeNet) for Efficient Hardware Deployment." Thesis, 2019.

Find full text
Abstract:
<p>In recent years, deep learning models have become popular in the real-time embedded application, but there are many complexities for hardware deployment because of limited resources such as memory, computational power, and energy. Recent research in the field of deep learning focuses on reducing the model size of the Convolution Neural Network (CNN) by various compression techniques like Architectural compression, Pruning, Quantization, and Encoding (e.g., Huffman encoding). Network pruning is one of the promising technique to solve these problems.</p> <p>This thesis proposes methods to prune the convolution neural network (SqueezeNet) without introducing network sparsity in the pruned model. </p> <p>This thesis proposes three methods to prune the CNN to decrease the model size of CNN without a significant drop in the accuracy of the model.</p> <p>1: Pruning based on Taylor expansion of change in cost function Delta C.</p> <p>2: Pruning based on L<sub>2</sub> normalization of activation maps.</p> <p>3: Pruning based on a combination of method 1 and method 2.</p><p>The proposed methods use various ranking methods to rank the convolution kernels and prune the lower ranked filters afterwards SqueezeNet model is fine-tuned by backpropagation. Transfer learning technique is used to train the SqueezeNet on the CIFAR-10 dataset. Results show that the proposed approach reduces the SqueezeNet model by 72% without a significant drop in the accuracy of the model (optimal pruning efficiency result). Results also show that Pruning based on a combination of Taylor expansion of the cost function and L<sub>2</sub> normalization of activation maps achieves better pruning efficiency compared to other individual pruning criteria and most of the pruned kernels are from mid and high-level layers. The Pruned model is deployed on BlueBox 2.0 using RTMaps software and model performance was evaluated.</p><p></p>
APA, Harvard, Vancouver, ISO, and other styles

Book chapters on the topic "L2 Normalization"

1

Yang, Bei. "Variables and Pitch Normalization." In Perception and Production of Mandarin Tones by Native Speakers and L2 Learners. Springer Berlin Heidelberg, 2015. http://dx.doi.org/10.1007/978-3-662-44645-4_3.

Full text
APA, Harvard, Vancouver, ISO, and other styles

Conference papers on the topic "L2 Normalization"

1

Yang, Menglin, Ziqiao Meng, and Irwin King. "FeatureNorm: L2 Feature Normalization for Dynamic Graph Embedding." In 2020 IEEE International Conference on Data Mining (ICDM). IEEE, 2020. http://dx.doi.org/10.1109/icdm50108.2020.00082.

Full text
APA, Harvard, Vancouver, ISO, and other styles
2

Gaikwad, Akash Sunil, and Mohamed El-Sharkawy. "Pruning the Convolution Neural Network (SqueezeNet) based on L2 Normalization of Activation Maps." In 2019 IEEE 9th Annual Computing and Communication Workshop and Conference (CCWC). IEEE, 2019. http://dx.doi.org/10.1109/ccwc.2019.8666597.

Full text
APA, Harvard, Vancouver, ISO, and other styles
3

Dai, Zhuang, Weinan Chen, Xinghong Huang, et al. "CNN Descriptor Improvement Based on L2-Normalization and Feature Pooling for Patch Classification." In 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO). IEEE, 2018. http://dx.doi.org/10.1109/robio.2018.8665330.

Full text
APA, Harvard, Vancouver, ISO, and other styles
We offer discounts on all premium plans for authors whose works are included in thematic literature selections. Contact us to get a unique promo code!