Downloads & Free Reading Options - Results

The questions of use of neural networks models are discussed at the control of ship dynamics in ice conditions. The control and forecast of development of a situation is realized on the basis of the data dynamic measurements within the framework of a competition principle. The modeling is carried out with use of methods of classical mathematics and theory of artificial neural networks.

We are now witnessing the increasing availability of event stream data, i.e., a sequence of events with each event typically being denoted by the time it occurs and its mark information (e.g., event type). A fundamental problem is to model and predict such kind of marked temporal dynamics, i.e., when the next event will take place and what its mark will be. Existing methods either predict only the mark or the time of the next event, or predict both of them, yet separately. Indeed, in marked temporal dynamics, the time and the mark of the next event are highly dependent on each other, requiring a method that could simultaneously predict both of them. To tackle this problem, in this paper, we propose to model marked temporal dynamics by using a mark-specific intensity function to explicitly capture the dependency between the mark and the time of the next event. Extensive experiments on two datasets demonstrate that the proposed method outperforms state-of-the-art methods at predicting marked temporal dynamics.

A central challenge in neuroscience is understanding how neural system implements computation through its dynamics. We propose a nonlinear time series model aimed at characterizing interpretable dynamics from neural trajectories. Our model assumes low-dimensional continuous dynamics in a finite volume. It incorporates a prior assumption about globally contractional dynamics to avoid overly enthusiastic extrapolation outside of the support of observed trajectories. We show that our model can recover qualitative features of the phase portrait such as attractors, slow points, and bifurcations, while also producing reliable long-term future predictions in a variety of dynamical models and in real neural data.

http://uf.catalog.fcla.edu/uf.jsp?st=UF002056070&ix=pm&I=0&V=D&pm=1

This article is from Frontiers in Computational Neuroscience , volume 8 . Abstract None

In this paper, we propose an efficient transfer leaning methods for training a personalized language model using a recurrent neural network with long short-term memory architecture. With our proposed fast transfer learning schemes, a general language model is updated to a personalized language model with a small amount of user data and a limited computing resource. These methods are especially useful for a mobile device environment while the data is prevented from transferring out of the device for privacy purposes. Through experiments on dialogue data in a drama, it is verified that our transfer learning methods have successfully generated the personalized language model, whose output is more similar to the personal language style in both qualitative and quantitative aspects.

Recurrent neural network (RNN) based character-level language models (CLMs) are extremely useful for modeling out-of-vocabulary words by nature. However, their performance is generally much worse than the word-level language models (WLMs), since CLMs need to consider longer history of tokens to properly predict the next one. We address this problem by proposing hierarchical RNN architectures, which consist of multiple modules with different timescales. Despite the multi-timescale structures, the input and output layers operate with the character-level clock, which allows the existing RNN CLM training approaches to be directly applicable without any modifications. Our CLM models show better perplexity than Kneser-Ney (KN) 5-gram WLMs on the One Billion Word Benchmark with only 2% of parameters. Also, we present real-time character-level end-to-end speech recognition examples on the Wall Street Journal (WSJ) corpus, where replacing traditional mono-clock RNN CLMs with the proposed models results in better recognition accuracies even though the number of parameters are reduced to 30%.

When working with three-dimensional data, choice of representation is key. We explore voxel-based models, and present evidence for the viability of voxellated representations in applications including shape modeling and object classification. Our key contributions are methods for training voxel-based variational autoencoders, a user interface for exploring the latent space learned by the autoencoder, and a deep convolutional neural network architecture for object classification. We address challenges unique to voxel-based representations, and empirically evaluate our models on the ModelNet benchmark, where we demonstrate a 51.5% relative improvement in the state of the art for object classification.

Natural Language Processing (NLP) systems commonly leverage bag-of-words co-occurrence techniques to capture semantic and syntactic word relationships. The resulting word-level distributed representations often ignore morphological information, though character-level embeddings have proven valuable to NLP tasks. We propose a new neural language model incorporating both word order and character order in its embedding. The model produces several vector spaces with meaningful substructure, as evidenced by its performance of 85.8% on a recent word-analogy task, exceeding best published syntactic word-analogy scores by a 58% error margin. Furthermore, the model includes several parallel training methods, most notably allowing a skip-gram network with 160 billion parameters to be trained overnight on 3 multi-core CPUs, 14x larger than the previous largest neural network.

A hardware fingerprinting primitive known as physical unclonable function (PUF) has a huge potential for secret-key cryptography and identification/authentication applications. The hardware fingerprint is manifested by the random and unique binary strings extracted from the integrated circuit (IC) which exist due to inherent process variations during its fabrication. PUF technology has a huge potential to be used for device identification and authentication in resource-constrained internet of things (IoT) applications such as wireless sensor networks (WSN). A secret computational model of PUF is suggested to be stored in the verifier’s database as an alternative to challenge and response pairs (CRPs) to reduce area consumption. Therefore, in this paper, the design steps to build a PUF model in NodeMCU ESP8266 using an artificial neural network (ANN) are presented. Arbiter-PUF is used in our study and NodeMCU ESP8266 is chosen because it is suitable to be used as a sensor node or sink in WSN applications. ANN with a resilient back-propagation training algorithm is used as it can model the non-linearity with high accuracy. The results show that ANN can model the arbiter-PUF with approximately 99.5% prediction accuracy and the PUF model only consumes 309,889 bytes of memory space.

A hardware fingerprinting primitive known as physical unclonable function (PUF) has a huge potential for secret-key cryptography and identification/authentication applications. The hardware fingerprint is manifested by the random and unique binary strings extracted from the integrated circuit (IC) which exist due to inherent process variations during its fabrication. PUF technology has a huge potential to be used for device identification and authentication in resource-constrained internet of things (IoT) applications such as wireless sensor networks (WSN). A secret computational model of PUF is suggested to be stored in the verifier’s database as an alternative to challenge and response pairs (CRPs) to reduce area consumption. Therefore, in this paper, the design steps to build a PUF model in NodeMCU ESP8266 using an artificial neural network (ANN) are presented. Arbiter-PUF is used in our study and NodeMCU ESP8266 is chosen because it is suitable to be used as a sensor node or sink in WSN applications. ANN with a resilient back-propagation training algorithm is used as it can model the non-linearity with high accuracy. The results show that ANN can model the arbiter-PUF with approximately 99.5% prediction accuracy and the PUF model only consumes 309,889 bytes of memory space.

How to model a pair of sentences is a critical issue in many NLP tasks such as answer selection (AS), paraphrase identification (PI) and textual entailment (TE). Most prior work (i) deals with one individual task by fine-tuning a specific system; (ii) models each sentence's representation separately, rarely considering the impact of the other sentence; or (iii) relies fully on manually designed, task-specific linguistic features. This work presents a general Attention Based Convolutional Neural Network (ABCNN) for modeling a pair of sentences. We make three contributions. (i) ABCNN can be applied to a wide variety of tasks that require modeling of sentence pairs. (ii) We propose three attention schemes that integrate mutual influence between sentences into CNN; thus, the representation of each sentence takes into consideration its counterpart. These interdependent sentence pair representations are more powerful than isolated sentence representations. (iii) ABCNN achieves state-of-the-art performance on AS, PI and TE tasks.

Field-programmable gate array (FPGA) is a prominent device in developing the internet of things (IoT) application since it offers parallel computation, power efficiency, and scalability. The identification and authentication of these FPGAbased IoT applications are crucial to secure the user-sensitive data transmitted over IoT networks. Physical unclonable function (PUF) technology provides a great capability to be used as device identification and authentication for FPGAbased IoT applications. Nevertheless, conventional PUF-based authentication suffers a huge overhead in storing the challenge-response pairs (CRPs) in the verifier’s database. Therefore, in this paper, the FPGA implementation of the Arbiter-PUF model using an artificial neural network (ANN) is presented. The PUF model can generate the CRPs on-the-fly upon the authentication request (i.e., by a prover) to the verifier and eliminates huge storage of CRPs database in the verifier. The architecture of ANN (i.e., Arbiter-PUF model) is designed in Xilinx system generator and subsequently converted into intellectual property (IP). Further, the IP is programmed in Xilinx Artix-7 FPGA with other peripherals for CRPs generation and validation. The findings show that the Arbiter-PUF model implementation on FPGA using the ANN technique achieves approximately 98% accuracy. The model consumes 12,196 look-up tables (LUTs) and 67 mW power in FPGA.

The tonotopic representation of sounds is a well established organizational principle of the auditory cortex. However, given the small extent of auditory cortical regions, mapping tonotopic representation using noninvasive tools such as M/EEG is challenging. Resolving ongoing brain activity at a tonotopic level has been deemed virtually impossible due to volume conduction. However, based on previous data showing robust carrier-frequency decoding, it is clear tonotopic information is present at a noninvasive level. In order to also eavesdrop on ongoing activity, we propose that backward encoding models can be tuned to specific sound frequency bands applied to other data sets and to model neural activity in resulting “feature” (here: sound frequency band) channels.

The tonotopic representation of sounds is a well established organizational principle of the auditory cortex. However, given the small extent of auditory cortical regions, mapping tonotopic representation using noninvasive tools such as M/EEG is challenging. Resolving ongoing brain activity at a tonotopic level has been deemed virtually impossible due to volume conduction. However, based on previous data showing robust carrier-frequency decoding, it is clear tonotopic information is present at a noninvasive level. In order to also eavesdrop on ongoing activity, we propose that backward encoding models can be tuned to specific sound frequency bands applied to other data sets and to model neural activity in resulting “feature” (here: sound frequency band) channels.

Book Source: Digital Library of India Item 2015.194930 dc.contributor.author: Madhav Kumar.a dc.date.accessioned: 2015-07-08T05:19:38Z dc.date.available: 2015-07-08T05:19:38Z dc.date.digitalpublicationdate: 2005-09-27 dc.identifier.barcode: 1990010093680 dc.identifier.origpath: /rawdataupload/upload/0093/680 dc.identifier.copyno: 1 dc.identifier.uri: http://www.new.dli.ernet.in/handle/2015/194930 dc.description.scannerno: 14 dc.description.scanningcentre: IIIT, Allahabad dc.description.main: 1 dc.description.tagged: 0 dc.description.totalpages: 85 dc.format.mimetype: application/pdf dc.language.iso: English dc.publisher: Indian Institute Of Technology Kanpur dc.rights: Out_of_copyright dc.source.library: Indian Institute Of Technology Kanpur dc.subject.classification: Technology dc.subject.classification: Engineering. Technology In General dc.subject.classification: Civil Engineering dc.title: Modeling Of Monthly Run Off Time Series Using Artifical Neural Networks

[1] Introduction: Dried fruits are one of the most important non-oil exports and the efforts should be made to grow the economy of the country by increasing their exports to world markets. Meanwhile, quince juice contains various minerals including iron, phosphorus, calcium, potassium and rich in vitamins such as vitamins A, C and B vitamins. Drying of food is one of the ways to keep its quality and increase its shelflife. During this process, the removal of moisture through the simultaneous transfer of heat and mass occurs. By transferring heat from the environment to the foodstuff, the heat energy evaporates the surface moisture. The drying process has a great impact on the product. In recent years, new and innovative techniques have been considered that increase the drying rate and maintain the quality of the product and infrared drying is one of these novel techniques.. Infrared systems are emitting electromagnetic waves with a wavelength of 700 nm to 1 mm. The advantage of using infrared is to minimize waste and prevent product quality loss due to reduced drying time can be mentioned. The need to predict product quality in each process makes it necesary to model and discover the relationship between factors that can affect the final quality of the product. Artificial neural networks have been considered as a meta-innovative algorithm for modeling and prediction, which can be favored by the ability of these networks to model and predict processes The complexity and discovery of non-random fluctuations in data and the ability to discover the interactions between variables, economical savings in the use and disconnection of classical model abusive constraints (Togrul et al., 2004), the ability to reduce The effect of non-effective variables on the model by setting internal parameters is the ability to predict the desired parameter variations with minimum parameters (Bowers et al., 2000).   Materials and methods: In this research, quince fruit (Variety of Isfahan) was purchased as the premium product of Isfahan Gardens and was kept at 0 ° C in the cold room prior to further experiments. The fruits were removed from the refrigerator one hour before processing and exposed to ambient temperature. After washing, surface moisture was removed by moisture absorbent paper and turned into slices with a constant thickness of 4 mm. The specimens were subjected to pre-treatment with an osmotic solution (vacuum for 70 minutes at a temperature of 40 ° C for 5 hours). For drying the samples, an infrared convective dryer with three voltages (800.400 and 1200 watts) and a constant speed of 0.5 m / s was used. In this way, the samples were placed under infrared lamps on a plate made from a grid and the weight of the samples was measured in a scale of 10 minutes by means of a scale and recorded on the computer. In order to achieve stable conditions in the system, the dryer was switched on 30 minutes before the process. The distance between the samples and the infrared lamp was fixed in all treatments at 16 cm. The drying process continued to reach a moisture content of 0.22 basis. To perform a puncture tests, quince slices were used in a Brookfield-based American LFRA-4500 tissue analysis device. In order to model these parameters in the drying process, the results of examining the quality of the samples, including the firmness of the tissue as well as the drying time, were used as network outputs. The power, concentration and pressure parameters were considered as network inputs. In this research, a multilayer perceptron network (MLP) was used. Due to its simplicity and high precision, this model has a great application in modeling the drying of agricultural products. Many functions in transmitting numbers from the previous layer to the next layer may be used (Tripathy et al., 2008).   Result & discussion: The results indicated that the stiffness of the tissue is reduced in vacuum conditions with increased power. So, the least amount of stiffness was related to osmotic sample dried at 1200 watts. By increasing the infrared power, the stiffness of the tissue decreases, the reason for this is probably the volume increase phenomenon that occurs during the rapid evaporation of moisture through infrared rays from inside the tissue. The results showed that at the start of the drying process, due to the high moisture content of the product, the moisture loss rate is high. Gradually, with the advent of time and reduced initial moisture content, the rate of moisture reduction naturally decreases. At lower power, the drying time is longer and with increasing power, the drying time decreases due to the increase of the thermal gradient inside the product and consequently the increase in the rate of evaporation of the moisture content of the product. The results of this study showed that the neural artificial network, as a powerful tool, can estimate the stiffness parameters of the tissue and the drying time with high precision. The most suitable neural network structure to predict these parameters with a 3-7-2 topology along with logarithmic activation functions with a total explanation coefficient above 0.9923 represent the best results. Also, by increasing the drying capacity and using osmotic dehydration, the drying time and the stiffness of the tissue samples is decreased.

The goal of this work was to analyze the potential of neural networks and fuzzy logic methods to develop approximate response surfaces as process modeling, that is for mapping of input into output. Structural response was chosen as an example. Each of the many methods surveyed are explained and the results are presented. Future research directions are also discussed.

The goal of this work was to analyze the potential of neural networks and fuzzy logic methods to develop approximate response surfaces as process modeling, that is for mapping of input into output. Structural response was chosen as an example. Each of the many methods surveyed are explained and the results are presented. Future research directions are also discussed.

Large amount of small Unmanned Aerial Vehicles (sUAVs) are projected to operate in the near future. Potential sUAV applications include, but not limited to, search and rescue, inspection and surveillance, aerial photography and video, precision agriculture, and parcel delivery. sUAVs are expected to operate in the uncontrolled Class G airspace, which is at or below 500 feet above ground level (AGL), where many static and dynamic constraints exist, such as ground properties and terrains, restricted areas, various winds, manned helicopters, and conflict avoidance among sUAVs. How to enable safe, efficient, and massive sUAV operations at the low altitude airspace remains a great challenge. NASA's Unmanned aircraft system Traffic Management (UTM) research initiative works on establishing infrastructure and developing policies, requirement, and rules to enable safe and efficient sUAVs' operations. To achieve this goal, it is important to gain insights of future UTM traffic operations through simulations, where the accurate trajectory model plays an extremely important role. On the other hand, like what happens in current aviation development, trajectory modeling should also serve as the foundation for any advanced concepts and tools in UTM. Accurate models of sUAV dynamics and control systems are very important considering the requirement of the meter level precision in UTM operations. The vehicle dynamics are relatively easy to derive and model, however, vehicle control systems remain unknown as they are usually kept by manufactures as a part of intellectual properties. That brings challenges to trajectory modeling for sUAVs. How to model the vehicle's trajectories with unknown control system? This work proposes to use a neural network to model a vehicle's trajectory. The neural network is first trained to learn the vehicle's responses at numerous conditions. Once being fully trained, given current vehicle states, winds, and desired future trajectory, the neural network should be able to predict the vehicle's future states at next time step. A complete 4-D trajectory are then generated step by step using the trained neural network. Experiments in this work show that the neural network can approximate the sUAV's model and predict the trajectory accurately.

Speaker intent detection and semantic slot filling are two critical tasks in spoken language understanding (SLU) for dialogue systems. In this paper, we describe a recurrent neural network (RNN) model that jointly performs intent detection, slot filling, and language modeling. The neural network model keeps updating the intent estimation as word in the transcribed utterance arrives and uses it as contextual features in the joint model. Evaluation of the language model and online SLU model is made on the ATIS benchmarking data set. On language modeling task, our joint model achieves 11.8% relative reduction on perplexity comparing to the independent training language model. On SLU tasks, our joint model outperforms the independent task training model by 22.3% on intent detection error rate, with slight degradation on slot filling F1 score. The joint model also shows advantageous performance in the realistic ASR settings with noisy speech input.

Book Source: Digital Library of India Item 2015.225022 dc.contributor.author: Om Prakash dc.date.accessioned: 2015-07-10T15:28:14Z dc.date.available: 2015-07-10T15:28:14Z dc.date.digitalpublicationdate: 2005-09-08 dc.identifier.barcode: 5990010120112 dc.identifier.origpath: /rawdataupload/upload/0120/114 dc.identifier.copyno: 1 dc.identifier.uri: http://www.new.dli.ernet.in/handle/2015/225022 dc.description.scannerno: 15 dc.description.scanningcentre: IIIT, Allahabad dc.description.main: 1 dc.description.tagged: 0 dc.description.totalpages: 66 dc.format.mimetype: application/pdf dc.language.iso: English dc.publisher: Indian Institute Of Technology Kanpur dc.rights: Out_of_copyright dc.source.library: Indian Institute Of Technology Kanpur dc.subject.classification: Technology dc.subject.classification: Engineering. Technology In General dc.subject.classification: Mechanical Engineering In General. Nuclear Technology. Electrical Engineering. Machinery dc.title: Modeling Of Performence Of An Artillery Rocket Using Neural Networks

This article is from Frontiers in Computational Neuroscience , volume 8 . Abstract The antennal lobe (AL), olfactory processing center in insects, is able to process stimuli into distinct neural activity patterns, called olfactory neural codes. To model their dynamics we perform multichannel recordings from the projection neurons in the AL driven by different odorants. We then derive a dynamic neuronal network from the electrophysiological data. The network consists of lateral-inhibitory neurons and excitatory neurons (modeled as firing-rate units), and is capable of producing unique olfactory neural codes for the tested odorants. To construct the network, we (1) design a projection, an odor space, for the neural recording from the AL, which discriminates between distinct odorants trajectories (2) characterize scent recognition, i.e., decision-making based on olfactory signals and (3) infer the wiring of the neural circuit, the connectome of the AL. We show that the constructed model is consistent with biological observations, such as contrast enhancement and robustness to noise. The study suggests a data-driven approach to answer a key biological question in identifying how lateral inhibitory neurons can be wired to excitatory neurons to permit robust activity patterns.

The negative sampling (NEG) objective function, used in word2vec, is a simplification of the Noise Contrastive Estimation (NCE) method. NEG was found to be highly effective in learning continuous word representations. However, unlike NCE, it was considered inapplicable for the purpose of learning the parameters of a language model. In this study, we refute this assertion by providing a principled derivation for NEG-based language modeling, founded on a novel analysis of a low-dimensional approximation of the matrix of pointwise mutual information between the contexts and the predicted words. The obtained language modeling is closely related to NCE language models but is based on a simplified objective function. We thus provide a unified formulation for two main language processing tasks, namely word embedding and language modeling, based on the NEG objective function. Experimental results on two popular language modeling benchmarks show comparable perplexity results, with a small advantage to NEG over NCE.

Recurrent neural networks (RNNs) have shown promising performance for language modeling. However, traditional training of RNNs using back-propagation through time often suffers from overfitting. One reason for this is that stochastic optimization (used for large training sets) does not provide good estimates of model uncertainty. This paper leverages recent advances in stochastic gradient Markov Chain Monte Carlo (also appropriate for large training sets) to learn weight uncertainty in RNNs. It yields a principled Bayesian learning algorithm, adding gradient noise during training (enhancing exploration of the model-parameter space) and model averaging when testing. Extensive experiments on various RNN models and across a broad range of applications demonstrate the superiority of the proposed approach over stochastic optimization.

Here we demonstrate that the activity of neural ensembles can be quantitatively modeled. We first show that an ensemble dynamical model (EDM) accurately approximates the distribution of voltages and average firing rate per neuron of a population of simulated integrate-and-fire neurons. EDMs are high-dimensional nonlinear dynamical models. To faciliate the estimation of their parameters we present a dimensionality reduction method and study its performance with simulated data. We then introduce and evaluate a maximum-likelihood method to estimate connectivity parameters in networks of EDMS. Finally, we show that this model an methods accurately approximate the high-gamma power evoked by pure tones in the auditory cortex of rodents. Overall, this article demonstrates that quantitatively modeling brain activity at the ensemble level is indeed possible, and opens the way to understanding the computations performed by neural ensembles, which could revolutionarize our understanding of brain function.

The convolutional neural networks (CNNs) have proven to be a powerful tool for discriminative learning. Recently researchers have also started to show interest in the generative aspects of CNNs in order to gain a deeper understanding of what they have learned and how to further improve them. This paper investigates generative modeling of CNNs. The main contributions include: (1) We construct a generative model for the CNN in the form of exponential tilting of a reference distribution. (2) We propose a generative gradient for pre-training CNNs by a non-parametric importance sampling scheme, which is fundamentally different from the commonly used discriminative gradient, and yet has the same computational architecture and cost as the latter. (3) We propose a generative visualization method for the CNNs by sampling from an explicit parametric image distribution. The proposed visualization method can directly draw synthetic samples for any given node in a trained CNN by the Hamiltonian Monte Carlo (HMC) algorithm, without resorting to any extra hold-out images. Experiments on the challenging ImageNet benchmark show that the proposed generative gradient pre-training consistently helps improve the performances of CNNs, and the proposed generative visualization method generates meaningful and varied samples of synthetic images from a large-scale deep CNN.

The goal of sentence and document modeling is to accurately represent the meaning of sentences and documents for various Natural Language Processing tasks. In this work, we present Dependency Sensitive Convolutional Neural Networks (DSCNN) as a general-purpose classification system for both sentences and documents. DSCNN hierarchically builds textual representations by processing pretrained word embeddings via Long Short-Term Memory networks and subsequently extracting features with convolution operators. Compared with existing recursive neural models with tree structures, DSCNN does not rely on parsers and expensive phrase labeling, and thus is not restricted to sentence-level tasks. Moreover, unlike other CNN-based models that analyze sentences locally by sliding windows, our system captures both the dependency information within each sentence and relationships across sentences in the same document. Experiment results demonstrate that our approach is achieving state-of-the-art performance on several tasks, including sentiment analysis, question type classification, and subjectivity classification.

Talk by Zoran Tiganj of Indiana University.  Given to the Redwood Center for Theoretical Neuroscience at UC Berkeley. Abstract: Building artificial agents that can mimic human learning and reasoning has been a longstanding objective in artificial intelligence. I will discuss some of the empirical data and computational models from neuroscience and cognitive science that could help us advance towards this goal. Specifically, I will talk about the importance of structured representations of knowledge, particularly about mental or cognitive maps for time, space, and concepts. I will present data from recent behavioral and neural studies, which suggest that the brain maintains a scale-invariant mental timeline of the past and uses it to construct a compressed mental timeline of the future. From the computational perspective, these findings illustrate how associative learning can play a role in building structured representations of knowledge. Finally, I will discuss possible strategies to incorporate these findings into building artificial agents, especially in memory-augmented and attention-based neural networks.

Model of peripheral auditory system - case study in neural modeling

Model of peripheral auditory system - case study in neural modeling

Model of peripheral auditory system - case study in neural modeling

Headline generation for spoken content is important since spoken content is difficult to be shown on the screen and browsed by the user. It is a special type of abstractive summarization, for which the summaries are generated word by word from scratch without using any part of the original content. Many deep learning approaches for headline generation from text document have been proposed recently, all requiring huge quantities of training data, which is difficult for spoken document summarization. In this paper, we propose an ASR error modeling approach to learn the underlying structure of ASR error patterns and incorporate this model in an Attentive Recurrent Neural Network (ARNN) architecture. In this way, the model for abstractive headline generation for spoken content can be learned from abundant text data and the ASR data for some recognizers. Experiments showed very encouraging results and verified that the proposed ASR error model works well even when the input spoken content is recognized by a recognizer very different from the one the model learned from.

Research works are ongoing in mixing the biologically synthesized oil with the diesel for reducing the effect of global warming and climate change. From the review study, it is noted that the blended biodiesels require more assert about their practical viability. So, the non-edible Tamanu oil is synthesized and it is blended with diesel and its emission characteristics, engine performance and combustion characteristics are studied in our previous work. This paper attempts to model the diesel engine fueled with tamanu oil biodiesel blend. The proposed model exploits the context of neural network and the firefly algorithm is used to train it. After analyzing the various characteristics of the diesel engine, the acquired data is subjected to a proposed FF-NM method. The simulated results are statistically evaluated and the proposed modeling method is proved to be better than the other NM.

Models to predict tree survival and mortality can help to understand vegetation dynamics and to predict effects of climate change on native forests. The objective of the present study was to use Artificial Neural Networks, based on the competition index and climatic and categorical variables, to predict tree survival and mortality in Semideciduous Seasonal Forests in the Atlantic Forest biome. Numerical and categorical trees variables, in permanent plots, were used. The Agricultural Reference Index for Drought (ARID) and the distance-dependent competition index were the variables used. The overall efficiency of classification by ANNs was higher than 92% and 93% in the training and test, respectively. The accuracy for classification and number of surviving trees was above 99% in the test and in training for all ANNs. The classification accuracy of the number of dead trees was low. The mortality accuracy rate (10.96% for training and 13.76% for the test) was higher with the ANN 4, which considers the climatic variable and the competition index. The individual tree-level model integrates dendrometric and meteorological variables, representing a new step for modeling tree survival in the Atlantic Forest biome.

Trajectory reconstruction of pedestrian is of paramount importance to understand crowd dynamics and human movement pattern, which will provide insights to improve building design, facility management and route planning. Camera-based tracking methods have been widely explored with the rapid development of deep learning techniques. When moving to indoor environment, many challenges occur, including occlusions, complex environments and limited camera placement and coverage. Therefore, we propose a novel indoor trajectory reconstruction method using building information modeling (BIM) and graph neural network (GNN). A spatial graph representation is proposed for indoor environment to capture the spatial relationships of indoor areas and monitoring points. Closed circuit television (CCTV) system is integrated with BIM model through camera registration. Pedestrian simulation is conducted based on the BIM model to simulate the pedestrian movement in the considered indoor environment. The simulation results are embedded into the spatial graph for training of GNN. The indoor trajectory reconstruction is implemented as GNN conducts edge classification on the spatial graph

Statistical Analysis Plan (SAP) As part of the larger TIP project, 61 SAD patients and 41 healthy controls underwent an emotion regulation task with negative and neutral faces during fMRI scanning. We will use dynamic causal modeling (DCM) to shed light on potential disturbances in the effective connectivity of emotion regulation networks in social anxiety disorder (SAD).

In the article, a neural network analysis of the electrical activity of the human brain, which is included in the concept of "norm". A neural network model (Kohonen neural network) was built, which allows automatically classify electroencephalograms of an organized type.

We investigate the theory of observers in the quantum mechanical world by using a novel model of the human brain which incorporates the glial network into the Hopfield model of the neural network. Our model is based on a microscopic construction of a quantum Hamiltonian of the synaptic junctions. Using the Eguchi-Kawai large N reduction, we show that, when the number of neurons and astrocytes is exponentially large, the degrees of freedom of the dynamics of the neural and glial networks can be completely removed and, consequently, that the retention time of the superposition of the wave functions in the brain is as long as that of the microscopic quantum system of pre-synaptics sites. Based on this model, the classical information entropy of the neural-glial network is introduced. Using this quantity, we propose a criterion for the brain to be a quantum mechanical observer.

This article is from BMC Neuroscience , volume 15 . Abstract None

We developed physiologically relevant, neural networks to model time-varying neuronal population operations in the motor cortex and spinal cord, dealing with movements in space. We also developed a model of the interactions between these two networks dealing with generating time-varying motoneuronal outputs for movements in space. The novelty of our approach consisted in (a) the realistic nature of the elements in our networks, (b) the massive and asymmetric interconnectivity among network elements, (c) the physiologically relevant design of the networks, including the communication by spike trains among network elements and rules of connectivity based on experimental findings, (d) the dynamical behavior of the networks, and (e) the time-varying performance of the networks. Finally, we were able to reliably decode and transform the neuronal ensemble activity recorded in behaving animals for controlling an simulated arm. This demonstration suggests that the use of biologically inspired neural networks to transform raw cortical signals into the motor output of a multijoint artificial limb is both feasible and practical time-varying performance of the networks.

This study investigates how victim attitude responses (neutral vs. negative) influence third-party punishment decisions, using EEG and computational modeling. The goal is to understand the cognitive and neural mechanisms that underlie third-party punishment when victim feedback is incorporated. The EEG experiment aims to clarify the neural indicators of different victim attitudes (neutral vs. negative) under fair and unfair conditions, while the behavioral replication experiment seeks to replicate the behavioral results observed in the EEG study. Importantly, the study combines utility models to explore how parameters change in different attitude contexts, providing insights into the underlying psychological mechanisms.

This study investigates how victim attitude responses (neutral vs. negative) influence third-party punishment decisions, using EEG and computational modeling. The goal is to understand the cognitive and neural mechanisms that underlie third-party punishment when victim feedback is incorporated. The EEG experiment aims to clarify the neural indicators of different victim attitudes (neutral vs. negative) under fair and unfair conditions, while the behavioral replication experiment seeks to replicate the behavioral results observed in the EEG study. Importantly, the study combines utility models to explore how parameters change in different attitude contexts, providing insights into the underlying psychological mechanisms.

Massive small unmanned aerial vehicles are envisioned to operate in the near future. While there are lots of research problems need to be addressed before dense operations can happen, trajectory modeling remains as one of the keys to understand and develop policies, regulations, and requirements for safe and efficient unmanned aerial vehicle operations. The fidelity requirement of a small unmanned vehicle trajectory model is high because these vehicles are sensitive to winds due to their small size and low operational altitude. Both vehicle control systems and dynamic models are needed for trajectory modeling, which makes the modeling a great challenge, especially considering the fact that manufactures are not willing to share their control systems. This work proposed to use a neural network approach for modelling small unmanned vehicle's trajectory without knowing its control system and bypassing exhaustive efforts for aerodynamic parameter identification. As a proof of concept, instead of collecting data from flight tests, this work used the trajectory data generated by a mathematical vehicle model for training and testing the neural network. The results showed great promise because the trained neural network can predict 4D trajectories accurately, and prediction errors were less than 2:0 meters in both temporal and spatial dimensions.

This thesis evaluates a possible use of artificial neural networks for military manpower and personnel analysis. Two neural network models were constructed to predict the reenlistment behavior of a select group of individuals in the Navy, from a sample of 680 individuals. The data were extracted from the 1985 DoD Survey of Officer and Enlisted Personnel. Explanatory variables were grouped into demographic/personal, military characteristics, perceived probability of civilian employment, educational level, and satisfaction with military life and military benefits. The first neural network model was compared to a more traditional method of statistical modeling (logistic regression analysis) to determine the strengths and weaknesses of the neural network model. Both models used the same set of 17 variables and were tested using a holdout sample of 100 observations. The neural network model was found to be comparable to the logistic regression model as a predictor, but deficient as a policy analysis model. The second neural network model was constructed using the same data set and architecture as the first neural network model, including the original 17 variables, plus an additional II variables that consisted of variables with and without theoretical foundation for predicting reenlistment. The two neural network models were then compared and found to be similar at predicting reenlistment. Both neural network models were considered to be deficient as tools for policy analysts...

The brain is one of the most studied and highly complex systems in the biological world. It is the information center behind all vertebrate and most invertebrate life, and thus has become a major focus in current research. While many of these studies have concentrated on studying the brain directly, our focus is the structure of the brain itself: at its core an interconnected network of nodes (neurons). A better understanding of the structural aspects of the brain should elucidate some of its functional properties. In this paper we analyze the brain of the nematode Caenorhabditis elegans. Consisting of only 302 neurons, it is one of the better-understood neural networks. Using a Laplacian matrix of the 279-neuron "giant component" of the network, we use an eigenvalue counting function to look for fractal-like self similarity. This matrix representation is also used to plot (in eigenfunction coordinates) both 2 and 3 dimensional visualizations of the neural network. Further analysis examines the small-world properties of the system, including average path length and clustering coefficient. We then test for localization of eigenfunctions, using graph energy and spacial variance. To better understand these results, all of these calculations are also performed on random networks, branching trees, and known fractals, as well as fractals which have been "rewired" to have small-world properties. This analysis is one of many stepping-stones in the research of neural networks. While many of the structures and functions within the brain are known, understanding how the two interact is also important. A firmer grasp on the structural properties of the neural network is a key step in this process

Many important NLP problems can be posed as dual-sequence or sequence-to-sequence modeling tasks. Recent advances in building end-to-end neural architectures have been highly successful in solving such tasks. In this work we propose a new architecture for dual-sequence modeling that is based on associative memory. We derive AM-RNNs, a recurrent associative memory (AM) which augments generic recurrent neural networks (RNN). This architecture is extended to the Dual AM-RNN which operates on two AMs at once. Our models achieve very competitive results on textual entailment. A qualitative analysis demonstrates that long range dependencies between source and target-sequence can be bridged effectively using Dual AM-RNNs. However, an initial experiment on auto-encoding reveals that these benefits are not exploited by the system when learning to solve sequence-to-sequence tasks which indicates that additional supervision or regularization is needed.

Feedforward Neural Network (FNN)-based language models estimate the probability of the next word based on the history of the last N words, whereas Recurrent Neural Networks (RNN) perform the same task based only on the last word and some context information that cycles in the network. This paper presents a novel approach, which bridges the gap between these two categories of networks. In particular, we propose an architecture which takes advantage of the explicit, sequential enumeration of the word history in FNN structure while enhancing each word representation at the projection layer through recurrent context information that evolves in the network. The context integration is performed using an additional word-dependent weight matrix that is also learned during the training. Extensive experiments conducted on the Penn Treebank (PTB) and the Large Text Compression Benchmark (LTCB) corpus showed a significant reduction of the perplexity when compared to state-of-the-art feedforward as well as recurrent neural network architectures.

Fixed-vocabulary language models fail to account for one of the most characteristic statistical facts of natural language: the frequent creation and reuse of new word types. Although character-level language models offer a partial solution in that they can create word types not attested in the training corpus, they do not capture the "bursty" distribution of such words. In this paper, we augment a hierarchical LSTM language model that generates sequences of word tokens character by character with a caching mechanism that learns to reuse previously generated words. To validate our model we construct a new open-vocabulary language modeling corpus (the Multilingual Wikipedia Corpus, MWC) from comparable Wikipedia articles in 7 typologically diverse languages and demonstrate the effectiveness of our model across this range of languages.

Fixed-vocabulary language models fail to account for one of the most characteristic statistical facts of natural language: the frequent creation and reuse of new word types. Although character-level language models offer a partial solution in that they can create word types not attested in the training corpus, they do not capture the "bursty" distribution of such words. In this paper, we augment a hierarchical LSTM language model that generates sequences of word tokens character by character with a caching mechanism that learns to reuse previously generated words. To validate our model we construct a new open-vocabulary language modeling corpus (the Multilingual Wikipedia Corpus, MWC) from comparable Wikipedia articles in 7 typologically diverse languages and demonstrate the effectiveness of our model across this range of languages.