Downloads & Free Reading Options - Results

We are now witnessing the increasing availability of event stream data, i.e., a sequence of events with each event typically being denoted by the time it occurs and its mark information (e.g., event type). A fundamental problem is to model and predict such kind of marked temporal dynamics, i.e., when the next event will take place and what its mark will be. Existing methods either predict only the mark or the time of the next event, or predict both of them, yet separately. Indeed, in marked temporal dynamics, the time and the mark of the next event are highly dependent on each other, requiring a method that could simultaneously predict both of them. To tackle this problem, in this paper, we propose to model marked temporal dynamics by using a mark-specific intensity function to explicitly capture the dependency between the mark and the time of the next event. Extensive experiments on two datasets demonstrate that the proposed method outperforms state-of-the-art methods at predicting marked temporal dynamics.

A central challenge in neuroscience is understanding how neural system implements computation through its dynamics. We propose a nonlinear time series model aimed at characterizing interpretable dynamics from neural trajectories. Our model assumes low-dimensional continuous dynamics in a finite volume. It incorporates a prior assumption about globally contractional dynamics to avoid overly enthusiastic extrapolation outside of the support of observed trajectories. We show that our model can recover qualitative features of the phase portrait such as attractors, slow points, and bifurcations, while also producing reliable long-term future predictions in a variety of dynamical models and in real neural data.

A central challenge in neuroscience is understanding how neural system implements computation through its dynamics. We propose a nonlinear time series model aimed at characterizing interpretable dynamics from neural trajectories. Our model assumes low-dimensional continuous dynamics in a finite volume. It incorporates a prior assumption about globally contractional dynamics to avoid overly enthusiastic extrapolation outside of the support of observed trajectories. We show that our model can recover qualitative features of the phase portrait such as attractors, slow points, and bifurcations, while also producing reliable long-term future predictions in a variety of dynamical models and in real neural data.

http://uf.catalog.fcla.edu/uf.jsp?st=UF002056070&ix=pm&I=0&V=D&pm=1

We present the multiplicative recurrent neural network as a general model for compositional meaning in language, and evaluate it on the task of fine-grained sentiment analysis. We establish a connection to the previously investigated matrix-space models for compositionality, and show they are special cases of the multiplicative recurrent net. Our experiments show that these models perform comparably or better than Elman-type additive recurrent neural networks and outperform matrix-space models on a standard fine-grained sentiment analysis corpus. Furthermore, they yield comparable results to structural deep models on the recently published Stanford Sentiment Treebank without the need for generating parse trees.

In this paper, we propose an efficient transfer leaning methods for training a personalized language model using a recurrent neural network with long short-term memory architecture. With our proposed fast transfer learning schemes, a general language model is updated to a personalized language model with a small amount of user data and a limited computing resource. These methods are especially useful for a mobile device environment while the data is prevented from transferring out of the device for privacy purposes. Through experiments on dialogue data in a drama, it is verified that our transfer learning methods have successfully generated the personalized language model, whose output is more similar to the personal language style in both qualitative and quantitative aspects.

In this study, it was aimed to predict elementary education teacher candidates' achievements in "Science and Technology Education I and II" courses by using artificial neural networks. It was also aimed to show the independent variables importance in the prediction. In the data set used in this study, variables of gender, type of education, field of study in high school and transcript information of 14 courses including end-of-term letter grades were collected. The fact that the artificial neural network performance in this study was R = 0.84 for the Science and Technology Education I course, and R = 0.84 for the Science and Technology Education II course shows that the network performance overlaps with the findings obtained from the related studies.

Natural Language Processing (NLP) systems commonly leverage bag-of-words co-occurrence techniques to capture semantic and syntactic word relationships. The resulting word-level distributed representations often ignore morphological information, though character-level embeddings have proven valuable to NLP tasks. We propose a new neural language model incorporating both word order and character order in its embedding. The model produces several vector spaces with meaningful substructure, as evidenced by its performance of 85.8% on a recent word-analogy task, exceeding best published syntactic word-analogy scores by a 58% error margin. Furthermore, the model includes several parallel training methods, most notably allowing a skip-gram network with 160 billion parameters to be trained overnight on 3 multi-core CPUs, 14x larger than the previous largest neural network.

When working with three-dimensional data, choice of representation is key. We explore voxel-based models, and present evidence for the viability of voxellated representations in applications including shape modeling and object classification. Our key contributions are methods for training voxel-based variational autoencoders, a user interface for exploring the latent space learned by the autoencoder, and a deep convolutional neural network architecture for object classification. We address challenges unique to voxel-based representations, and empirically evaluate our models on the ModelNet benchmark, where we demonstrate a 51.5% relative improvement in the state of the art for object classification.

Recurrent neural network (RNN) based character-level language models (CLMs) are extremely useful for modeling out-of-vocabulary words by nature. However, their performance is generally much worse than the word-level language models (WLMs), since CLMs need to consider longer history of tokens to properly predict the next one. We address this problem by proposing hierarchical RNN architectures, which consist of multiple modules with different timescales. Despite the multi-timescale structures, the input and output layers operate with the character-level clock, which allows the existing RNN CLM training approaches to be directly applicable without any modifications. Our CLM models show better perplexity than Kneser-Ney (KN) 5-gram WLMs on the One Billion Word Benchmark with only 2% of parameters. Also, we present real-time character-level end-to-end speech recognition examples on the Wall Street Journal (WSJ) corpus, where replacing traditional mono-clock RNN CLMs with the proposed models results in better recognition accuracies even though the number of parameters are reduced to 30%.

Coronavirus disease 19 (COVID - 19), a disease caused by severe acute respiratory syndrome - coronavirus - 2 (SARS - CoV - 2), began as the flu and gradually developed into a highly infectious global pandemic leading to the death of over 6 million people in about 20 0 countries of the world. Its pathogenic nature has qualified it as a deadly disease, causing moderate and severe respiratory difficulty in infected individuals with the ability to mutate into different variants of the first version. As a result, different government agencies and health institutions have sought solutions within and outside the clinical space. This paper models COVID - 19 possible recurrence as variants and predicts that the subsequent waves will be more severe than the first wave. Long short - term memory network (LSTM) was used to predict the future occurrence of COVID - 19 and forecast the virus's pattern. Machine evaluation was performed using precision, recall, F1 - score, an area under the curve (AUC), and accuracy evaluation metrics. Datasets obtained were used to test the data. The collected characteristics were passed on to the system classification network, demonstrating the function's value based on the system's accuracy. The results showed that the COVID - 19 variants have a higher disastrou s effect within three months after the first wave.

Neural networks are a very useful tool for analyzing and modeling complex real world systems. Applying neural network simulations to real world problems generally involves large amounts of data and massive amounts of computation. To efficiently handle the computational requirements of large problems, we have implemented at Los Alamos a highly efficient neural network compiler for serial computers, vector computers, vector parallel computers, and fine grain SIMD computers such as the CM-2 connection machine. This paper describes the mapping used by the compiler to implement feed-forward backpropagation neural networks for a SIMD (Single Instruction Multiple Data) architecture parallel computer. Thinking Machines Corporation has benchmarked our code at 1.3 billion interconnects per second (approximately 3 gigaflops) on a 64,000 processor CM-2 connection machine (Singer 1990). This mapping is applicable to other SIMD computers and can be implemented on MIMD computers such as the CM-5 connection machine. Our mapping has virtually no communications overhead with the exception of the communications required for a global summation across the processors (which has a sub-linear runtime growth on the order of O(log(number of processors)). We can efficiently model very large neural networks which have many neurons and interconnects and our mapping can extend to arbitrarily large networks (within memory limitations) by merging the memory space of separate processors with fast adjacent processor interprocessor communications. This paper will consider the simulation of only feed forward neural network although this method is extendable to recurrent networks.

This project utilizes the neurocomputing technology towards modeling semiconductor fabrication processes for which analytical descriptions do not exist. Using data measured on GaAs fabrication lines of microwave circuits, partial fabrication stages as well as the complete process have been modeled. The developed models allow yield estimation and the determination as to which devices/wafers should be continued in the fabrication line. Subsequently, sensitivity analysis can be performed on process input factors to reveal which inputs carry more importance in producing final electronic devices having targeted specifications. The concept of neural network models of fabrication process has also been applied for achieving improved yield of fabricated devices. Process data have been evaluated for principal components and reduced neural network models developed. Perceptron networks have then been inverted and process inputs recentered to maximize the yield. To achieve this, optimization has been performed in the reduced input space. The principal component analysis allows for re-adjustment of actual inputs for maximum yield. The software DESCENT, developed as a part of this project, can be used as a tool for practical design centering for maximum yield. It should be noted that results of modeling and centering, including the DESCENT package, are available to model and improve yield of other fabrication and manufacturing techniques.

A neural network-based parking system with real-time license plate detection and vacant space detection using hyper parameter optimization is presented. When number of epochs increased from 30, 50 to 80 and learning rate tuned to 0.001, the validation loss improved to 0.017 and training object loss improved to 0.040. The model means average precision mAP_0.5 is improved to 0.988 and the precision is improved to 99%. The proposed neural network-based parking system also uses a regularization technique for effective predictive modeling. The proposed modified lasso ridge elastic (LRE) regularization technique provides a 5.21 root mean square error (RMSE) and an R-square of 0.71 with a 4.22 mean absolute error (MAE) indicative of higher accuracy performance compared to other regularization regression models. The advantage of the proposed modified LRE is that it enables effective regularization via modified penalty with the feature selection characteristics of both lasso and ridge.

The tonotopic representation of sounds is a well established organizational principle of the auditory cortex. However, given the small extent of auditory cortical regions, mapping tonotopic representation using noninvasive tools such as M/EEG is challenging. Resolving ongoing brain activity at a tonotopic level has been deemed virtually impossible due to volume conduction. However, based on previous data showing robust carrier-frequency decoding, it is clear tonotopic information is present at a noninvasive level. In order to also eavesdrop on ongoing activity, we propose that backward encoding models can be tuned to specific sound frequency bands applied to other data sets and to model neural activity in resulting “feature” (here: sound frequency band) channels.

Feedforward Neural Network (FNN)-based language models estimate the probability of the next word based on the history of the last N words, whereas Recurrent Neural Networks (RNN) perform the same task based only on the last word and some context information that cycles in the network. This paper presents a novel approach, which bridges the gap between these two categories of networks. In particular, we propose an architecture which takes advantage of the explicit, sequential enumeration of the word history in FNN structure while enhancing each word representation at the projection layer through recurrent context information that evolves in the network. The context integration is performed using an additional word-dependent weight matrix that is also learned during the training. Extensive experiments conducted on the Penn Treebank (PTB) and the Large Text Compression Benchmark (LTCB) corpus showed a significant reduction of the perplexity when compared to state-of-the-art feedforward as well as recurrent neural network architectures.

Many important NLP problems can be posed as dual-sequence or sequence-to-sequence modeling tasks. Recent advances in building end-to-end neural architectures have been highly successful in solving such tasks. In this work we propose a new architecture for dual-sequence modeling that is based on associative memory. We derive AM-RNNs, a recurrent associative memory (AM) which augments generic recurrent neural networks (RNN). This architecture is extended to the Dual AM-RNN which operates on two AMs at once. Our models achieve very competitive results on textual entailment. A qualitative analysis demonstrates that long range dependencies between source and target-sequence can be bridged effectively using Dual AM-RNNs. However, an initial experiment on auto-encoding reveals that these benefits are not exploited by the system when learning to solve sequence-to-sequence tasks which indicates that additional supervision or regularization is needed.

The brain is one of the most studied and highly complex systems in the biological world. It is the information center behind all vertebrate and most invertebrate life, and thus has become a major focus in current research. While many of these studies have concentrated on studying the brain directly, our focus is the structure of the brain itself: at its core an interconnected network of nodes (neurons). A better understanding of the structural aspects of the brain should elucidate some of its functional properties. In this paper we analyze the brain of the nematode Caenorhabditis elegans. Consisting of only 302 neurons, it is one of the better-understood neural networks. Using a Laplacian matrix of the 279-neuron "giant component" of the network, we use an eigenvalue counting function to look for fractal-like self similarity. This matrix representation is also used to plot (in eigenfunction coordinates) both 2 and 3 dimensional visualizations of the neural network. Further analysis examines the small-world properties of the system, including average path length and clustering coefficient. We then test for localization of eigenfunctions, using graph energy and spacial variance. To better understand these results, all of these calculations are also performed on random networks, branching trees, and known fractals, as well as fractals which have been "rewired" to have small-world properties. This analysis is one of many stepping-stones in the research of neural networks. While many of the structures and functions within the brain are known, understanding how the two interact is also important. A firmer grasp on the structural properties of the neural network is a key step in this process

How to model a pair of sentences is a critical issue in many NLP tasks such as answer selection (AS), paraphrase identification (PI) and textual entailment (TE). Most prior work (i) deals with one individual task by fine-tuning a specific system; (ii) models each sentence's representation separately, rarely considering the impact of the other sentence; or (iii) relies fully on manually designed, task-specific linguistic features. This work presents a general Attention Based Convolutional Neural Network (ABCNN) for modeling a pair of sentences. We make three contributions. (i) ABCNN can be applied to a wide variety of tasks that require modeling of sentence pairs. (ii) We propose three attention schemes that integrate mutual influence between sentences into CNN; thus, the representation of each sentence takes into consideration its counterpart. These interdependent sentence pair representations are more powerful than isolated sentence representations. (iii) ABCNN achieves state-of-the-art performance on AS, PI and TE tasks.

Models to predict tree survival and mortality can help to understand vegetation dynamics and to predict effects of climate change on native forests. The objective of the present study was to use Artificial Neural Networks, based on the competition index and climatic and categorical variables, to predict tree survival and mortality in Semideciduous Seasonal Forests in the Atlantic Forest biome. Numerical and categorical trees variables, in permanent plots, were used. The Agricultural Reference Index for Drought (ARID) and the distance-dependent competition index were the variables used. The overall efficiency of classification by ANNs was higher than 92% and 93% in the training and test, respectively. The accuracy for classification and number of surviving trees was above 99% in the test and in training for all ANNs. The classification accuracy of the number of dead trees was low. The mortality accuracy rate (10.96% for training and 13.76% for the test) was higher with the ANN 4, which considers the climatic variable and the competition index. The individual tree-level model integrates dendrometric and meteorological variables, representing a new step for modeling tree survival in the Atlantic Forest biome.

Knowing which words have been attended to in previous time steps while generating a translation is a rich source of information for predicting what words will be attended to in the future. We improve upon the attention model of Bahdanau et al. (2014) by explicitly modeling the relationship between previous and subsequent attention levels for each word using one recurrent network per input word. This architecture easily captures informative features, such as fertility and regularities in relative distortion. In experiments, we show our parameterization of attention improves translation quality.

The goal of this work was to analyze the potential of neural networks and fuzzy logic methods to develop approximate response surfaces as process modeling, that is for mapping of input into output. Structural response was chosen as an example. Each of the many methods surveyed are explained and the results are presented. Future research directions are also discussed.

This dissertation research extends the current knowledge of feature saliency in artificial neural networks (ANN). Feature saliency measures allow for the user to rank order the features based upon the saliency, or relative importance, of the features. Selecting a parsimonious set of salient input features is crucial to the success of any ANN model. In this research, several methodologies were developed using the Signal to Noise Ratio (SNR) Feature Screening Method and its associated SNR Saliency Measure for selecting a parsimonious set of salient features to classify pilot workload in addition to air traffic controller workload. Candidate features were derived from electroencephalography (EEG), electrocardiography (EKG), electro-oculography (EOG), and respiratory gauges. In addition, a new saliency measure was developed that can account for time in Elman Recurrent Neural Networks (RNN). This Partial Derivative Based Spatial Temporal Saliency Measure is used via a Spatial Temporal Feature Screening Method for selecting a parsimonious set of salient features in both time and space. Finally, a technique for investigating the memory capacity of an Elman RNN was developed.

This dissertation research extends the current knowledge of feature saliency in artificial neural networks (ANN). Feature saliency measures allow for the user to rank order the features based upon the saliency, or relative importance, of the features. Selecting a parsimonious set of salient input features is crucial to the success of any ANN model. In this research, several methodologies were developed using the Signal to Noise Ratio (SNR) Feature Screening Method and its associated SNR Saliency Measure for selecting a parsimonious set of salient features to classify pilot workload in addition to air traffic controller workload. Candidate features were derived from electroencephalography (EEG), electrocardiography (EKG), electro-oculography (EOG), and respiratory gauges. In addition, a new saliency measure was developed that can account for time in Elman Recurrent Neural Networks (RNN). This Partial Derivative Based Spatial Temporal Saliency Measure is used via a Spatial Temporal Feature Screening Method for selecting a parsimonious set of salient features in both time and space. Finally, a technique for investigating the memory capacity of an Elman RNN was developed.

This dissertation research extends the current knowledge of feature saliency in artificial neural networks (ANN). Feature saliency measures allow for the user to rank order the features based upon the saliency, or relative importance, of the features. Selecting a parsimonious set of salient input features is crucial to the success of any ANN model. In this research, several methodologies were developed using the Signal to Noise Ratio (SNR) Feature Screening Method and its associated SNR Saliency Measure for selecting a parsimonious set of salient features to classify pilot workload in addition to air traffic controller workload. Candidate features were derived from electroencephalography (EEG), electrocardiography (EKG), electro-oculography (EOG), and respiratory gauges. In addition, a new saliency measure was developed that can account for time in Elman Recurrent Neural Networks (RNN). This Partial Derivative Based Spatial Temporal Saliency Measure is used via a Spatial Temporal Feature Screening Method for selecting a parsimonious set of salient features in both time and space. Finally, a technique for investigating the memory capacity of an Elman RNN was developed.

This thesis evaluates the capabilities of artificial neural networks in forecasting the take-rates of the Voluntary Separations Incentive/Special Separations Benefit (VSI/SSB) programs for male, Marine Corps Enlisted Personnel in the grades of E-5 and E-6. The Artificial Neural Networks models are compared with the forecasting abilities of a classical regression model. The data are taken from the Headquarters Marine Corps Enlisted Master File which contains military and personal background on each enlisted member of the United States Marine Corps. The classical regression model is a casual model constructed based upon the theory of occupational job choice. The neural network models are presented with all available data elements. Empirical results indicate that artificial neural networks provide forecasting results at least as good as, if not better than, those obtained using classical regression techniques. However, artificial neural networks are limited in their usefulness for policy analysis. Neural networks, Modeling techniques, Voluntary separation programs, VSI, SSB, Marine Corps separations incentives.

Large amount of small Unmanned Aerial Vehicles (sUAVs) are projected to operate in the near future. Potential sUAV applications include, but not limited to, search and rescue, inspection and surveillance, aerial photography and video, precision agriculture, and parcel delivery. sUAVs are expected to operate in the uncontrolled Class G airspace, which is at or below 500 feet above ground level (AGL), where many static and dynamic constraints exist, such as ground properties and terrains, restricted areas, various winds, manned helicopters, and conflict avoidance among sUAVs. How to enable safe, efficient, and massive sUAV operations at the low altitude airspace remains a great challenge. NASA's Unmanned aircraft system Traffic Management (UTM) research initiative works on establishing infrastructure and developing policies, requirement, and rules to enable safe and efficient sUAVs' operations. To achieve this goal, it is important to gain insights of future UTM traffic operations through simulations, where the accurate trajectory model plays an extremely important role. On the other hand, like what happens in current aviation development, trajectory modeling should also serve as the foundation for any advanced concepts and tools in UTM. Accurate models of sUAV dynamics and control systems are very important considering the requirement of the meter level precision in UTM operations. The vehicle dynamics are relatively easy to derive and model, however, vehicle control systems remain unknown as they are usually kept by manufactures as a part of intellectual properties. That brings challenges to trajectory modeling for sUAVs. How to model the vehicle's trajectories with unknown control system? This work proposes to use a neural network to model a vehicle's trajectory. The neural network is first trained to learn the vehicle's responses at numerous conditions. Once being fully trained, given current vehicle states, winds, and desired future trajectory, the neural network should be able to predict the vehicle's future states at next time step. A complete 4-D trajectory are then generated step by step using the trained neural network. Experiments in this work show that the neural network can approximate the sUAV's model and predict the trajectory accurately.

Speaker intent detection and semantic slot filling are two critical tasks in spoken language understanding (SLU) for dialogue systems. In this paper, we describe a recurrent neural network (RNN) model that jointly performs intent detection, slot filling, and language modeling. The neural network model keeps updating the intent estimation as word in the transcribed utterance arrives and uses it as contextual features in the joint model. Evaluation of the language model and online SLU model is made on the ATIS benchmarking data set. On language modeling task, our joint model achieves 11.8% relative reduction on perplexity comparing to the independent training language model. On SLU tasks, our joint model outperforms the independent task training model by 22.3% on intent detection error rate, with slight degradation on slot filling F1 score. The joint model also shows advantageous performance in the realistic ASR settings with noisy speech input.

Full-scale flight-test pilot floor vibration is modeled using neural networks and full-scale wind tunnel test data for low speed level flight conditions. Neural network connections between the wind tunnel test data and the three flight test pilot vibration components (vertical, lateral, and longitudinal) are studied. Two full-scale UH-60A Black Hawk databases are used. The first database is the NASA/Army UH-60A Airloads Program flight test database. The second database is the UH-60A rotor-only wind tunnel database that was acquired in the NASA Ames 80- by 120- Foot Wind Tunnel with the Large Rotor Test Apparatus (LRTA). Using neural networks, the flight-test pilot vibration is modeled using the wind tunnel rotating system hub accelerations, and separately, using the hub loads. The results show that the wind tunnel rotating system hub accelerations and the operating parameters can represent the flight test pilot vibration. The six components of the wind tunnel N/rev balance-system hub loads and the operating parameters can also represent the flight test pilot vibration. The present neural network connections can significantly increase the value of wind tunnel testing.

Book Source: Digital Library of India Item 2015.225022 dc.contributor.author: Om Prakash dc.date.accessioned: 2015-07-10T15:28:14Z dc.date.available: 2015-07-10T15:28:14Z dc.date.digitalpublicationdate: 2005-09-08 dc.identifier.barcode: 5990010120112 dc.identifier.origpath: /rawdataupload/upload/0120/114 dc.identifier.copyno: 1 dc.identifier.uri: http://www.new.dli.ernet.in/handle/2015/225022 dc.description.scannerno: 15 dc.description.scanningcentre: IIIT, Allahabad dc.description.main: 1 dc.description.tagged: 0 dc.description.totalpages: 66 dc.format.mimetype: application/pdf dc.language.iso: English dc.publisher: Indian Institute Of Technology Kanpur dc.rights: Out_of_copyright dc.source.library: Indian Institute Of Technology Kanpur dc.subject.classification: Technology dc.subject.classification: Engineering. Technology In General dc.subject.classification: Mechanical Engineering In General. Nuclear Technology. Electrical Engineering. Machinery dc.title: Modeling Of Performence Of An Artillery Rocket Using Neural Networks

A Volterra series approach was applied to the identification of nonlinear systems which are described by a neural network model. A procedure is outlined by which a mathematical model can be developed from experimental data obtained from the network structure. Applications of the results to the control of robotic systems are discussed.

The negative sampling (NEG) objective function, used in word2vec, is a simplification of the Noise Contrastive Estimation (NCE) method. NEG was found to be highly effective in learning continuous word representations. However, unlike NCE, it was considered inapplicable for the purpose of learning the parameters of a language model. In this study, we refute this assertion by providing a principled derivation for NEG-based language modeling, founded on a novel analysis of a low-dimensional approximation of the matrix of pointwise mutual information between the contexts and the predicted words. The obtained language modeling is closely related to NCE language models but is based on a simplified objective function. We thus provide a unified formulation for two main language processing tasks, namely word embedding and language modeling, based on the NEG objective function. Experimental results on two popular language modeling benchmarks show comparable perplexity results, with a small advantage to NEG over NCE.

Recurrent neural networks (RNNs) have shown promising performance for language modeling. However, traditional training of RNNs using back-propagation through time often suffers from overfitting. One reason for this is that stochastic optimization (used for large training sets) does not provide good estimates of model uncertainty. This paper leverages recent advances in stochastic gradient Markov Chain Monte Carlo (also appropriate for large training sets) to learn weight uncertainty in RNNs. It yields a principled Bayesian learning algorithm, adding gradient noise during training (enhancing exploration of the model-parameter space) and model averaging when testing. Extensive experiments on various RNN models and across a broad range of applications demonstrate the superiority of the proposed approach over stochastic optimization.

This article is from Frontiers in Computational Neuroscience , volume 7 . Abstract Drosophila larvae crawl by peristaltic waves of muscle contractions, which propagate along the animal body and involve the simultaneous contraction of the left and right side of each segment. Coordinated propagation of contraction does not require sensory input, suggesting that movement is generated by a central pattern generator (CPG). We characterized crawling behavior of newly hatched Drosophila larvae by quantifying timing and duration of segmental boundary contractions. We developed a CPG network model that recapitulates these patterns based on segmentally repeated units of excitatory and inhibitory (EI) neuronal populations coupled with immediate neighboring segments. A single network with symmetric coupling between neighboring segments succeeded in generating both forward and backward propagation of activity. The CPG network was robust to changes in amplitude and variability of connectivity strength. Introducing sensory feedback via “stretch-sensitive” neurons improved wave propagation properties such as speed of propagation and segmental contraction duration as observed experimentally. Sensory feedback also restored propagating activity patterns when an inappropriately tuned CPG network failed to generate waves. Finally, in a two-sided CPG model we demonstrated that two types of connectivity could synchronize the activity of two independent networks: connections from excitatory neurons on one side to excitatory contralateral neurons (E to E), and connections from inhibitory neurons on one side to excitatory contralateral neurons (I to E). To our knowledge, such I to E connectivity has not yet been found in any experimental system; however, it provides the most robust mechanism to synchronize activity between contralateral CPGs in our model. Our model provides a general framework for studying the conditions under which a single locally coupled network generates bilaterally synchronized and longitudinally propagating waves in either direction.

While processing polymetallic ores at the non-ferrous metallurgy problems arises connecting with the excellence of production and the efficient applying the technological devices-firing furnace and crusher machine. In earlier time, similar questions were solved due to the big practice experiences and using a mathematical modeling method. The mathematical model for optimizing those operating mode is a very complex and hard to calculation. Performing computations is needed too much time and many resources. Because the control of the agglomeration furnaces and other machines are including complex multiparameter processes. The method of the math modeling for optimization the operating mode to the firing furnace is replaced with modeling based on the neural network that is here a new method. The results obtained have shown that proposed methods based on the neural network modeling of metallurgical processes allow determining more accurate and adequate results of calculations than mathematical modeling by the traditional program. The use of new approaches for modeling the technological processes at the non-ferrous metallurgy gives opportunity to enhance an effectiveness of production excellence and to enhance an efficient applying the heat-energy equipment while a firing the sulfide polymetallic ores of non-ferrous metallurgy.

Ionospheric models have been developed to interpret Relocatable Over-the-Horizon Radar data. This thesis examines the applicability of neural networks to ionospheric modeling in support of Relocatable Over-the-Horizon Radar. Two neural networks were used for this investigation. The flrst network was trained and tested on experimental ionospheric sounding data. Results showed neural networks are excellent at modeling ionospheric data for a given day. The second network was trained on ionospheric models and tested on experimental data. Results showed neural networks are able to learn many ionospheric models and the modeling network generally agreed with the experimental data.

Here we demonstrate that the activity of neural ensembles can be quantitatively modeled. We first show that an ensemble dynamical model (EDM) accurately approximates the distribution of voltages and average firing rate per neuron of a population of simulated integrate-and-fire neurons. EDMs are high-dimensional nonlinear dynamical models. To faciliate the estimation of their parameters we present a dimensionality reduction method and study its performance with simulated data. We then introduce and evaluate a maximum-likelihood method to estimate connectivity parameters in networks of EDMS. Finally, we show that this model an methods accurately approximate the high-gamma power evoked by pure tones in the auditory cortex of rodents. Overall, this article demonstrates that quantitatively modeling brain activity at the ensemble level is indeed possible, and opens the way to understanding the computations performed by neural ensembles, which could revolutionarize our understanding of brain function.

The convolutional neural networks (CNNs) have proven to be a powerful tool for discriminative learning. Recently researchers have also started to show interest in the generative aspects of CNNs in order to gain a deeper understanding of what they have learned and how to further improve them. This paper investigates generative modeling of CNNs. The main contributions include: (1) We construct a generative model for the CNN in the form of exponential tilting of a reference distribution. (2) We propose a generative gradient for pre-training CNNs by a non-parametric importance sampling scheme, which is fundamentally different from the commonly used discriminative gradient, and yet has the same computational architecture and cost as the latter. (3) We propose a generative visualization method for the CNNs by sampling from an explicit parametric image distribution. The proposed visualization method can directly draw synthetic samples for any given node in a trained CNN by the Hamiltonian Monte Carlo (HMC) algorithm, without resorting to any extra hold-out images. Experiments on the challenging ImageNet benchmark show that the proposed generative gradient pre-training consistently helps improve the performances of CNNs, and the proposed generative visualization method generates meaningful and varied samples of synthetic images from a large-scale deep CNN.

A practical means of reducing the impact of blast loads on buildings is to introduce a barrier wall between the explosive device and the building. The height and location of the barrier wall are key design variables in terms of effectively reducing the peak positive and negative overpressure and impulse on the building. Until recently, set-ups that included a barrier between the explosive device and the building could only be modeled with consistent accuracy by using numeric simulation techniques. Unfortunately, these models require many hours of processing time to complete a simulation run, even for the fastest of today's computers. This has led several researchers to consider the use of advanced empirical modeling methods, specifically artificial neural networks, to overcome problems of computationally expensive simulations. Neural networks have the potential to make predictions of the influence of a barrier on blast propagation in a matter of seconds using a desktop computer, thus making it easier for designers to home-in on an optimal solution. Artificial neural networks appear to be well suited to this application, performing well for problems that are strongly non-linear and comprise many independent variables. This paper reports on past and on-going research in this field at AFRL Tyndall, using both scaled-live experimental data and simulated data to develop the neural models. The design and validation of these models are presented, and their successes and deficiencies are discussed. The paper concludes with an overview of current and future research plans to take this work to a state suitable for use in the field, and to extend it to problems comprising significantly more complicated configurations of structures than a barrier positioned between the explosive device and a building.

Field-programmable gate array (FPGA) is a prominent device in developing the internet of things (IoT) application since it offers parallel computation, power efficiency, and scalability. The identification and authentication of these FPGAbased IoT applications are crucial to secure the user-sensitive data transmitted over IoT networks. Physical unclonable function (PUF) technology provides a great capability to be used as device identification and authentication for FPGAbased IoT applications. Nevertheless, conventional PUF-based authentication suffers a huge overhead in storing the challenge-response pairs (CRPs) in the verifier’s database. Therefore, in this paper, the FPGA implementation of the Arbiter-PUF model using an artificial neural network (ANN) is presented. The PUF model can generate the CRPs on-the-fly upon the authentication request (i.e., by a prover) to the verifier and eliminates huge storage of CRPs database in the verifier. The architecture of ANN (i.e., Arbiter-PUF model) is designed in Xilinx system generator and subsequently converted into intellectual property (IP). Further, the IP is programmed in Xilinx Artix-7 FPGA with other peripherals for CRPs generation and validation. The findings show that the Arbiter-PUF model implementation on FPGA using the ANN technique achieves approximately 98% accuracy. The model consumes 12,196 look-up tables (LUTs) and 67 mW power in FPGA.

Trajectory reconstruction of pedestrian is of paramount importance to understand crowd dynamics and human movement pattern, which will provide insights to improve building design, facility management and route planning. Camera-based tracking methods have been widely explored with the rapid development of deep learning techniques. When moving to indoor environment, many challenges occur, including occlusions, complex environments and limited camera placement and coverage. Therefore, we propose a novel indoor trajectory reconstruction method using building information modeling (BIM) and graph neural network (GNN). A spatial graph representation is proposed for indoor environment to capture the spatial relationships of indoor areas and monitoring points. Closed circuit television (CCTV) system is integrated with BIM model through camera registration. Pedestrian simulation is conducted based on the BIM model to simulate the pedestrian movement in the considered indoor environment. The simulation results are embedded into the spatial graph for training of GNN. The indoor trajectory reconstruction is implemented as GNN conducts edge classification on the spatial graph

Statistical Analysis Plan (SAP) As part of the larger TIP project, 61 SAD patients and 41 healthy controls underwent an emotion regulation task with negative and neutral faces during fMRI scanning. We will use dynamic causal modeling (DCM) to shed light on potential disturbances in the effective connectivity of emotion regulation networks in social anxiety disorder (SAD).

The overall objective of this ongoing effort is to provide the capability to model and simulate rotorcraft aeromechanics behaviors in real-time. This would be accomplished by the addition of an aeromechanics element to an existing high-fidelity, real-time helicopter flight simulation. As a first step, the peak vertical vibration at the pilot floor location was considered in this neural-network-based study. The flight conditions considered were level flights, rolls, pushovers, pull-ups, autorotations, and landing flares. The NASA/Army UH-60A Airloads Program flight test database was the source of raw data. The present neural network training databases were created in a physically consistent manner. Two modeling approaches, with different physical assumptions, were considered. The first approach involved a maneuver load factor that was derived using the roll-angle and the pitch-rate. The second approach involved the three pilot control stick positions. The resulting, trained back-propagation neural networks were small, implying rapid execution. The present neural-network-based approach involving the peak pilot vibration was utilized in a quasi-static manner to simulate an extreme, time-varying pull-up maneuver. For the above pull-up maneuver, the maneuver load factor approach was better for real-time simulation, i.e., produced greater fidelity, as compared to the control stick positions approach. Thus, neural networks show promise for use in high-fidelity, real-time modeling of rotorcraft vibration.

Neural network relationships between the full-scale, flight test hub accelerations and the corresponding three N/rev pilot floor vibration components (vertical, lateral, and longitudinal) are studied. The present quantitative effort on the UH-60A Black Hawk hub accelerations considers the lateral and longitudinal vibrations. An earlier study had considered the vertical vibration. The NASA/Army UH-60A Airloads Program flight test database is used. A physics based maneuver-effect- factor (MEF), derived using the roll-angle and the pitch-rate, is used. Fundamentally, the lateral vibration data show high vibration levels (up to 0.3 g's) at low airspeeds (for example, during landing flares) and at high airspeeds (for example, during turns). The results show that the advance ratio and the gross weight together can predict the vertical and the longitudinal vibration. However, the advance ratio and the gross weight together cannot predict the lateral vibration. The hub accelerations and the advance ratio can be used to satisfactorily predict the vertical, lateral, and longitudinal vibration. The present study shows that neural network based representations of all three UH-60A pilot floor vibration components (vertical, lateral, and longitudinal) can be obtained using the hub accelerations along with the gross weight and the advance ratio. The hub accelerations are clearly a factor in determining the pilot vibration. The present conclusions potentially allow for the identification of neural network relationships between the experimental hub accelerations obtained from wind tunnel testing and the experimental pilot vibration data obtained from flight testing. A successful establishment of the above neural network based link between the wind tunnel hub accelerations and the flight test vibration data can increase the value of wind tunnel testing.

In the article, a neural network analysis of the electrical activity of the human brain, which is included in the concept of "norm". A neural network model (Kohonen neural network) was built, which allows automatically classify electroencephalograms of an organized type.

In this paper we present a methodological framework that meets novel requirements emerging from upcoming types of accelerated and highly configurable neuromorphic hardware systems. We describe in detail a device with 45 million programmable and dynamic synapses that is currently under development, and we sketch the conceptual challenges that arise from taking this platform into operation. More specifically, we aim at the establishment of this neuromorphic system as a flexible and neuroscientifically valuable modeling tool that can be used by non-hardware-experts. We consider various functional aspects to be crucial for this purpose, and we introduce a consistent workflow with detailed descriptions of all involved modules that implement the suggested steps: The integration of the hardware interface into the simulator-independent model description language PyNN; a fully automated translation between the PyNN domain and appropriate hardware configurations; an executable specification of the future neuromorphic system that can be seamlessly integrated into this biology-to-hardware mapping process as a test bench for all software layers and possible hardware design modifications; an evaluation scheme that deploys models from a dedicated benchmark library, compares the results generated by virtual or prototype hardware devices with reference software simulations and analyzes the differences. The integration of these components into one hardware-software workflow provides an ecosystem for ongoing preparative studies that support the hardware design process and represents the basis for the maturity of the model-to-hardware mapping software. The functionality and flexibility of the latter is proven with a variety of experimental results.

In this work, the beta-decay halflives problem is dealt as a nonlinear optimization problem, which is resolved in the statistical framework of Machine Learning (LM). Continuing past similar approaches, we have constructed sophisticated Artificial Neural Networks (ANNs) and Support Vector Regression Machines (SVMs) for each class with even-odd character in Z and N to global model the systematics of nuclei that decay 100% by the beta-minus-mode in their ground states. The arising large-scale lifetime calculations generated by both types of machines are discussed and compared with each other, with the available experimental data, with previous results obtained with neural networks, as well as with estimates coming from traditional global nuclear models. Particular attention is paid on the estimates for exotic and halo nuclei and we focus to those nuclides that are involved in the r-process nucleosynthesis. It is found that statistical models based on LM can at least match or even surpass the predictive performance of the best conventional models of beta-decay systematics and can complement the latter.

Encoding models are used for predicting brain activity in response to sensory stimuli with the objective of elucidating how sensory information is represented in the brain. Encoding models typically comprise a nonlinear transformation of stimuli to features (feature model) and a linear transformation of features to responses (response model). While there has been extensive work on developing better feature models, the work on developing better response models has been rather limited. Here, we investigate the extent to which recurrent neural network models can use their internal memories for nonlinear processing of arbitrary feature sequences to predict feature-evoked response sequences as measured by functional magnetic resonance imaging. We show that the proposed recurrent neural network models can significantly outperform established response models by accurately estimating long-term dependencies that drive hemodynamic responses. The results open a new window into modeling the dynamics of brain activity in response to sensory stimuli.

Electricity consumption is increasing gradually and this trend will continue in the future. In addition, rapid network control systems using the resources offered by power electronics and control microelectronics have been recently studied and developed, and are currently in normal application for some, for others, in pilot applications or as prototypes. This paper attempts to show that these systems are referred to by the general acronym flexible alternative current transmission systems (FACTS) similarly dethroned the traditional systems while offering better solutions and solving the energy quality problem such as the hybrid system (unified power flow controller (UPFC), or universal phase shifter regulator (UPSR)) which opens up new perspectives for more efficient operation of networks by continuous and rapid action on the various parameters of the network (voltage, phase shift, and impedance); thus, the power transits will be better controlled and the voltages better held, which will make it possible to increase the stability margins or tend towards the thermal limits of the lines. In this work, we used a classic control (PI-decoupled) and others while offering more flexibility of control thanks to the development of strategies identification/control based on generalized predictive control (GPC) with neural network to ensure robust control with advanced algorithms.

Econophysics has developed as a research field that applies the formalism of Statistical Mechanics and Quantum Mechanics to address Economics and Finance problems. The branch of Econophysics that applies of Quantum Theory to Economics and Finance is called Quantum Econophysics. In Finance, Quantum Econophysics' contributions have ranged from option pricing to market dynamics modeling, behavioral finance and applications of Game Theory, integrating the empirical finding, from human decision analysis, that shows that nonlinear update rules in probabilities, leading to non-additive decision weights, can be computationally approached from quantum computation, with resulting quantum interference terms explaining the non-additive probabilities. The current work draws on these results to introduce new tools from Quantum Artificial Intelligence, namely Quantum Artificial Neural Networks as a way to build and simulate financial market models with adaptive selection of trading rules, leading to turbulence and excess kurtosis in the returns distributions for a wide range of parameters.