Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks - Info and Reading Options
By Ji Li, Zihao Yuan, Zhe Li, Caiwen Ding, Ao Ren, Qinru Qiu, Jeffrey Draper and Yanzhi Wang
“Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks” Metadata:
- Title: ➤ Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks
- Authors: ➤ Ji LiZihao YuanZhe LiCaiwen DingAo RenQinru QiuJeffrey DraperYanzhi Wang
“Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks” Subjects and Themes:
Edition Identifiers:
- Internet Archive ID: arxiv-1703.04135
AI-generated Review of “Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks”:
"Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks" Description:
The Internet Archive:
Recently, Deep Convolutional Neural Networks (DCNNs) have made unprecedented progress, achieving the accuracy close to, or even better than human-level perception in various tasks. There is a timely need to map the latest software DCNNs to application-specific hardware, in order to achieve orders of magnitude improvement in performance, energy efficiency and compactness. Stochastic Computing (SC), as a low-cost alternative to the conventional binary computing paradigm, has the potential to enable massively parallel and highly scalable hardware implementation of DCNNs. One major challenge in SC based DCNNs is designing accurate nonlinear activation functions, which have a significant impact on the network-level accuracy but cannot be implemented accurately by existing SC computing blocks. In this paper, we design and optimize SC based neurons, and we propose highly accurate activation designs for the three most frequently used activation functions in software DCNNs, i.e, hyperbolic tangent, logistic, and rectified linear units. Experimental results on LeNet-5 using MNIST dataset demonstrate that compared with a binary ASIC hardware DCNN, the DCNN with the proposed SC neurons can achieve up to 61X, 151X, and 2X improvement in terms of area, power, and energy, respectively, at the cost of small precision degradation.In addition, the SC approach achieves up to 21X and 41X of the area, 41X and 72X of the power, and 198200X and 96443X of the energy, compared with CPU and GPU approaches, respectively, while the error is increased by less than 3.07%. ReLU activation is suggested for future SC based DCNNs considering its superior performance under a small bit stream length.
Read “Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks”:
Read “Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks” by choosing from the options below.
Available Downloads for “Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks”:
"Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks" is available for download from The Internet Archive in "texts" format, the size of the file-s is: 0.95 Mbs, and the file-s went public at Sat Jun 30 2018.
Legal and Safety Notes
Copyright Disclaimer and Liability Limitation:
A. Automated Content Display
The creation of this page is fully automated. All data, including text, images, and links, is displayed exactly as received from its original source, without any modification, alteration, or verification. We do not claim ownership of, nor assume any responsibility for, the accuracy or legality of this content.
B. Liability Disclaimer for External Content
The files provided below are solely the responsibility of their respective originators. We disclaim any and all liability, whether direct or indirect, for the content, accuracy, legality, or any other aspect of these files. By using this website, you acknowledge that we have no control over, nor endorse, the content hosted by external sources.
C. Inquiries and Disputes
For any inquiries, concerns, or issues related to the content displayed, including potential copyright claims, please contact the original source or provider of the files directly. We are not responsible for resolving any content-related disputes or claims of intellectual property infringement.
D. No Copyright Ownership
We do not claim ownership of any intellectual property contained in the files or data displayed on this website. All copyrights, trademarks, and other intellectual property rights remain the sole property of their respective owners. If you believe that content displayed on this website infringes upon your intellectual property rights, please contact the original content provider directly.
E. Fair Use Notice
Some content displayed on this website may fall under the "fair use" provisions of copyright law for purposes such as commentary, criticism, news reporting, research, or educational purposes. If you believe any content violates fair use guidelines, please reach out directly to the original source of the content for resolution.
Virus Scanning for Your Peace of Mind:
The files provided below have already been scanned for viruses by their original source. However, if you’d like to double-check before downloading, you can easily scan them yourself using the following steps:
How to scan a direct download link for viruses:
- 1- Copy the direct link to the file you want to download (don’t open it yet). (a free online tool) and paste the direct link into the provided field to start the scan.
- 2- Visit VirusTotal (a free online tool) and paste the direct link into the provided field to start the scan.
- 3- VirusTotal will scan the file using multiple antivirus vendors to detect any potential threats.
- 4- Once the scan confirms the file is safe, you can proceed to download it with confidence and enjoy your content.
Available Downloads
- Source: Internet Archive
- All Files are Available: Yes
- Number of Files: 6
- Number of Available Files: 6
- Added Date: 2018-06-30 16:20:39
- Scanner: Internet Archive Python library 1.7.0.dev2
Available Files:
1- Text PDF
- File origin: original
- File Format: Text PDF
- File Size: 0.00 Mbs
- File Name: 1703.04135.pdf
- Direct Link: Click here
2- Metadata
- File origin: original
- File Format: Metadata
- File Size: 0.00 Mbs
- File Name: 1703.04135_metadata.xml
- Direct Link: Click here
3- Metadata
- File origin: original
- File Format: Metadata
- File Size: 0.00 Mbs
- File Name: arxiv-1703.04135_files.xml
- Direct Link: Click here
4- Metadata
- File origin: original
- File Format: Metadata
- File Size: 0.00 Mbs
- File Name: arxiv-1703.04135_meta.sqlite
- Direct Link: Click here
5- Metadata
- File origin: original
- File Format: Metadata
- File Size: 0.00 Mbs
- File Name: arxiv-1703.04135_meta.xml
- Direct Link: Click here
6- Archive BitTorrent
- File origin: metadata
- File Format: Archive BitTorrent
- File Size: 0.00 Mbs
- File Name: arxiv-1703.04135_archive.torrent
- Direct Link: Click here
Search for “Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks” downloads:
Visit our Downloads Search page to see if downloads are available.
Find “Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks” in Libraries Near You:
Read or borrow “Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks” from your local library.
Buy “Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks” online:
Shop for “Hardware-Driven Nonlinear Activation For Stochastic Computing Based Deep Convolutional Neural Networks” on popular online marketplaces.
- Ebay: New and used books.