"Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity" - Information and Links:

Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity - Info and Reading Options


“Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity” Metadata:

  • Title: ➤  Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity
  • Authors:

“Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity” Subjects and Themes:

Edition Identifiers:

  • Internet Archive ID: arxiv-1406.1102

AI-generated Review of “Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity”:


"Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity" Description:

The Internet Archive:

Stochastic gradient algorithms estimate the gradient based on only one or a few samples and enjoy low computational cost per iteration. They have been widely used in large-scale optimization problems. However, stochastic gradient algorithms are usually slow to converge and achieve sub-linear convergence rates, due to the inherent variance in the gradient computation. To accelerate the convergence, some variance-reduced stochastic gradient algorithms, e.g., proximal stochastic variance-reduced gradient (Prox-SVRG) algorithm, have recently been proposed to solve strongly convex problems. Under the strongly convex condition, these variance-reduced stochastic gradient algorithms achieve a linear convergence rate. However, many machine learning problems are convex but not strongly convex. In this paper, we introduce Prox-SVRG and its projected variant called Variance-Reduced Projected Stochastic Gradient (VRPSG) to solve a class of non-strongly convex optimization problems widely used in machine learning. As the main technical contribution of this paper, we show that both VRPSG and Prox-SVRG achieve a linear convergence rate without strong convexity. A key ingredient in our proof is a Semi-Strongly Convex (SSC) inequality which is the first to be rigorously proved for a class of non-strongly convex problems in both constrained and regularized settings. Moreover, the SSC inequality is independent of algorithms and may be applied to analyze other stochastic gradient algorithms besides VRPSG and Prox-SVRG, which may be of independent interest. To the best of our knowledge, this is the first work that establishes the linear convergence rate for the variance-reduced stochastic gradient algorithms on solving both constrained and regularized problems without strong convexity.

Read “Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity”:

Read “Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity” by choosing from the options below.

Available Downloads for “Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity”:

"Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity" is available for download from The Internet Archive in "texts" format, the size of the file-s is: 0.33 Mbs, and the file-s went public at Sat Jun 30 2018.

Legal and Safety Notes

Copyright Disclaimer and Liability Limitation:

A. Automated Content Display
The creation of this page is fully automated. All data, including text, images, and links, is displayed exactly as received from its original source, without any modification, alteration, or verification. We do not claim ownership of, nor assume any responsibility for, the accuracy or legality of this content.

B. Liability Disclaimer for External Content
The files provided below are solely the responsibility of their respective originators. We disclaim any and all liability, whether direct or indirect, for the content, accuracy, legality, or any other aspect of these files. By using this website, you acknowledge that we have no control over, nor endorse, the content hosted by external sources.

C. Inquiries and Disputes
For any inquiries, concerns, or issues related to the content displayed, including potential copyright claims, please contact the original source or provider of the files directly. We are not responsible for resolving any content-related disputes or claims of intellectual property infringement.

D. No Copyright Ownership
We do not claim ownership of any intellectual property contained in the files or data displayed on this website. All copyrights, trademarks, and other intellectual property rights remain the sole property of their respective owners. If you believe that content displayed on this website infringes upon your intellectual property rights, please contact the original content provider directly.

E. Fair Use Notice
Some content displayed on this website may fall under the "fair use" provisions of copyright law for purposes such as commentary, criticism, news reporting, research, or educational purposes. If you believe any content violates fair use guidelines, please reach out directly to the original source of the content for resolution.

Virus Scanning for Your Peace of Mind:

The files provided below have already been scanned for viruses by their original source. However, if you’d like to double-check before downloading, you can easily scan them yourself using the following steps:

How to scan a direct download link for viruses:

  • 1- Copy the direct link to the file you want to download (don’t open it yet).
    • (a free online tool) and paste the direct link into the provided field to start the scan.
  • 2- Visit VirusTotal (a free online tool) and paste the direct link into the provided field to start the scan.
  • 3- VirusTotal will scan the file using multiple antivirus vendors to detect any potential threats.
  • 4- Once the scan confirms the file is safe, you can proceed to download it with confidence and enjoy your content.

Available Downloads

  • Source: Internet Archive
  • All Files are Available: Yes
  • Number of Files: 6
  • Number of Available Files: 6
  • Added Date: 2018-06-30 04:38:07
  • Scanner: Internet Archive Python library 1.7.0.dev2

Available Files:

1- Text PDF

  • File origin: original
  • File Format: Text PDF
  • File Size: 0.00 Mbs
  • File Name: 1406.1102.pdf
  • Direct Link: Click here

2- Metadata

  • File origin: original
  • File Format: Metadata
  • File Size: 0.00 Mbs
  • File Name: 1406.1102_metadata.xml
  • Direct Link: Click here

3- Metadata

  • File origin: original
  • File Format: Metadata
  • File Size: 0.00 Mbs
  • File Name: arxiv-1406.1102_files.xml
  • Direct Link: Click here

4- Metadata

  • File origin: original
  • File Format: Metadata
  • File Size: 0.00 Mbs
  • File Name: arxiv-1406.1102_meta.sqlite
  • Direct Link: Click here

5- Metadata

  • File origin: original
  • File Format: Metadata
  • File Size: 0.00 Mbs
  • File Name: arxiv-1406.1102_meta.xml
  • Direct Link: Click here

6- Archive BitTorrent

  • File origin: metadata
  • File Format: Archive BitTorrent
  • File Size: 0.00 Mbs
  • File Name: arxiv-1406.1102_archive.torrent
  • Direct Link: Click here

Search for “Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity” downloads:

Visit our Downloads Search page to see if downloads are available.

Find “Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity” in Libraries Near You:

Read or borrow “Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity” from your local library.

Buy “Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity” online:

Shop for “Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity” on popular online marketplaces.



Find "Linear Convergence Of Variance-Reduced Stochastic Gradient Without Strong Convexity" in Wikipdedia