Conference paper · 2019

Channel and filter parallelism for large-scale CNN training

Nikoli Dryden, Naoya Maruyama, Tim Moon, Tom Benson, Marc Snir, Brian Van Essen

International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 1–20 · Published 17 November 2019 · DOI 10.1145/3295500.3356207

View at the publisherCite this paper

In brief

“Channel and filter parallelism for large-scale CNN training” is a 2019 conference paper by Nikoli Dryden and 5 co-authors, published in International Conference for High Performance Computing, Networking, Storage and Analysis (SC). OpenAlex counts 57 citations as of 21 November 2026, which puts it in the top 7% of works published in 2019 by citations. The publisher's version is not open access, and OpenAlex records no free legal copy.

Citations
57
Most cited in
2021 (14)
Field-weighted impact
5.31
References
65
Authors
6

Abstract

Accelerating large-scale CNN training is needed to keep training times reasonable as datasets grow larger and models become more complex. Existing frameworks primarily scale using data-parallelism, but this is limited by the mini-batch size, which cannot grow arbitrarily. We introduce three algorithms that partition channel or filter data to exploit parallelism beyond the sample dimension.… Read the full abstract at the publisher.

Excerpt. This paper is not open access.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Dryden, N., Maruyama, N., Moon, T., Benson, T., Snir, M., & Van Essen, B. (2019). Channel and filter parallelism for large-scale CNN training. International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 1–20. https://doi.org/10.1145/3295500.3356207

MLA 9

Dryden, Nikoli, et al. “Channel and filter parallelism for large-scale CNN training.” International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 2019, pp. 1–20. https://doi.org/10.1145/3295500.3356207.

Chicago

Dryden, Nikoli, Naoya Maruyama, Tim Moon, Tom Benson, Marc Snir, and Brian Van Essen. 2019. “Channel and filter parallelism for large-scale CNN training.” International Conference for High Performance Computing, Networking, Storage and Analysis (SC): 1–20. https://doi.org/10.1145/3295500.3356207.

Harvard

Dryden, N. et al. (2019) ‘Channel and filter parallelism for large-scale CNN training’, International Conference for High Performance Computing, Networking, Storage and Analysis (SC), pp. 1–20. doi:10.1145/3295500.3356207.

IEEE

N. Dryden, N. Maruyama, T. Moon, T. Benson, M. Snir, and B. Van Essen, “Channel and filter parallelism for large-scale CNN training,” International Conference for High Performance Computing, Networking, Storage and Analysis (SC), pp. 1–20, 2019, doi: 10.1145/3295500.3356207.

BibTeX

@inproceedings{dryden2019channel,
  title     = {{Channel and filter parallelism for large-scale CNN training}},
  author    = {Dryden, Nikoli and Maruyama, Naoya and Moon, Tim and Benson, Tom and Snir, Marc and Van Essen, Brian},
  booktitle = {International Conference for High Performance Computing, Networking, Storage and Analysis (SC)},
  year      = {2019},
  pages     = {1--20},
  doi       = {10.1145/3295500.3356207},
  url       = {https://doi.org/10.1145/3295500.3356207}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201933
20201313
20211414
202299
202388
202444
202555
202611

Its field-weighted citation impact is 5.31: it has been cited 5.31 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Hardware and Architecture › Parallel Computing and Optimization Techniques

  • mini-batch size
  • strong scaling
  • communication overhead
  • memory pressure

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Dryden, N., Maruyama, N., Moon, T., Benson, T., Snir, M., & Van Essen, B. (2019). Channel and filter parallelism for large-scale CNN training. International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 1–20. https://doi.org/10.1145/3295500.3356207

How many times has this paper been cited?

57 times, according to OpenAlex on 21 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

OpenAlex records no free legal copy. Check your library's access, the authors' pages or a repository, or ask the corresponding author for a copy.

Who wrote this paper?

Nikoli Dryden, Naoya Maruyama, Tim Moon, Tom Benson, Marc Snir, Brian Van Essen.

What is the DOI of this paper?

10.1145/3295500.3356207, permanently at https://doi.org/10.1145/3295500.3356207. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 21 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.