Donate to arXiv
Please join the Simons Foundation and our generous member organizations in supporting arXiv during our giving campaign September 23-27. 100% of your contribution will fund improvements and new initiatives to benefit arXiv’s global scientific community.
[secure site, no need to create account]
Computer Science > Machine Learning
Title: The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks
Donate to arXiv Please join the Simons Foundation and our generous member organizations in supporting arXiv during our giving campaign September 23-27. 100% of your contribution will fund
Abstract: Neural network pruning techniques can reduce the parameter counts of trained networks by over 90%, decreasing storage requirements and improving computational performance of inference without compromising accuracy. However, contemporary experience is that the sparse architectures produced by pruning are difficult to train from the start, which would similarly improve training performance.
We find that a standard pruning technique naturally uncovers subnetworks whose initializations made them capable of training effectively. Based on these results, we articulate the “lottery ticket hypothesis:” dense, randomly-initialized, feed-forward networks contain subnetworks (“winning tickets”) that – when trained in isolation – reach test accuracy comparable to the original network in a similar number of iterations. The winning tickets we find have won the initialization lottery: their connections have initial weights that make training particularly effective.
We present an algorithm to identify winning tickets and a series of experiments that support the lottery ticket hypothesis and the importance of these fortuitous initializations. We consistently find winning tickets that are less than 10-20% of the size of several fully-connected and convolutional feed-forward architectures for MNIST and CIFAR10. Above this size, the winning tickets that we find learn faster than the original network and reach higher test accuracy.
Lottery Ticket (I) (2010)
PG-13 | 99 min | Comedy
Kevin Carson is a young man living in the projects who has to survive a three-day weekend after his opportunistic neighbors find out he’s holding a winning lottery ticket worth $370 million.
See all photos
Get More From IMDb
For an enhanced browsing experience, get the IMDb app on your smartphone or tablet.
Cast & Crew
Top Billed Cast
All Cast & Crew
Reviews & Commentary
While “Lottery Ticket” is a comedy movie, it wasn’t all that funny. Don’t get me wrong here, because the movie is still entertaining enough for what it turned out to be, but it just wasn’t all that funny, and it lacked certain elements that would make it stand out from numerous other comedies in the genre.
The story in “Lottery Ticket” is about young Kevin who lives with his grandmother in a project housing. When he happens to win 370 million dollars in a lottery, things are about to change. And not everything changes for the better.
There were some good enough aspects to the movie, such as what happens to a person when winning a ridiculous amount such as 370 million dollars, and what happens to the people and everything and everyone in the nearby vicinity when finding out about such a winning. But it was just all hindered by the predictability of the movie.
“Lottery Ticket” is a very predictable movie. You know what will happen a long time before it does happen on the screen, and that predictability was a cumbersome anchor around the movie, slowing it down.
The acting in the movie was quite alright, and they had some good names to the cast list; which included Loretta Devine, Terry Crews, Keith David. I will also says that both Shad Moss and Brandon T. Jackson were actually doing quite alright in carrying the movie.
If you enjoy comedies, then there are far better and more amusing choices available in the comedy genre. “Lottery Ticket” is the type of movie that you will most likely watch once, then never return to it again, as it just doesn’t have contents to support multiple viewings.
My rating of “Lottery Ticket” is a slightly less than mediocre four out of ten stars.Directed by Erik White. With Shad Moss, Brandon T. Jackson, Naturi Naughton, Loretta Devine. Kevin Carson is a young man living in the projects who has to survive a three-day weekend after his opportunistic neighbors find out he’s holding a winning lottery ticket worth $370 million. ]]>