Friday, December 04, 2009

Project idea: two neural nets, one data set

Here's a project idea.

Train two neural networks on the same data, but with different initial random weights. They will come out differently, but probably equally good at whatever classification task they are learning to do.

Come up with a way to determine that they were trained on the same data.

I expect that this finding will shed some light on how this might eventually work in brains. Neurally, your belief that 'a' is th first letter of 'apple' probably looks a lot different from mine.

I'm not a neural net scientist, so I'll probably never run this study. If you do, let me know.

Bookmark and Share

2 comments:

Anonymous said...

美女遊戲,情色a片,成人遊戲,上班族聊天室,巨乳,成人論壇,嘟嘟貼圖區,美女寫真,ut聊天室,同志聊天室,色情小遊戲,貼圖區,哈比寬頻成人,嘟嘟成人,玩美女人,視訊交友,自拍貼圖,正妹計時器,919sex成人網,免費a片觀看,jp成人,正妹牆,聊天室,ut聊天室,視訊聊天室,情色,微風成人,豆豆聊天室,視訊美女,85cc成人片,85cc成人片觀看,交友戀愛進行室,嘟嘟成人網,成人,色情,美女,色情小說,情色貼圖,情色小說,交友覓戀會館,情色文學,

Cindy said...

I always assumed that the different connections formed by those two networks would ultimately result in different strengths and weaknesses across a variety of tasks.
When I first learned of this work, I thought it was a potential analog to how our brains develop. I also thought that it might be a good explanation of individual differences in the ability to perform various cognitive tasks (i.e., language vs. math).
Even though the two neural networks might achieve the same level of performance on the classification task on which they were trained, it is possible that they would differ in how quickly they were able to reach criterion on a different type of task (of course, this is assuming neural networks vastly more complex than what we have now).