1/14/2025 at 5:18:09 AM
If we wanted to make a drone have the intelligence of a dragonfly (which might still be a decade away), we would at least need a billion parameters and a trillion tokens in training data. Just helps us appreciate what nature is capable of.by sashank_1509
1/14/2025 at 5:41:55 AM
Sounds about right, 1 million neurons and potentially 1 billion synapses. Back in school I used to think computers and machines were so advanced and complex compared to boring old biology. It was such a silly misconception to be so many orders of magnitude off in complexity.by z2
1/14/2025 at 7:19:29 AM
Tokens? Is that the new « bit »?by jurgenaut23
1/14/2025 at 1:06:03 PM
I guess we're still not out of the 'flying into a window' stage. https://en.wikipedia.org/wiki/Loitering_munitionby _joel
1/14/2025 at 8:48:37 AM
Is nature doing that? Or following a much simpler pattern?by noja
1/14/2025 at 12:53:11 PM
Producing complex behavior simply is usually harder and more elegant than using a lot of superfluous complexity.by thoroughburro
1/14/2025 at 4:12:35 PM
I feel pretty confident saying it is not following a simpler pattern. It is doing something very hard, with far less training data and a much more alien form of compute (which is also much slower in general than computers).Is there some elegant learning algorithm in nature that enables this? Maybe. But I don’t think there’s any simplification of the task, that nature has found. For example, I doubt we will find a 100 line algorithm to do the motion the dragonfly did, or a simple physics equation to describe it etc. My intuition, stems from the bitter lesson, a lot of these tasks are irreducibly complex and trying to find elegant simple models, tends to be a waste of time.
by sashank_1509
1/14/2025 at 9:38:27 AM
Does the how matter if we can’t replicate it the same way?by tw04