Unspoken knowledge is also not one of the 5 human senses.
FSD needs the human sense that seeing a stop sign on the freeway (sticking out of the back of a highway maintenance trailer) doesn't mean what a stop sign usually means - but that stopped highway trailer, with a person holding the same sign and looking at you means you should follow it.
Should you run into a pile of gravel to avoid a baby stroller? If a loose garbage can and a baby stroller appear on opposite sides of the road and both block your path, which one do you hit? A soccer ball coming out between parked cars probably has a kid following it...
The people who have died with FSD ran into problems like these. A human would see a transport truck cab, and the wheels on the other side of the road and infer that - even though it blends into the sky - that there's a trailer in between. One of the Tesla accidents was that the side of the trailer appeared the same color and location as the sky, so the Tesla didn't see it and went under the trailer at highway speeds. The driver wasn't paying attention and didn't make it.
Sensing packages will only get you so far, human intuition for new unexpected situations is impossible to get AI to learn - at least at this point.
Agree 100% but I wouldn’t call it intuition, but human understanding. We don’t just see stuff, we understand it. We understand so much context surrounding the things we see. We can predict the weight of an object by observing it’s motion in response to wind, essentially running a physics simulation, to know that that 4x8 sheet of styrofoam blowing in our lane poses no risk. Or that an empty cardboard box tumbling in the wind is actually empty based on it's motion.
We have an incredible level of understanding.
Jeez I even put myself in other drivers’ shoes/heads so as to predict their behavior. Their subtle cues in lane positioning, distraction, etc. they’re all incredibly telling if you can model human psychology.
FSD needs the human sense that seeing a stop sign on the freeway (sticking out of the back of a highway maintenance trailer) doesn't mean what a stop sign usually means - but that stopped highway trailer, with a person holding the same sign and looking at you means you should follow it.
Should you run into a pile of gravel to avoid a baby stroller? If a loose garbage can and a baby stroller appear on opposite sides of the road and both block your path, which one do you hit? A soccer ball coming out between parked cars probably has a kid following it...
The people who have died with FSD ran into problems like these. A human would see a transport truck cab, and the wheels on the other side of the road and infer that - even though it blends into the sky - that there's a trailer in between. One of the Tesla accidents was that the side of the trailer appeared the same color and location as the sky, so the Tesla didn't see it and went under the trailer at highway speeds. The driver wasn't paying attention and didn't make it.
Sensing packages will only get you so far, human intuition for new unexpected situations is impossible to get AI to learn - at least at this point.