So it will be with larger applications. The very point is that they note and act upon patterns – ones that we can’t see, that we don’t know why are happening. Just as with markets – we might not know why the price of apples has risen, but we’re all getting the information that they have and are acting according to that incentive. The desire to audit all algorithms is missing the very point of having them at all.
AI has to be based on real-world information flowing in. For any result to be useful, the system must operate on the same rules as the real world, imperfections and all, and the very point of our doing all of this is to do what we ourselves cannot.
Any attempts to insist on full audits, moral compliance and preferred data aren’t just going to fail – they’re missing the entire point of the exercise.