1/7 It is good to be aware of the literature. Shannon and McCarthy describe a `neural network' doing what GPT-3 does in their intro (pg vi) to Automata Studies, Princeton University Press, 1956.
2/7 `Such a machine, in a sense, for any given input situation (including past history) merely looks up in a "dictionary" the appropriate response. With a suitable dictionary such a machine would surely satisfy Turing's definition but...
3/7 ...does not reflect our usual intuitive concept of thinking. This suggests that a more fundamental definition must involve something relating to the manner in which a machine arrives at its responses--something which...
4/7 ...corresponds to differentiating between a person who solves a problem by thinking it out and one who has previously memorized the answer.' They refer to methods for constructing such a machine in two papers in the collection:
5/7 Representation of Events in Nerve Nets and Finite Automata, Stephen C. Kleene, pgs 3--41, and Some Uneconomical Robots, James T. Culbertson, pgs 99--116 (a `neuron' based model).
6/7 This volume is a gem. Does not use the words `Artificial Intelligence' but includes a revised chapter of Minsky's Ph.D. thesis on neural networks and in the very first paragraph of the volume's introduction (pg v), Shannon and McCarthy say:
7/7 `How does the brain function? Can we design a machine which will simulate a brain?' ... 'Currently it is fashionable to compare the brain with large scale electronic computing machines.' Indeed!
