THE SP THEORY OF INTELLIGENCE
COMPUTING AS COMPRESSION
Too blue for logic
My axioms were so clean-hewn,
The joins of 'thus' and 'therefore' neat
But, I admit
Life would not fit
Between straight lines
And all the cornflowers said was 'blue,'
All summer long, so blue.
So when the sea came in and with one wave
Threatened to wash my edifice away -
I let it.
SP GROUP: If you would like to receive occasional news about progress in the SP programme of research, please contact me, Gerry Wolff, via email, phone or Skype. There is more information about the SP group here: SP GROUP.
- SP introduction:
- Distinctive features and advantages: The SP theory of intelligence: distinctive features and advantages (PDF, J G Wolff, IEEE Access, 4, 216-246, 2016). See also Awards for IEEE Access.
- Research proposal: Short version: Short proposal for the development of the SP machine (PDF). Long version: Proposal for the creation of a research facility for the development of the SP machine (PDF).
- Foundations: Information compression, intelligence, computing, and mathematics (PDF, submitted for publication). Slides: Information compression, intelligence, computing, and mathematics (slides) (PDF).
- Extended overview: The SP theory of intelligence: an overview (PDF, J G Wolff, Information, 4 (3), 283-341, 2013).
- Benefits and applications: The SP theory of intelligence: benefits and applications (PDF, J G Wolff, Information, 5 (1), 1-27, 2014).
- Big data: Big data and the SP theory of intelligence (PDF, J G Wolff, IEEE Access, 2, 301-315, 2014). See also Awards for IEEE Access.
- Autonomous robots: Autonomous robots and the SP theory of intelligence (PDF, J G Wolff, IEEE Access, 2, 1629-1651, 2014). See also Awards for IEEE Access.
- Vision: Application of the SP theory of intelligence to the understanding of natural vision and the development of computer vision (PDF, J G Wolff, SpringerPlus, 3, 552, 2014).
- SP-neural: The SP theory of intelligence and the representation and processing of knowledge in the brain (PDF).
- Computing as compression: Computing as compression: the SP theory of intelligence (PDF).
- Book: Unifying Computing and Cognition.
- Intelligent databases: Towards an intelligent database system founded on the SP theory of computing and cognition (PDF, J G Wolff, Data & Knowledge Engineering, 60, 596-624, 2007).
- Medical diagnosis: Medical diagnosis as pattern recognition in a framework of information compression by multiple alignment, unification and search (PDF, J G Wolff, Decision Support Systems, 42, 608-625, 2006).
The SP theory of intelligence is a unique attempt to integrate and simplify observations and concepts across artificial intelligence, mainstream computing, mathematics, and human perception and cognition, with information compression as a unifying theme.
The name "SP" is short for simplicity and power, because compression of any given body of information, I, may be seen as a process of reducing informational “redundancy” in I and thus increasing its “simplicity”, whilst retaining as much as possible of its non-redundant expressive “power”.
Central in the theory is the powerful concept of multiple alignment, with versatility in the representation of knowledge and in AI functions.
The SP theory is realised in the form of a computer model, SP71. This model may be seen as a first version of the SP machine, an expression of the SP theory and a means for it to be applied. Source code for the model, with associated files, may be downloaded via links under the heading 'SOURCE CODE', below.
The SP theory combines conceptual simplicity with descriptive and explanatory power in several areas, including concepts of 'computing', the representation of knowledge, natural language processing, pattern recognition, several kinds of reasoning, the storage and retrieval of information, planning and problem solving, unsupervised learning, information compression, and human perception and cognition.
An introduction to the ideas is in the slide show The SP theory of intelligence (PDF)—see below. A much fuller account is in the book Unifying Computing and Cognition.
The background and motivation for the research is described in Computing, cognition and information compression (PDF).
- Information compression, intelligence, computing, and mathematics (slides) (PDF). This is about background observations and ideas that provide the foundations of the SP theory. An article with the same title is here: Information compression, intelligence, computing, and mathematics (PDF)
- The SP theory of intelligence (slides) (PDF). This talk describes the SP theory, the multiple alignment concept, and the SP machine, and potential benefits and applications. As a supplement to this talk, there are additional examples of multiple alignments (PDF), with notes.
- Big data and the SP theory of intelligence (slides) (PDF). These slides are based on Big data and the SP theory of intelligence (PDF, J G Wolff, IEEE Access, 2, 301-315, 2014).
Unless it is self-explanatory, each slide has one or more notes, each one shown with a 'speech bubble' icon, normally in the top left-hand corner. To see a note, position the cursor over the icon. If the whole note is not visible, right-click on the icon and choose "Open pop-up note".
To view a presentation, it is probably best to download the file and open it in the Adobe Reader. Other systems may not show the notes properly. Controls: Full screen: CTRL-L; Escape from full screen: ESC; Zoom in: CTRL-plus; Zoom out: CTRL-minus; Next slide: left-click; Previous slide: right-click; Scrolling left or right, up or down: use the 'hand'.
An article, giving an overview of the SP system and its expected benefits and applications is here: The SP theory of intelligence: benefits and applications (PDF).
Most of the publications from this section may be obtained as a PDF, Postscript or MS Word file. The articles that give the best overall view of the research programme and the SP framework are marked with .
For readers who are not previously acquainted with this field,
these are the articles to start with. For convenience, they are listed here
in a suggested order for reading:
|UNIFYING COMPUTING AND COGNITION
The SP Theory and its Applications
J Gerard Wolff
2006, ISBN 0-9550726-0-3 (ebook edition),
ISBN 0-9550726-1-1 (print edition)
| Ebook cover
|| Print edition cover
Description of the book
Ordering the book
PROPOSAL FOR THE CREATION OF A HIGH-PARALLEL IMPLEMENTATION OF THE SP MACHINE
A good step forward in the development of these ideas would be the creation of a new version of the SP machine. It would be:
- Based on the SP71 computer model.
- Built as a software virtual machine, using high-parallel search mechanisms, and with a good user interface. The high-parallel search mechanisms in an existing search engine would provide a good foundation for this version of the SP machine.
- An open-source model, available, via the web, to the research community everywhere.
- A vehicle for experimentation and research with two main aims:
- To explore the range of applications of the SP machine.
- To refine the SP theory itself.
If you wish to see the exact workings of the SP71 computer model or experiment with
it, the source code and a Windows executable is available in the file SP71.zip, and via "Ancillary files" under www.arxiv.org/abs/1306.3888. A slightly earlier version, SP70, referenced in published papers and in Unifying Computing and Cognition, may be downloaded via SP70.zip.
It is probably best to start by looking at SP62, a subset of SP71 that lacks any ability for learning. The source code and a Windows executable is available in the file SP62.zip.
Please note: these programs are for
research, they are not shrink-wrapped software packages that you might buy from
a shop. I have released them mainly for people who want to dig around inside
them and see what is going on.
This software is released to the public domain without any restrictions, but
please read the notice on the source files.