Logo KiF Research Programme

Computational Semiotics
ICIS Nijmegen

 

Knowledge in Formation

Logo

    Summary

    The aim of this project is the development of a cognitively based, semiotical model of information processing with applications in (cognitive) modeling, language parsing, meaningful summarization and ontology design.

Information is conceived by us as the knowledge increment brought about on the occasion that an actor of whatever nature receives input. Thus interpreted it presupposes an interpretational process in which data eventually result in meaningful responsive behavior, but at least add something to the stock of knowledge present in the interpreting agent. The primary goal of this research project is to give an account of the non-accidental properties of those interpretation processes. A secondary goal is the design of a combinatorial engine fit for computational interpretation. The later in order to use the engine for modeling cognitive behavior in different domains. Since the machinery itself is simple (it offers nine types of combinations recursively), it enables the systematic specification of domains by explication of the combinatorial properties of the signs that make up the interpretation processes in the domain to be specified.

Theoretical background

At the heart of our research program reside three basic assumptions:
  1. Cognition is relational. On the one hand this means that mind is part of the reality it tries to understand on the other this means that reality cannot be reduced to matter.
  2. An account of cognitive processes must be teleological. Any agent interprets data offered from the perspective of the goals, inscribed in it through past experience, that happen to be operative in the process of their interpretation.
  3. Habitual behavior is rule governed, thus it is, in principle, capable of a computational interpretation. Due to assumptions 1. and 2. this does not only mean that the interpreting mind must be modeled (the combinatorial machine), but also that the conditions that give rise to the execution of the habits must be modeled (the stock of knowledge and operational goals required).

A process model of cognitive activity

Even a quick scan of the intellectual history of man reveals that there is a close connection between informational progress and sign use. Just think about the sequence: artifacts and speech; handwriting; print and digital media, and consider the effects each sign-technique has on the intellectual habits of its users [BR04]. The intimate relation between signs and thought can be generalized in the notion that every idea is only manifest by being of the nature of a sign, so every thought is a sign and only on account of this feat an interpreter is able to think. But then it must be possible to study thought processes by studying the ways in which signs give rise to new signs and by doing so realize a knowledge increment. These assumptions place our program in the American pragmatist tradition of the Peircean flavor in which the concept of sign plays a central role.

In conformity with the above we assume that knowledge arises from the cognition of phenomena by means of signs. This primarily requires an interaction between the (input) phenomenon functioning as a sign, and the observer as an interpreting system. As a result of this interaction the phenomenon effects the observer by changing its sensory state. This change again can be interpreted as a sign, for example by the brain, by linking it with existing knowledge about similar changes and experience with earlier response strategies, in order to generate an adequate response to the observed phenomenon. This way, the phenomenon, which itself is a sign of some interaction between phenomena, is re-presented through a sequence of interactions between signs, starting with the input sign that is offering itself for interpretation (response) and the interpreting or dynamical sign that is being affected (interpreting system). In virtue of the goal oriented nature of cognitive activity, the interaction events define a process, which is the (re)cognition of the input phenomenon as a meaningful sign to the end of generating a response. Our model describes this process (see

For a definition of the model see: The Machine in the Ghost (to be found in Section "Articles 2009").

First exploration

Since the process model of cognitive activity explicates what must be assumed in order to account for any cognitive process whatever, the model is general and turns out to be simple. Thus a heavy burden is laid on the available knowledge or the lexicon, the items of which must contain the combinatorial properties that enables them to get combined with the input data in order to derive a correct interpretation. In the brain, so we assume, the way in which the neural tissue gets organized in the course of growing experience and the activation patterns that get associated with the different occasions for input processing, account for the lexicon and the combinatorial machine alike. Or, to put it in other words, in our nervous system there is no identifiable place where a combinatorial machinery is located that crunches data that are stored somewhere else and retrieved upon the proper occasion. Instead, the machinery is coexistent with the instances of processes of cognitive activity. In our semiotical process model we present an abstraction, it specifies the moments present in all informational processes without going into the details of its physical realization. From the point of view of the applicability of the model to specific domains this semiotical model functions as a schema from which domain and/or actor specific (human, IT-based, organizational actors) models can be derived.

For computational purposes we developed a 'naive' logical interpretation of the process model in which each interaction discerned in the process is provided with a logical operation, see [SF06], [FS00]. Through a set theoretical interpretation this enables a model in which signs can be defined as sets and sign interactions as operations on sets and so it offers the promise of the realization of applications. A drawback of this logical interpretation however consists in the limitations it imposes on the scope of the model. In the logical interpretation the model is only of use for what already is habitual. But, what already is habitual, goal governed behavior, is feasible for specification. In order to derive a specification one first has to identify the goal and the input that triggers the associated response or interpretation process. In a second phase the lexicon is built by specifying the elements needed for each of the steps that collectively constitute the habit. If sub-goals are involved, the associated sub-processes are specified along the same lines recursively. The specification ends when a lexicon is specified that is sufficiently rich to reach the goal(s) on the proper occasions.

Research

We explored the corners of the envelope in different domains: syntactic parsing, problem specification, modeling and text summarization. Since our main aims consisted in the first phases of the project in an enhancement of our understanding of the processing schema and an assessment of the value of the sign theoretical paradigm we work with, we preferred breadth over depth. Some words about the results so far:
  1. Syntactic parsing
    We developed a parser for natural language syntax conform the processing schema and tested it with a simple lexicon. From the linear complexity of the parser, and the syntactic nature of computational processes in general, it follows that all computational interpretations of our schema can be linearly complex.
    As a spin off we gained a greater understanding of the different kinds of combinatorial needs of the lexical items.

  2. Problem specification
    The processing schema specifies the distinctions pertinent to all sign processing, the way in which they are ordered and the ways in which they can be related . Since the schema professes to be general, it is to be expected to be present in the conceptualization of any problem. But, as it is an abstraction, it is devoid of content. This offers the possibility to use the empty schema as a heuristic device. In order to systematically specify a problem one has to formulate a goal, vague as it may be at the outset, and fill in the slots of the schema in such a way that the wished for result can be generated. In the course of specifying a problem sub-goals will pop up and as a consequence iterations are needed. If everything needed to reach the goals is specified, the problem is specified.
    As a spin off we gained better insight in the way in which to deal with iterations of the schema.

  3. Organizational modeling
    At the present time there are some pretty good business modeling techniques. Communication oriented methods like NIAM/ORM excel in retrieving and validating knowledge from domain experts and transforming the results into a consistent model (modeling how it is). A notable problem however with those approaches is the measurement of the semantic quality of a model in cases of business re-design (modeling how it ought to be or must become). It is with respect to this problem that the problem specification capabilities of the process model can be beneficial by providing a top down specification of the processes to be modeled, thus complementing the bottom up technique of NIAM/ORM.
    As a spin off we refined our process notion, we gained more understanding of the different types of actor (IT-based, human and organizational) and in their interrelations.

  4. Meaningful summarization
    Meaningful summarization as distinguished form statistical text summarization is very demanding since it involves the processing of text from multiple perspectives. It involves morpho-syntactical, syntactical, semantical, logical and discourse analysis of the text, to name just a few of the perspectives needed. To be frank, we only scratched the surface see [SF04]. However, since our processing schema entails the promise of a uniform representation for all domains pertinent to sign processing, it becomes feasible that the complex task of merging knowledge from different domains, can be reduced to the more simple task of structural co-ordination of domain specific instances of the processing schema.
    We feel that the assumption that there exists a uniform mechanism for all domains of sign processing, is strengthened by experimental evidence of cognitive research. The results point out that at least in the syntactical and semantical domain, the brain performs a simultaneous analysis of the data offered. But, as the (full) meaning of the input may require an interpretation in both domains and the temporal difference between syntactic and semantic analysis is small (making a translation between the representations in the domains unlikely), the use of a uniform representation, at least in these domains, might be inevitable.

    Looked at in this way meaning summarization is not different from interpretation. Hence, our highest goal is to reveal the calculational properties of semiosis or Knowledge in Formation.


Besides domain oriented research a theory oriented line of research has been pursued. Three interrelated topics surfaced.

  1. Semiotic foundations
    Our work builds on the foundations laid by Ch. S. Peirce (1839 -1914). Many of the valuable sign theoretical manuscripts are still not easily accessible. Currently we are working on a derivation of our process model from those foundations [BS07].
  2. Modes of realization, its consequences and the possibilities offered
    Sign interpretation processes are executed by dynamical signs or actors. Different types of dynamical signs can be distinguished. The order below is from more encompassing to more specific.
    • Organizations as actors
    • Since the organization considered as an actor contains human and IT-based actors, this is the most encompassing mode of sign processing. It calls for an investigation of the interactions between the acting agents. Besides that, it is the domain in which the increasingly important question of architecture in information sciences finds its place.
    • The Human actor
    • Studying the ways in which humans generate meaningful responses is a key to a deeper understanding of informational processes. On the one hand research in the cognitive sciences offers a possibility to test the model. On the other hand this kind of research offers material for attempts to rebuild the processes identified, but in a computational way.
    • IT-based actors
    • The most interesting part of the development of IT-based actors consists in the urge it contains to be specific. Success and failure will be informative with regard to what can be modeled and what can not at the moment. Thus enhancing our understanding of ourselves.
  3. Domain specific applications See the first part of this section for the domains we probed. An important function of domain specific research from the point of view of theory consists in the effects it has on the work on semiotic foundations.

Members of the project

Auke J.J. van Breemen (a.vanbreemen at science.ru.nl)
Jozsef I. Farkas (jfarkas99 at yahoo.com)
Rein Cozijn (r.cozijn at uvt.nl)
Jessica Hong Yang (j.h.yang at henley.ac.uk)
Janos J. Sarbo (janos at cs.ru.nl)

Former members

Maikel Couwenberg (maikelc at gmx.net)
Eddy Klomp
Megan Buuron
Irena Draskovic (I.Draskovic at kwazo.umcn.nl)

Publications

Book

[SF06] J.J. Sarbo, J.I. Farkas, A.J.J. van Breemen, Knowledge in Formation. Springer-Verlag, Series: Cognitive Technologies, pages 1-220, E-book, 2011. ''Complementary Notes'', pages 1-64, 2014, (pdf), contains exercises with solutions for each chapter.

Book chapter

[BF11] A.J.J. van Breemen, J.I. Farkas, J.J. Sarbo, Knowledge representation as a tool for Intelligence Augmentation. In: Computational Modeling and Simulation of Intellect: Current State and Future Perspectives, ed. B. Igelnik, pages 321-341, IGI Global, Hersey (PA), 2011
Extended Abstract, Paper

[SF06] J.J. Sarbo, J.I. Farkas, A.J.J. van Breemen, Natural Grammar. In: Semiotics and Intelligent Systems Development, ed. R. Gudwin, J. Queiroz, pages 152-175, Idea Group Publishing, Hersey (PA). 2006
Abstract, Paper

PhD Thesis

[FA08] J.I. Farkas, A semiotically oriented cognitive model of knowledge representation, Radboud University Nijmegen, The Netherlands, pages 1-209, 2008.
Pdf

Journal/conference paper

[SA19] J.J. Sarbo, Towards a unifying concept of information, Cybernetics and Human Knowing, Vol. 26, No. 4, pp. 33-45, December 2019.

[SC19] J.J. Sarbo, R. Cozijn, Belief in reasoning, Cognitive Systems Research, Vol. 55, pp. 245-256, June 2019.

[SA18] J.J. Sarbo, On a uniform ontology for logic and reasoning, INTERSYMP 2018, ed. D. Dubois, pages 55-60, Baden Baden (Germany), 2018. Paper

[FS18] J.I. Farkas, J.J. Sarbo, Interpreting nature, Cognitive Systems Research, Vol. 49, pp. 1-9, 2018.

[SA16] J.J. Sarbo, J.H. Yang, Vitalising Semiotics, 17th IFIP WG 8.1 International Conference on Informatics and Semiotics in Organisations (ICISO2016), eds. Baranauskas, M.C.C., Liu, K., Sun, L., Neris, V.P. de A., Bonacin, R., Nakata, pages 25-34, Campinas (Brazil), 2016. Paper

[SA15] J.J. Sarbo, J.H. Yang, A Semiotic Approach to Critical Reasoning, IFIP AAICT449, 16th International Conference on Informatics and Semiotics in Organisations (ICISO2015), eds. K. Liu, K. Nakata, W. Li, D. Galarreta, pages 10-20, Toulouse (France), 2015. Paper

[SA14] J.J. Sarbo, A Semiotic Approach to Integrative Negotiation, IFIP AAICT426, 15th International Conference on Informatics and Semiotics in Organisations (ICISO2014), eds. K. Liu, W. Li, S.R. Gulliver, pages 1-10, Shanghai (China), 2014. Paper


[BR14] A.J.J. van Breemen, Quality of Service in the Long Tail: Narratives and the Exploitation of Soft Metadata, IFIP AICT426, 15th International Conference on Informatics and Semiotics in Organisations (ICISO2013), eds. K. Liu, S. Gulliver, W. Li, C. Yu, pages 22-31, Shanghai (China), 2014. (pdf is available on request from a.breemen@chello.nl)

[SA13] J.J. Sarbo, A Meta-Theory for Knowledge Representation, Procs. of the First Intl. Workshop on Artificial Intelligence and Cognition (AIC 2013) pages 1-44, 2013. Pdf

[SF13] J.J. Sarbo, J.I. Farkas, Towards Meaningful Information Processing: A unifying representation for Peirce's sign types, SIGNS volume 7, pages 1-44, 2013. Pdf

[BS13] A.J.J. van Breemen, J.J. Sarbo, Beyond Flatland: What does semiotics add to information sciences, 14th International Conference on Informatics and Semiotics in Organisations (ICISO2013), eds. K. Liu, S. Gulliver, W. Li, pages 50-56, Stockholm (S), 2013. Paper, Talk

[BR10] A.J.J. van Breemen, The semiotic framework: Peirce and Stamper, 12th International Conference on Informatics and Semiotics in Organisations (ICISO2010), eds. R. Jorna, K. Liu, G. Jiang, K. Nakata, L. Sun, pages 87-95, Reading (UK), 2010.

[DC10] I. Draskovic, M. Couwenberg, J.J. Sarbo, New Concept Development Model: Explorative Study of Its Usability in Intelligence Augmentation, In: 2nd International Conference on Computer Supported Education (CSEDU 2010), eds. J. Cordeiro, B. Shishkov, pages 147-153, Valencia (Spain), 2010. Paper,

[BS09] A.J.J. van Breemen, J.J. Sarbo, The Machine in the Ghost: The Syntax of Mind, SIGNS pages 135-184, 2009. Pdf

[SA09] J.J. Sarbo, On Well-formedness in Requirement Elicitation Processes, 11th International Conference on Informatics and Semiotics in Organisations (ICISO) eds. X. Feng, K. Liu and G. Jiang, pages 18-25, Beijing (China), 2009.

[BS08] A.J.J. van Breemen, J.J. Sarbo, On conceptualization as a Systematic Process, 10th International Conference on Enterprise Information Systems (ICEIS), eds. J. Filipe and J. Cordeiro, pages 37-42, Barcelona (Spain), 2008.

[BS07] A.J.J. van Breemen, J.J. Sarbo, Sign Processes and the Sheets of Semeiosis (Ss), 10th International Conference on Complexity in Organisational and Technological Systems (ICOS), ed. Kecheng Liu, pages 89-98, Sheffield (UK), 2007

[BS07a] A.J.J. van Breemen, J.J. Sarbo, Th. P. van der Weide, Towards a theory of natural conceptualization, 10th International Conference on Complexity in Organisational Technological Systems (ICOS), ed. Kecheng Liu, pages 24-32, Sheffield (UK), 2007

[SA07] J.J. Sarbo, On the Logic Underlying Common Sense, 9th International Conference on Enterprise Information Systems (ICEIS), eds. J. Cardoso, J. Cordeiro and J. Filipe, pages 395-400, Funchal, Madeira (Portugal), 2007.

[BS06] A.J.J. Breemen, J.J. Sarbo, Surviving in the Bermuda Triangle of semeiosis. In: International Journal of Computing Anticipatory Systems, ed. D.M. Dubois, volume 18, pages 337-346, CHAOS. 2006

[SA06] J.J. Sarbo, Peircean Proto-Signs, AIP Conference Proceedings of Computing Anticipatory Systems, ed. D.M. Dubois, volume 839, pages 474-479, Liege (Belgium), 2006.

[FS04] J.I. Farkas, J.J. Sarbo, Mathematica Utens, Proceedings of ICCS'04, eds. H.D. Pfeiffer, H. Delugach, K.E. Wolff, pages 29-42, Hunstville (AL), Shaker-Verlag, 2004.

[SF04] J.J. Sarbo, J.I. Farkas, Towards a Theory of Meaning Extraction, In: Proceedings of ICCS'04, eds H.D. Pfeiffer, H. Delugach, K.E. Wolff, pages 55-68, Hunstville (AL), Shaker-Verlag, 2004.

[SA04] J.J. Sarbo, Towards a New World-Ontology, Proc. of the 16th Belgium-Netherlands Conference on Artificial Intelligence, pages 51-58, Groningen (Netherlands), 2004.

[SF03] J.J. Sarbo, J.I. Farkas, Logica Utens, In: Using Conceptual Structures, eds. A. de Moor, B. Ganter, pages 43-56, Dresden (Germany), Shaker-Verlag, 2003.

[FS02] J.I. Farkas, J.J. Sarbo, Peircean Ontology of Semantics In: Conceptual Structures: Integration and Interfaces, LNAI 2193, eds. U.Priss, D. Corbett, pages 177-190, Borovets (Bulgaria), Springer-Verlag, 2002.

[SF02] J.J. Sarbo, J.I. Farkas, A Linearly Complex Model for Knowledge Representation, In: Conceptual Structures: Integration and Interfaces, LNAI 2193, eds. U.Priss, D. Corbett, pages 20-33, Borovets (Bulgaria), Springer-Verlag, 2002.

[SF01] J.J. Sarbo, J.I. Farkas, A Peircean Ontology of Language. In: In Proceedings of ICCS'2001, LNAI 2120, eds. H. Delugach, G. Stumme, pages 1-14, Stanford (CA), Springer-Verlag. 2001.

[FS00] J.I. Farkas, J.J. Sarbo, A Logical Ontology In: Working with Conceptual Structures: Contributions to ICCS'2000, ed. G. Stumme, pages 138-151, Darmstadt (Germany), Shaker Verlag. 2000.

Technical reports, Posters

[BS10] A.J.J. van Breemen, J.J. Sarbo, Knowledge in Formation, poster presented at "Philosophy of the Information and Computing Sciences, Lorentz Center, Leiden, 2010.

[BR04] A.J.J. van Breemen, Diagrammatic theorizing: discussion on form is discussion of content, paper presented at the 8th AIS/IASS Congress Universite Lyon 2, Lyon, 2004.

[BR14] A.J.J. van Breemen, Wouter

[BR14a] A.J.J. van Breemen, De dunne lijn perspectieven