<?xml version="1.0" encoding="utf-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.0 20120330//EN" "JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">INFORMATICA</journal-id>
<journal-title-group><journal-title>Informatica</journal-title></journal-title-group>
<issn pub-type="epub">1822-8844</issn>
<issn pub-type="ppub">0868-4952</issn>
<issn-l>0868-4952</issn-l>
<publisher>
<publisher-name>Vilnius University</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">INFO1235</article-id>
<article-id pub-id-type="doi">10.15388/Informatica.2019.214</article-id>
<article-categories><subj-group subj-group-type="heading">
<subject>Research Article</subject></subj-group></article-categories>
<title-group>
<article-title>Modelling Subject Domain Causality for Learning Content Renewal</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<name><surname>Gudas</surname><given-names>Saulius</given-names></name><email xlink:href="saulius.gudas@mii.vu.lt">saulius.gudas@mii.vu.lt</email><xref ref-type="aff" rid="j_info1235_aff_001">1</xref><xref ref-type="corresp" rid="cor1">∗</xref><bio>
<p><bold>S. Gudas</bold>, PhD, is a full professor at the Institute of Data Science and Digital Technologies, Faculty of Mathematics and Informatics, Vilnius University, Lithuania. 2008–2013, Dean of VU KHF. Education: in 1969–1974, studied at Kaunas University of Technology, Lithuania; in 1982 defended the PhD dissertation on the topic “Synthesis of Algorithmic Structure of Information Systems for Manufacturing Objects”; in 2005, passed the doctor habilitation procedure on the topic “Modelling of Knowledge Based Information Systems Engineering Processes”. Research directions are as follows: knowledge-based enterprise modelling, information systems theory, knowledge-based information system engineering. He is the author of the monograph on foundations of the information systems engineering theory and co-author of more than 165 research publications.</p></bio>
</contrib>
<contrib contrib-type="author">
<name><surname>Tekutov</surname><given-names>Jurij</given-names></name><email xlink:href="jurij.tekutov@yahoo.com">jurij.tekutov@yahoo.com</email><xref ref-type="aff" rid="j_info1235_aff_002">2</xref><xref ref-type="aff" rid="j_info1235_aff_003">3</xref><bio>
<p><bold>J. Tekutov</bold> received the PhD degree in computer science (informatics) at the Vilnius University in 2013, Lithuania. He is a lecturer at the Department of Informatics and Statistics at Klaipeda University; associate professor at the Department of Information Technologies at Klaipeda State University of Applied Sciences and Lithuania Business University of Applied Sciences. He is a member of council of the Faculty of Marine Technologies and Natural Sciences of KU. In 2008 he took part in project “Modernisation, development and assurance of mobility of Master study programmes in information technology area” implementation. In 2009 he attended 10th extended workshop/summer school of NordForsk network “Methodologies for Interactive Networked Enterprises – MINE”. 2012–2015 – researcher of project “Lithuanian Maritime Sector’s Technologies and Environment Research Development”. His main research interests include study process control knowledge based models. He is the author of more than 15 publications, several e-learning materials in the virtual environment, participated in several international and republican scientific conferences of young scientists and the methodological-training camps.</p></bio>
</contrib>
<contrib contrib-type="author">
<name><surname>Butleris</surname><given-names>Rimantas</given-names></name><email xlink:href="rimantas.butleris@ktu.lt">rimantas.butleris@ktu.lt</email><xref ref-type="aff" rid="j_info1235_aff_004">4</xref><bio>
<p><bold>R. Butleris</bold>, PhD, is a full professor and director of Center of Information Systems Design Technologies at the Faculty of Informatics of Kaunas University of Technology (Lithuania), and professor at Kaunas Faculty of Humanities, Vilnius University (Lithuania). Prof. Butleris is the co-author and author of over 130 scientific publications. He was a general chairman of international conferences: BIR 2006, I3E’2011, ICIST 2012; chairman of organizing committees of international conferences: IT’2008, IT’2009, IT’2010, IT’2011; a member of program committees of over 30 international conferences. During the past 10 years, Prof. Butleris coordinated or managed over 15 national or International research and development projects.</p></bio>
</contrib>
<contrib contrib-type="author">
<name><surname>Denisovas</surname><given-names>Vitalijus</given-names></name><email xlink:href="vitalijus.denisovas@ku.lt">vitalijus.denisovas@ku.lt</email><xref ref-type="aff" rid="j_info1235_aff_002">2</xref><bio>
<p><bold>V. Denisovas</bold>, PhD in technical sciences, is a professor at the Department of Informatics and Statistics, Faculty of Marine Technologies and Natural Sciences, Klaipeda University, Lithuania. 2013–2014, Dean of the Faculty of Natural Sciences and Mathematics of KU. He is a member of the working group of development of new study cycles and informatics study area regulations, established by the Lithuanian Centre for Quality Assessment in Higher Education; member of the Senate of KU; member council of the Marine Technologies and Natural Sciences of KU; member of the International Council on Systems Engineering, INCOSE; member of the Association of the Lithuanian Informatics Teachers; also member of Academic Council of Lithuania Business University of Applied Sciences. He is the author of about 20 books (textbooks) and more than 70 prestigious scientific publications on mathematical and simulation modelling, software implementation of models, their identification algorithms and modelling systems (simulators), data mining methods as well as on the various e-learning methods.</p></bio>
</contrib>
<aff id="j_info1235_aff_001"><label>1</label>Institute of Data Science and Digital Technologies, Faculty of Mathematics and Informatics, <institution>Vilnius University</institution>, LT-04812 Vilnius, <country>Lithuania</country></aff>
<aff id="j_info1235_aff_002"><label>2</label>Informatics and Statistics Department, Faculty of Marine Technologies and Natural Sciences, <institution>Klaipeda University</institution>, Bijunu St. 17, LT-91225 Klaipeda, <country>Lithuania</country></aff>
<aff id="j_info1235_aff_003"><label>3</label>Information Technologies Department, Faculty of Technology, <institution>Klaipeda State University of Applied Sciences</institution>, Bijunu St. 10, LT-91223 Klaipeda, <country>Lithuania</country></aff>
<aff id="j_info1235_aff_004"><label>4</label>Department of Information Systems, <institution>Kaunas University of Technology</institution>, LT-44249 Kaunas, <country>Lithuania</country></aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><label>∗</label>Corresponding author.</corresp>
</author-notes>
<pub-date pub-type="ppub"><year>2019</year></pub-date>
<pub-date pub-type="epub"><day>1</day><month>1</month><year>2019</year></pub-date><volume>30</volume><issue>3</issue><fpage>455</fpage><lpage>480</lpage>
<history>
<date date-type="received"><month>1</month><year>2019</year></date>
<date date-type="accepted"><month>6</month><year>2019</year></date>
</history>
<permissions><copyright-statement>© 2019 Vilnius University</copyright-statement><copyright-year>2019</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/">
<license-p>Open access article under the <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/">CC BY</ext-link> license.</license-p></license></permissions>
<abstract>
<p>The paper deals with the causality driven modelling method applied for the domain deep knowledge elicitation. This method is suitable for discovering causal relationships in domains that are characterized by internal circular causality, e.g. control and management, regulatory processes, self-regulation and renewal. Such domains are organizational systems (i.e. enterprise) or cyber-social systems, also biological systems, ecological systems, and other complex systems. Subject domain may be of different nature: real-world activities or documented content. A causality driven approach is applied here for the learning content analysis and normalization of the knowledge structures. This method was used in the field of education, and a case study of learning content renewal is provided. The domain here is a real world area – a learning content is about. The paper is on how to align the existing learning content and current (new) knowledge of the domain using the same causality driven viewpoint and the described models (frameworks). Two levels of the domain causal modelling are obtained. The first level is the discovery of the causality of the domain using the Management Transaction (MT) framework. Secondly, a deep knowledge structure of MT is revealed through a more detailed framework called the Elementary Management Cycle (EMC). The algorithms for updating the LO content in two steps are presented. Traceability matrix indicates the mismatch of the LO content (old knowledge) and new domain knowledge. Classification of the content discrepancies and an example of the study program content analysis is presented. The main outcome of the causality driven modelling approach is the effectiveness of discovering the deep knowledge when the relevant domain causality frameworks are applicable.</p>
</abstract>
<kwd-group>
<label>Key words</label>
<kwd>enterprise domain</kwd>
<kwd>causal knowledge</kwd>
<kwd>circular causality</kwd>
<kwd>domain causality</kwd>
<kwd>management transaction</kwd>
<kwd>learning content</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="j_info1235_s_001">
<label>1</label>
<title>Introduction</title>
<p>Causal modelling is a branch of complex systems modelling approaches. Causal modelling methods are common in statistics, econometrics, cybernetics, computer science, data science and other complexity sciences to study cause-effect relationships, and constructing causality driven models to predict and to control the possible dynamics of the systems.</p>
<p>Causal knowledge and causality are two of the key concepts in our approach. A causal knowledge is a type of knowledge, next to declarative, procedural, and relational knowledge. A causal knowledge is “a description of causal links among a set of factors … which provides a means for organizations … how best to achieve some goal” (Zack, <xref ref-type="bibr" rid="j_info1235_ref_046">1999</xref>). The awareness of the theory of domain causality is the prerequisite to gain deep knowledge (i.e. causal dependencies) by analysis. This deep knowledge problem formulated in a good regulator theorem in cybernetics: “any regulator (if it conforms to the qualifications given) must model what it regulates” (Conant and Ashby, <xref ref-type="bibr" rid="j_info1235_ref_004">1970</xref>). The Internal Model (IM) is a model of the subject domain. The Internal Model is created in advance using prior knowledge, i.e. IM is a predefined model, based on knowledge of the essential properties of the domain. In other words, IM is a causal knowledge model. The internal model first was articulated as the internal model principle of control theory in 1976 (Francis and Wonham, <xref ref-type="bibr" rid="j_info1235_ref_010">1976</xref>).</p>
<p>Causality as a theoretical concept is discussed in Schurz and Gebharter (<xref ref-type="bibr" rid="j_info1235_ref_035">2016</xref>). According to Glymour (<xref ref-type="bibr" rid="j_info1235_ref_013">2004</xref>), Schurz and Gebharter (<xref ref-type="bibr" rid="j_info1235_ref_035">2016</xref>) causality should be understood as a theoretical concept (in analogy to the concept of force in Newtonian physics). A general theory of causation was developed by J. Pearl (<xref ref-type="bibr" rid="j_info1235_ref_028">2000</xref>, <xref ref-type="bibr" rid="j_info1235_ref_029">2009</xref>), which underlies the theory of causal nets (TCN) developed in Spirtes <italic>et al.</italic> (<xref ref-type="bibr" rid="j_info1235_ref_038">2000</xref>), Pearl (<xref ref-type="bibr" rid="j_info1235_ref_029">2009</xref>). There are distinguished two notions of causality – type causality (so-called general causality) and actual causality (called specific causality) (Halpern, <xref ref-type="bibr" rid="j_info1235_ref_019">2015</xref>). Actual causality focuses on particular events, while type causality is looking for common regularity (law). The understanding of causality in systems modelling can be quite different according to the nature of the knowledge used.</p>
<p>From the point of view of our approach, if the external modelling paradigm is applied, then external observation of some domain is a source of knowledge. Such way of modelling is the analysis of “the particular events”, and the actual causality discovered in that way. If we follow the internal modelling paradigm, then the regularity inherent to a type of domain (causality) is already perceived, this deep knowledge determines the final model.</p>
<p>The domain (or subject domain) here is a real world area – a content of what the learning object (LO) is about. The paper is on how to align the existing learning content and current (new) knowledge of the domain using the same causality driven viewpoint and the described models (frameworks).</p>
<p>Some examples of different domain types and causality. In enterprise modelling, causality is defined as dependencies of the enterprise goals upon components of the enterprise, such as processes, services, systems, etc. (Lagerström <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_023">2009</xref>). Causality in the risk management is to be considered as the relation of the event directly to a risk situation (influence relation) (Sienou <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_037">2008</xref>). Influence relation is a causality relation between causal events of risk situations. In physical system causality is a dependency between causes (impacts, events, faults, etc.) and changes of a system (state, transition, parameter values, etc.). The captured domain knowledge specified in the knowledge base is the internal domain model (e.g. the cause-consequence rules, equations, ontology, meta-model or other structures of causal knowledge) (Grundspenkis, <xref ref-type="bibr" rid="j_info1235_ref_015">1998</xref>).</p>
<p>By the way of contract, data analytics (data mining, process mining) is a discovery of actual causality seeing that it is revealed by analysis of observable associations between elements of the domain using the Bayesian nets (causal graphs), conditional probabilistic dependencies of processes are counted (model content is data analysis based). Examples are causal nets and Bayesian nets (Glymour, <xref ref-type="bibr" rid="j_info1235_ref_013">2004</xref>; Francis and Wonham, <xref ref-type="bibr" rid="j_info1235_ref_010">1976</xref>). However, it should be recalled that conditional probabilistic dependencies (correlation) do not imply causation. In domain related theory based causality modelling the pre-condition is a deep knowledge of domain causality, e.g. exploring of the underlying theory of the subject domain, which defines a system of causal dependencies (regularities).</p>
<p>A learning object (LO) is “a collection of content items, practice items, and assessment items that are combined based on a single learning objective” (Sicilia <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_036">2005</xref>). LO’s have granular structure (are modular units). Modules can be assembled together to form the study subject – study program, course, lessons, or concept (Convertini <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_005">2006</xref>).</p>
<p>The learning object content predefines a set of capabilities to handle the subject domain, which was obtained by studies (Xu <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_044">2005</xref>). This viewpoint is inherently fitting with the role of the LO metadata as “function-enabler” and instructional design based on knowledge objects in Merrill (<xref ref-type="bibr" rid="j_info1235_ref_026">2000</xref>). In other words, the validity of learning object content (i.e. validity of the domain knowledge) is a decisive factor. IT-supported LO content renewal (adaptation) using a causal knowledge is promising, rational considering the changing business requirements and their impact on educational content (Stuikys <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_041">2017</xref>).</p>
<p>We are dealing with the subject domain summarized by the term “organizational system” and related to a wide range of industries, e.g. manufacturing, military, healthcare, energy, communication enterprises, and other. Such subject domain is a type of complex systems referred to as “enterprise” in systems engineering.</p>
<p>The concepts “management functional dependency” (MFD), “management transaction” (MT), and “elementary management cycle” (EMC) were introduced for enterprise causal modelling in information systems engineering (Gudas, <xref ref-type="bibr" rid="j_info1235_ref_016">2012</xref>; Gudas and Lopata, <xref ref-type="bibr" rid="j_info1235_ref_017">2016</xref>). Conceptual representation of MT and EMC can be considered as transactional workflows, which associated with conceptual models is as follows: Action Workflow model (Rusinkiewicz and Sheth, <xref ref-type="bibr" rid="j_info1235_ref_034">1994</xref>; Medina-Mora <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_025">1992</xref>), Deming’s PDCA cycle of business management (Deming, <xref ref-type="bibr" rid="j_info1235_ref_007">1993</xref>), ITIL Framework (Persse, <xref ref-type="bibr" rid="j_info1235_ref_030">2012</xref>), or the autonomic computing component (Kephart and Chess, <xref ref-type="bibr" rid="j_info1235_ref_022">2003</xref>). The unified representation (normalization) of captured knowledge is a reasonable condition for comparison of distinct knowledge structures. Normalization in this approach is based on the usage of MT and EMC frameworks (Gudas and Valatavicius, <xref ref-type="bibr" rid="j_info1235_ref_018">2017</xref>) as the pre-defined causal models of the subject domain.</p>
<p>This method is suitable for discovering causal relationships in domains that are characterized by internal circular causality – control and management, regulatory processes, self-regulation, renewal. These are not just organizational systems (i.e. enterprise) or cyber-social systems, but also biological systems (organisms), ecological systems, content of education systems and other complex systems.</p>
<p>A subject domain may be of different nature: real-world activities or documented content. A brief example of the real-world domain causality modelling for learning content renewal is presented. The normalized model of a subject domain reveals a set of MTs to be included in the learning content. There is also a detailed example of the causal modelling of the study content and content renewal process. The existing (old) learning content (LO, course, or study programme A) and the subject domain (i.e. content of advanced (best) study programme B) – both are reconstructed using the same frameworks MT and EMC. The mandatory normalization of the content (knowledge structures) occurs due to clustering of content items (dimensionality reduction). This normalization reveals the causality of the domain, helps the analyst to capture and compare knowledge structures. Then, the causal model of the existing learning content is compared to the causal model of the subject domain for adapting LO content.</p>
<p>The remainder of the paper is structured as follows: Section <xref rid="j_info1235_s_002">2</xref> reviews causal knowledge modelling concepts, stressing the causality driven paradigm. The learning content renewal assumptions are stated, and the key concepts of the causality driven modelling are discussed. Section <xref rid="j_info1235_s_006">3</xref> introduces the subject domain – an enterprise, and the causal knowledge structures: MT – a management transaction, and EMC – an elementary management cycle. A detailed model of the management transaction (MT) and a particular version of EMC for the enterprise modelling is laid out in Section <xref rid="j_info1235_s_007">4</xref>. In Section <xref rid="j_info1235_s_008">5</xref>, the knowledge normalization and renewal algorithms are described. A case study of the content renewal of two study subjects is laid out in Section <xref rid="j_info1235_s_009">6</xref>. Traceability matrixes are introduced to specify the mismatch of the different knowledge objects and illustrated. Classification of the content discrepancies are introduced and illustrated. The LO content repository model is discussed. Conclusions in Section <xref rid="j_info1235_s_010">7</xref> summarize the key features of the causality driven approach to the subject domain (i.e. enterprise) modelling and knowledge discovery.</p>
</sec>
<sec id="j_info1235_s_002">
<label>2</label>
<title>Causal Knowledge Modelling Concepts</title>
<sec id="j_info1235_s_003">
<label>2.1</label>
<title>The Modelling Paradigm and Assumptions</title>
<p>There are two different systems modelling paradigms: external modelling (a black box approach based), and internal modelling (a grey-box approach and white box approach based) (Gudas and Valatavicius, <xref ref-type="bibr" rid="j_info1235_ref_018">2017</xref>). The level of awareness of the subject domain is increasing when moving from black-box models towards a grey-box and, finally, to a white-box model. Domain analysis and modelling methods correspond to one of two paradigms: 
<list>
<list-item id="j_info1235_li_001">
<label>1.</label>
<p>Domain analysis based on the external observation (<italic>the external modelling paradigm</italic>);</p>
</list-item>
<list-item id="j_info1235_li_002">
<label>2.</label>
<p>Causality-based domain analysis (<italic>the internal modelling paradigm</italic>).</p>
</list-item>
</list> 
In the first case, the externally observed relationships of processes (events or objects), inputs and outputs are the elements that make up the model. The causes of relationships in such model are not explicable, because there is no theory related content of causal dependencies of domain elements. More sophisticated modelling methods use domain related generalized frameworks (meta-models, ontologies or patterns) for domain analysis and modelling. Generalized frameworks (meta-models, ontologies or patterns) are an integral part in knowledge-based approaches. Such frameworks are based on the external observation or experience, and have no theoretical basis, which explains the subject domain causality. Therefore, such generalized frameworks and modelling methods are still in the external modelling paradigm and are empirical.</p>
<p>Most of the systems modelling methods belong to the external modelling paradigm (Gudas and Valatavicius, <xref ref-type="bibr" rid="j_info1235_ref_018">2017</xref>). Business process modelling languages BPMN (OMG specification), Data Flow Diagrams (DFD), IDEF, UML, SysML, Event-Process Chain (EPC) based ARIS method designed to describe the results of the external observation, but not internal causation dependencies. This also applies to frameworks like UEML (Unified Enterprise Modelling Language), also enterprise architecture frameworks CIMOSA, DoDAF, MODAF, UPDM, and newly created UAF (Morkevičius and Gudas, <xref ref-type="bibr" rid="j_info1235_ref_027">2011</xref>). However, amongst them, one can rarely find modelling concepts that would help to reveal the domain causality – help to capture the causal dependencies. This is more than cause-effect interactions of domain elements (activities, processes and functions, material and information flows) perceived by external observation. <italic>The external observation is not enough for investigating dynamic aspects of complex systems: management and control, adaptation, self-management and coordination processes, it requires capturing a deep knowledge of causal relationships</italic>.</p>
<p>In the second case, e.g. in terms of causality based domain analysis, the domain model is constructed using deep knowledge – a theoretical background describing causal dependencies (regularities) of the domain.</p>
<p><italic>Cybernetics and the emergence of complexity sciences have developed general descriptions that reveal the process of causality in complex systems: social systems, biological systems, economical, and other types of complex systems</italic>.</p>
<p>Forster’s remarkable note on circularity (circular causality) is of particular importance today: “Should one name one central concept, a first principle, of cybernetics, it would be circularity” (Von Foerster <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_042">1953</xref>). The circular causality can be exposed using transactional workflows – a combination of workflow patterns and transaction models (Grefen, <xref ref-type="bibr" rid="j_info1235_ref_014">2002</xref>; Injun <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_020">2002</xref>). Transactional workflow refers to a model in which a sequence of interactions goes from one workflow task (step) to another (from one subsystem to another) and back to the first one. A topology of the generalized transaction is a wheel graph (Gudas and Valatavicius, <xref ref-type="bibr" rid="j_info1235_ref_018">2017</xref>).</p>
<p>A few business level enterprise frameworks reveal circular causality from the managerial perspective, e.g. PDCA cycle of quality management (Deming, <xref ref-type="bibr" rid="j_info1235_ref_007">1993</xref>), Rummler-Brache enterprise management model (Rummler <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_033">2010</xref>), a business value oriented Porter’s Value Chain Model (VCM) (Porter, <xref ref-type="bibr" rid="j_info1235_ref_031">1985</xref>), a business risk management standards (ISO:31000:2009, OCEG “Red Book” 2.0: 2009, etc.), enterprise transaction framework in DEMO (Dietz, <xref ref-type="bibr" rid="j_info1235_ref_006">2006</xref>), Action Workflow (Medina-Mora <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_025">1992</xref>), and also some other frameworks. The conceptual models of these frameworks are transactional workflows, which include feedback loops as essential constructs representing circularity (see Fig. <xref rid="j_info1235_fig_002">2</xref>).</p>
<p>This causality based approach to domain analysis and developed frameworks are appropriate for the studies of the business enterprise activities and enterprise software development – business management, business information technologies, information systems engineering, software systems engineering, or other specialties related to the design or management of various enterprises (complex systems). The learning content renewal based on the assumptions as follows: 
<list>
<list-item id="j_info1235_li_003">
<label>a)</label>
<p>The subject domain here is an organizational system (enterprise, cyber-social system, or cyber-physical-social system), and is a type of complex systems. A content of study subject encapsulates the same causal knowledge as the causal model of the subject domain.</p>
</list-item>
<list-item id="j_info1235_li_004">
<label>b)</label>
<p>A causal knowledge consists of the essential causal dependencies, which are inherent to the subject domain according to some theory. In this approach, MT and EMC frameworks conceptualize the causal dependencies within the enterprise domain, and the theoretical underpinning presented in Gudas (<xref ref-type="bibr" rid="j_info1235_ref_016">2012</xref>), Gudas and Lopata (<xref ref-type="bibr" rid="j_info1235_ref_017">2016</xref>).</p>
</list-item>
<list-item id="j_info1235_li_005">
<label>c)</label>
<p>The normalization of the knowledge structures is a pre-condition of content analysis and renewal: the content should be represented using the same framework (internal model of a domain).</p>
</list-item>
</list> 
The key concepts of the causality driven modelling are presented in Fig. <xref rid="j_info1235_fig_001">1</xref>.</p>
<fig id="j_info1235_fig_001">
<label>Fig. 1</label>
<caption>
<p>Causality driven modelling.</p>
</caption>
<graphic xlink:href="info1235_g001.jpg"/>
</fig>
<p>The causality driven modelling in Fig. <xref rid="j_info1235_fig_001">1</xref> intends to map the perceived knowledge (domain properties as well as study subject content) to some causality driven framework.</p>
<p>In our approach, the management transaction (MT) and elementary management cycle (EMC) are causality driven frameworks introduced for enterprise management modelling in Gudas (<xref ref-type="bibr" rid="j_info1235_ref_016">2012</xref>), Gudas and Lopata (<xref ref-type="bibr" rid="j_info1235_ref_017">2016</xref>). Therefore, EMC is used here as the unified structure for normalization of the learning content as well as of the subject domain knowledge. The topology of MT and EMC is a kind of the transactional workflows Rusinkiewicz and Sheth (<xref ref-type="bibr" rid="j_info1235_ref_034">1994</xref>). The examples of the similar topology are Deming’s PDCA cycle, enterprise transaction of DEMO (Dietz, <xref ref-type="bibr" rid="j_info1235_ref_006">2006</xref>), TOGAF framework, ITIL framework (Persse, <xref ref-type="bibr" rid="j_info1235_ref_030">2012</xref>). All these models adopted for the conceptualization of goal-driven systems, and consequently includes the element Goal.</p>
</sec>
<sec id="j_info1235_s_004">
<label>2.2</label>
<title>A Relationship Between LO Content and Subject Domain</title>
<p>There are several LO definitions that are found in the literature (Convertini <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_005">2006</xref>; Stuikys, <xref ref-type="bibr" rid="j_info1235_ref_040">2015</xref>; Jovanovic <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_021">2005</xref>). Our understanding of LO as a structural, process-based chunk of knowledge of subject domain corresponds to the definitions in Merrill (<xref ref-type="bibr" rid="j_info1235_ref_026">2000</xref>), Burbaite <italic>et al.</italic> (<xref ref-type="bibr" rid="j_info1235_ref_003">2014</xref>), Garrison (<xref ref-type="bibr" rid="j_info1235_ref_011">2003</xref>). The following types of knowledge structures proposed in Merrill (<xref ref-type="bibr" rid="j_info1235_ref_026">2000</xref>): List, Learning-Prerequisite, Parts-Taxonomy, Kinds-Taxonomy, Procedural-Prerequisite, Procedural-Decision, and Causal.</p>
<p>The importance of analysing a subject domain nature (subject matter) (Merrill, <xref ref-type="bibr" rid="j_info1235_ref_026">2000</xref>) for capturing and selecting the appropriate knowledge, and the context awareness (Burbaite <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_003">2014</xref>) are in line with our research direction. Such understanding of LO content co-related with definitions of knowledge objects in Berllinger (<xref ref-type="bibr" rid="j_info1235_ref_001">2004</xref>) or knowledge structures in Merrill (<xref ref-type="bibr" rid="j_info1235_ref_026">2000</xref>).</p>
<p>Theoretically, it can be said that the causality of the subject domain is the deep knowledge to be encapsulated in the educational content of the well developed learning object (in research based university studies).</p>
</sec>
<sec id="j_info1235_s_005">
<label>2.3</label>
<title>Type of the Subject Domain</title>
<p>This approach focused on the complex systems summarized by the term “organizational system” or “enterprise”. A large number of studies are associated with organizational systems (enterprises): management sciences, economics, microeconomics, risk management, ecology, security science, information security science, enterprise software engineering, engineering of cyber-physical systems (CPS), and cyber-social systems (CSS).</p>
<p>The provided method is suitable for discovering causal relationships in domains that are characterized by internal circular processes of control and/or management, self-regulation, adaptation. Such circular causality is characteristic not just of organizational systems (i.e. enterprise) or cyber-social systems, but also common to biological systems (organisms), ecological systems, and other complex systems.</p>
<p>The particularity of that kind of complex systems is a self-management capability due to a control feedback loop between data/information transformation processes (data or signal processing, decision making, computations) and physical processes (material flows and transformations). The feedback loops in such systems include humans (sources of needs, goals, requirements, etc.), and economics (pricing signals, financial information, and economic attributes) as the integral components. Therefore, a content of the feedback loops in such systems includes various origins of information and knowledge. That is why in our approach a causal knowledge structure of some subject domain is conceptualized as a type of the transactional workflow (a goal-driven transactional workflow) in Fig. <xref rid="j_info1235_fig_002">2</xref> (Gudas, <xref ref-type="bibr" rid="j_info1235_ref_016">2012</xref>; Gudas and Lopata, <xref ref-type="bibr" rid="j_info1235_ref_017">2016</xref>).</p>
<p>We assume that a content of the study program (courses, lessons and etc.) should comprise causal dependencies of the subject domain. Such content should be systematized using the relevant knowledge framework. Therefore, a pre-condition for content analysis and evaluation is the unified representation (<italic>normalization</italic>) of distinct content by mapping to the same knowledge structure.</p>
<fig id="j_info1235_fig_002">
<label>Fig. 2</label>
<caption>
<p>Internal models of the enterprise (business management viewpoint): a) Enterprise management according to Fayol, and b) Deming’s PDCA cycle of management.</p>
</caption>
<graphic xlink:href="info1235_g002.jpg"/>
</fig>
<p>For instance: 1) Content of the business management studies could be <italic>normalized</italic> by mapping on the causal knowledge structures as follows: the enterprise management functions framework as defined by Fayol (Fig. <xref rid="j_info1235_fig_003">3</xref>a), or the Deming’s (PDCA cycle (Fig. <xref rid="j_info1235_fig_003">3</xref>b)), or the enterprise transaction model in DEMO (Dietz, <xref ref-type="bibr" rid="j_info1235_ref_006">2006</xref>), or some other well-defined knowledge structure; 2) Content of the enterprise architecture engineering studies could be normalized using LC definition in TOGAF – the knowledge structure for enterprise architecture development; 3) Content of software engineering studies could be normalized by alignment to some of LC types (V-Shaped, RUP, SCRUM and etc.).</p>
</sec>
</sec>
<sec id="j_info1235_s_006">
<label>3</label>
<title>Subject Domain Causality Modelling</title>
<p>In this approach, the management functional dependency (MFD) is defined as a primary cause that creates a causal behaviour between activities of the subject domain (a chain of causal dependencies) defined as Gudas (<xref ref-type="bibr" rid="j_info1235_ref_016">2012</xref>), Gudas and Lopata (<xref ref-type="bibr" rid="j_info1235_ref_017">2016</xref>). MFD denotes the causal dependencies of some activities, processes, operational capabilities or organizational units required by particular business needs (i.e. strategic plan or actual business event). MFD is a real-world phenomenon, which could be revealed by managers or domain analysts (or not perceived in case of incompetence). The perceived MFD is visualized using the Management Transaction (MT) and the Elementary Management Cycle (EMC) frameworks (Gudas, <xref ref-type="bibr" rid="j_info1235_ref_016">2012</xref>; Gudas and Lopata, <xref ref-type="bibr" rid="j_info1235_ref_017">2016</xref>).</p>
<p>As an example, look at Porter’s Value Chain Model (VCM) (Porter, <xref ref-type="bibr" rid="j_info1235_ref_031">1985</xref>) from the internal modelling viewpoint (Gudas, <xref ref-type="bibr" rid="j_info1235_ref_016">2012</xref>). The transformed VCM view in Fig. <xref rid="j_info1235_fig_003">3</xref> is a system of MFDs (MFD tsub11, MFD<sub>12</sub>, …, MFD<sub>55</sub>), where MFDij is a pair of interacting Support Activities (Administration <inline-formula id="j_info1235_ineq_001"><alternatives>
<mml:math><mml:mo mathvariant="normal" fence="true" stretchy="false">(</mml:mo><mml:mi mathvariant="italic">i</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mo mathvariant="normal" fence="true" stretchy="false">)</mml:mo></mml:math>
<tex-math><![CDATA[$(i=1)$]]></tex-math></alternatives></inline-formula>, HRM <inline-formula id="j_info1235_ineq_002"><alternatives>
<mml:math><mml:mo mathvariant="normal" fence="true" stretchy="false">(</mml:mo><mml:mi mathvariant="italic">i</mml:mi><mml:mo>=</mml:mo><mml:mn>2</mml:mn><mml:mo mathvariant="normal" fence="true" stretchy="false">)</mml:mo></mml:math>
<tex-math><![CDATA[$(i=2)$]]></tex-math></alternatives></inline-formula>, Finance Management <inline-formula id="j_info1235_ineq_003"><alternatives>
<mml:math><mml:mo mathvariant="normal" fence="true" stretchy="false">(</mml:mo><mml:mi mathvariant="italic">i</mml:mi><mml:mo>=</mml:mo><mml:mn>3</mml:mn><mml:mo mathvariant="normal" fence="true" stretchy="false">)</mml:mo></mml:math>
<tex-math><![CDATA[$(i=3)$]]></tex-math></alternatives></inline-formula>, Product and Technology Development <inline-formula id="j_info1235_ineq_004"><alternatives>
<mml:math><mml:mo mathvariant="normal" fence="true" stretchy="false">(</mml:mo><mml:mi mathvariant="italic">i</mml:mi><mml:mo>=</mml:mo><mml:mn>4</mml:mn><mml:mo mathvariant="normal" fence="true" stretchy="false">)</mml:mo></mml:math>
<tex-math><![CDATA[$(i=4)$]]></tex-math></alternatives></inline-formula>, Procurement <inline-formula id="j_info1235_ineq_005"><alternatives>
<mml:math><mml:mo mathvariant="normal" fence="true" stretchy="false">(</mml:mo><mml:mi mathvariant="italic">i</mml:mi><mml:mo>=</mml:mo><mml:mn>5</mml:mn><mml:mo mathvariant="normal" fence="true" stretchy="false">)</mml:mo></mml:math>
<tex-math><![CDATA[$(i=5)$]]></tex-math></alternatives></inline-formula>) and Primary Activities (Inbound Logistics <inline-formula id="j_info1235_ineq_006"><alternatives>
<mml:math><mml:mo mathvariant="normal" fence="true" stretchy="false">(</mml:mo><mml:mi mathvariant="italic">j</mml:mi><mml:mo>=</mml:mo><mml:mn>1</mml:mn><mml:mo mathvariant="normal" fence="true" stretchy="false">)</mml:mo></mml:math>
<tex-math><![CDATA[$(j=1)$]]></tex-math></alternatives></inline-formula>, Operation <inline-formula id="j_info1235_ineq_007"><alternatives>
<mml:math><mml:mo mathvariant="normal" fence="true" stretchy="false">(</mml:mo><mml:mi mathvariant="italic">j</mml:mi><mml:mo>=</mml:mo><mml:mn>2</mml:mn><mml:mo mathvariant="normal" fence="true" stretchy="false">)</mml:mo></mml:math>
<tex-math><![CDATA[$(j=2)$]]></tex-math></alternatives></inline-formula>, Outbound Logistics <inline-formula id="j_info1235_ineq_008"><alternatives>
<mml:math><mml:mo mathvariant="normal" fence="true" stretchy="false">(</mml:mo><mml:mi mathvariant="italic">j</mml:mi><mml:mo>=</mml:mo><mml:mn>3</mml:mn><mml:mo mathvariant="normal" fence="true" stretchy="false">)</mml:mo></mml:math>
<tex-math><![CDATA[$(j=3)$]]></tex-math></alternatives></inline-formula>, Sales and Marketing <inline-formula id="j_info1235_ineq_009"><alternatives>
<mml:math><mml:mo mathvariant="normal" fence="true" stretchy="false">(</mml:mo><mml:mi mathvariant="italic">j</mml:mi><mml:mo>=</mml:mo><mml:mn>4</mml:mn><mml:mo mathvariant="normal" fence="true" stretchy="false">)</mml:mo></mml:math>
<tex-math><![CDATA[$(j=4)$]]></tex-math></alternatives></inline-formula>, Servicing <inline-formula id="j_info1235_ineq_010"><alternatives>
<mml:math><mml:mo mathvariant="normal" fence="true" stretchy="false">(</mml:mo><mml:mi mathvariant="italic">j</mml:mi><mml:mo>=</mml:mo><mml:mn>5</mml:mn><mml:mo mathvariant="normal" fence="true" stretchy="false">)</mml:mo></mml:math>
<tex-math><![CDATA[$(j=5)$]]></tex-math></alternatives></inline-formula>).</p>
<fig id="j_info1235_fig_003">
<label>Fig. 3</label>
<caption>
<p>The internal model of enterprise domain is perceived as a set of <inline-formula id="j_info1235_ineq_011"><alternatives>
<mml:math><mml:mtext>MFD</mml:mtext><mml:mo>=</mml:mo><mml:mo fence="true" stretchy="false">{</mml:mo><mml:msub><mml:mrow><mml:mtext>MFD</mml:mtext></mml:mrow><mml:mrow><mml:mn>11</mml:mn></mml:mrow></mml:msub><mml:mo mathvariant="normal">,</mml:mo><mml:msub><mml:mrow><mml:mtext>MFD</mml:mtext></mml:mrow><mml:mrow><mml:mn>12</mml:mn></mml:mrow></mml:msub><mml:mo mathvariant="normal">,</mml:mo><mml:mo>…</mml:mo><mml:mo mathvariant="normal">,</mml:mo><mml:msub><mml:mrow><mml:mtext>MFD</mml:mtext></mml:mrow><mml:mrow><mml:mn>45</mml:mn></mml:mrow></mml:msub><mml:mo fence="true" stretchy="false">}</mml:mo></mml:math>
<tex-math><![CDATA[$\text{MFD}=\{{\text{MFD}_{11}},{\text{MFD}_{12}},\dots ,{\text{MFD}_{45}}\}$]]></tex-math></alternatives></inline-formula>.</p>
</caption>
<graphic xlink:href="info1235_g003.jpg"/>
</fig>
<p>The discovered by experts set <inline-formula id="j_info1235_ineq_012"><alternatives>
<mml:math><mml:mo fence="true" stretchy="false">{</mml:mo><mml:msub><mml:mrow><mml:mtext>MFD</mml:mtext></mml:mrow><mml:mrow><mml:mn>11</mml:mn></mml:mrow></mml:msub><mml:mo mathvariant="normal">,</mml:mo><mml:msub><mml:mrow><mml:mtext>MFD</mml:mtext></mml:mrow><mml:mrow><mml:mn>12</mml:mn></mml:mrow></mml:msub><mml:mo mathvariant="normal">,</mml:mo><mml:mo>…</mml:mo><mml:mo mathvariant="normal">,</mml:mo><mml:msub><mml:mrow><mml:mtext>MFD</mml:mtext></mml:mrow><mml:mrow><mml:mn>55</mml:mn></mml:mrow></mml:msub><mml:mo fence="true" stretchy="false">}</mml:mo></mml:math>
<tex-math><![CDATA[$\{{\text{MFD}_{11}},{\text{MFD}_{12}},\dots ,{\text{MFD}_{55}}\}$]]></tex-math></alternatives></inline-formula> is conceptualized from the viewpoint of information processing as the <italic>management transactions</italic> (<italic>MTs</italic>). By definition, <inline-formula id="j_info1235_ineq_013"><alternatives>
<mml:math><mml:msub><mml:mrow><mml:mtext>MT</mml:mtext></mml:mrow><mml:mrow><mml:mi mathvariant="italic">i</mml:mi><mml:mi mathvariant="italic">j</mml:mi></mml:mrow></mml:msub><mml:mo>=</mml:mo><mml:mo fence="true" stretchy="false">{</mml:mo><mml:msub><mml:mrow><mml:mi mathvariant="italic">F</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="italic">i</mml:mi></mml:mrow></mml:msub><mml:mo mathvariant="normal">,</mml:mo><mml:msub><mml:mrow><mml:mi mathvariant="italic">P</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="italic">j</mml:mi></mml:mrow></mml:msub><mml:mo mathvariant="normal">,</mml:mo><mml:mo mathvariant="normal" fence="true" stretchy="false">(</mml:mo><mml:mtext>A</mml:mtext><mml:mo mathvariant="normal">,</mml:mo><mml:mtext>V</mml:mtext><mml:mo mathvariant="normal" fence="true" stretchy="false">)</mml:mo><mml:mo fence="true" stretchy="false">}</mml:mo></mml:math>
<tex-math><![CDATA[${\text{MT}_{ij}}=\{{F_{i}},{P_{j}},(\text{A},\text{V})\}$]]></tex-math></alternatives></inline-formula> includes two types of activities: <inline-formula id="j_info1235_ineq_014"><alternatives>
<mml:math><mml:msub><mml:mrow><mml:mi mathvariant="italic">P</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="italic">j</mml:mi></mml:mrow></mml:msub></mml:math>
<tex-math><![CDATA[${P_{j}}$]]></tex-math></alternatives></inline-formula> – an enterprise process, <inline-formula id="j_info1235_ineq_015"><alternatives>
<mml:math><mml:msub><mml:mrow><mml:mi mathvariant="italic">F</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="italic">i</mml:mi></mml:mrow></mml:msub></mml:math>
<tex-math><![CDATA[${F_{i}}$]]></tex-math></alternatives></inline-formula> – an enterprise management function which is linked together by a feedback loop comprising information flows A and V (Gudas, <xref ref-type="bibr" rid="j_info1235_ref_016">2012</xref>). Therefore, an internal model of VCM is presented in Fig. <xref rid="j_info1235_fig_004">4</xref> as a set of the management transactions <inline-formula id="j_info1235_ineq_016"><alternatives>
<mml:math><mml:mo fence="true" stretchy="false">{</mml:mo><mml:msub><mml:mrow><mml:mtext>MT</mml:mtext></mml:mrow><mml:mrow><mml:mn>11</mml:mn></mml:mrow></mml:msub><mml:mo mathvariant="normal">,</mml:mo><mml:mo>…</mml:mo><mml:msub><mml:mrow><mml:mtext>MT</mml:mtext></mml:mrow><mml:mrow><mml:mn>55</mml:mn></mml:mrow></mml:msub><mml:mo fence="true" stretchy="false">}</mml:mo></mml:math>
<tex-math><![CDATA[$\{{\text{MT}_{11}},\dots {\text{MT}_{55}}\}$]]></tex-math></alternatives></inline-formula>. We provide concepts from other fields of engineering and science describing causal dependencies – analogs of MFD and MT, for instance:</p>
<list>
<list-item id="j_info1235_li_006">
<label>•</label>
<p>A closed-loop control, self-regulation, and adaptation are the key concepts of systems theory, and control theory are the terms that cybernetics and complex systems theory deals with;</p>
</list-item>
<list-item id="j_info1235_li_007">
<label>•</label>
<p>In biological systems, the term <italic>homeostasis</italic> denotes a self-regulating process by which biological systems tend to maintain its parameters that are required for survival within a normal range of values;</p>
</list-item>
<list-item id="j_info1235_li_008">
<label>•</label>
<p>In ecology research, the term <italic>vicious circle</italic> refers to a complex chain of events, which reinforce themselves through a feedback loop;</p>
</list-item>
<list-item id="j_info1235_li_009">
<label>•</label>
<p>In economics, <italic>sustainable development</italic> deals with mutual dependencies (self-regulating processes) of four interconnected domains: ecology, economics, politics, and culture;</p>
</list-item>
<list-item id="j_info1235_li_010">
<label>•</label>
<p>Rummler-Brache methodology of managing the organization (enterprise) as an adaptive system reveals a hierarchy of management causal dependencies (feedback loops on the organizational level, the process level, and the job/performer level).</p>
</list-item>
</list>
<fig id="j_info1235_fig_004">
<label>Fig. 4</label>
<caption>
<p>Next step of Porter’s VCM internal modelling: perceived MFDs conceptualized as the <italic>management transactions</italic> (<italic>MTs</italic>).</p>
</caption>
<graphic xlink:href="info1235_g004.jpg"/>
</fig>
<fig id="j_info1235_fig_005">
<label>Fig. 5</label>
<caption>
<p>Two level granularity of the causal knowledge: Level 1: a management transaction (MT) framework, and Level 2 – an elementary management cycle (EMC) framework.</p>
</caption>
<graphic xlink:href="info1235_g005.jpg"/>
</fig>
<p>The internal model of Porter’s VCM (in Fig. <xref rid="j_info1235_fig_004">4</xref>) consists of a set of MTs, which are clarified as follows:</p>
<list>
<list-item id="j_info1235_li_011">
<label>•</label>
<p>Support Activities are named <italic>the management functions</italic> F = (Administration (F1), HRM (F2), Finance Management (F3), Product and technology development (F4), and Procurement (F5));</p>
</list-item>
<list-item id="j_info1235_li_012">
<label>•</label>
<p>Primary Activities are named <italic>the processes</italic> P = (Inbound Logistics (P1), Operation (P2), Outbound Logistics (P3), Sales and Marketing (P4), Servicing (P5)) (Merrill, <xref ref-type="bibr" rid="j_info1235_ref_026">2000</xref>). A set of the management transactions (MTs) is considered as Detailed VCM (Fig. <xref rid="j_info1235_fig_004">4</xref>).</p>
</list-item>
</list>
<p>Two level granularity of the domain causal knowledge is presented in Fig. <xref rid="j_info1235_fig_005">5</xref>:</p>
<list>
<list-item id="j_info1235_li_013">
<label>•</label>
<p>Level 1: the management transaction (MT) framework reveals a context of a transaction;</p>
</list-item>
<list-item id="j_info1235_li_014">
<label>•</label>
<p>Level 2: the elementary management cycle (EMC) framework reveals a deep structure of MT.</p>
</list-item>
</list>
<p>The concept “the management transaction” (MT) is explored in this approach for the first step of LO content modelling – MT conceptualizes the management information transformations inherent for the subject domain.</p>
<p>The internal model of MT is an elementary management cycle (EMC) – a more detailed knowledge granule in Fig. <xref rid="j_info1235_fig_005">5</xref> (Level 2).</p>
<p>EMC is considered as an essential (unified) building block of an enterprise as a self-managed system, i.e. EMC is a deep knowledge component (Gudas, <xref ref-type="bibr" rid="j_info1235_ref_016">2012</xref>). The similar interpretation of the deep knowledge component (“a molecule”), which is defined as a transaction, is in enterprise ontology described in DEMO (Grundspenkis, <xref ref-type="bibr" rid="j_info1235_ref_015">1998</xref>).</p>
</sec>
<sec id="j_info1235_s_007">
<label>4</label>
<title>Deep Structure of the Management Transactions</title>
<p>A particular version of EMC in Fig. <xref rid="j_info1235_fig_006">6</xref> is developed for the needs of the knowledge-based business process modelling and software engineering in Gudas (<xref ref-type="bibr" rid="j_info1235_ref_016">2012</xref>), Gudas and Lopata (<xref ref-type="bibr" rid="j_info1235_ref_017">2016</xref>). The elementary management cycle (EMC) explicitly specifies the enterprise management transaction. EMC framework includes components as follows: a management Goal (Gw), a goal-driven management function Fj (G), enterprise process Pi (G), and connecting management information flows. Management function Fj(G) is a complex structure, which consists of a set of goal-driven procedural components IN, DP, DM, and RE (four types of the information transformation steps) and the management information flows (A, B, C, D, V) (data/knowledge), and S (impacts of goal G) (Gudas, <xref ref-type="bibr" rid="j_info1235_ref_016">2012</xref>; Gudas and Lopata, <xref ref-type="bibr" rid="j_info1235_ref_017">2016</xref>).</p>
<p>A semantics of EMC procedural components is as follows:</p>
<list>
<list-item id="j_info1235_li_015">
<label>•</label>
<p><italic>Interpretation</italic> (IN) step performs the raw data acquisition (the process P state data gathering): identification, checking and systemizing of raw data according to the requirements of the management function F.</p>
</list-item>
<list-item id="j_info1235_li_016">
<label>•</label>
<p><italic>Data processing</italic> (DP) step performs data transformations according to the required content and tasks structure of the management function F.</p>
</list-item>
<list-item id="j_info1235_li_017">
<label>•</label>
<p><italic>Decision-making</italic> (DM) step generates decisions according to the required content and tasks structure of the management function F.</p>
</list-item>
<list-item id="j_info1235_li_018">
<label>•</label>
<p><italic>Decision realization</italic> (RE) step accomplishes decisions according to the required content and tasks structure of the management function F.</p>
</list-item>
</list>
<p>A semantics of the management information flows in Fig. <xref rid="j_info1235_fig_006">6</xref> is as follows: A is the “process state attributes”, B is the “systematized raw data”, C is the “processed data”, D is the “management decisions”, and V is the “controls” of the Process Pi (G). The specific semantics of EMC procedural components (steps) and flows depends on the nature of the particular enterprise.</p>
<fig id="j_info1235_fig_006">
<label>Fig. 6</label>
<caption>
<p>EMC is a detailed model of the management transaction MT.</p>
</caption>
<graphic xlink:href="info1235_g006.jpg"/>
</fig>
<p>The causal knowledge analysis includes two steps: the first step is based on the MT framework (Fig. <xref rid="j_info1235_fig_005">5</xref>), and the next step is the more detailed analysis based on the EMC framework (Fig. <xref rid="j_info1235_fig_006">6</xref>).</p>
<p>The specific semantics of EMC procedural components (steps) and information flows depend on the nature of the subject domain. In the enterprise domain the EMC steps are defined as the clusters of knowledge (Gudas, <xref ref-type="bibr" rid="j_info1235_ref_016">2012</xref>):</p>
<list>
<list-item id="j_info1235_li_019">
<label>–</label>
<p>Process (P) denotes the subject domain activities that create a material output of the enterprise;</p>
</list-item>
<list-item id="j_info1235_li_020">
<label>–</label>
<p>Interpretation (IN) content is a cluster of the domain raw data gathering and systematizing knowledge;</p>
</list-item>
<list-item id="j_info1235_li_021">
<label>–</label>
<p>Data processing (DP) includes the domain data processing knowledge;</p>
</list-item>
<list-item id="j_info1235_li_022">
<label>–</label>
<p>Decision making (DM) step content is a cluster of the decision making knowledge of the domain;</p>
</list-item>
<list-item id="j_info1235_li_023">
<label>–</label>
<p>Decision realization (RE) step content is a cluster of the decision implementation knowledge;</p>
</list-item>
<list-item id="j_info1235_li_024">
<label>–</label>
<p>Goal (G) is a cluster of the Requirements for learning content.</p>
</list-item>
</list>
<p>In the context of LO renewal issue, the semantics of the <italic>management information</italic> flows in Fig. <xref rid="j_info1235_fig_006">6</xref> is as follows:</p>
<list>
<list-item id="j_info1235_li_025">
<label>–</label>
<p>Flow A (“process state attributes”) includes the prerequisites of the first year student;</p>
</list-item>
<list-item id="j_info1235_li_026">
<label>–</label>
<p>Flow B (“systematized raw data”) includes the knowledge delivered by the courses about raw data gathering and systematizing methodologies, methods and practical knowledge of techniques and tools (IN output);</p>
</list-item>
<list-item id="j_info1235_li_027">
<label>–</label>
<p>Flow C (“processed data”) includes the knowledge delivered by the courses about domain data processing methodologies, methods and practical knowledge of techniques and tools (DP output);</p>
</list-item>
<list-item id="j_info1235_li_028">
<label>–</label>
<p>Flow D (“management decisions”) includes the knowledge delivered by courses about decision making methodologies, methods and practical knowledge of techniques and tools (DM output);</p>
</list-item>
<list-item id="j_info1235_li_029">
<label>–</label>
<p>Flow V (“controls” of the Process P) includes the knowledge delivered by courses of decision implementation methodologies, methods and practical knowledge of techniques and tools (RE output);</p>
</list-item>
<list-item id="j_info1235_li_030">
<label>–</label>
<p>Flows S (influence of goal G) are the study program goal requirements for learning content items (courses).</p>
</list-item>
</list>
</sec>
<sec id="j_info1235_s_008">
<label>5</label>
<title>Learning Object Content Renewal</title>
<p>Unified representation (normalization) is the obligatory pre-condition for comparison of the different knowledge structures (contents): old knowledge (LO content) and captured new knowledge (current state of subject domain). Normalization of knowledge representation is achieved in two steps by mapping different knowledge structures to the same causal frameworks: (phase 1) content transformation to the MT framework (normalization) and next (phase 2) – normalized content detailing by transformation to EMC framework (see Fig. <xref rid="j_info1235_fig_005">5</xref> and Fig. <xref rid="j_info1235_fig_006">6</xref>). The set of identified MT in the context of specialty studies means the main topics of the study (chunks of knowledge) which form the basis of specialty, provide required abilities. Process of the study subject content analysis and renewal is as follows:</p>
<list>
<list-item id="j_info1235_li_031">
<label>1.</label>
<p>Development of the new requirements to the content of study subject and/or LO.</p>
</list-item>
<list-item id="j_info1235_li_032">
<label>2.</label>
<p>Phase 1: MT-based LO content renewal (Fig. <xref rid="j_info1235_fig_005">5</xref>):</p>
<list>
<list-item id="j_info1235_li_033">
<label>a.</label>
<p>Analysis of the existing LO content (old knowledge).</p>
</list-item>
<list-item id="j_info1235_li_034">
<label>b.</label>
<p>Normalization of knowledge structure: transformation of the existing LO content to the MT-based domain model. The normalized domain model consists of the set of identified MTs <inline-formula id="j_info1235_ineq_017"><alternatives>
<mml:math><mml:mo fence="true" stretchy="false">{</mml:mo><mml:msup><mml:mrow><mml:mtext>MT</mml:mtext></mml:mrow><mml:mrow><mml:mo>′</mml:mo></mml:mrow></mml:msup><mml:mo fence="true" stretchy="false">}</mml:mo></mml:math>
<tex-math><![CDATA[$\{{\text{MT}^{\prime }}\}$]]></tex-math></alternatives></inline-formula>. Note: a set of MTs could be considered as Detailed VCM.</p>
</list-item>
<list-item id="j_info1235_li_035">
<label>c.</label>
<p>Discovery of the current state of subject domain (actual knowledge) (in the context of new requirements):</p>
<list>
<list-item id="j_info1235_li_036">
<label>i.</label>
<p>Analysis of the subject domain using the MT-based modelling framework;</p>
</list-item>
<list-item id="j_info1235_li_037">
<label>ii.</label>
<p>Capturing the current set of MTs MT″ of the subject domain. Specification of the captured knowledge using MT-based modelling framework.</p>
</list-item>
</list>
</list-item>
<list-item id="j_info1235_li_038">
<label>d.</label>
<p>Comparison of two MT-based (“normalized”) models (i.e. comparison of old LO content and perceived new knowledge) one by one comparing elements of MTs. This leads to the identification of discrepancies between the existing LO content and current domain knowledge. New knowledge items are revealed for LO content renewal.</p>
</list-item>
<list-item id="j_info1235_li_039">
<label>e.</label>
<p>Renewal of LO content: MT-based updating of LO content in LO repository.</p>
</list-item>
<list-item id="j_info1235_li_040">
<label>f.</label>
<p>LO repository: updated LO content is a set of MT-based knowledge objects.</p>
</list-item>
</list>
</list-item>
<list-item id="j_info1235_li_041">
<label>3.</label>
<p>Phase 2: EMC-based LO content detailing and renewal (Fig. <xref rid="j_info1235_fig_006">6</xref>):</p>
<list>
<list-item id="j_info1235_li_042">
<label>a.</label>
<p>Processing of all MT-based knowledge objects developed in phase 1.</p>
</list-item>
<list-item id="j_info1235_li_043">
<label>b.</label>
<p>Transformation of MT-based knowledge objects (existing LO content) to EMC-based representation (EMC″).</p>
</list-item>
<list-item id="j_info1235_li_044">
<label>c.</label>
<p>Transformation of perceived current domain knowledge to EMC-based representation (EMC″).</p>
</list-item>
<list-item id="j_info1235_li_045">
<label>d.</label>
<p>Comparison of two EMC-based (“normalized”) models one by one comparing internal elements of two EMCs. This leads to the identification of discrepancies between the existing LO content (old knowledge) and current state of domain (actual knowledge). New knowledge items are revealed for LO content renewal.</p>
</list-item>
<list-item id="j_info1235_li_046">
<label>e.</label>
<p>Renewal of LO content: EMC-based updating of LO content in LO repository.</p>
</list-item>
<list-item id="j_info1235_li_047">
<label>f.</label>
<p>LO repository: updated deep LO content is a set of EMC-based knowledge objects.</p>
</list-item>
</list>
</list-item>
</list>
<p>The algorithm of LO content renewal includes two phases and is presented in Fig. <xref rid="j_info1235_fig_007">7</xref> (phase 1), and in Fig. <xref rid="j_info1235_fig_008">8</xref> (phase 2).</p>
<fig id="j_info1235_fig_007">
<label>Fig. 7</label>
<caption>
<p>LO content renewal algorithm (phase 1): MT-based renewal of study subject scope.</p>
</caption>
<graphic xlink:href="info1235_g007.jpg"/>
</fig>
<p>Phase 1 is MT-based knowledge acquisition and renewal of main topics of the study subject (renewal of the scope of study program or course). The phase 2 involves deepening of the knowledge captured in phase 1, when MT-based knowledge objects are decomposed to detailed EMC-based representation.</p>
<fig id="j_info1235_fig_008">
<label>Fig. 8</label>
<caption>
<p>LO content renewal algorithm: phase 2 is the EMC-based renewal of LO content.</p>
</caption>
<graphic xlink:href="info1235_g008.jpg"/>
</fig>
</sec>
<sec id="j_info1235_s_009">
<label>6</label>
<title>Case study of LO content renewal</title>
<p>It is important to notice that subject domain may be of different nature: real-world activities or documented content. In both cases, the described method of knowledge discovery is suitable for transforming perceived knowledge into normalized specifications. The need to extract new knowledge and update the known content is constant, the reasons and the goals of the renewal may vary.</p>
<p>The following are actually possible and realistic:</p>
<p>a) Learning content needs to be updated because new types of phenomena (processes, transactions, technologies) are not taught in the study program or study subject.</p>
<p>b) The ministry of the country seeks to harmonize the similar (analogous) programs and their content at different universities.</p>
<p>c) The University seeks to bring it into line with the best study program in the field of science (leading university).</p>
<p>The normalized view of learning content makes it easy to identify the differences and similarities (discrepancies of knowledge) of the different study programs or courses.</p>
<p>Let’s take an example of the first case (a) are new types of phenomenon (processes, transactions, systems) linked by the 4th Industrial revolution, such as augmented reality, genome editing, smart materials, blockchain technology, 3-D printing and 4-D printing, autonomic systems, cyber-systems, Internet of Things and other (Gartner, <xref ref-type="bibr" rid="j_info1235_ref_012">2018</xref>).</p>
<p>A new emerged knowledge needs to be described, and new content created using the method discussed above, i.e. the key topics are specified as management transactions (MT) (see Fig. <xref rid="j_info1235_fig_004">4</xref>), and then each key topic is specified in detail as EMC (see Fig. <xref rid="j_info1235_fig_005">5</xref>).</p>
<p>For example, normalized (existing) software engineering (SE) course covers key topics MT<sub>1</sub>–MT<sub>15</sub>. A normalized representation of the SE course is as follows: SE (old) = (MT<sub>1</sub>, MT<sub>2</sub>, …, MT<sub>15</sub>). Performing problem domain analysis, the result is a normalized domain model: SE (new) = (MT<sub>1</sub>, MT<sub>2</sub>, …, MT<sub>15</sub>, MT<sub>16</sub>, MT<sub>17</sub>, MT<sub>18</sub>, MT<sub>19</sub>), where the new needs to be identified and modelled as the <italic>management transactions</italic> (<italic>MTs</italic>) MT<sub>16</sub> – Block Chain Technology, MT<sub>17</sub>–3-D Printing and 4-D Printing, MT<sub>18</sub> – Cyber Systems (CPS, CSS, CPSS), MT<sub>19</sub> – Internet of Things.</p>
<p>The second case (b) is described in more detail, a specific case from our experience, confirmed by real documents. An example of the normalized view of the learning contents of two study subjects (Study program SP1, and Study program SP2) presented in Table <xref rid="j_info1235_tab_004">A.1</xref> (Appendix <xref rid="j_info1235_app_001">A</xref>). The learning content of study programs is specified on the level of courses. Our assumption is that the subject domain of SP1 and SP2 is the same, and its causality has a theoretical basis described by EMC framework (see Fig. <xref rid="j_info1235_fig_006">6</xref>) in detail. Table <xref rid="j_info1235_tab_004">A.1</xref> illustrates the normalized view of the learning content of both study programs by mapping to EMC framework.</p>
<p>The EMC-based content normalization of the study program (SP2 – Software engineering, Bachelor of Informatics engineering, University B) depicted in Fig. <xref rid="j_info1235_fig_009">9</xref>. This normalized view reveals the particular goal G of SP2, and the clusters of learning content (i.e. clusters of courses) as follows: IN – courses on data/information capture (methods, techniques and tools) in SE, DP – courses on data processing methods, techniques and tools in SE, DM – courses on decision making methods, techniques and tools in SE, and RE – courses on decision implementation methods, techniques and tools in SE. The causal links (flows A, B, C and D) between the clusters of courses (Acquirements 1–4), and the impact S of goal G to the content of each cluster and causal link are defined. Suppose each course of the study program implemented by LO (one or more LOs) in the learning system.</p>
<fig id="j_info1235_fig_009">
<label>Fig. 9</label>
<caption>
<p>The EMC-based content normalization of the study program SP2.</p>
</caption>
<graphic xlink:href="info1235_g009.jpg"/>
</fig>
<p>The presented method considers other normalization step – the disclosure of the causality dependencies within the each cluster of courses of study program. In this case, the courses are specified at the level of lessons (topics). The causal modelling of courses should be done by analogy with the study program normalization. Note: the successful case is to assume the appropriate causality framework (specific to the course or cluster of courses) (see Fig. <xref rid="j_info1235_fig_001">1</xref>).</p>
<p>An example of the normalized content of course “B014 Fundamentals of Software Engineering” (Study program SP2) is presented in Table <xref rid="j_info1235_tab_001">1</xref>. The learning contents of course B014 correspond to the methodology of software engineering described in Sommerville (<xref ref-type="bibr" rid="j_info1235_ref_039">2016</xref>). For conciseness, Table <xref rid="j_info1235_tab_001">1</xref> describes the content of EMC steps, the graphical representation corresponds to EMC representation in Fig. <xref rid="j_info1235_fig_005">5</xref>.</p>
<table-wrap id="j_info1235_tab_001">
<label>Table 1</label>
<caption>
<p>The normalized content of the course “B014 Fundamentals of Software Engineering”.</p>
</caption>
<table>
<tbody>
<tr>
<td style="vertical-align: top; text-align: left; border-top: solid thin"><bold>Steps of EMC</bold> (clusters of the content topics)</td>
<td style="vertical-align: top; text-align: left; border-top: solid thin"><bold>Learning content of course B104: main topics</bold> <italic>Reference: Sommerville (</italic><xref ref-type="bibr" rid="j_info1235_ref_039"><italic>2016</italic></xref><italic>) Software engineering – 10th ed</italic>.</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left"><bold>G</bold> – goal of the course B104</td>
<td style="vertical-align: top; text-align: left">Advanced knowledge and skills in software engineering of sociotechnical systems.</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left"><bold>P</bold> – Topics about process that is being studied – software engineering (SE)</td>
<td style="vertical-align: top; text-align: left">Software process. Agile software development. Software evolution. Sociotechnical systems. Systems engineering.</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left"><bold>IN</bold> – topics about identification, checking and systemizing of raw data according to the requirements of the SE</td>
<td style="vertical-align: top; text-align: left">System modelling. Systems of systems. Requirements engineering. Security and dependability. Cybersecurity. Sociotechnical resilience.</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left"><bold>DP</bold> – topics about data transformations in the required tasks of SE</td>
<td style="vertical-align: top; text-align: left">Architectural design. Systems of systems architecture. Advanced software engineering (<italic>Component-based SE, Distributed SE, SO architecture, Embedded software, Aspect oriented SE</italic>). Security and dependability specification.</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left"><bold>DM</bold> – topics about the decision making in the required tasks of SE</td>
<td style="vertical-align: top; text-align: left">Design and implementation. Security and dependability engineering.</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin"><bold>RE</bold> – topics about decision realization in the required tasks of SE</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Design and implementation. Software testing. Software reuse. Software management (<italic>Project management, Quality management, Configuration management, Process improvement</italic>)</td>
</tr>
</tbody>
</table>
</table-wrap>
<p>This normalized view reveals the particular goal G of course B104 focused on the software engineering of sociotechnical systems (Sommerville, <xref ref-type="bibr" rid="j_info1235_ref_039">2016</xref>), the clusters of topics as follows: IN – topics on data/information capture (methods, techniques and tools), DP – topics on data processing (methods, techniques and tools), DM – topics on decision making (methods, techniques and tools) and RE – topics on decision implementation (methods, techniques and tools).</p>
<p>Content normalization helps to systematize course content, create causal relationships between lecture topics according to selected engineering methodology (development technology) stages.</p>
<p>The third case (b) is also possible for a qualitative leap if there is sufficient resources. In this case, the modelling process is similar to case(b); only the role of the subject area is the best study program in the world leading university. Further modelling, as in the case (b), does not have any fundamental differences.</p>
</sec>
<sec id="j_info1235_s_010">
<label>7</label>
<title>Traceability Matrixes</title>
<p>Traceability matrixes specify the results of comparison – discrepancies of the old knowledge (the normalized LO content) and captured actual knowledge (current state of subject domain). Several options identified: 1) LO content is actual (S – sameness); 2) LO content should be restructured or supplemented by new knowledge items (C – change); 3) a new LO content item (a new knowledge) is required (N – new); 4) the exclusion of LO content item – LO no longer meets requirements (D – delete). Therefore, the traceability matrix elements indicate discrepancies, which can have values as follows: 
<disp-formula id="j_info1235_eq_001">
<label>(1)</label><alternatives>
<mml:math display="block"><mml:mtable displaystyle="true"><mml:mtr><mml:mtd><mml:mi mathvariant="normal">R</mml:mi><mml:mo>=</mml:mo><mml:mo fence="true" stretchy="false">{</mml:mo><mml:mi mathvariant="normal">S</mml:mi><mml:mo mathvariant="normal">,</mml:mo><mml:mi mathvariant="normal">C</mml:mi><mml:mo mathvariant="normal">,</mml:mo><mml:mi mathvariant="normal">N</mml:mi><mml:mo mathvariant="normal">,</mml:mo><mml:mi mathvariant="normal">D</mml:mi><mml:mo fence="true" stretchy="false">}</mml:mo><mml:mo>.</mml:mo></mml:mtd></mml:mtr></mml:mtable></mml:math>
<tex-math><![CDATA[\[ \mathrm{R}=\{\mathrm{S},\mathrm{C},\mathrm{N},\mathrm{D}\}.\]]]></tex-math></alternatives>
</disp-formula>
</p>
<p>The mismatch of knowledge structures could be checked on the two levels of granularity: a) using the MT-based knowledge clustering (MT-based normalization), and b) using the EMC-based clustering (EMC-based normalization).</p>
<p>An example of the traceability matrix using the MT-based SP content clustering is depicted in Table <xref rid="j_info1235_tab_002">2</xref>. The MT-based normalized learning content (from Table <xref rid="j_info1235_tab_004">A.1</xref>, Appendix <xref rid="j_info1235_app_001">A</xref>) is evaluated in Table <xref rid="j_info1235_tab_002">2</xref> on the top level of (knowledge) granularity, where the study program SP1 is to be improved, and is compared against study program SP2.</p>
<table-wrap id="j_info1235_tab_002">
<label>Table 2</label>
<caption>
<p>MT-based traceability matrix: comparison of SP1 and SP2 content.</p>
</caption>
<table>
<thead>
<tr>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">Causal knowledge items (MT–based) → <bold>SP 2</bold></td>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">Goal (G)</td>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">Process (P)</td>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">Input of P</td>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">Output of P</td>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">Management function (F)</td>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">Input of F</td>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">Output of F</td>
</tr>
</thead>
<tbody>
<tr>
<td style="vertical-align: top; text-align: left"><bold>SP 1</bold></td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left"><bold>Goal</bold> (<bold>G</bold>): <italic>Purpose of the study subject</italic></td>
<td style="vertical-align: top; text-align: left">Change</td>
<td style="vertical-align: top; text-align: left">-</td>
<td style="vertical-align: top; text-align: left">-</td>
<td style="vertical-align: top; text-align: left">-</td>
<td style="vertical-align: top; text-align: left">-</td>
<td style="vertical-align: top; text-align: left">-</td>
<td style="vertical-align: top; text-align: left">-</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left"><bold>Process</bold> (<bold>P</bold>): <italic>Provided capabilities</italic></td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">Change</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left"><bold>An input of Process</bold> (<bold>P</bold>): <italic>Required skills</italic></td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">Sameness</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left"><bold>An output of Process</bold> (<bold>P</bold>): <italic>Obtained skills</italic></td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">Change</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left"><bold>Management function</bold> (<bold>F</bold>): <italic>Core knowledge</italic></td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">Change</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left"><bold>An input of F</bold>: <italic>Required skills</italic></td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">Sameness</td>
<td style="vertical-align: top; text-align: left">–</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin"><bold>An output of F</bold>: <italic>Provided skills and abilities</italic></td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">–</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">–</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">–</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">–</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">–</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Change</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin"/>
</tr>
</tbody>
</table>
</table-wrap>
<p>The most complicated part is the evaluation methods of the likelihood and difference of content. It can be done by experts or it can be supported by software tools using data science (knowledge discovery, data mining, text mining, domain ontologies) (Wowczko, <xref ref-type="bibr" rid="j_info1235_ref_043">2015</xref>; Embley and Campbell, <xref ref-type="bibr" rid="j_info1235_ref_009">1998</xref>; Ye and Chua, <xref ref-type="bibr" rid="j_info1235_ref_045">2006</xref>; Zhai and Liu, <xref ref-type="bibr" rid="j_info1235_ref_047">2005</xref>; Dou and Hu, <xref ref-type="bibr" rid="j_info1235_ref_008">2012</xref>) or process mining methods (Bolt <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_002">2018</xref>; Mannhardt <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_024">2018</xref>).</p>
<p>In this example, experts have fixed the following changes to the study program SP1 in MT-based traceability matrix (Table <xref rid="j_info1235_tab_002">2</xref>): the purpose of SP1 need to be adjusted (goal G), capabilities provided (Process P), skills obtained, core knowledge of SP1 restructured or supplemented (F) and skills of SP1 provided. Another example of an expert evaluation is in Table <xref rid="j_info1235_tab_003">3</xref>.</p>
<p>The evaluation of content discrepancies using software tools is the most promising solution. Some attempts of using data mining methods for development of content (text) analysis software systems are discussed in Wowczko (<xref ref-type="bibr" rid="j_info1235_ref_043">2015</xref>), Embley and Campbell (<xref ref-type="bibr" rid="j_info1235_ref_009">1998</xref>), Ye and Chua (<xref ref-type="bibr" rid="j_info1235_ref_045">2006</xref>), Zhai and Liu (<xref ref-type="bibr" rid="j_info1235_ref_047">2005</xref>), Dou and Hu (<xref ref-type="bibr" rid="j_info1235_ref_008">2012</xref>). Data mining based method for the similar content (skills and vacancy) analysis is proposed in Wowczko (<xref ref-type="bibr" rid="j_info1235_ref_043">2015</xref>), the prototype tool is developed using RapidMiner and R. Ontology based methods Embley and Campbell (<xref ref-type="bibr" rid="j_info1235_ref_009">1998</xref>) use heuristics and domain ontologies to identify data, but the disadvantage is that the method requires the predefined object-relationship model.</p>
<p>The detection and evaluation of content discrepancies applying the process mining approach is more in line with the causal modelling principles as the reconstructed process model is based on current domain data (event log) (Bolt <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_002">2018</xref>; Mannhardt <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_024">2018</xref>). The proposed Guided Process Discovery (GPD) technique (Mannhardt <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_024">2018</xref>) is a close causal modelling based PM. The core of the GPD technique is the relation between high-level activities and low-level events. GPD need to translate low-level events into high-level activities that are recognizable by stakeholders (Mannhardt <italic>et al.</italic>, <xref ref-type="bibr" rid="j_info1235_ref_024">2018</xref>). In case when the higher-level activities model is an adequate model of the domain causality (regularity inherent to some type of domain), we have causality-based process mining. In this case, a content assessment tool can be created on basis of GPD technique.</p>
<p>Here top-level event log corresponds to the EMC-based structure, consisting of few knowledge clusters (i.e. groups of courses). The content of each cluster (i.e. the course group) can also be arranged (i.e. normalized) according to known causal dependencies model. Thus getting a lower level event log. The evaluation of similarities and differences between process models provides initial data to the content discrepancies assessment. The method for comparing the two process models is described in Bolt <italic>et al.</italic> (<xref ref-type="bibr" rid="j_info1235_ref_002">2018</xref>). This process variant comparison approach can serve to content evaluation software development. Such tool would greatly help to process the knowledge that is structured into Table <xref rid="j_info1235_tab_004">A.1</xref> and obtain the values of the evaluation column.</p>
<p>The more detailed comparison of the study programs SP1 and SP2 (on the level of courses) can be specified using the EMC-based traceability matrix. Due to limited space of the article the column “Evaluation” in Table <xref rid="j_info1235_tab_004">A.1</xref> is added to specify the results of comparison. An example of the EMC-based traceability matrix of only one knowledge cluster “Raw data gathering and systematizing process” (the step IN of EMC) is presented in Table <xref rid="j_info1235_tab_003">3</xref>. The normalized learning content in Table <xref rid="j_info1235_tab_003">3</xref> is evaluated on the level of courses.</p>
<table-wrap id="j_info1235_tab_003">
<label>Table 3</label>
<caption>
<p>EMC-based traceability matrix of IN cluster: comparison of SP1 and SP2.</p>
</caption>
<table>
<thead>
<tr>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin"><bold>IN cluster:</bold> <italic>Raw data gathering and systematizing knowledge</italic></td>
<td colspan="4" style="vertical-align: top; text-align: center; border-top: solid thin; border-bottom: solid thin">Study program SP2 (IN cluster)</td>
</tr>
</thead>
<tbody>
<tr>
<td style="vertical-align: top; text-align: left">Study program SP1 (IN cluster)</td>
<td style="vertical-align: top; text-align: left">B068 IT and Operating Systems</td>
<td style="vertical-align: top; text-align: left">B066 Fundamentals of Logic and Discrete Math.</td>
<td style="vertical-align: top; text-align: left">B027 Probability and Statistical Data Analysis</td>
<td style="vertical-align: top; text-align: left">&lt;Elective specialization track courses&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left">B119 Information Technologies</td>
<td style="vertical-align: top; text-align: left">Sameness</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left">B304 Operating Systems</td>
<td style="vertical-align: top; text-align: left">Sameness</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left">B125 Computer Architecture</td>
<td style="vertical-align: top; text-align: left">New</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left">B001 Mathematics 1</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">Change</td>
<td style="vertical-align: top; text-align: left">Change</td>
<td style="vertical-align: top; text-align: left">–</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left">B002 Mathematics 2</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">New</td>
<td style="vertical-align: top; text-align: left">–</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left">B101 Physics 1</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">–</td>
<td style="vertical-align: top; text-align: left">Delete</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">&lt;Elective specialization track courses&gt;</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">–</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">–</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">–</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Sameness</td>
</tr>
</tbody>
</table>
</table-wrap>
<fig id="j_info1235_fig_010">
<label>Fig. 10</label>
<caption>
<p>The LO content repository model (the Entity Class Model).</p>
</caption>
<graphic xlink:href="info1235_g010.jpg"/>
</fig>
<p>The following required modifications of SP1 content have been fixed by experts: the course B101 Physics 1 is deleted (Delete), course B001 Mathematics 1 is clarified (Change) using the content of SP2 courses, and course B002 Mathematics 2 is replaced (New) by new content from SP2.</p>
</sec>
<sec id="j_info1235_s_011">
<label>8</label>
<title>The LO Repository</title>
<p>The LO repository model in Fig. <xref rid="j_info1235_fig_010">10</xref> is designed by integrating the study subject requirements with the LO content repository. The structure of LO content repository is based on the causal knowledge models, i.e. it is based on the definitions of MT and EMC frameworks. The LO content repository prototype is developed using the IBM Rational RequisiteProTM tool.</p>
<p>Thus, the deep characteristics of subject domain are captured (note: in the case under consideration the domain type is an enterprise) using the causal knowledge frameworks MT and EMC. The LO knowledge repository is designed to store clusters of knowledge (matching MT and EMC elements): Goals (G), Processes (P), Functions (F), also internal elements of F structure: steps Interpretation (IN), Data Processing (DP), Decision Making (DM), and Decision Realization (RE), Flows (S), Flows (I). The LO content repository is integrated with the repository of study subject (study program, course) requirements.</p>
</sec>
<sec id="j_info1235_s_012">
<label>9</label>
<title>Conclusions</title>
<p>The causality driven modelling approach is applied for the domain knowledge discovery and learning object content analysis. The theory of the subject domain causal dependencies is the prerequisite to gain deep knowledge by analyst. The domain here is a real world area – a content of what the LO is about – and is considered as a complex system. The paper is on how to align the existing learning content and current (new) knowledge of the domain using the described models (frameworks).</p>
<p>The provided method is suitable for discovering causal relationships in domains that are characterized by internal circular processes of control and/or management, self-regulation, adaptation. Such circular causality is characteristic not just of organizational systems (i.e. enterprise) or cyber-social systems, but also common to biological systems (organisms), ecological systems, and other complex systems.</p>
<p>Two level granularity of modelling is introduced. The causal model of subject domain (content of what LO is about) is conceptualized using MT and EMC frameworks in two steps. The top-level causal dependencies are revealed and visualized as a set of the management transactions. Secondly, a deep knowledge is captured using the elementary management cycle (EMC) framework for decomposition of the identified set of MT’s. These frameworks are used here to transformation (normalization) and renewal (adaptation) of the learning objects (study program content).</p>
<p>The normalization of LO content is used for clustering of content items. Normalization is obtained by mapping LO content items onto the causal knowledge framework. Such normalization of knowledge structure is valid only when the relevant causal knowledge frameworks are used, e.g. causality models are inherent to the subject domain. Provided algorithms describe the renewal process of LO content in two phases. Phase 1 reveals the scope of causal knowledge within the subject domain. Phase 1 of the knowledge capturing is based on the management transaction (MT) framework. Phase 2 involves deepening of the MT-based knowledge using the EMC framework. Phase 2 of content normalization is based on the EMC framework, which represents an internal model of MT.</p>
<p>A case study of learning content renewal showed that the causal modelling is useful for clustering the knowledge, discovering the logical sequences, systematic comparison of the different knowledge objects. The comparison of two knowledge structures is carried out at different levels of detail. We used two levels of granularity: a top level is the MT-based normalization, and a more detailed level – using the EMC-based normalization. An example of the study programs (learning content) causal modelling is presented. Traceability matrixes have been developed to assess discrepancies between different knowledge structures and to compare study programs used here.</p>
<p>The main outcome is the effectiveness of discovering deep knowledge in the subject domain, but only when the domain causality frameworks are theory based. The presented causal models can be applied to modelling information transactions of any type of goal-driven complex systems (characterized by internal circular causality). One of these types of complex systems is enterprise (organizational system), for which MT and EMC models have been developed. Causal models (modified) can also be applied to the analysis of educational content by teaching the deep knowledge (domain causality) of different subject domains (e.g. eco-systems, bio-systems, organizational systems, economical systems, etc.).</p>
<p>This causal modelling method allows you to effectively update complex knowledge structures (training content) using software tools. The creation of such tools is a development perspective for knowledge-based e-learning systems. The causality driven knowledge modelling is suitable for analysis of various domains, and not only for the educational content analysis. It may be the objective of further works.</p>
</sec>
</body>
<back>
<app-group>
<app id="j_info1235_app_001"><label>A</label>
<title>Appendix</title>
<table-wrap id="j_info1235_tab_004">
<label>Table A.1</label>
<caption>
<p>Normalized learning content.</p>
</caption>
<table>
<tbody>
<tr>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">EMC framework (causal knowledge clusters)</td>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">Semantics of EMC elements in the context of learning</td>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">Study program SP1 (University A): Information systems (Bachelor)</td>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">Study program SP2 (University B): Software engineering (Bachelor)</td>
<td style="vertical-align: top; text-align: left; border-top: solid thin; border-bottom: solid thin">Evaluation R = &lt;S, C, N, D&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Performance: Process (P) /<italic>Activities of the subject domain</italic>/</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">A core process of the study subject domain (<italic>Provided capabilities</italic>)</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Information systems analysis and development</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Informatics Engineering: development and maintenance of enterprise software systems</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input/Output of Process (P) /<italic>Material flows</italic>/</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Obligatory properties: required skills and provided abilities</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input: applicants to the University;<break/>Output: Bachelor of Informatics Engineering</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input: applicants to the University;<break/>Output: Bachelor of Computing</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Management function (F)</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Learning content: communicated core knowledge (special skills and abilities)</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Provide special skills and abilities: Programming;<break/>Business modelling and computerization of management;<break/>Databases and their online access</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Provide special skills and abilities:<break/>Informatics Engineering Specialization;<break/>Robot Software Engineering Specialization</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Function (F): Input/Output /<italic>Knowledge flow</italic>/</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Learning content:<break/>Input/required skills;<break/>Output: special skills and abilities</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input: university (program) entrance requirements.<break/>Output: requirements for graduation</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input: university (program) entrance requirements.<break/>Output: requirements for graduation</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Goal (G) /<italic>Purpose of the study subject</italic>/</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">The mission/purpose/goal/objectives of the study program</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">To provide advanced capabilities related to information systems analysis and development</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">To provide advanced knowledge and skills of the CPS and enterprise software systems development and maintenance</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">The Impacts (S) of Goal /<italic>Requirements of learning content</italic>/</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Flow S: Requirements for the items of the study program</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Not defined<break/>&lt;<italic>should be defined</italic>&gt;</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Not defined<break/>&lt;<italic>should be defined</italic>&gt;</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">IN – Interpretation step /<italic>Domain raw data gathering and systematizing knowledge</italic>/</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Learning content: raw knowledge of data gathering and description relevant to the study program</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">B119 Information Technologies B304 Operating systems B125 Computer architecture B001 Mathematics 1 B002 Mathematics 2 B101 Physics 1<break/>&lt;<italic>Elective specialization track courses</italic>&gt;</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">B068 Information Technologies and Operating Systems<break/>B066 Fundamentals of Logic and Discrete Mathematics<break/>B027 Probability and Statistical Data Analysis<break/>&lt;<italic>Elective specialization track courses</italic>&gt;</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input A/Output B of IN step /<italic>Identified data</italic>/<italic>checked data</italic>/</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Flow A: Prerequisites of the first year student<break/>Flow B: Knowledge delivered of IN step</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input: Prerequisites<break/>Output: Knowledge of the delivered courses (IN)</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input: Prerequisites<break/>Output: Knowledge of the delivered courses (IN)</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">DP – Data processing step /<italic>Study subject domain data processing knowledge</italic>/</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Learning content: Knowledge of data processing relevant to the study subject (i.e. Process P) Courses/lessons</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">B505 Computer Graphics<break/>B400 Algorithms development and analysis<break/>B008 Digital structures<break/>B100 Digital logic<break/>B145 Computer Networks<break/>&lt;<italic>Elective specialization track courses</italic>&gt;</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">B009 Programming Languages<break/>B012 Data Structures and Algorithms<break/>B064 Object-Oriented Programming<break/>B054 Embedded Systems Programming<break/>B073 Computer Aided Design tools<break/>&lt;Elective specialization track courses&gt;</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input B/Output C of DP step: abilities of the domain data processing/</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Flow C: Knowledge delivered of DP step</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input: Prerequisites.<break/>Output: Knowledge of the delivered courses</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input: Prerequisites.<break/>Output: Knowledge of the delivered courses</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">DM – Decision making step /<italic>Decision-making knowledge</italic>/</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Learning content: delivered knowledge of decision-making relevant to the study subject</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">B602 Data Bases<break/>B314 Software engineering<break/>B126 IS user interface<break/>B148 IS design and CASE technology B121 Project<break/>&lt;Elective specialization track courses&gt;</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">B025 Databases of Engineering Systems<break/>B014 Fundamentals of Software Engineering<break/>B024 Computer System Engineering<break/>B048 Signal Processing<break/>B059 Theory of Systems and CASE Technologies<break/>B030 Modelling of Automatic Control Systems<break/>B057 Virtual Engineering and Prototyping<break/>&lt;Elective specialization track courses&gt;</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input C/Output D of DM step: abilities of decisions making</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Flow D: Knowledge delivered of DM step</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input: Prerequisites.<break/>Output: Knowledge of the delivered courses</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input: Prerequisites.<break/>Output: Knowledge of the delivered courses</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">RE – Decision realization step (<italic>decision implementation knowledge</italic>)</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Learning content: knowledge of decision implementation relevant to the study subject</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">B114 IS fundamentals<break/>B103 Data Warehouses<break/>B113 Graduation project<break/>B112 Graduation Practice</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">B055 Applied Research Methodology<break/>B021 Placement<break/>B013 Bachelor Final Project</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
<tr>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input (D)/Output (V) of RE step: <italic>abilities of the decision implementation</italic></td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Flow V: Knowledge delivered of RE step, Graduation project</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input: Prerequisites<break/>Output: Knowledge of the delivered courses, and Graduation project</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">Input: Prerequisites<break/>Output: Knowledge of the delivered courses, and Graduation project</td>
<td style="vertical-align: top; text-align: left; border-bottom: solid thin">R = &lt;…&gt;</td>
</tr>
</tbody>
</table>
</table-wrap>
</app></app-group>
<ref-list id="j_info1235_reflist_001">
<title>References</title>
<ref id="j_info1235_ref_001">
<mixed-citation publication-type="other"><string-name><surname>Berllinger</surname>, <given-names>G.</given-names></string-name> (2004). Creating knowledge objects. <uri>http://www.systems-thinking.org/cko/guide.htm</uri>. Accessed 15 February 2018.</mixed-citation>
</ref>
<ref id="j_info1235_ref_002">
<mixed-citation publication-type="journal"><string-name><surname>Bolt</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>de Leoni</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>van der Aalst</surname>, <given-names>W.M.P.</given-names></string-name> (<year>2018</year>). <article-title>Process variant comparison: using event logs to detect differences in behavior and business rules</article-title>. <source>Information Systems</source>, <volume>74</volume>, <fpage>53</fpage>–<lpage>66</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_003">
<mixed-citation publication-type="journal"><string-name><surname>Burbaite</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Bespalova</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Damasevicius</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Stuikys</surname>, <given-names>V.</given-names></string-name> (<year>2014</year>). <article-title>Context-aware generative learning objects for teaching</article-title>. <source>Computer Science International Journal of Engineering Education</source>, <volume>30</volume>(<issue>4</issue>), <fpage>929</fpage>–<lpage>936</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_004">
<mixed-citation publication-type="other"><string-name><surname>Conant</surname>, <given-names>R.C.</given-names></string-name>, <string-name><surname>Ashby</surname>, <given-names>R.W.</given-names></string-name> (1970). Every good regulator of a system must be a model of that system. <italic>International Journal of Systems Science</italic>, 89–97.</mixed-citation>
</ref>
<ref id="j_info1235_ref_005">
<mixed-citation publication-type="journal"><string-name><surname>Convertini</surname>, <given-names>V.N.</given-names></string-name>, <string-name><surname>Albanese</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Marengo</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Marengo</surname>, <given-names>V.</given-names></string-name>, <string-name><surname>Scalera</surname>, <given-names>M.</given-names></string-name> (<year>2006</year>). <article-title>The OSEL taxonomy for the classification of learning objects</article-title>. <source>Interdisciplinary Journal of Knowledge and Learning Objects</source>, <volume>2</volume>, <fpage>125</fpage>–<lpage>138</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_006">
<mixed-citation publication-type="journal"><string-name><surname>Dietz</surname>, <given-names>J.L.G.</given-names></string-name> (<year>2006</year>). <article-title>The deep structure of business processes</article-title>. <source>Communications of the ACM</source>, <volume>49</volume>(<issue>5</issue>), <fpage>58</fpage>–<lpage>64</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_007">
<mixed-citation publication-type="book"><string-name><surname>Deming</surname>, <given-names>W.E.</given-names></string-name> (<year>1993</year>). <source>The New Economics for Industry, Government and Education. Massachusetts Institute of Technology</source>. <publisher-name>Center for Advanced Engineering Study</publisher-name>, <publisher-loc>Cambridge</publisher-loc>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_008">
<mixed-citation publication-type="chapter"><string-name><surname>Dou</surname>, <given-names>W.</given-names></string-name>, <string-name><surname>Hu</surname>, <given-names>J.</given-names></string-name> (<year>2012</year>). <chapter-title>Automated web data mining using semantic analysis</chapter-title>. In: <source>ADMA 2012, LNAI</source>, Vol. <volume>7713</volume>. <publisher-name>Springer-Verlag</publisher-name>, <publisher-loc>Berlin, Heidelberg</publisher-loc>, pp. <fpage>539</fpage>–<lpage>551</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_009">
<mixed-citation publication-type="chapter"><string-name><surname>Embley</surname>, <given-names>D.W.</given-names></string-name>, <string-name><surname>Campbell</surname>, <given-names>D.M.</given-names></string-name> (<year>1998</year>). <chapter-title>Ontology-based extraction and structuring of information from data-rich unstructured documents</chapter-title>. In: <source>Proc. CIKM</source>, pp. <fpage>52</fpage>–<lpage>59</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_010">
<mixed-citation publication-type="journal"><string-name><surname>Francis</surname>, <given-names>B.A.</given-names></string-name>, <string-name><surname>Wonham</surname>, <given-names>W.M.</given-names></string-name> (<year>1976</year>). <article-title>The internal model principle of control theory</article-title>. <source>Automatica</source>, <volume>12</volume>(<issue>5</issue>), <fpage>457</fpage>–<lpage>465</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_011">
<mixed-citation publication-type="chapter"><string-name><surname>Garrison</surname>, <given-names>D.R.</given-names></string-name> (<year>2003</year>). <chapter-title>Self-directed learning and distance education</chapter-title>. In: <source>Handbook of Distance Education</source>, pp. <fpage>161</fpage>–<lpage>168</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_012">
<mixed-citation publication-type="other"><string-name><surname>Gartner</surname>, <given-names>I.</given-names></string-name> (2018). <italic>Top 10 Strategic Technology Trends for 2019</italic>. ID:G00374252. Published: 15 October 2018.</mixed-citation>
</ref>
<ref id="j_info1235_ref_013">
<mixed-citation publication-type="journal"><string-name><surname>Glymour</surname>, <given-names>C.</given-names></string-name> (<year>2004</year>). <article-title>Critical notice</article-title>. <source>British Journal for the Philosophy of Science</source>, <volume>55</volume>, <fpage>779</fpage>–<lpage>790</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_014">
<mixed-citation publication-type="chapter"><string-name><surname>Grefen</surname>, <given-names>P.W.P.J.</given-names></string-name> (<year>2002</year>). <chapter-title>Transactional workflows or workflow transactions?</chapter-title> In: <source>DEXA 2002</source>, <series><italic>LNCS</italic></series>, Vol. <volume>2453</volume>. <publisher-name>Springer-Verlag</publisher-name>, <publisher-loc>Berlin, Heidelberg</publisher-loc>, pp. <fpage>60</fpage>–<lpage>69</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_015">
<mixed-citation publication-type="journal"><string-name><surname>Grundspenkis</surname>, <given-names>J.</given-names></string-name> (<year>1998</year>). <article-title>Causal domain model driven knowledge acquisition for expert diagnosis system development</article-title>. <source>Journal of Intelligent Manufacturing</source>, <volume>9</volume>(<issue>6</issue>), <fpage>547</fpage>–<lpage>558</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_016">
<mixed-citation publication-type="book"><string-name><surname>Gudas</surname>, <given-names>S.</given-names></string-name> (<year>2012</year>). <source>Foundations of the Information Systems’ Engineering Theory</source>. <publisher-name>Vilnius University</publisher-name>, <publisher-loc>Vilnius</publisher-loc>. <comment>(monograph, in Lithuanian)</comment>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_017">
<mixed-citation publication-type="journal"><string-name><surname>Gudas</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Lopata</surname>, <given-names>A.</given-names></string-name> (<year>2016</year>). <article-title>Towards internal modelling of the information systems application domain</article-title>. <source>Informatica</source>, <volume>27</volume>(<issue>1</issue>), <fpage>1</fpage>–<lpage>29</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_018">
<mixed-citation publication-type="journal"><string-name><surname>Gudas</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Valatavicius</surname>, <given-names>A.</given-names></string-name> (<year>2017</year>). <article-title>Normalization of domain modeling in enterprise software development</article-title>. <source>Modern Computing</source>, <volume>5</volume>(<issue>4</issue>), <fpage>329</fpage>–<lpage>350</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_019">
<mixed-citation publication-type="chapter"><string-name><surname>Halpern</surname>, <given-names>J.Y.</given-names></string-name> (<year>2015</year>). <chapter-title>A modification of the Halpern-Pearl definition of causality</chapter-title>. In: <source>Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (IJCAI 2015)</source>, pp. <fpage>3022</fpage>–<lpage>3033</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_020">
<mixed-citation publication-type="journal"><string-name><surname>Injun</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Chulsoon</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Changwoo</surname>, <given-names>L.</given-names></string-name> (<year>2002</year>). <article-title>A transactional workflow model for engineering/manufacturing processes</article-title>. <source>International Journal of Computer Integrated Manufacturing</source>, <volume>15</volume>(<issue>2</issue>), <fpage>178</fpage>–<lpage>192</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_021">
<mixed-citation publication-type="other"><string-name><surname>Jovanovic</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Gasevic</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Verbert</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Duval</surname>, <given-names>E.</given-names></string-name> (2005). Ontology of learning object content structure. <italic>Artificial Intelligence in Education</italic>, 322–329.</mixed-citation>
</ref>
<ref id="j_info1235_ref_022">
<mixed-citation publication-type="journal"><string-name><surname>Kephart</surname>, <given-names>J.O.</given-names></string-name>, <string-name><surname>Chess</surname>, <given-names>D.M.</given-names></string-name> (<year>2003</year>). <article-title>The vision of autonomic computing</article-title>. <source>Computer</source>, <volume>36</volume>(<issue>1</issue>), <fpage>41</fpage>–<lpage>50</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_023">
<mixed-citation publication-type="chapter"><string-name><surname>Lagerström</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Saat</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Franke</surname>, <given-names>U.</given-names></string-name>, <string-name><surname>Aier</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Ekstedt</surname>, <given-names>M.</given-names></string-name> (<year>2009</year>). <chapter-title>Enterprise meta modeling methods – combining a stakeholder-oriented and a causality-based approach</chapter-title>. In: <source>BPMDS 2009 and EMMSAD 2009, LNBIP</source>, Vol. <volume>29</volume>, pp. <fpage>381</fpage>–<lpage>393</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_024">
<mixed-citation publication-type="journal"><string-name><surname>Mannhardt</surname>, <given-names>F.</given-names></string-name>, <string-name><surname>de Leoni</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Reijers</surname>, <given-names>H.A.</given-names></string-name>, <string-name><surname>van der Aalst</surname>, <given-names>W.M.P.</given-names></string-name>, <string-name><surname>Toussaint</surname>, <given-names>P.J.</given-names></string-name> (<year>2018</year>). <article-title>Guided process discovery – a pattern-based approach</article-title>. <source>Information Systems</source>, <volume>76</volume>, <fpage>1</fpage>–<lpage>18</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_025">
<mixed-citation publication-type="chapter"><string-name><surname>Medina-Mora</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Wong</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Flores</surname>, <given-names>P.</given-names></string-name> (<year>1992</year>). <chapter-title>The action workflow approach to workflow management</chapter-title>. In: <source>Proceedings of the 4th Conference on Computer-Supported Cooperative Work</source>, pp. <fpage>281</fpage>–<lpage>288</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_026">
<mixed-citation publication-type="other"><string-name><surname>Merrill</surname>, <given-names>M.D.</given-names></string-name> (2000). Knowledge objects and mental models. The instructional use of learning objects. Available at: <uri>http://reusability.org/read/chapters/merrill.doc</uri>. Accessed 10 February 2018.</mixed-citation>
</ref>
<ref id="j_info1235_ref_027">
<mixed-citation publication-type="journal"><string-name><surname>Morkevičius</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Gudas</surname>, <given-names>S.</given-names></string-name> (<year>2011</year>). <article-title>Enterprise knowledge based software requirements elicitation</article-title>. <source>Information Technology and Control</source>, <volume>40</volume>(<issue>3</issue>), <fpage>181</fpage>–<lpage>190</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_028">
<mixed-citation publication-type="book"><string-name><surname>Pearl</surname>, <given-names>J.</given-names></string-name> (<year>2000</year>). <source>Causality</source>. <publisher-name>Cambridge University Press</publisher-name>, <publisher-loc>Cambridge</publisher-loc>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_029">
<mixed-citation publication-type="journal"><string-name><surname>Pearl</surname>, <given-names>J.</given-names></string-name> (<year>2009</year>). <article-title>Causal inference in statistics: an overview</article-title>. <source>Statistics Surveys</source>, <volume>3</volume>, <fpage>96</fpage>–<lpage>146</lpage>. <ext-link ext-link-type="doi" xlink:href="https://doi.org/10.1214/09-SS057" xlink:type="simple">https://doi.org/10.1214/09-SS057</ext-link>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_030">
<mixed-citation publication-type="book"><string-name><surname>Persse</surname>, <given-names>J.</given-names></string-name> (<year>2012</year>). <source>The ITIL Process Manual – Key Processes and Their Application</source>. <publisher-name>Van Haren Publishing</publisher-name>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_031">
<mixed-citation publication-type="book"><string-name><surname>Porter</surname>, <given-names>M.E.</given-names></string-name> (<year>1985</year>). <source>Competitive Advantage</source>. <publisher-name>The Free Press</publisher-name>, <publisher-loc>New York</publisher-loc>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_032">
<mixed-citation publication-type="journal"><string-name><surname>Reigeluth</surname>, <given-names>C.M.</given-names></string-name>, <string-name><surname>Merrill</surname>, <given-names>M.D.</given-names></string-name>, <string-name><surname>Bunderson</surname>, <given-names>C.V.</given-names></string-name> (<year>1978</year>). <article-title>The structure of subject matter content and its instructional design implications</article-title>. <source>Instructional Science</source>, <volume>7</volume>(<issue>2</issue>), <fpage>107</fpage>–<lpage>126</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_033">
<mixed-citation publication-type="book"><string-name><surname>Rummler</surname>, <given-names>G.A.</given-names></string-name>, <string-name><surname>Ramias</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Rummler</surname>, <given-names>R.A.</given-names></string-name> (<year>2010</year>). <source>White Space Revisited: Creating Value Through Process</source>. <publisher-name>Wiley</publisher-name>, <publisher-loc>San Francisco</publisher-loc>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_034">
<mixed-citation publication-type="chapter"><string-name><surname>Rusinkiewicz</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Sheth</surname>, <given-names>A.</given-names></string-name> (<year>1994</year>). <chapter-title>Specification and execution of transactional workflows</chapter-title>. In: <string-name><surname>Kim</surname>, <given-names>W.</given-names></string-name> (Ed.), <source>Modern Database Systems: The Object Model, Interoperability, and Beyond</source>. <publisher-name>ACM Press</publisher-name>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_035">
<mixed-citation publication-type="journal"><string-name><surname>Schurz</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Gebharter</surname>, <given-names>A.</given-names></string-name> (<year>2016</year>). <article-title>Causality as a theoretical concept: explanatory warrant and empirical content of the theory of causal nets</article-title>. <source>Synthese</source>, <volume>193(4)</volume>, <fpage>1073</fpage>–<lpage>1103</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_036">
<mixed-citation publication-type="chapter"><string-name><surname>Sicilia</surname>, <given-names>M.A.</given-names></string-name>, <string-name><surname>García-Barriocanal</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Sánchez-Alonso</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Soto</surname>, <given-names>J.</given-names></string-name> (<year>2005</year>). <chapter-title>A semantic lifecycle approach to learning object repositories</chapter-title>. In: <source>Proceedings of the Advanced Industrial Conference on Telecommunications</source>, pp. <fpage>466</fpage>–<lpage>471</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_037">
<mixed-citation publication-type="chapter"><string-name><surname>Sienou</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Lamine</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Karduck</surname>, <given-names>A.P.</given-names></string-name>, <string-name><surname>Pingaud</surname>, <given-names>H.</given-names></string-name> (<year>2008</year>). <chapter-title>Towards a semi-formal modeling language supporting collaboration between risk and process manager</chapter-title>. In: <source>Proceedings of the 2008 Second IEEE International Conference on Digital Ecosystems and Technologies</source>, <conf-loc>Phitsanulok, Thailand</conf-loc>, pp. <fpage>119</fpage>–<lpage>125</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_038">
<mixed-citation publication-type="book"><string-name><surname>Spirtes</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Glymour</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Scheines</surname>, <given-names>R.</given-names></string-name> (<year>2000</year>). <source>Causation, Prediction, and Search</source>. <publisher-name>MIT Press</publisher-name>. ISBN <isbn>0-262-19440-6</isbn>. <comment>543 pp.</comment></mixed-citation>
</ref>
<ref id="j_info1235_ref_039">
<mixed-citation publication-type="book"><string-name><surname>Sommerville</surname>, <given-names>I.</given-names></string-name> (<year>2016</year>). <source>Software Engineering/Ian Sommerville</source> <edition>10</edition>th ed. <publisher-name>Pearson Education Limited</publisher-name>, <comment>ISBN-13:978-0133943030, ISBN-10:0133943038</comment>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_040">
<mixed-citation publication-type="book"><string-name><surname>Stuikys</surname>, <given-names>V.</given-names></string-name> (<year>2015</year>). <source>Smart Learning Objects for Smart Education in Computer Science: Theory, Methodology and Robot-Based Implementation</source>. <publisher-name>Springer</publisher-name>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_041">
<mixed-citation publication-type="journal"><string-name><surname>Stuikys</surname>, <given-names>V.</given-names></string-name>, <string-name><surname>Burbaite</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Bespalova</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Blazauskas</surname>, <given-names>T.</given-names></string-name>, <string-name><surname>Barisas</surname>, <given-names>D.</given-names></string-name> (<year>2017</year>). <article-title>Stage-based generative learning object model for automated content adaptation</article-title>. <source>Modern Computing</source>, <volume>5</volume>(<issue>2</issue>), <fpage>183</fpage>–<lpage>205</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_042">
<mixed-citation publication-type="book"><string-name><surname>Von Foerster</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Mead</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Teuber</surname>, <given-names>H.L.</given-names></string-name> (<year>1953</year>). <source>Cybernetics: Circular Causal and Feedback Mechanisms in Biological and Social Systems</source>. <publisher-name>Josiah Macy Jr. Foundation</publisher-name>, <publisher-loc>New York, NY</publisher-loc>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_043">
<mixed-citation publication-type="journal"><string-name><surname>Wowczko</surname>, <given-names>I.A.</given-names></string-name> (<year>2015</year>). <article-title>Skills and vacancy analysis with data mining techniques</article-title>. <source>Informatics</source>, <volume>2</volume>, <fpage>31</fpage>–<lpage>49</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_044">
<mixed-citation publication-type="journal"><string-name><surname>Xu</surname>, <given-names>D.</given-names></string-name>, <string-name><surname>Wang</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Wang</surname>, <given-names>M.</given-names></string-name> (<year>2005</year>). <article-title>A conceptual model of personalized virtual learning environments</article-title>. <source>Expert Systems with Applications</source>, <volume>29</volume>, <fpage>525</fpage>–<lpage>534</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_045">
<mixed-citation publication-type="journal"><string-name><surname>Ye</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Chua</surname>, <given-names>T.S.</given-names></string-name> (<year>2006</year>). <article-title>Learning object models from semistructured web documents</article-title>. <source>IEEE Transaction on Knowledge and Data Engineering</source>, <volume>18</volume>(<issue>3</issue>), <fpage>334</fpage>–<lpage>349</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_046">
<mixed-citation publication-type="journal"><string-name><surname>Zack</surname>, <given-names>M.H.</given-names></string-name> (<year>1999</year>). <article-title>Developing a knowledge strategy</article-title>. <source>California Management Review</source>, <volume>41</volume>(<issue>3</issue>), <fpage>125</fpage>–<lpage>145</lpage>.</mixed-citation>
</ref>
<ref id="j_info1235_ref_047">
<mixed-citation publication-type="chapter"><string-name><surname>Zhai</surname>, <given-names>Y.</given-names></string-name>, <string-name><surname>Liu</surname>, <given-names>B.</given-names></string-name> (<year>2005</year>). <chapter-title>Extracting web data using instance-based learning</chapter-title>. In: <source>Proceedings of 6th Internanional Conference on Web Information Systems Engineering (WISE’05)</source>, pp. <fpage>318</fpage>–<lpage>331</lpage>.</mixed-citation>
</ref>
</ref-list>
</back>
</article>