Self-efficacy is crucial for successful self-regulated learning, particularly in an online environment, yet research on self-efficacy for online self-regulated learning has received relatively little empirical attention in the language education domain. In this study, we investigated the dynamic features of English as a Foreign Language university students’ self-efficacy for self-regulated learning in the online environment, and explored the influencing factors on SESRL. Multiple sources of data over a period of one semester were collected, analysed, and triangulated. Our (...) results demonstrated that most students displayed a relatively constant and high self-efficacy for self-regulated online learning, and that a few students also experienced an increased or decreased SESRL. Thematic analysis further revealed a variety of task-, learner-, course-, and technology-level factors contributing to learners’ self-efficacy beliefs for self-regulated online learning. Our findings thus offer pedagogical implications for self-regulated foreign language learning in an online context. (shrink)

Previous research on cross-situational word learning has demonstrated that learners are able to reduce ambiguity in mapping words to referents by tracking co-occurrence probabilities across learning events. In the current experiments, we examined whether learners are able to retain mappings over time. The results revealed that learners are able to retain mappings for up to 1 week later. However, there were interactions between the amount of retention and the different learning conditions. Interestingly, the strongest retention was associated (...) with a learning condition that engendered retrieval dynamics that initially challenged the learner but eventually led to more successful retrieval toward the end of learning. The ease/difficulty of retrieval is a critical process underlying cross-situational word learning and is a powerful example of how learning dynamics affect long-term learning outcomes. (shrink)

This paper discusses the possibility of modelling inductive inference (Gold 1967) in dynamic epistemic logic (see e.g. van Ditmarsch et al. 2007). The general purpose is to propose a semantic basis for designing a modal logic for learning in the limit. First, we analyze a variety of epistemological notions involved in identification in the limit and match it with traditional epistemic and doxastic logic approaches. Then, we provide a comparison of learning by erasing (Lange et al. 1996) and (...) iterated epistemic update (Baltag and Moss 2004) as analyzed in dynamic epistemic logic. We show that finite identification can be modelled in dynamic epistemic logic, and that the elimination process of learning by erasing can be seen as iterated belief-revision modelled in dynamic doxastic logic. Finally, we propose viewing hypothesis spaces as temporal frames and discuss possible advantages of that perspective. (shrink)

Topics in Cognitive Science, Volume 14, Issue 1, Page 14-30, January 2022.

Sender–receiver games, first introduced by David Lewis ([1969]), have received increased attention in recent years as a formal model for the emergence of communication. Skyrms ([2010]) showed that simple models of reinforcement learning often succeed in forming efficient, albeit not necessarily minimal, signalling systems for a large family of games. Later, Alexander et al. ([2012]) showed that reinforcement learning, combined with forgetting, frequently produced both efficient and minimal signalling systems. In this article, I define a ‘dynamic’ sender–receiver game (...) in which the state–action pairs are not held constant over time and show that neither of these two models of learning learn to signal in this environment. However, a model of reinforcement learning with discounting of the past does learn to signal; it also gives rise to the phenomenon of linguistic drift. 1 Introduction2 Dynamic Signalling Games with Reinforcement Learning2.1 Introducing new states2.2 Swapping state–action pairs3 Discounting the Past3.1 Learning to signal in a dynamic world3.2 An unexpected outcome: linguistic drift4 ConclusionAppendix: A Markov Chain Analysis. (shrink)

Statistical learning enables humans to involuntarily process and utilize different kinds of patterns from the environment. However, the cognitive mechanisms underlying the simultaneous acquisition of multiple regularities from different perceptual modalities remain unclear. A novel multidimensional serial reaction time task was developed to test 40 participants’ ability to learn simple first‐order and complex second‐order relations between uni‐modal visual and cross‐modal audio‐visual stimuli. Using the difference in reaction times between sequenced and random stimuli as the index of domain‐general statistical (...) class='Hi'>learning, a significant difference and dissociation of learning occurred between the initial and final learning phases. Furthermore, we used a negative and positive occurrence‐frequency‐and‐reaction‐time correlation to indicate implicit and explicit learning, respectively, and found that learning simple uni‐modal patterns involved an implicit‐to‐explicit segue, while acquiring complex cross‐modal patterns required an explicit‐to‐implicit segue, resulting in a X‐shape crossing of regularity learning. Thus, we propose an X‐way hypothesis to elucidate the dynamic interplay between the implicit and explicit systems at two distinct stages when acquiring various regularities in a multidimensional probability space. (shrink)

While the study of implicit learning is nothing new, the field as a whole has come to embody — over the last decade or so — ongoing questioning about three of the most fundamental debates in the cognitive sciences: The nature of consciousness, the nature of mental representation (in particular the difficult issue of abstraction), and the role of experience in shaping the cognitive system. Our main goal in this chapter is to offer a framework that attempts to integrate (...) current thinking about these three issues in a way that specifically links consciousness with adaptation and learning. Our assumptions about this relationship are rooted in further assumptions about the nature of processing and of representation in cognitive systems. When considered together, we believe that these assumptions offer a new perspective on the relationships between conscious and unconscious processing and on the function of consciousness in cognitive systems. (shrink)

In recent decades, the logical study of rational belief dynamics has played an increasingly important role in philosophy. However, the dynamics of concepts such as conceptual learning received comparatively little attention within this debate. This is problematic insofar as the occurrence of conceptual change (especially in the sciences) has been an influential argument against a merely logical analysis of beliefs. Especially Kuhn’s ideas about the incommensurability, i.e., untranslatability, of succeeding theories seem to stand in the way of (...) logical reconstruction. This paper investigates conceptual change as model-changing operations similar to belief revision and relates it to the notion of incommensurability. I consider several versions of conceptual change and discuss their influences on the expressive power, translatability and the potential arising of incommensurability. The paper concludes with a discussion of animal taxonomy in Aristotle’s and Linnaeus’s work. (shrink)

Current psychological theories of human causal learning and judgment focus primarily on long-run predictions: two by estimating parameters of a causal Bayes nets, and a third through structural learning. This paper focuses on people’s short-run behavior by examining dynamical versions of these three theories, and comparing their predictions to a real-world dataset.

The prefrontal cortex is widely believed to play an important role in facilitating people's ability to switch performance between different tasks. We present a biologically‐based computational model of prefrontal cortex (PFC) that explains its role in task switching in terms of the greater flexibility conferred by activation‐based working memory representations in PFC, as compared with more slowly adapting weight‐based memory mechanisms. Specifically we show that PFC representations can be rapidly updated when a task switches via a dynamic gating mechanism based (...) on a temporal‐differences reward‐prediction learning mechanism. Unlike prior models of this type, the present model develops all of its internal representations via learning mechanisms as shaped by the demands of continuous periodic task switching. This advance opens up a new domain of research into the interactions between working memory task demands and the representations that develop to meet them. Results on a version of the Wisconsin card sorting task are presented for the full model and a number of comparison networks that test the importance of various model features. Furthermore, we show that a lesioned model produces perseverative errors like those seen in frontal patients. (shrink)

A dynamic learning method is developed for an uncertain n-link robot with unknown system dynamics, achieving predefined performance attributes on the link angular position and velocity tracking errors. For a known nonsingular initial robotic condition, performance functions and unconstrained transformation errors are employed to prevent the violation of the full-state tracking error constraints. By combining two independent Lyapunov functions and radial basis function neural network approximator, a novel and simple adaptive neural control scheme is proposed for the (...) class='Hi'>dynamics of the unconstrained transformation errors, which guarantees uniformly ultimate boundedness of all the signals in the closed-loop system. In the steady-state control process, RBF NNs are verified to satisfy the partial persistent excitation condition. Subsequently, an appropriate state transformation is adopted to achieve the accurate convergence of neural weight estimates. The corresponding experienced knowledge on unknown robotic dynamics is stored in NNs with constant neural weight values. Using the stored knowledge, a static neural learning controller is developed to improve the full-state tracking performance. A comparative simulation study on a 2-link robot illustrates the effectiveness of the proposed scheme. (shrink)

The relationship between machine learning and the philosophy of science can be classed as a dynamic interaction: a mutually beneficial connection between two autonomous fields that changes direction over time. I discuss the nature of this interaction and give a case study highlighting interactions between research on Bayesian networks in machine learning and research on causality and probability in the philosophy of science.

The prefrontal cortex is widely believed to play an important role in facilitating people's ability to switch performance between different tasks. We present a biologically‐based computational model of prefrontal cortex (PFC) that explains its role in task switching in terms of the greater flexibility conferred by activation‐based working memory representations in PFC, as compared with more slowly adapting weight‐based memory mechanisms. Specifically we show that PFC representations can be rapidly updated when a task switches via a dynamic gating mechanism based (...) on a temporal‐differences reward‐prediction learning mechanism. Unlike prior models of this type, the present model develops all of its internal representations via learning mechanisms as shaped by the demands of continuous periodic task switching. This advance opens up a new domain of research into the interactions between working memory task demands and the representations that develop to meet them. Results on a version of the Wisconsin card sorting task are presented for the full model and a number of comparison networks that test the importance of various model features. Furthermore, we show that a lesioned model produces perseverative errors like those seen in frontal patients. (shrink)

This paper presents a learning theory pertinent to dynamic decision making (DDM) called instancebased learning theory (IBLT). IBLT proposes five learning mechanisms in the context of a decision‐making process: instance‐based knowledge, recognition‐based retrieval, adaptive strategies, necessity‐based choice, and feedback updates. IBLT suggests in DDM people learn with the accumulation and refinement of instances, containing the decision‐making situation, action, and utility of decisions. As decision makers interact with a dynamic task, they recognize a situation according to its similarity (...) to past instances, adapt their judgment strategies from heuristic‐based to instance‐based, and refine the accumulated knowledge according to feedback on the result of their actions. The IBLT's learning mechanisms have been implemented in an ACT‐R cognitive model. Through a series of experiments, this paper shows how the IBLT's learning mechanisms closely approximate the relative trend magnitude and performance of human data. Although the cognitive model is bounded within the context of a dynamic task, the IBLT is a general theory of decision making applicable to other dynamic environments. (shrink)

Many events that humans and other species experience contain regularities in which certain elements within an event predict certain others. While some of these regularities involve tracking the co‐occurrences between temporally adjacent stimuli, others involve tracking the co‐occurrences between temporally distant stimuli (i.e., nonadjacent dependencies, NADs). Prior research shows robust learning of adjacent dependencies in humans and other species, whereas learning NADs is more difficult, and often requires support from properties of the stimulus to help learners notice the (...) NADs. Here, we report on seven experiments that examined NAD learning from various types of visual stimuli, exploring the effects of dynamic motion on adults' NAD learning from visual sequences involving human and nonhuman agents. We tested adults' NAD learning from visual sequences of human actions, object transformations, static images of human postures, and static images of an object in different postures. We found that dynamic motion aids the acquisition of NADs. We also found that learning NADs in sequences involving human agents is more robust compared to sequences involving nonhuman objects. We propose that dynamic motion and human agents both independently result in richer representations that provide a stronger signal for NAD learning. (shrink)

Job shop scheduling problem is one of the most difficult optimization problems in manufacturing industry, and flexible job shop scheduling problem is an extension of the classical JSP, which further challenges the algorithm performance. In FJSP, a machine should be selected for each process from a given set, which introduces another decision element within the job path, making FJSP be more difficult than traditional JSP. In this paper, a variant of grasshopper optimization algorithm named dynamic opposite learning assisted GOA (...) is proposed to solve FJSP. The recently proposed dynamic opposite learning strategy adopts the asymmetric search space to improve the exploitation ability of the algorithm and increase the possibility of finding the global optimum. Various popular benchmarks from CEC 2014 and FJSP are used to evaluate the performance of DOLGOA. Numerical results with comparisons of other classic algorithms show that DOLGOA gets obvious improvement for solving global optimization problems and is well-performed when solving FJSP. (shrink)

This exploratory paper considers the concept of generation in the context of learning across the life course. Although researchers have often found considerable inequalities in participation by age, as well as strongly articulated attitudinal differences, there have so far been only a handful of studies that have explored these patterns through the perspective of generational formations. The paper is primarily conceptual, exploratory and reflective, setting out a number of approaches to the concept of generations, most of which derive largely (...) from debates with the ghost of Karl Mannheim; it then considers how these concepts of generation have been applied to understandings of educational inequalities in recent research in Germany and the Nordic nations. It then examines the dynamics of inter-generational relations in learning, drawing on research undertaken as part of the Teaching and Learning Research Programme. The paper argues that although inter-generational dynamics are a relatively neglected dimension of Anglophone research on life chances and learning, there is a strong case for understanding their dual roles in both inequality and cohesion. It concludes by outlining some themes and areas for further investigation in the future. (shrink)

The present commentary addresses the Quartz & Sejnowski (Q&S) target article from the point of view of the dynamical learning algorithm for neural networks. These techniques implicitly adopt Q&S's neural constructivist paradigm. Their approach hence receives support from the biological and psychological evidence. Limitations of constructive learning for neural networks are discussed with an emphasis on grammar learning.

Theories of cognitive development must address both the issue of how children bring their knowledge to bear on behavior in‐the‐moment, and how knowledge changes over time. We argue that seeking answers to these questions requires an appreciation of the dynamic nature of the developing system in its full, reciprocal complexity. We illustrate this dynamic complexity with results from two lines of research on early word learning. The first demonstrates how the child's active engagement with objects and people supports referent (...) selection via memories for what objects were previously seen in a cued location. The second set of results highlights changes in the role of novelty and attentional processes in referent selection and retention as children's knowledge of words and objects grows. Together this work suggests that understanding systems for perception, action, attention, and memory, and their complex interaction, is critical to understand word learning. We review recent literature that highlights the complex interactions between these processes in cognitive development and point to critical issues for future work. (shrink)

Constant risk to the confidentiality, integrity and the availability of information in our everyday lives and work has increased the need for responsible use and handling of information. Security education is becoming an integral part of any undergraduate curriculum in computer science and information systems. The evolving role of security in this digital era makes it nontrivial to decide the appropriate topics that need to be covered during the course duration in a way that all aspects of security deployment are (...) examined. The only approach to this challenge is to use student-oriented learning strategies to encourage the students not only to recognize relationships between concepts and comprehend the underlying structure of what is being learned but also expose them to methods where they are responsible for their own independent learning. The current study examines the experiences gained in COMP-431 Computer Security, a senior-level undergraduate computer security course using such methods, with an emphasis on the students’ reactions, perceptions, and experiences as well as the educator’s role in the teaching and learning process. (shrink)

Theories of cognitive development must address both the issue of how children bring their knowledge to bear on behavior in-the-moment, and how knowledge changes over time. We argue that seeking answers to these questions requires an appreciation of the dynamic nature of the developing system in its full, reciprocal complexity. We illustrate this dynamic complexity with results from two lines of research on early word learning. The first demonstrates how the child's active engagement with objects and people supports referent (...) selection via memories for what objects were previously seen in a cued location. The second set of results highlights changes in the role of novelty and attentional processes in referent selection and retention as children's knowledge of words and objects grows. Together this work suggests that understanding systems for perception, action, attention, and memory, and their complex interaction, is critical to understand word learning. We review recent literature that highlights the complex interactions between these processes in cognitive development and point to critical issues for future work. (shrink)

Tetris provides a difficult, dynamic task environment within which some people are novices and others, after years of work and practice, become extreme experts. Here we study two core skills; namely, choosing the goal or objective function that will maximize performance and a feature-based analysis of the current game board to determine where to place the currently falling zoid so as to maximize the goal. In Study 1, we build cross-entropy reinforcement learning models to determine whether different goals result (...) in different feature weights. Two of these optimization strategies quickly rise to performance plateaus, whereas two others continue toward higher but more jagged heights. In Study 2, we compare the zoid placement decisions made by our best CERL models with those made by 67 human players. Across 370,131 human game episodes, two CERL models picked the same zoid placements as our lowest scoring human for 43% of the placements and as our three best scoring experts for 65% of the placements. Our findings suggest that people focus on maximizing points, not number of lines cleared or number of levels reached. They also show that goal choice influences the choice of zoid placements for CERLs and suggest that the same is true of humans. Tetris has a repetitive task structure that makes Tetris more tractable and more like a traditional experimental psychology paradigm than many more complex games or tasks. Hence, although complex, Tetris is not overwhelmingly complex and presents a right-sized challenge to cognitive theories, especially those of integrated cognitive systems. (shrink)

Tetris provides a difficult, dynamic task environment within which some people are novices and others, after years of work and practice, become extreme experts. Here we study two core skills; namely, choosing the goal or objective function that will maximize performance and a feature-based analysis of the current game board to determine where to place the currently falling zoid so as to maximize the goal. In Study 1, we build cross-entropy reinforcement learning models to determine whether different goals result (...) in different feature weights. Two of these optimization strategies quickly rise to performance plateaus, whereas two others continue toward higher but more jagged heights. In Study 2, we compare the zoid placement decisions made by our best CERL models with those made by 67 human players. Across 370,131 human game episodes, two CERL models picked the same zoid placements as our lowest scoring human for 43% of the placements and as our three best scoring experts for 65% of the placements. Our findings suggest that people focus on maximizing points, not number of lines cleared or number of levels reached. They also show that goal choice influences the choice of zoid placements for CERLs and suggest that the same is true of humans. Tetris has a repetitive task structure that makes Tetris more tractable and more like a traditional experimental psychology paradigm than many more complex games or tasks. Hence, although complex, Tetris is not overwhelmingly complex and presents a right-sized challenge to cognitive theories, especially those of integrated cognitive systems. (shrink)