1. Fairness is about the just distribution of society's resources, and in ML, the main resource being distributed is model performance, e.g. the translation quality produced by machine translation...

What kind of Theory of Music and Theory of Metric was taught to the young Pindar or the young Sophocles? So far are we from an answer to this question that we do not even know how far extra study was necessary, or usual, for the professional poet as compared with the ordinary educated Greek citizen. The interdependence of music and metric in lyric poetry gave complexity to the word-rhythms but kept the study of music, the subordinate partner, theoretically simple. (...) Doubtless by the time the young poet had learnt by heart the words of past masters of lyric verse, sung or accompanied them on the lyre, and danced them in choir or κ⋯μος, he had absorbed by practice and somewhat rule-of-thumb methods of training a great deal of the τ⋯χενη which his calling would require. He would have to learn, in common with the χοροδιδ⋯σκαλος, how to read and write a simple score, and so he must know the symbols of pitch in such scales as were then in use. The notation of arsis and thesis may have been required too, and if we knew that this was so, and how he was taught to apply it, we might be in a much better position to assess the kind of theory he learnt. But of one thing we may be sure: genius apart, it was his practical training, as performer and spectator, rather than theoretical teaching which gave his ear its cunning and technical skill to compose new rhythms. (shrink)

What kind of Theory of Music and Theory of Metric was taught to the young Pindar or the young Sophocles? So far are we from an answer to this question that we do not even know how far extra study was necessary, or usual, for the professional poet as compared with the ordinary educated Greek citizen. The interdependence of music and metric in lyric poetry gave complexity to the word-rhythms but kept the study of music, the subordinate partner, theoretically simple. (...) Doubtless by the time the young poet had learnt by heart the words of past masters of lyric verse, sung or accompanied them on the lyre, and danced them in choir or κμος, he had absorbed by practice and somewhat rule-of-thumb methods of training a great deal of the τχενη which his calling would require. He would have to learn, in common with the χοροδιδσκαλος, how to read and write a simple score, and so he must know the symbols of pitch in such scales as were then in use. The notation of arsis and thesis may have been required too, and if we knew that this was so, and how he was taught to apply it, we might be in a much better position to assess the kind of theory he learnt. But of one thing we may be sure: genius apart, it was his practical training, as performer and spectator, rather than theoretical teaching which gave his ear its cunning and technical skill to compose new rhythms. (shrink)

This paper introduces a concept called task muddiness as a metric for higher intelligence. Task muddiness is meant to be inclusive and expendable in nature. The intelligence required to execute a task is measured by the composite muddiness of the task described by multiple muddiness factors. The composite muddiness explains why many challenging tasks are muddy and why autonomous mental development is necessary for muddy tasks. It facilitates better understanding of intelligence, what the human adult mind can do, and how (...) to build a machine to acquire higher intelligence. The task-muddiness indicates a major reason why a higher biological mind is autonomously developed from autonomous, simple-to-complex experience. The paper also discusses some key concepts that are necessary for understanding the mind and intelligence, such as intelligence metrics, the mode a task is conveyed to the task executor, a human and a machine being a joint task performer in the traditional artificial intelligence (AI), a developmental agent (human or machine) being a sole task performer, and the need for autonomy in task-nonexplicit learning. (shrink)

The topological structures imposed on the collection of binary relations on a given set by the symmetric difference metric and the Hausdorff metric provide opportunities for learning about how collections of binary relations with various properties fit into the collection of all binary relations. For example, there is some agreement and some disagreement between conclusions drawn about the rarity of certain properties of binary relations using first the symmetric difference metric and then the Hausdorff metric.

As machine learning informs increasingly consequential decisions, different metrics have been proposed for measuring algorithmic bias or unfairness. Two popular “fairness measures” are calibration and equality of false positive rate. Each measure seems intuitively important, but notably, it is usually impossible to satisfy both measures. For this reason, a large literature in machine learning speaks of a “fairness tradeoff” between these two measures. This framing assumes that both measures are, in fact, capturing something important. To date, philosophers (...) have seldom examined this crucial assumption, and examined to what extent each measure actually tracks a normatively important property. This makes this inevitable statistical conflict – between calibration and false positive rate equality – an important topic for ethics. In this paper, I give an ethical framework for thinking about these measures and argue that, contrary to initial appearances, false positive rate equality is in fact morally irrelevant and does not measure fairness. (shrink)

Typically, fair machine learning research focuses on a single decision maker and assumes that the underlying population is stationary. However, many of the critical domains motivating this work are characterized by competitive marketplaces with many decision makers. Realistically, we might expect only a subset of them to adopt any non-compulsory fairness-conscious policy, a situation that political philosophers call partial compliance. This possibility raises important questions: how does partial compliance and the consequent strategic behavior of decision subjects affect the allocation (...) outcomes? If k% of employers were to voluntarily adopt a fairness-promoting intervention, should we expect k% progress (in aggregate) towards the benefits of universal adoption, or will the dynamics of partial compliance wash out the hoped-for benefits? How might adopting a global (versus local) perspective impact the conclusions of an auditor? In this paper, we propose a simple model of an employment market, leveraging simulation as a tool to explore the impact of both interaction effects and incentive effects on outcomes and auditing metrics. Our key findings are that at equilibrium: (1) partial compliance by k% of employers can result in far less than proportional (k%) progress towards the full compliance outcomes; (2) the gap is more severe when fair employers match global (vs local) statistics; (3) choices of local vs global statistics can paint dramatically different pictures of the performance vis-a-vis fairness desiderata of compliant versus non-compliant employers; (4) partial compliance based on local parity measures can induce extreme segregation. Finally, we discuss implications for auditors and insights concerning the design of regulatory frameworks. (shrink)

Figurative drawing is a skill that takes time to learn, and it evolves during different childhood phases that begin with scribbling and end with representational drawing. Between these phases, it is difficult to assess when and how children demonstrate intentions and representativeness in their drawings. The marks produced are increasingly goal-oriented and efficient as the child’s skills progress from scribbles to figurative drawings. Pre-figurative activities provide an opportunity to focus on drawing processes. We applied fourteen metrics to two different (...) datasets (_N_ = 65 and _N_ = 344) to better understand the intentional and representational processes behind drawing, and combined these metrics using principal component analysis (PCA) in different biologically significant dimensions. Three dimensions were identified: efficiency based on spatial metrics, diversity with color metrics, and temporal sequentiality. The metrics at play in each dimension are similar for both datasets, and PCA explains 77% of the variance in both datasets. Gender had no effect, but age influenced all three dimensions differently. These analyses for instance differentiate scribbles by children from those drawn by adults. The three dimensions highlighted by this study provide a better understanding of the emergence of intentions and representativeness in drawings. We discussed the perspectives of such findings in comparative psychology and evolutionary anthropology. (shrink)

Neurodegenerative Parkinson's Disease is one of the common incurable diseases among the elderly. Clinical assessments are characterized as standardized means for PD diagnosis. However, relying on medical evaluation of a patient's status can be subjective to physicians' experience, making the assessment process susceptible to human errors. The use of ICT-based tools for capturing the status of patients with PD can provide more objective and quantitative metrics. In this vein, the Personalized Serious Game Suite and intelligent Motor Assessment Tests, produced (...) within the i-PROGNOSIS European project, are explored in the current study. More specifically, data from 27 patients with PD at Stage 1 and Stage 3 produced from their interaction with PGS/iMAT are analyzed. Five feature vector scenarios are set, including features from PGS or iMAT scores or their combination, after also taking into consideration the age of patients with PD. These FVs are fed into three machine learning classifiers, i.e., K-Nearest Neighbor, Support Vector Machines, and Random Forest, to infer the stage of each patient with PD. A Leave-One-Out Cross-Validation method is adopted for testing the classification performance. The experimental results show that a high classification accuracy is achieved from both data sources, justifying the effectiveness of PGS/iMAT to efficiently reflect the motor skill status of patients with PD and further potentiating PGS/iMAT enhancement with a machine learning a part to infer for the stage of patients with PD. Clearly, this integrated approach provides new opportunities for remote monitoring of the stage of patients with PD, contributing to a more efficient organization and set up of personalized interventions. (shrink)

Image similarity metric, also known as metric learning in computer vision, is a significant step in various advanced image tasks. Nevertheless, existing well-performing approaches for image similarity measurement only focus on the image itself without utilizing the information of other modalities, while pictures always appear with the described text. Furthermore, those methods need human supervision, yet most images are unlabeled in the real world. Considering the above problems comprehensively, we present a novel visual similarity metric model named PTF-SimCM. It (...) adopts a self-supervised contrastive structure like SimSiam and incorporates a multimodal fusion module to utilize textual modality correlated to the image. We apply a cross-modal model for text modality rather than a standard unimodal text encoder to improve late fusion productivity. In addition, the proposed model employs Sentence PIE-Net to solve the issue caused by polysemous sentences. For simplicity and efficiency, our model learns a specific embedding space where distances directly correspond to the similarity. Experimental results on MSCOCO, Flickr 30k, and Pascal Sentence datasets show that our model overall outperforms all the compared methods in this work, which illustrates that the model can effectively address the issues faced and enhance the performances on unsupervised visual similarity measuring relatively. (shrink)

Role-based database management systems are most widely used for information storage and analysis but are known as vulnerable to insider attacks. The core of intrusion detection lies in an adaptive system, where an insider attack can be judged if it is different from the predicted role by performing classification on the user’s queries accessing the database and comparing it with the authorized role. In order to handle the high similarity of user queries for misclassified roles, this paper proposes a deep (...) metric neural network with strategic sampling algorithm that properly extracts salient features and directly learns a quantitative measure of similarity. A strategic sampling method of heuristically generating and learning training pairs through Monte Carlo search is proposed to select a training pair that can represent the entire dataset. With the TPC-E–based benchmark data trained with 11,000 queries for 11 roles, the proposed model produces the classification accuracy of 95.41%, which is the highest compared with the previous models. The results are verified through comparison of quantitative and qualitative evaluations, and the feature space modelled in the neural network is analysed by t-SNE algorithm. (shrink)

The Iowa Gambling Task (IGT) is widely used to study decision‐making within healthy and psychiatric populations. However, the complexity of the IGT makes it difficult to attribute variation in performance to specific cognitive processes. Several cognitive models have been proposed for the IGT in an effort to address this problem, but currently no single model shows optimal performance for both short‐ and long‐term prediction accuracy and parameter recovery. Here, we propose the Outcome‐Representation Learning (ORL) model, a novel model that (...) provides the best compromise between competing models. We test the performance of the ORL model on 393 subjects' data collected across multiple research sites, and we show that the ORL reveals distinct patterns of decision‐making in substance‐using populations. Our work highlights the importance of using multiple model comparison metrics to make valid inference with cognitive models and sheds light on learning mechanisms that play a role in underweighting of rare events. (shrink)

The input data to grammar learning algorithms often consist of overt forms that do not contain full structural descriptions. This lack of information may contribute to the failure of learning. Past work on Optimality Theory introduced Robust Interpretive Parsing (RIP) as a partial solution to this problem. We generalize RIP and suggest replacing the winner candidate with a weighted mean violation of the potential winner candidates. A Boltzmann distribution is introduced on the winner set, and the distribution’s parameter (...) $T$ is gradually decreased. Finally, we show that GRIP, the Generalized Robust Interpretive Parsing Algorithm significantly improves the learning success rate in a model with standard constraints for metrical stress assignment. (shrink)

Extended redundancy analysis is a statistical method that relates multiple sets of predictors to response variables. In ERA, the conventional approach of model evaluation tends to overestimate the performance of a model since the performance is assessed using the same sample used for model development. To avoid the overly optimistic assessment, we introduce a new model evaluation approach for ERA, which utilizes computer-intensive resampling methods to assess how well a model performs on unseen data. Specifically, we suggest several new model (...) evaluation metrics for ERA that compute a model’s performance on out-of-sample data, i.e., data not used for model development. Although considerable work has been done in machine learning and statistics to examine the utility of cross-validation and bootstrap variants for assessing such out-of-sample predictive performance, to date, no research has been carried out in the context of ERA. We use simulated and real data examples to compare the proposed model evaluation approach with the conventional one. Results show the conventional approach always favor more complex ERA models, thereby failing to prevent the problem of overfitting in model selection. Conversely, the proposed approach can select the true ERA model among many mis-specified models. (shrink)

An application of the Method of Analysis of Relational Complexity (MARC) to suppositional reasoning in the knight-knave task is outlined. The task requires testing suppositions derived from statements made by individuals who either always tell the truth or always lie. Relational complexity (RC) is defined as the number of unique entities that need to be processed in parallel to arrive at a solution. A selection of five ternary and five quaternary items were presented to 53 psychology students using a pencil (...) and paper format. A computer-administered version was presented to 50 students. As predicted, quaternary problems were associated with higher error rates and longer response times than ternary problems. The computer-administered form was more difficult than the pencil and paper version of the test. These differences are discussed in terms of RC theory and alternative processing accounts. Together, they indicate that the relational complexity metric is a useful and parsimonious way to quantify complexity of reasoning tasks. (shrink)

In the model proposed by Findlay & Walker, the programming of saccadic eye movements is achieved by two parallel processes, one dedicated to the coding of saccade metrics (Where) and the other controlling saccade initiation (When). One outcome of the “winner-take-all” characteristics of the salience map, the main node of the model, is an independence between the metrics and the latency of saccades. We report on some observations, made in the head-unrestrained cat under pathological conditions, of a correlation (...) between accuracy and latency of saccadic gaze shifts. To account for such a correlation, the link between metrics specification (Where) and saccade triggering (When) should be amended in the model. (shrink)

Magnetic resonance imaging is precise and efficient for interpreting the soft and hard tissues. Moreover, for the detailed diagnosis of varied diseases such as knee rheumatoid arthritis, segmentation of the knee magnetic resonance image is a challenging and complex task that has been explored broadly. However, the accuracy and reproducibility of segmentation approaches may require prior extraction of tissues from MR images. The advances in computational methods for segmentation are reliant on several parameters such as the complexity of the tissue, (...) quality, and acquisition process involved. This review paper focuses and briefly describes the challenges faced by segmentation techniques from magnetic resonance images followed by an overview of diverse categories of segmentation approaches. The review paper also focuses on automatic approaches and semiautomatic approaches which are extensively used with performance metrics and sufficient achievement for clinical trial assistance. Furthermore, the results of different approaches related to MR sequences used to image the knee tissues and future aspects of the segmentation are discussed. (shrink)

This paper describes the application of eight statistical and machine-learning methods to derive computer models for predicting mortality of hospital patients with pneumonia from their findings at initial presentation. The eight models were each constructed based on 9847 patient cases and they were each evaluated on 4352 additional cases. The primary evaluation metric was the error in predicted survival as a function of the fraction of patients predicted to survive. This metric is useful in assessing a model’s potential to (...) assist a clinician in deciding whether to treat a given patient in the hospital or at home. We examined the error rates of the models when predicting that a given fraction of patients will survive. We examined survival fractions between 0.1 and 0.6. Over this range, each model’s predictive error rate was within 1% of the error rate of every other model. When predicting that approximately 30°K of the patients will survive, all the models have an error rate of less than 1.5%. The models are distinguished more by the number of variables and parameters that they contain than by their error rates; these differences suggest which models may be the most amenable to future implementation as paper-based guidelines. (shrink)

One of the few certainties we have about our collective future is that it will require a massive amount of learning, by just about everybody, everywhere. The time for generating as many creative and collaborative knowledge builders has come. Therefore, improving the efficiency of learning could very well become a key leverage point for successfully meeting the challenges of the twenty-first century. This paper explores the possibilities of using mutual learning as a systemic means to improve (...) class='Hi'>learning efficiencies. This is measured through three different metrics: (1) the time required to learn, (2) the quantity of learning that is retained over time, and (3) the leveraging of the cost of scholarships through the use of a complementary currency designed to track and encourage mutual learning. In all three metrics, mutual learning is shown as an important approach to increase the effectiveness of learning and, at the very least, can be an adjunct to the conventional educational methods. Mutual learning could apply not only to learning among peers, but also to social, intergenerational, or intercultural mutual learning. (shrink)

Serious games have become an important tool to train individuals in a range of different skills. Importantly, serious games or gamified scenarios allow for simulating realistic time-critical situations to train and also assess individual performance. In this context, determining the user’s cognitive load during training seems crucial for predicting performance and potential adaptation of the training environment to improve training effectiveness. Therefore, it is important to identify in-game metrics sensitive to users’ cognitive load. According to Barrouillets’ time-based resource-sharing model, (...) particularly relevant for measuring cognitive load in time-critical situations, cognitive load does not depend solely on the complexity of actions but also on temporal aspects of a given task. In this study, we applied this idea to the context of a serious game by proposing in-game metrics for workload prediction that reflect a relation between the time during which participants’ attention is captured and the total time available for the task at hand. We used an emergency simulation serious game requiring management of time-critical situations. Forty-seven participants completed the emergency simulation and rated their workload using the NASA-TLX questionnaire. Results indicated that the proposed in-game metrics yielded significant associations both with subjective workload measures as well as with gaming performance. Moreover, we observed that a prediction model based solely on data from the first minutes of the gameplay predicted overall gaming performance with a classification accuracy significantly above chance level and not significantly different from a model based on subjective workload ratings. These results imply that in-game metrics may qualify for a real-time adaptation of a game-based learning environment. (shrink)

The study of imitation and other mechanisms of social learning is an exciting area of research for all those interested in understanding the origin and the nature of animal learning in asocial context. Moreover, imitation is an increasingly important research topic in Artificial Intelligence and social robotics which opens up the possibility ofindividualized social intelligencein robots that are part of a community, and allows us to harness not only individual learning by the single robot, but also the (...) acquisition of new skills by observing other members of the community. After an introduction to the main research issues in research on imitation in various fields, we motivate the particular focus of this work, namely thecorrespondence problem. We describeAction Learning for Imitation via Correspondences between Embodiments, an implemented generic framework for solving the correspondence problem between differently embodied robots. Alice enables a robotic agent to learn a behavioral repertoire suitable to performing a task by observing a model agent. Importantly, the model agent could possibly possess a different type of body, e.g. a different number of limbs or joints, a different height, different sensors, a different basic action repertoire, etc. Previously, in a test-bed where the agents differed according to their possible movement patterns, we demonstrated that the character of imitation achieved will depend on the granularity of subgoal matching, and on the metrics used to evaluate success.In our current work, we implemented Alice in a new test-bed calledRabitwhere simple simulated robotic arm agents use various metrics for evaluating success according to actions, states, effects, or weighted combinations.We examine the roles ofsynchronization,looseness of perceptual matching, and ofproprioceptive matchingby a series of experiments. Also, we study how Alice copes withchanges in the embodimentof the imitator during learning. Our simulation results suggest thatsynchronizationandloose perceptual matchingallow for faster acquisition of behavioral compentencies at low error rates.Social learning plays a role as areplicationmechanism for behaviors and results invariabilitywhen the transmitted behavior differs from the model’s behavior, thus providing theevolutionary substrate for cultureand its pre-cursors. Social learning in robotics could therefore serve as the basis for culture in societies whose members include artificial agents. We address the use of imitative social learning mechanisms like Alice for transmission of skills between robots, and give first examples of transmission of a skill despite differences in embodiment of agents involved. In the particular setup, transmission occurs through a chain, as well as emerging in cyclic arrangements of robots. These simple examples demonstrate that by using social learning and imitation,cultural transmissionis possible among robots, even in heterogeneous groups of robots. (shrink)

Analyzing and evaluating legal case reports are labor-intensive tasks for judges and lawyers, who usually base their decisions on report abstracts, legal principles, and commonsense reasoning. Thus, summarizing legal documents is time-consuming and requires excellent human expertise. Moreover, public legal corpora of specific languages are almost unavailable. This paper proposes a transfer learning approach with extractive and abstractive techniques to cope with the lack of labeled legal summarization datasets, namely a low-resource scenario. In particular, we conducted extensive multi- and (...) cross-language experiments. The proposed work outperforms the state-of-the-art results of extractive summarization on the Australian Legal Case Reports dataset and sets a new baseline for abstractive summarization. Finally, syntactic and semantic metrics assessments have been carried out to evaluate the accuracy and the factual consistency of the machine-generated legal summaries. (shrink)

The rise of learning analytics, the application of complex metrics developed to exploit the proliferation of ‘Big Data’ in educational work, raises important moral questions about the nature of what is measurable in education. Teachers, schools and nations are increasingly held to account based on metrics, exacerbating the tendency for fine-grained measurement of learning experiences. In this article, the origins of learning analytics ontology are explored, drawing upon core ideas in the philosophy of computing, such (...) as the general definition of information and the information-theoretic account of knowledge. Drawing upon a reading of Descartes Meditatio II, which extends the phenomenology of Jean-Luc Marion into a pedagogy of intentionality, the article identifies a fundamental incompatibility between the subjective experience of learning and the information-theoretic account of knowledge. Human subjects experience and value their own information incommensurably with the ways in which computers measure and quantify information. The consequences of this finding for the design of online learning environments, and the necessary limitations of learning analytics and measurement are explored. (shrink)

The use of machine learning systems for decision-support in healthcare may exacerbate health inequalities. However, recent work suggests that algorithms trained on sufficiently diverse datasets could in principle combat health inequalities. One concern about these algorithms is that their performance for patients in traditionally disadvantaged groups exceeds their performance for patients in traditionally advantaged groups. This renders the algorithmic decisions unfair relative to the standard fairness metrics in machine learning. In this paper, we defend the permissible use (...) of affirmative algorithms; that is, algorithms trained on diverse datasets that perform better for traditionally disadvantaged groups. Whilst such algorithmic decisions may be unfair, the fairness of algorithmic decisions is not the appropriate locus of moral evaluation. What matters is the fairness of final decisions, such as diagnoses, resulting from collaboration between clinicians and algorithms. We argue that affirmative algorithms can permissibly be deployed provided the resultant final decisions are fair. (shrink)

The problem of fair machine learning has drawn much attention over the last few years and the bulk of offered solutions are, in principle, empirical. However, algorithmic fairness also raises important conceptual issues that would fail to be addressed if one relies entirely on empirical considerations. Herein, I will argue that the current debate has developed an empirical framework that has brought important contributions to the development of algorithmic decision-making, such as new techniques to discover and prevent discrimination, additional (...) assessment criteria, and analyses of the interaction between fairness and predictive accuracy. However, the same framework has also suggested higher-order issues regarding the translation of fairness into metrics and quantifiable trade-offs. Although the tools which have been developed so far are essential to address discrimination encoded in data and algorithms, their integration into society elicits key questions such as: What kind of assumptions and decisions underlies the empirical framework? How do the results of the empirical approach penetrate public debate? What kind of reflection and deliberation should stakeholders have over available fairness metrics? I will outline the empirical approach to fair machine learning, i.e. how the problem is framed and addressed, and suggest that there are important non-empirical issues that should be tackled. While this work will focus on the problem of algorithmic fairness, the lesson can extend to other conceptual problems in the analysis of algorithmic decision-making such as privacy and explainability. (shrink)

Deep learning techniques, which use a massive technology known as convolutional neural networks, have shown excellent results in a variety of areas, including image processing and interpretation. However, as the depth of these networks grows, so does the demand for a large amount of labeled data required to train these networks. In particular, the medical field suffers from a lack of images because the procedure for obtaining labeled medical images in the healthcare field is difficult, expensive, and requires specialized (...) expertise to add labels to images. Moreover, the process may be prone to errors and time-consuming. Current research has revealed transfer learning as a viable solution to this problem. Transfer learning allows us to transfer knowledge gained from a previous process to improve and tackle a new problem. This study aims to conduct a comprehensive survey of recent studies that dealt with solving this problem and the most important metrics used to evaluate these methods. In addition, this study identifies problems in transfer learning techniques and highlights the problems of the medical dataset and potential problems that can be addressed in future research. According to our review, many researchers use pre-trained models on the Imagenet dataset in many applications such as skin cancer, breast cancer, and diabetic retinopathy classification tasks. These techniques require further investigation of these models, due to training them on natural, non-medical images. In addition, many researchers use data augmentation techniques to expand their dataset and avoid overfitting. However, not enough studies have shown the effect of performance with or without data augmentation. Accuracy, recall, precision, F1 score, receiver operator characteristic curve, and area under the curve were the most widely used measures in these studies. Furthermore, we identified problems in the datasets for melanoma and breast cancer and suggested corresponding solutions. (shrink)

Structure–activity relationship and quantitative SAR are modeling methods largely used in assessing biological properties of chemical substances. QSAR is based on the hypothesis that the chemical structure is responsible for the activity; it follows that similar molecules are expected to have similar properties. Similarity plays an important role in read across, which categorizes molecules primarily on the basis of similarity. Similarity, and chemical similarity too, is a property differently perceived by humans. The various proposed metrics often disagree with human (...) judgment, and no a unique metric for chemical similarity is universally adopted. Researchers argued that categorization is not only explained by similarity but depends as well on abstract knowledge and the task to accomplish. Moreover, similarity cannot be the unique explanation of a categorization, as different perceptual processes take place in category formation. Assuming that similarity judgments are deeply rooted in human knowledge and perception, cognitive sciences contributions are as important as the mathematical considerations of the classical theories. After an excursus in the many views of similarity in philosophy, mathematics, and cognitive science, the paper explores how connectionist systems, which loosely mimic the human cognitive system, could improve similarity-based choices. A case study on building SARs using connectionism and deep neural networks shows the role of similarity in building and explaining those models. A discussion about deep learning for QSAR and as a modeling tool for science concludes the presentation. (shrink)

Malware is a sophisticated, malicious, and sometimes unidentifiable application on the network. The classifying network traffic method using machine learning shows to perform well in detecting malware. In the literature, it is reported that this good performance can depend on a reduced set of network features. This study presents an empirical evaluation of two statistical methods of reduction and selection of features in an Android network traffic dataset using six supervised algorithms: Naïve Bayes, support vector machine, multilayer perceptron neural (...) network, decision tree, random forest, and K-nearest neighbors. The principal component analysis and logistic regression methods with p value were applied to select the most representative features related to the time properties of flows and features of bidirectional packets. The selected features were used to train the algorithms using binary and multiclass classification. For performance evaluation and comparison metrics, precision, recall, F-measure, accuracy, and area under the curve were used. The empirical results show that random forest obtains an average accuracy of 96% and an AUC-ROC of 0.98 in binary classification. For the case of multiclass classification, again random forest achieves an average accuracy of 87% and an AUC-ROC over 95%, exhibiting better performance than the other machine learning algorithms. In both experiments, the 13 most representative features of a mixed set of flow time properties and bidirectional network packets selected by LR were used. In the case of the other five classifiers, their results in terms of precision, recall, and accuracy, are competitive with those obtained in related works, which used a greater number of input features. Therefore, it is empirically evidenced that the proposed method for the selection of features, based on statistical techniques of reduction and extraction of attributes, allows improving the identification performance of malware traffic, discriminating it from the benign traffic of Android applications. (shrink)

The importance of self-regulated learning has increased during the COVID-19 pandemic and measures for assessing students’ self-regulation skills and knowledge are greatly needed. We present the results of the first thorough adaptation of the Children’s Perceived use of Self-Regulated Learning Inventory. The inventory, consisting of 15 scales measuring nine components of SRL, was administered to a sample of 541 Slovenian ninth graders. Confirmatory factor analyses supported internal structure validity of most components, but two components required some structural modifications. (...) Internal consistency coefficients were acceptable for the majority of scale scores and were highly comparable to the original ones. While metric invariance across gender was confirmed, the scalar invariance of some scales needs further examination. Meaningful correlations with relevant externally assessed and self-reported self-regulation and school performance variables indicated good criterion validity of the inventory. The Slovenian version of the CP-SRLI thus proved to be a sufficiently valid and reliable instrument for assessing pupils’ learning self-regulation. (shrink)

The management control system aids administrators in guiding a business toward its organizational plans; as a result, management control is primarily concerned with the execution of the plan and plans. Financial and nonfinancial criteria are used to create management control systems. The financial element focuses on net income, earnings, and other financial metrics. The two components of leadership strategy in this study are cost and differentiation, which highlight the strategy of differentiation in attaining higher quality due to the robust (...) strategy’s attention on a particular area of the company. In this study, we presented a novel method named deep interaction neural network to predict the performance of the manufacturing companies based on their leading competitors using features cost leadership and differentiation strategies. Moreover, the management control system is classified into two financial and nonfinancial factors based on machine learning methods. Based on the results, the presented factors can accurately estimate the company’s performance based on management control criteria with a 93.48% R-square. Moreover, it can be seen that the DT method is presented with higher classification performance values. (shrink)

As we begin to witness a new phase in the integration of digital social media platforms with educational institutions, we ought to ask how learning exchanges may be altered as a result. Looking to transformations in knowledge exchanges outside of formal education, we find that these technologies have already modified the ways in which communities engage with each other. Gerlitz and Helmond explain that the Like Economy built into all major social media platforms flattens exchanges between users to engagement (...) metrics. With online communities increasingly isolated from each other thanks to inscrutable recommendation algorithms, the most frequent cross-community exchanges manifest in outbursts of rage, producing a so-called ‘Dislike Society’. Practitioners would rather briefly unite to tear down other ways of living than to build new ones. Within the Dislike Society, any form of knowledge that could shape new communities is lost to the governance of algorithms in what Bernard Stiegler calls ‘proletarianisation’. To re-apply knowledge to the improvement of life, as suggested by Whitehead, the attention of learners needs to be shaped in response to new technological conditions. This is best achieved within the educational institutions that now face a reorganisation by the same companies that brought us the Dislike Society. (shrink)

In this study, a new mathematical model is presented to solve the flexible flow shop problem where transportation is reliable and there are constraints on intermediate buffers, budgets, and human resource learning effects. Firstly, the model is validated to confirm the accuracy of its performance. Then, since it is an NP-hard one, two metaheuristic algorithms, namely, MOSA and MOEA/D, are rendered to solve mid- and large-scale problems. To confirm their accuracy of performance, two small-scale problems are solved using GAMS (...) exact solution software, and the obtained results have been compared with the output of the algorithms. Since the problem in this study is multiobjective, five comparative indices are used to compare the performance of algorithms. The results show that the answers achieved using the metaheuristic algorithms are very close to the ones achieved via the GAMS exact program. Therefore, the proposed algorithms are validated, and it is proved that they are accurately designed and useable in solving the real-world problems in logical calculation time. By comparing the obtained results, it can be seen that the MOEA/D algorithm performs better in terms of computational time and Mean ideal distance. The MOSA algorithm also performs better according to the index Spread of nondominated solutions, diversity metric, and number of Pareto solutions. Considering the confirmation of precision and accuracy of performance of the proposed algorithms, it can be concluded that MOSA and MOEA/D are useful in solving the mid- and large-scale modes of the problem in the study, which is very applicable in the real world. (shrink)

With the increasing prevalence of Internet usage, Internet-Delivered Psychological Treatment (IDPT) has become a valuable tool to develop improved treatments of mental disorders. IDPT becomes complicated and labor intensive because of overlapping emotion in mental health. To create a usable learning application for IDPT requires diverse labeled datasets containing an adequate set of linguistic properties to extract word representations and segmentations of emotions. In medical applications, it is challenging to successfully refine such datasets since emotion-aware labeling is time consuming. (...) Other known issues include vocabulary sizes per class, data source, method of creation, and baseline for the human performance level. This paper focuses on the application of personalized mental health interventions using Natural Language Processing (NLP) and attention-based in-depth entropy active learning. The objective of this research is to increase the trainable instances using a semantic clustering mechanism. For this purpose, we propose a method based on synonym expansion by semantic vectors. Semantic vectors based on semantic information derived from the context in which it appears are clustered. The resulting similarity metrics help to select the subset of unlabeled text by using semantic information. The proposed method separates unlabeled text and includes it in the next active learning mechanism cycle. Our method updates model training by using the new training points. The cycle continues until it reaches an optimal solution, and it converts all the unlabeled text into the training set. Our in-depth experimental results show that the synonym expansion semantic vectors help enhance training accuracy while not harming the results. The bidirectional Long Short-Term Memory (LSTM) architecture with an attention mechanism achieved 0.85 Receiver Operating Characteristic (ROC curve) on the blind test set. The learned embedding is then used to visualize the activated word's contribution to each symptom and find the psychiatrist's qualitative agreement. Our method improves the detection rate of depression symptoms from online forum text using the unlabeled forum texts. (shrink)

This study aims to examine the main determinants of efficiency of both conventional and Islamic Saudi banks and then choose the best fit model among machine learning prediction models, Chi-squared automatic interaction detector, linear regression, and neural network ). The data were collected from the annual financial reports of Saudi banks from 2014 to 2018. The Saudi banking sector consists of 11 banks, 4 of which are Islamic. In this study, the major financial ratios are subgrouped into the profitability (...) ratios, managerial practices, asset and loans, capital adequacy ratios, and liquidity. First, regression analysis is implemented with efficiency ratio as a dependent variable and the proxies of banks’ profitability, liquidity, asset quality, management ratios, and capital adequacy ratios as independent variables. Next, the feature selection is applied for different prediction models. Subsequently, 4 prediction models were developed to choose the best fit. The performance metrics have also been evaluated. Regression results exhibit that the efficiency of both conventional and Islamic banks is highly affected by profitability, liquidity, and managerial practices. Finally, we choose the best prediction model with the highest R2 in the training and the testing phases with/out feature selection that is the CHAID model. The best predictors of cost efficiency for Saudi banks are the capital ratios, namely, CAR total and CAR tier 1. Findings are theoretically and practically important to academics, investors, and policymakers. Policymakers can benefit from the novelty of this study in building an early warning system using the CHAID model to predict different financial distress scenarios. (shrink)

Background and ObjectivesFocal cortical dysplasia is a type of malformations of cortical development and one of the leading causes of drug-resistant epilepsy. Postoperative results improve the diagnosis of lesions on structural MRIs. Advances in quantitative algorithms have increased the identification of FCD lesions. However, due to significant differences in size, shape, and location of the lesion in different patients and a big deal of time for the objective diagnosis of lesion as well as the dependence of individual interpretation, sensitive approaches (...) are required to address the challenge of lesion diagnosis. In this research, a FCD computer-aided diagnostic system to improve existing methods is presented.MethodsMagnetic resonance imaging data were collected from 58 participants. Morphological and intensity-based features were calculated for each cortical surface and inserted into an artificial neural network. Statistical examinations evaluated classifier efficiency.ResultsNeural network evaluation metrics—sensitivity, specificity, and accuracy—were 96.7, 100, and 98.6%, respectively. Furthermore, the accuracy of the classifier for the detection of the lobe and hemisphere of the brain, where the FCD lesion is located, was 84.2 and 77.3%, respectively.ConclusionAnalyzing surface-based features by automated machine learning can give a quantitative and objective diagnosis of FCD lesions in presurgical assessment and improve postsurgical outcomes. (shrink)

The car-sharing system is a popular rental model for cars in shared use. It has become particularly attractive due to its flexibility; that is, the car can be rented and returned anywhere within one of the authorized parking slots. The main objective of this research work is to predict the car usage in parking stations and to investigate the factors that help to improve the prediction. Thus, new strategies can be designed to make more cars on the road and fewer (...) in the parking stations. To achieve that, various machine learning models, namely vector autoregression, support vector regression, eXtreme gradient boosting, k-nearest neighbors, and deep learning models specifically long short-time memory, gated recurrent unit, convolutional neural network, CNN-LSTM, and multilayer perceptron, were performed on different kinds of features. These features include the past usage levels, Chongqing’s environmental conditions, and temporal information. After comparing the obtained results using different metrics, we found that CNN-LSTM outperformed other methods to predict the future car usage. Meanwhile, the model using all the different feature categories results in the most precise prediction than any of the models using one feature category at a time. (shrink)

While often presented as promising assistive technologies for motor-impaired users, electroencephalography (EEG)-based Brain-Computer Interfaces (BCIs) remain barely used outside laboratories due to low reliability in real-life conditions. There is thus a need to design long-term reliable BCIs that can be used outside-of-the-lab by end-users, e.g., severely motor-impaired ones. Therefore, we propose and evaluate the design of a multi-class Mental Task (MT)-based BCI for longitudinal training (20 sessions over 3 months) of a tetraplegic user for the CYBATHLON BCI series 2019. In (...) this BCI championship, tetraplegic pilots are mentally driving a virtual car in a racing video game. We aimed at combining a progressive user MT-BCI training with a newly designed machine learning pipeline based on adaptive Riemannian classifiers shown to be promising for real-life applications. We followed a two step training process: the first 11 sessions served to train the user to control a 2-class MT-BCI by performing either two cognitive tasks (REST and MENTAL SUBTRACTION) or two motor-imagery tasks (LEFT-HAND and RIGHT-HAND). The second training step (9 remaining sessions) applied an adaptive, session-independent Riemannian classifier that combined all 4 MT classes used before. Moreover, as our Riemannian classifier was incrementally updated in an unsupervised way it would capture both within and between-session non-stationarity. Experimental evidences confirm the effectiveness of this approach. Namely, the classification accuracy improved by about 30% at the end of the training compared to initial sessions. We also studied the neural correlates of this performance improvement. Using a newly proposed BCI user learning metric, we could show our user learned to improve his BCI control by producing EEG signals matching increasingly more the BCI classifier training data distribution, rather than by improving his EEG class discrimination. However, the resulting improvement was effective only on synchronous (cue-based) BCI and it did not translate into improved CYBATHLON BCI game performances. For the sake of overcoming this in the future, we unveil possible reasons for these limited gaming performances and identify a number of promising future research directions. Importantly, we also report on the evolution of the user's neurophysiological patterns and user experience throughout the BCI training and competition. (shrink)