vi
en
Understanding what the users say in chatbots: A case study for the Vietnamese language
Content
Authors: Luong Chi Tho, Tran Thi Oanh
Abstract: This paper1 presents a study on understanding what the users say in chatbot systems: the situation where users input utterances bots would hopefully detect intents and recognize corresponding contexts implied by utterances. This helps bots better understand what users are saying, and act upon a much wider range of actions. To this end, we propose a framework which models the first task as a classification problem and the second one as a two-layer sequence labeling problem. The framework explores deep neural networks to automatically learn useful features at both character and word levels. We apply this framework to building a chatbot in a Vietnamese e-commerce domain to help retail brands better communicate with their customers. Experimental results on four newly-built datasets demonstrate that deep neural networks could be able to outperform strong conventional machine-learning methods. In detecting intents, we achieve the best F-measure of 82.32%. In extracting contexts, the proposed method yields promising F-measures ranging from 78% to 91% depending on specific types of contexts.
Published: 11 November 2019
DOI: https://doi.org/10.1016/j.engappai.2019.103322
Download now
Do you need a workthrough of our platform? Let us know
Do you need a workthrough of our platform? Let us know
Related Posts
Feature normalization for similarity calculations in matrix factorization method
Content Authors: Hoang Vu Dang Abstract: Matrix factorization is a well-established approach in recommender systems with its roots in document retrieval. In this approach the original matrix of interactions between users and items is approximately factorized into matrices representing user features and item features. In this paper we argue for an orthogonality condition, under which the rows … Continued
Solving the k-dominating set problem on very large-scale networks
Content Authors: Minh Hai Nguyen, Minh Hoàng Hà, Diep N. Nguyen & The Trung Tran Abstract: The well-known minimum dominating set problem (MDSP) aims to construct the minimum-size subset of vertices in a graph such that every other vertex has at least one neighbor in the subset. In this article, we study a general version of the … Continued
Attentive Neural Network for Named Entity Recognition in Vietnamese
Content Authors: Kim Anh Nguyen; Ngan Dong; Cam-Tu Nguyen Abstract: We propose an attentive neural network for the task of named entity recognition in Vietnamese. The proposed attentive neural model makes use of character-based language models and word embeddings to encode words as vector representations. A neural network architecture of encoder, attention, and decoder layers is then utilized to … Continued
On the effect of the label bias problem in part-of-speech tagging
Content Authors: Phuong Le-Hong; Xuan-Hieu Phan; The-Trung Tran Abstract: This paper investigates the effect of the label bias problem of maximum entropy Markov models for part-of-speech tagging, a typical sequence prediction task in natural language processing. This problem has been underexploited and underappreciated. The investigation reveals useful information about the entropy of local transition probability distributions of … Continued
Online Adaptation of Language Models for Speech Recognition
Content Authors: Dang Hoang Vu, V. Nguyen, Hong Phuong Le Abstract: Hybrid models of speech recognition combine a neural acoustic model with a language model, which rescores the output of the acoustic model to find the most linguistically likely transcript. Consequently the language model is of key importance in both open and domain specific speech recognition and much work … Continued
A BERT-based Hierarchical Model for Vietnamese Aspect Based Sentiment Analysis
ContentAuthors: Viet Bui The, Oanh Tran Thi Abstract: Aspect based sentiment analysis (ABSA) is the task of identifying sentiment polarity towards specific entities and their aspects mentioned in customers’ reviews. This paper presents a new and effective hierarchical model using the pre-trained language model, Bidirectional Encoder Representations from Transformers (BERT). This model integrates the context … Continued
Dave the debater: a retrieval-based and generative argumentative dialogue agent
Content Authors: Dieu Thu Le, Cam-Tu Nguyen, Kim Anh Nguyen Abstract: In this paper, we explore the problem of developing an argumentative dialogue agent that can be able to discuss with human users on controversial topics. We describe two systems that use retrieval-based and generative models to make argumentative responses to the users. The experiments show promising results although they … Continued
Improving Sequence Tagging for Vietnamese Text Using Transformer-based Neural Models
ContentAuthors: Viet Bui The, Oanh Tran Thi, Phuong Le-Hong Comments: Accepted at the Conference PACLIC 2020 Subjects: Computation and Language (cs.CL) Abstract: This paper describes our study on using mutilingual BERT embeddings and some new neural models for improving sequence tagging tasks for the Vietnamese language. We propose new model architectures and evaluate them extensively … Continued
Fully Residual Convolutional Neural Networks for Aerial Image Segmentation
Content Authors: Dinh Viet Sang; Nguyen Duc Minh Abstract: Semantic segmentation from aerial imagery is one of the most essential tasks in the field of remote sensing with various potential applications ranging from map creation to intelligence service. One of the most challenging factors of these tasks is the very heterogeneous appearance of artificial objects like buildings, … Continued
An End-to-end Vietnamese Identification Card Detection and Recognition in Images
Content Authors: Hoang Danh Liem; Nguyen Duc Minh; Nguyen Bao Trung; Hoang Tien Duc; Pham Hoang Hiep; Doan Viet Dung; Dang Hoang Vu Abstract: The neccesity of digitializing all old constrained forms such identification card or register book have become a critical issue due to the importance of practical applications for sales or financial services. To address … Continued
Neural Network based 3D Mapping Using Depth Image Camera
Content Authors: Tran Duc Dung; Genci Capi Comments: Accepted at the Conference PACLIC 2020 Abstract: Mapping is a crucial task for robot navigation. Especially, in order to develop a fully autonomous robot that can interact well with human, the map is not only required to contain geometry but also the semantic contents. Building a detailed map of the … Continued
Neural Text Normalization in Speech-to-Text Systems with Rich Features
Content Authors: Oanh Thi Tran, Viet The Bui Abstract: This paper presents the task of normalizing Vietnamese transcribed texts in Speech-to-Text (STT) systems. The main purpose is to develop a text normalizer that automatically converts proper nouns and another context-specific formatting of the transcription such as dates, time, and numbers into their appropriate expressions. To this end, … Continued
Multifeature Image Indexing for Robot Localization in Textureless Environments
Content Authors: Tran Duc Dung; Delowar Hossain; Shin-ichiro Kaneko; Genci Kapi Abstract: Robot localization is an important task for mobile robot navigation. There are many methods focused on this issue. Some methods are implemented in indoor and outdoor environments. However, robot localization in textureless environments is still a challenging task. This is because in these environments, the scene … Continued
Cross-lingual Extended Named Entity Classification of Wikipedia Articles
Content Authors: The Viet Bui, Phuong Le-Hong Comments: Accepted to NTCIR-15 Subjects: Computation and Language (cs.CL) Abstract: The this http URL team participated in the SHINRA2020-ML subtask of the NTCIR-15 SHINRA task. This paper describes our method to solving the problem and discusses the official results. Our method focuses on learning cross-lingual representations, both on the word level and … Continued
A Faster R-CNN Approach for Partially Occluded Robot Object Recognition
Content Authors: Delowar Hossain, Sivapong Nilwong, Duc Dung Tran, Genci Capi Abstract: Many objects in household and industrial environments are commonly found partially occluded. In this paper, we address the problem of recognizing objects for use in partially occluded object recognition. To enable the use of more expensive features and classifiers, a region proposal network (RPN) which … Continued
Improving Vietnamese Dependency Parsing Using Distributed Word Representations
Content Authors: Cam Vu-Manh, Anh Tuan Luong, Phuong Le-Hong Abstract: Dependency parsing has become an important line of research in natural language processing in recent years. This is due to its usefulness in a wide variety of real world applications. This paper presents the improvement of Vietnamese dependency parsing using distributed word representations. Our parser achieves … Continued
Towards Understanding User Requests in AI Bots
Content Authors: Luong Chi Tho, Tran Thi Oanh Abstract: This paper presents the task of deeply analyzing user requests: the situation in ordering bots where users input an utterance, the bots would hopefully extract its full product descriptions and then parse them to recognize each product information (PI). This information is useful to help bots better understand … Continued
Local search approach for the pairwise constrained clustering problem
Content Authors: Tran Khanh Hiep, Nguyen Minh Duc, Bui Quoc Trung Abstract: The pairwise constrained clustering is the problem of partitioning a set of data points into clusters when we know in advance that some pairs of points should be in the same cluster and some pairs should not. Previous studies on this problem can be … Continued
A combined syntactic-semantic embedding model based on lexicalized tree-adjoining grammar
ContentAuthors: Le Hong Phuong, Dang Hoang Vu Abstract: This paper presents a joint syntactic-semantic embedding model which not only uses syntactic information to enrich the word embeddings but also generates distributed representations for the syntactic structures themselves. The syntactic input to our model comes from a Lexicalized Tree-Adjoining Grammar parser. The word embeddings from our … Continued
Content-based approach for Vietnamese spam SMS filtering
Content Authors: Thai-Hoang Pham; Phuong Le-Hong Abstract: Short Message Service (SMS) spam is a serious problem in Vietnam because of the availability of very cheap prepaid SMS packages. There are some systems to detect and filter spam messages for English, most of which use machine learning techniques to analyze the content of messages and classify them. … Continued
An Efficient Algorithm for the k-Dominating Set Problem on Very Large-Scale Networks (Extended Abstract)
Content Authors: Tran The Trung, Nguyen Minh Hai, Ha Minh Hoang, Hoang Thai Dinh, Eryk Dutkiewicz, Diep N. Nguyen Abstract: The minimum dominating set problem (MDSP) aims to construct the minimum-size subset D⊂VD⊂V of a graph G=(V,E)G=(V,E) such that every vertex has at least one neighbor in D. The problem is proved to be NP-hard. In a recent industrial application, we encountered a more general variant … Continued
Designing service sectors for daily maintenance operations in a road network
Content Authors: Lu Chen; Boxiao Chen, Quoc Trung Bui, Minh Hoang Ha Abstract: The problem of designing service sectors in a road network for the organisation of route maintenance activities is addressed in this paper. The decisions involve determining the locations of a set of depots and assigning road segments to the selected depots to … Continued
Introducing a Large-Scale Dataset for Vietnamese POS Tagging on Conversational Texts
Content Authors: Oanh Tran, Tu Pham, Vu Dang, Bang Nguyen Abstract: This paper introduces a large-scale human-labeled dataset for the Vietnamese POS tagging task on conversational texts. To this end, wepropose a new tagging scheme (with 36 POS tags) consisting of exclusive tags for special phenomena of conversational words, developthe annotation guideline and manually annotate 16.310K sentences … Continued
Using Dependency Analysis to Improve Question Classification
Content Authors: Phuong Le-Hong, Xuan-Hieu Phan, Tien-Dung Nguyen Abstract: Question classification is a first necessary task of automatic question answering systems. Linguistic features play an important role in developing an accurate question classifier. This paper proposes to use typed dependencies which are extracted automatically from dependency parses of questions to improve accuracy of classification. Experiment results … Continued
Online Adaptation of Language Models for Speech Recognition
Content Authors: Dang Hoang Vu, Van Huy Nguyen, Phuong Le-Hong Abstract: Hybrid models of speech recognition combine a neural acoustic model with a language model, which rescores the output of the acoustic model to find the most linguistically likely transcript. Consequently the language model is of key importance in both open and domain specific speech recognition and … Continued
Solving the TimeTabling problem at FPT University
Content Authors: Nguyen Van Hoai; Luu Thanh Cong; Pham Quang Dung Abstract: TimeTabling is a classical problem in combinatorial optimization. There are many variants of the problem depending on specific requirements of the given institution. In this paper, we describe a new variant of the timetabling problem arising in FPT university called FUTimeTabling. We propose an … Continued
Towards Task-Oriented Dialogue in Mixed Domains
Content Authors: Luong Chi Tho, Le Hong Phuong Abstract: This work investigates the task-oriented dialogue problem in mixed-domain settings. We study the effect of alternating between different domains in sequences of dialogue turns using two related state-of-the-art dialogue systems. We first show that a specialized state tracking component in multiple domains plays an important role and gives … Continued
3rd Place Solution for Open Images 2019 – Visual Relationship
Content Authors: Roman Solovyev; Weimin Wang; Vladislav Golubev; Arthur Stsepanenka; Nikolay Sergievskiy Abstract: In this technical report, we discuss our 3rd place solution for the Visual Relationship track of Open Images 2019 competition. Specially, we demonstrate the effectiveness of using two models – ‘Relationship Model‘ and ‘Attribute Model‘ – to solve the task. In particular, for the ‘Relationship Model‘, we have … Continued
Building Vietnamese Linguistic Resources for Social Network Text Analysis
Content Authors: The-Tuyen Nguyen; Xuan-Luong Vu; Phuong Le-Hong Abstract: In this paper, we report our work on building linguistic resources for Vietnamese social network text analysis in multiple domains. We first describe our annotation methodology including guidelines development, annotation softwares and quality assurance. We then present results of the first pilot phase of the project. Finally, we outline some … Continued
Computational Flood Modeling with UPC Architecture
Content Authors: Thanh Tung Vu; Adrian Wing-Keung Law; Tien H. Nguyen; and Alvin Wei Ze Chew Abstract: Demand for effective flood modeling and forecasting based on the two-dimensional shallow water equations has increased due to uncertainties with climate changes and the need for further accuracy in the urbanized environment. In this study, an alternative parallel computing architecture is presented that … Continued
Effects of Soft-Masking Function on Spectrogram-Based Instrument – Vocal Separation
Content Authors: Duc Chung Tran; M.K.A. Ahamed Khan Abstract: This paper presents an analysis of effects of soft-masking function on spectrogram-based instrument – vocal separation for audio signals. The function taken into consideration is of 1st-order with two masking magnitude parameters: one for background and one foreground separation. It is found that as the masking magnitude … Continued
Solving the multi-vehicle multi-covering tour problem
Content Authors: Tuan Anh Pham, Minh Hoang Ha, Xuan Hoai Nguyen Abstract: The well-known multi-vehicle covering tour problem (m-CTP) involves finding a minimum-length set of vehicle routes passing through a subset of vertices, subject to constraints on the length of each route and the number of vertices that it contains, such that each vertex not included … Continued
Building a semantic role labelling system for Vietnamese
Content Authors: Thai-Hoang Pham; Xuan-Khoai Pham; Phuong Le-Hong Abstract: Semantic role labelling (SRL) is a task in natural language processing which detects and classifies the semantic arguments associated with the predicates of a sentence. It is an important step towards understanding the meaning of a natural language. There exists SRL systems for well-studied languages like English, Chinese or Japanese … Continued
APPLICATION OF AI TECHNOLOGY IN AUTHENTICATION OF ONLINE TRANSACTIONS
APPLYING AI TECHNOLOGY IN AUTHENTICATION OF ONLINE TRANSACTIONS👉 By 2023, non-cash payments in Vietnam will reach about 11 billion transactions👉 The number of transactions increases by 50% compared to 2022 with a total transaction value of more than 200 million billion VND👉 27 million payment accounts and 12.9 million active cards issued using eKYC method … Continued
STRATEGIC MANUAL Application of Artificial Intelligence in INSURANCE INDUSTRY operations
McKinsey estimates that 1.1 trillion USD/year is the potential added value if AI technology is thoroughly applied to the Insurance sector. The explosion of Artificial Intelligence (AI) application solutions has created momentum to promote the entire digital transformation process in the Insurance sector, spanning the industry’s value chain, including from Sales, Marketing, Risk Management, Operations, … Continued
Title subscribe
All good things homepage. Get inspired without breaking your wallet. Download premium Figma and Sketch templates.