Question Answering based on Sequence Generative Adversarial Nets and Implementation of Customer Service

摘要

Recently, Sequence Generative Adversarial Nets is very popular. It has achieved good results in both text generation and dialog generation. Therefore, we planned to build a question answering system via SeqGAN to teach machine reading question related documents and generate answers like human responses. The demands for smart customer service is increasing day by day. Most of the systems built by template-based method failed to response users easily whenever the question asked by user does not follow the established rule or does not exist in the database, hence they are often limited on specific tasks. To resolve the weaknesses of the template-based customer service, we try to build a customer service with question answering system based on SeqGAN. This thesis involves three parts. The first part is the pre-training of the generator and the discriminator. The generator is a seq2seq model with GRU. Besides, we use dynamic dictionary to decrease the probability that the decoder generates wrong words. The discriminator, which is a CNN model to classify the QA pair generated by human or machine, could give reward for both fully and partially QA pairs. The second part is SeqGAN. Different from general generative adversarial training, we consider the length difference between actual answer and generated answer when calculating the reward. Experimental results proved that the proposed system improved the performance successfully. In the last part we try to build a customer service system. We crawl the information such as product information and user manuals on the company website and use FAQ provided by the company to train our model.