Outline

Sequence Tagging

Semi-supervised Learning

Transfer Learning

Conclusions

References

Sequence Tagging

Introduction

DefinitionSequence tagging is a type of pattern recognition task that involves the algorithmic assignment of a categorical label to each member of a sequence of observed values.SignificanceSequence tagging is one of the first stages in most natural language processing applications, such as part-of-speech tagging, chunking and named entity recognition.Approaches

Traditional models

Hidden Markov Models

Conditional Random Fields

Neural network models

RNN, LSTM, GRU

Neural Network Model

Results

Sequence Tagging with Little Labeled Data

BackgroundsAlthough recent neural networks obtain state-of-the-art performance on several sequence tagging tasks, they can’t be used for tasks with little labeled data.Approaches