Welcome to the Reading Group on
Natural Language Processing at UO

---

The Natural Language Processing group at UO conducts research on Information Extraction, Natural Language Processing, Deep Learning and Machine Learning. We organize a reading group weekly in each quarter to discuss the recent advances in these areas. One or two papers will be presented in each meeting. We will also have a discussion section after each presentation to discuss about the topics. Everybody is welcome!

The time for the meeting will be announced at the beginning of each quarter. Please check this page regularly for the next papers to be presented and the location of the meeting.

This reading group is maintained by Prof. Thien Huu Nguyen. Come and talk with him if you want to do research!

Winter 2022

We will meet on Thursday 2pm-3pm via Zoom due to COVID-19 (LINK). Please check the schedule for any potential changes.

Schedule (the top is the most recent)

Date	Paper	Slide	Time	Location	Speakers
Monday, Jan 24th	Graph Neural News Recommendation with Unsupervised Preference Disentanglement (Amir) Editing Factual Knowledge in Language Models (Qiuhao)	Amir Qiuhao	2:00pm	Zoom	Amir Qiuhao

Fall 2021

We will meet on Thursday 3pm-4pm via Zoom due to COVID-19 (LINK). Please check the schedule for any potential changes.

Schedule (the top is the most recent)

Date	Paper	Slide	Time	Location	Speakers
Thursday, Dec 16	Exploring Task Difficulty for Few-Shot Relation Extraction (Viet) DEGREE: A Data-Efficient Generative Event Extraction Model (Minh)	Viet Minh	3:00pm	Zoom	Viet Minh
Thursday, Dec 9	What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimation (Zayd) Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training (Luis)	Zayd Luis	3:00pm	Zoom	Zayd Luis
Thursday, Dec 2	NSP-NER: A Prompt-based Learner for Few-shot NER Driven by Next Sentence Prediction (Viet) TableIE: Capture the Interactions among Joint Information Extraction Explicitly via Double Tables (Minh)	Viet Minh	3:00pm	Zoom	Viet Minh
Thursday, Nov 18	Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extraction (Luis) SegMix: A Simple Structure-Aware Data Augmentation Method (Amir)	Luis Amir	3:00pm	Zoom	Luis Amir
Thursday, Oct 28	Data Augmentation for Cross-Domain Named Entity Recognition (Amir) An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (Zayd)	Amir Zayd	3:00pm	Zoom	Amir Zayd
Thursday, Oct 21	CONTAINER: Few-Shot Named Entity Recognition via Contrastive Learning (Viet) Cold-start Active Learning through Self-supervised Language Modeling (Minh)	Viet Minh	3:00pm	Zoom	Viet Minh
Thursday, Oct 14	LearnDA: Learnable Knowledge-Guided Data Augmentation for Event Causality Identification (Amir) Language Model Priming for Cross-Lingual Event Extraction (Luis)	Amir Luis	3:00pm	Zoom	Amir Luis
Thursday, Oct 7	STraTA: Self-Training with Task Augmentation for Better Few-shot Learning (Viet) TEXT2EVENT: Controllable Sequence-to-Structure Generation for End-to-end Event Extraction (Minh)	Viet Minh	3:00pm	Zoom	Viet Lai Minh Nguyen

Summer 2021

We will meet on Wed 2:30-3:30 via Zoom due to COVID-19 (LINK). Please check the schedule for any potential changes.

Schedule (the top is the most recent)

Date	Paper	Slide	Time	Location	Speakers
Wednesday, June 30	MetaXL: Meta Representation Transformation for Low-resource Cross-lingual Learning (Viet)	Viet	2:30pm	Zoom	Viet Lai
Wednesday, June 23	Robust Question Answering Through Sub-part Alignment (Minh)	Minh	2:30pm	Zoom	Minh Nguyen
Wednesday, June 16	Document-level Event Extraction via Heterogeneous Graph-based Interaction Model with a Tracker (Amir)	Amir	2:30pm	Zoom	Amir Veyseh

Spring 2021

We will meet on Wed 2:30-3:30 via Zoom due to COVID-19 (LINK). Please check the schedule for any potential changes.

Schedule

Date	Paper	Slide	Time	Location	Speakers
Wednesday, March 31	Knowledge-Grounded Dialogue Generation with Pre-trained Language Models (Amir)	Amir	2:30pm	Zoom	Amir Veyseh
Wednesday, April 14	Few-Shot Sequence Labeling with Label Dependency Transfer and Pair-wise Embeddings (Viet)	Viet	2:30pm	Zoom	Viet Lai
Wednesday, April 28	Cross-media Structured Common Space for Multimedia Event Extraction (Minh) Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space (Amir)	Minh Amir	2:30pm	Zoom	Minh Nguyen Amir Veyseh
Wednesday, May 5	Meta-Learning for Effective Multi-task and Multilingual Modelling	Viet	2:30pm	Zoom	Viet Lai
Wednesday, May 19	Textual Data Augmentation for Efficient Active Learning on Tiny Datasets	Amir	2:30pm	Zoom	Amir Veyseh
Wednesday, June 1	ADAPTIVE SELF-TRAINING FOR FEW-SHOT NEURAL SEQUENCE LABELING A Frustratingly Easy Approach for Entity and Relation Extraction	Viet Louis	2:30pm	Zoom	Viet Lai Luis Guzman

Winter 2021

We will meet on Monday 2:00-3:30 via Zoom due to COVID-19 (LINK). Please check the schedule for any potential changes.

Schedule

Date	Paper	Slide	Time	Location	Speakers
Monday, Feb 15	On the Cross-lingual Transferability of Monolingual Representations (Minh) AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts (Amir) Making Pre-trained Language Models Better Few-shot Learners (Viet)	Minh Amir Viet	2:00pm	Zoom	Minh Nguyen Amir Veyseh Viet Lai
Monday, Feb 22	TinyBERT: Distilling BERT for Natural Language Understanding (Tuan)	Tuan	2:00pm	Zoom	Tuan Nguyen
Monday, Mar 1	Train Large, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers(Minh) Local Additivity Based Data Augmentation for Semi-supervised NER (Amir)	Minh Amir	2:00pm	Zoom	Minh Nguyen Amir Veyseh
Monday, March 8	Self-training for few-shot transfer across extreme task differences(Viet) Towards Open Domain Event Trigger Identification using Adversarial Domain Adaptation(Luis)	Viet Luis	2:00pm	Zoom	Viet Lai Luis Guzman
Monday, March 15	Recent Advances in Language Model Fine-tuning(Minh) X-Class: Text Classification with Extremely Weak Supervision(Qiuhao)	Minh Qiuhao	2:00pm	Zoom	Minh Nguyen Qiuhao Lu
Monday, March 22	MELR: Meta-Learning via Modeling Episod-Level Relationships for Few-Shot Learning (Viet) POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training (Tuan)	Viet Tuan	2:00pm	Zoom	Viet Lai Tuan Nguyen

Fall 2020

We will meet on Fridays 2:00-3:30 via Zoom due to COVID-19 (LINK). Please check the schedule for any potential changes.

Schedule

Date	Paper	Slide	Time	Location	Speakers
Friday, Oct 9	Unsupervised Domain Adaptation via Structurally Regularized Deep Clustering (Minh) Neural Relational Inference for Interacting Systems (Amir)	Minh Amir	2:00pm	Zoom	Minh Nguyen Amir Veyseh
Friday, Oct 16	Double Graph Based Reasoning for Document-level Relation Extraction (Amir) Adversarial Multiple Source Domain Adaptation (Tuan) Exploiting Cloze Questions for Few Shot Text Classification and Natural Language Inference (Viet)	Amir Tuan Viet	2:00pm	Zoom	Minh Nguyen Amir Veyseh
Friday, Oct 23	Moment Matching for Multi-Source Domain Adaptation (Tuan) Dialogue Relation Extraction with Document-level Heterogeneous Graph Attention Networks (Minh)	Tuan Minh	2:00pm	Zoom	Minh Nguyen Amir Veyseh
Friday, Oct 30	Survey on training signals for finetuning domain-specific BERT (Viet)	Viet	2:00pm	Zoom	Viet Lai
Friday, Nov 6	Connecting the Dots: Event Graph Schema Induction with Path Language Modeling (Minh)	Minh	2:00pm	Zoom	Minh Nguyen
Friday, Nov 13	SSMBA: Self-Supervised Manifold Based Data Augmentation for Improving Out-of-Domain Robustness (Viet)	Viet	2:00pm	Zoom	Viet Lai
Friday, Dec 4th	HYPERGRID: Efficient Multi-Task Transformers with Grid-wise Decomposable Hyper Projections (Minh) Recurrent Event Network: Autoregressive Structure Inference over Temporal Knowledge Graphs (Amir)	Minh Amir	2:00pm	Zoom	Minh Nguyen Amir Veyseh
Friday, Dec 11th	Joint Constrained Learning for Event-Event Relation Extraction (Viet) Self-ensembling for visual domain adaptation (Tuan)	Viet Tuan	2:00pm	Zoom	Viet Lai Tuan Nguyen
Friday, Dec 18th	Event Extraction as Machine Reading Comprehension Directed acyclic graph neural networks	Minh Amir	2:00pm	Zoom	Minh Nguyen Amir Veyseh

Summer 2020

We will meet on Saturdays 2:00pm via Zoom due to COVID-19 (LINK). Please check the schedule for any potential changes.

Schedule

Date	Paper	Slide	Time	Location	Speakers
Saturday, June 27	Document-Level Event Role Filler Extraction using Multi-Granularity Contextualized Encoding(Minh) Zero-shot Text Classification via Reinforced Self-training (Viet) Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning (Tuan) Adversarial Training Methods for Semi-Supervised Text Classification (Tuan)	Minh Viet Tuan	2:00pm	Zoom	Minh Nguyen Viet Lai Tuan Nguyen
Saturday, July 4	A Joint Neural Model for Information Extraction with Global Features (Minh) Neural Graph Matching Networks for Chinese Short Text Matching (Viet) Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results (Tuan) FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence (Tuan)	Minh Viet Tuan	2:00pm	Zoom	Minh Nguyen Viet Lai Tuan Nguyen
Saturday, July 11	Feature Projection for Improved Text Classification (Minh) Dynamic Memory Induction Networks for Few-Shot Text Classification(Viet) mixup: Beyond Empirical Risk Minimization(Tuan) MixMatch: A Holistic Approach to Semi-Supervised Learning(Tuan)	Minh Viet Tuan	2:00pm	Zoom	Minh Nguyen Viet Lai Tuan Nguyen
Saturday, July 18	A Novel Cascade Binary Tagging Framework for Relational Triple Extraction (Minh) Adaptive Subspaces for Few-Shot Learning(Viet) Unsupervised Domain Clusters in Pretrained Language Models(Tuan)	Minh Viet Tuan	2:00pm	Zoom	Minh Nguyen Viet Lai Tuan Nguyen
Saturday, July 25	Few-Shot Open-Set Recognition using Meta-Learning (Viet) Plug and Play Language Models: A Simple Approach to Controlled Text Generation (Tuan) Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph Information (Minh)	Viet Tuan Minh	2:00pm	Zoom	Minh Nguyen Viet Lai Tuan Nguyen
Saturday, August 1	Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning(Minh) Boosting Few-Shot Learning with Adaptive Margin Loss(Viet) CTRL: A Conditional Transformer Language Model for Controllable Generation(Tuan) Fine-Tuning Language Models from Human Preferences(Tuan)	Minh Viet Tuan	2:00pm	Zoom	Minh Nguyen Viet Lai Tuan Nguyen
Saturday, August 15	CANCELED
Saturday, August 15	Simple and Deep Graph Convolutional Networks(Minh) Fine-grained Fact Verification with Kernel Graph Attention Network(Viet) Unsupervised Domain Adaptation via Regularized Conditional Alignment(Tuan)	Minh Viet Tuan	2:00pm	Zoom	Minh Nguyen Viet Lai Tuan Nguyen
Saturday, August 22	Entity-Relation Extraction as Multi-turn Question Answering (Minh) Relational Graph Attention Network for Aspect-based Sentiment Analysis (Viet) Span-ConveRT: Few-shot Span Extraction for Dialog with Pretrained Conversational Representations (Viet) Meta-Learning with Latent Embedding Optimization (Tuan)	Minh Viet Tuan	2:00pm	Zoom	Minh Nguyen Viet Lai Tuan Nguyen
Saturday, August 29	A Survey of Cross-lingual Word Embedding Models (Minh) When Does Self-supervision Improve Few-shot Learning? (Viet) Meta-Curvature (Tuan)	Minh Viet Tuan	2:00pm	Zoom	Minh Nguyen Viet Lai Tuan Nguyen
Saturday, September 5	Chinese Relation Extraction with Multi-Grained Information and External Linguistic Knowledge (Minh) Taxonomy Construction of Unseen Domains via Graph-based Cross-Domain Knowledge Transfer (Viet) Meta-Learning with Implicit Gradients (Tuan)	Minh Viet Tuan	2:00pm	Zoom	Minh Nguyen Viet Lai Tuan Nguyen
Saturday, September 12	INFOXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training (Minh) Meta-Learning with Differentiable Convex Optimization(Viet) TADAM: Task dependent adaptive metric for improved few-shot learning(Tuan)	Minh Viet Tuan	2:00pm	Zoom	Minh Nguyen Viet Lai Tuan Nguyen
Saturday, September 19	Document-level Event-based Extraction Using Generative Template-filling Transformers (Minh) Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks (Viet) Learning Semantic Representations for Unsupervised Domain Adaptation (Tuan)	Minh Viet Tuan	2:00pm	Zoom	Minh Nguyen Viet Lai Tuan Nguyen
Saturday, September 26	MAD-X: An Adapter-based Framework for Multi-task Cross-lingual Transfer (Minh)	Minh	2:00pm	Zoom	Minh Nguyen

---

Spring 2020

We will meet on Fridays 2:00pm via Zoom due to COVID-19 (LINK). Please check the schedule for any potential changes.

Schedule

Date	Paper	Slide	Time	Location	Speakers
Friday, April 3	CANCELED due to COVID-19
Friday, April 10	CANCELED due to COVID-19
Friday, April 17	Neural Cross-Lingual Named Entity Recognition with Minimal Resources (Minh)		2:00pm	Zoom	Minh Nguyen
Friday, April 24	Measure Country-Level Socio-Economic Indicators with Streaming News: An Empirical Study Machine Reading Comprehension Using Structural Knowledge Graph-aware Network CaRe: Open Knowledge Graph Embeddings	Viet Amir	2:00pm	Zoom	Viet Lai Amir Veyseh Amir Veyseh
Friday, May 01	Contextualised Graph Attention for Improved Relation Extraction (Minh) Zero-shot Word Sense Disambiguation using Sense Definition Embeddings (Viet)	Viet	2:00pm	Zoom	Minh Nguyen VIet Lai
Friday, May 08	MEMORY-BASED GRAPH NETWORKS (Amir) Single-/Multi-Source Cross-Lingual NER via Teacher-Student Learning on Unlabeled Data in Target Language (Minh) Few-shot text classification with distributional signatures (Viet)	Viet	2:00pm	Zoom	Amir Veyseh Minh Nguyen Viet Lai
Friday, May 15	EDITABLE NEURAL NETWORKS (Minh) StructSum: Incorporating Latent and Explicit Sentence Dependencies for Single Document Summarization(Amir) Learning to Self-Train for Semi-Supervised Few-Shot Classification (Viet)	Minh Amir Viet	2:00pm	Zoom	Minh Nguyen Amir Veyseh Viet Lai
Friday, May 22	CROSS-LINGUAL ALIGNMENT VS JOINT TRAINING: A COMPARATIVE STUDY AND A SIMPLE UNIFIED FRAMEWORK (Minh) Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networks (Amir) Prototypical Contrastive Learning of Unsupervised Representations (Viet)	Minh Amir Viet	2:00pm	Zoom	Minh Nguyen Amir Veyseh Viet Lai
Friday, May 29	Adversarial Learning with Contextual Embeddings for Zero-resource Cross-lingual Classification and NER (Minh) Reasoning with Latent Structure Refinement for Document-Level Relation Extraction (Amir) Learning to Few-Shot Learn Across Diverse Natural Language Classification Tasks (Viet)	Amir Viet	2:00pm	Zoom	Minh Nguyen Amir Veyseh Viet Lai
Friday, June 05	Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing (Minh) Semantic Graphs for Generating Deep Questions (Amir) Rapid Learning or Feature Reuse? Towards Understanding The Effectiveness of MAML (Viet)	Viet	2:00pm	Zoom	Minh Nguyen Amir Veyseh Viet Lai

---

Winter 2020

We don't have a reading group for Winter 2020. Instead, we organize a seminar on Deep Learning for Natural Language Processing here. We will meet on Fridays from 2:00 to 3:20pm in Deschutes 200.

---

Fall 2019

We will meet on Mondays 3:30pm (room 160, Deschutes Hall) for Fall 2019. Please check the schedule for any potential changes.

Schedule

Date	Paper	Slide	Time	Location	Speakers
Monday, Dec 2	Tree-Structured Attention with Hierarchical Accumulation (Amir) A Novel Bi-directional Interrelated Model for Joint Intent Detection andSlot Filling (Amir) A Stack-Propagation Framework with Token-Level Intent Detection forSpoken Language Understanding (Amir) Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabularies (Viet)	Link	3:30pm	160 Deschutes	Amir Veyseh Viet Lai
Monday, Nov 25	Sequence-to-Nuggets: Nested Entity Mention Detection via Anchor-Region Networks (Minh) "Why Should I Trust You?": Explaining the Predictions of Any Classifier (Tuan)	Link	3:30pm	160 Deschutes	Minh Nguyen Tuan Nguyen
Monday, Nov 18	InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximization (Amir) Matching the Blanks: Distributional Similarity for Relation Learning (Amir) Induction Networks for Few-Shot Text Classification (Viet)	Link	3:30pm	160 Deschutes	Amir Veyseh Viet Lai
Monday, Nov 11	Neural Cross-Lingual Event Detection with Minimal Parallel Resources (Minh) Learning how to Active Learn: A Deep Reinforcement Learning Approach (Tuan)	Link	3:30pm	160 Deschutes	Minh Nguyen Tuan Nguyen
Monday, Nov 4	Connecting the Dots: Document-level Neural Relation Extraction with Edge-oriented Graphs (Amir) Transformer-XL: Attentive Language ModelsBeyond a Fixed-Length Context (Amir) Query expansion techniques for information retrieval: A survey (Viet)	Link	3:30pm	160 Deschutes	Amir Veyseh Viet Lai
Monday, Oct 28	Incorporating Syntactic and Semantic Information in Word Embeddings using Graph Convolutional Networks (Minh) Improving Vector Space Word Representations Using Multilingual Correlation (Tuan) Massively Multilingual Word Embeddings (Tuan)	Link	3:30pm	160 Deschutes	Minh Nguyen Tuan Nguyen
Monday, Oct 21	A Novel Aspect-Guided Deep Transition Model for Aspect Based Sentiment Analysis (Amir) Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networks (Amir) Syntax-Aware Aspect Level Sentiment Classification with Graph Attention Networks (Amir) Sentence Embedding Alignment for Lifelong Relation Extraction (Viet)	Link	3:30pm	160 Deschutes	Amir Veyseh Viet Lai
Monday, Oct 14	Loss in Translation: Learning Bilingual Word Mapping with a Retrieval Criterion (Tuan) Cross-lingual Structure Transfer for Relation and Event Extraction (Minh)	Link	3:30pm	160 Deschutes	Tuan Nguyen Minh Nguyen
Monday, Oct 7	A General Framework for Information Extractionusing Dynamic Span Graphs (Amir) You Only Need Attention to Traverse Trees (Amir) Few-Shot Representation Learning for Out-Of-Vocabulary Words (Viet)	Link	3:30pm	160 Deschutes	Amir Veyseh Viet Lai

---

Spring 2019

We will meet on Mondays 3pm (room 200, Deschutes Hall) for Spring 2019. Please check the schedule for any potential changes.

Schedule

Date	Paper	Slide	Time	Location	Speaker
Monday, April 8	Multi-class Classification without Multi-class Labels	Link	3pm	200 Deschutes	Amir Veyseh
Monday, April 15	Prototypical Networks for Few-shot Learning	Link	3pm	200 Deschutes	Viet Lai
Monday, April 22	Hybrid Attention-Based Prototypical Networksfor Noisy Few-Shot Relation Classification	Link	3pm	200 Deschutes	Amir Veyseh
Monday, April 29	Program Synthesis from Natural Language Using Recurrent Neural Networks	Link	3pm	200 Deschutes	Dewi Yokelson
Monday, May 06	Learning to Compare: Relation Network for Few-Shot Learning	Link	3pm	200 Deschutes	Viet Lai
Monday, May 13	Mutual Information Neural Estimation	Link	3pm	200 Deschutes	Amir Veyseh
Monday, May 20	Infinite Mixture Prototypes for Few-shot Learning	Link	3pm	200 Deschutes	Viet Lai
Monday, May 27	Canceled (Memorial Day)
Monday, June 3	Ordered Neurons: Integrating Tree Structures into Recurrent Neural Networks	Link	3pm	200 Deschutes	Amir Veyseh

---

Winter 2019

We don't have a reading group for Winter 2019. Instead, we organize a seminar on Deep Learning for Natural Language Processing here.