Simplifying graph convolutional networks
Graph Convolutional Networks (GCNs) and their variants have experienced significant
attention and have become the de facto methods for learning graph representations. GCNs …
attention and have become the de facto methods for learning graph representations. GCNs …
The impacts of climate change on water resources and agriculture in China
China is the world’s most populous country and a major emitter of greenhouse gases.
Consequently, much research has focused on China’s influence on climate change but somewhat …
Consequently, much research has focused on China’s influence on climate change but somewhat …
Revisiting few-sample BERT fine-tuning
This paper is a study of fine-tuning of BERT contextual representations, with focus on
commonly observed instabilities in few-sample scenarios. We identify several factors that cause …
commonly observed instabilities in few-sample scenarios. We identify several factors that cause …
Bertscore: Evaluating text generation with bert
We propose BERTScore, an automatic evaluation metric for text generation. Analogously to
common metrics, BERTScore computes a similarity score for each token in the candidate …
common metrics, BERTScore computes a similarity score for each token in the candidate …
The interplay of histone modifications–writers that read
T Zhang, S Cooper, N Brockdorff - EMBO reports, 2015 - embopress.org
Histones are subject to a vast array of posttranslational modifications including acetylation,
methylation, phosphorylation, and ubiquitylation. The writers of these modifications play …
methylation, phosphorylation, and ubiquitylation. The writers of these modifications play …
On the opportunities and risks of foundation models
AI is undergoing a paradigm shift with the rise of models (eg, BERT, DALL-E, GPT-3) that are
trained on broad data at scale and are adaptable to a wide range of downstream tasks. We …
trained on broad data at scale and are adaptable to a wide range of downstream tasks. We …
Expectation vs. experience: Evaluating the usability of code generation tools powered by large language models
Recent advances in Large Language Models (LLM) have made automatic code generation
possible for real-world programming tasks in general-purpose programming languages such …
possible for real-world programming tasks in general-purpose programming languages such …
Holistic evaluation of language models
Language models (LMs) are becoming the foundation for almost all major language
technologies, but their capabilities, limitations, and risks are not well understood. We present …
technologies, but their capabilities, limitations, and risks are not well understood. We present …
Designing asynchronous online discussion environments: Recent progress and possible future directions
Asynchronous online discussion environments are important platforms to support learning.
Research suggests, however, threaded forums, one of the most popular asynchronous …
Research suggests, however, threaded forums, one of the most popular asynchronous …
Alpacafarm: A simulation framework for methods that learn from human feedback
Large language models (LLMs) such as ChatGPT have seen widespread adoption due to
their ability to follow user instructions well. Developing these LLMs involves a complex yet …
their ability to follow user instructions well. Developing these LLMs involves a complex yet …