2017-01 | March 1, 2020

This paper demonstrates state-of-the-art text sentiment analysis tools while developing a new time-series measure of economic sentiment derived from economic and financial newspaper articles from January 1980 to April 2015. We compare the predictive accuracy of a large set of sentiment analysis models using a sample of articles that have been rated by humans on a positivity/negativity scale. The results highlight the gains from combining existing lexicons and from accounting for negation. We also generate our own sentiment-scoring model, which includes a new lexicon built specifically to capture the sentiment in economic news articles. This model is shown to have better predictive accuracy than existing, “off-the-shelf”, models. Lastly, we provide two applications to the economic research on sentiment. First, we show that daily news sentiment is predictive of movements of survey-based measures of consumer sentiment. Second, motivated by Barsky and Sims (2012), we estimate the impulse responses of macroeconomic variables to sentiment shocks, finding that positive sentiment shocks increase consumption, output, and interest rates and dampen inflation.

Article Citation

Shapiro, Adam Hale, Daniel J. Wilson, and Moritz Sudhof. 2017. “Measuring News Sentiment,” Federal Reserve Bank of San Francisco Working Paper 2017-01. Available at https://doi.org/10.24148/wp2017-01

About the Authors
Adam Shapiro
Adam Shapiro is a vice president in the Economic Research Department of the Federal Reserve Bank of San Francisco. Learn more about Adam Shapiro
Daniel Wilson
Daniel Wilson is a vice president in the Economic Research Department of the Federal Reserve Bank of San Francisco. Learn more about Daniel Wilson