机器学习和大数据计量经济学, 你必须阅读一下这篇

凡是搞计量经济的，都关注这个号了

投稿：[e-mail]

所有计量经济圈方法论丛的程序文件, 微观数据库和各种软件都放在社群里.欢迎到计量经济圈社群交流访问. 

在将来的计量经济学发展趋势中，Machine learning和Big data一定是绕不过去的弯，原因在于他们是AI时代的标配。以下19篇文章可以帮助咱们更好地理解机器学习和大数据在计量经济学中的应用，因此建议收藏。

下面这个是林光平教授在厦门大学讲解的“大数据计量经济学”，可以在看完了上面19篇文章后继续看看下面的视频讲解。

Machine learning (ML) is most commonly understood as a set of computational techniques applied to big datasets in order to make granular predictions for businesses, from advertising to fraud detection to user recommendations. Yet another, perhaps less appreciated, application comes from academia, where social scientists have slowly but steadily begun leveraging ML techniques to gain new insights from data.

In a recent paper from the National Bureau of Economic Research (NBER), Susan Athey provided a useful assessment of the contributions of ML to economics, summarizing emerging econometric literature combining ML and causal inference, before drawing broader conclusions about the impact of ML on economics as a field.

The crucial difference between econometrics and ML: The former aims to establish causality, while the latter aims to produce accurate and actionable predictions

First, Athey culled through the plethora of buzzwords related to ML to establish a practical definition for economists and policy analysts. She defined ML as “a field that develops algorithms designed to be applied to data sets, with the main areas of focus being prediction, classification and clustering tasks.” For the author, the key was a clear distinction between the goals of ML techniques and the goals of traditional econometric methods of causal inference. In econometrics, Athey wrote, the primary aim is typically to uncover a clean, causal relationship between the outcome variable and another variable of interest. As such, econometricians established a solid empirical framework for answering questions regarding the impact of various policy changes on particular populations. In contrast, ML techniques are not designed to identify causal relationships between variables; rather, their purpose is to make accurate predictions. Athey argued that this constitutes the crucial difference between econometrics and ML: The former aims to establish causality, while the latter aims to produce accurate and actionable predictions.

Fortunately, this does not mean both frameworks cannot work together. In fact, Athey argued that there is much to gain from implementing both frameworks side by side. For instance, as sophisticated ML applications become increasingly skilled at granular prediction, ML practitioners may no longer be able to ignore the question of causality. If they do, they risk losing sight of what drives the predictive success of their models. Because of this, ML experts can benefit from a coordinated application of econometrics to their work.

Likewise, ML techniques can be useful for econometricians. These experts can employ ML techniques to improve, expand and even uncover data to build stronger econometric models. By allowing the design of systematic model-selection processes, ML techniques can help economists avoid inappropriate model selection. Moreover, ML techniques can improve the evaluation of policy interventions by tweaking several standard methodologies, thereby enabling econometricians to identify causal relationships even with small samples. An alliance between ML and econometrics also permits the estimation of more realistic—and therefore more complex—models, due to the computational performance of novel ML techniques. For example, Ruiz et al. (2017) used ML techniques to analyze consumer preferences for bundles selected from more than 5,000 items, an exercise that yielded more than 25,000possibilities. A calculation of this magnitude would computationally have been prohibitively intensive only a few years ago.

The combination of ML techniques and econometric tools for causal inference stands not only to produce a promising new strand of literature, but also to inspire a profound transformation in the field of economics. In the future, the ML-econometrics partnership may provide novel solutions to important econometric problems and enhance the debate around contentious policy research questions.

Article source: Athey, Susan. “The Impact of Machine Learning on Economics.” The Economics of Artificial Intelligence: An Agenda. National Bureau of Economic Research, forthcoming (draft 2018).

SHOPPER: A Probabilistic Model of Consumer Choice with Substitutes and Complements, https://arxiv.org/abs/1711.03560

2年，计量经济圈公众号近1000篇文章，

Econometrics Circle

数据系列：空间矩阵 | 工企数据 | PM2.5 | 市场化指数 | CO2数据 |  夜间灯光 

计量系列：匹配方法 | 内生性 | 工具变量 | DID | 面板数据 | 常用TOOL | 中介调节

干货系列：能源环境 | 效率研究 | 空间计量 | 国际经贸 | 计量软件 | 商科研究

计量经济圈组织了一个计量社群，有如下特征：热情互助最多、前沿趋势最多、社科资料最多、社科数据最多、科研牛人最多、海外名校最多。因此，建议积极进取和有强烈研习激情的中青年学者到社群交流探讨，始终坚信优秀是通过感染优秀而互相成就彼此的。