Law, Probability and Risk Advance Access originally published online on March 4, 2009
Law, Probability and Risk 2009 8(3):277-288; doi:10.1093/lpr/mgp003
| ||||||||||||||||||||||||||||||||||||||||||||||||
© The Author [2009]. Published by Oxford University Press. All rights reserved.
How accurate are the power calculations relied on by the SEC in its regulatory deliberations?
Department of Statistics, The George Washington University, Washington, DC 20052, USA and Biometrics, Vertex Pharmaceuticals, Cambridge, MA 02139, USA

Department of Statistics, The George Washington University, Washington, DC 20052, USA
* Email: ebura{at}gwu.edu
Email: jlgast{at}gwu.edu
| Abstract |
|---|
In two related decisions in Chamber of Commerce of the United States of America v. Securities and Exchange Commission (SEC), the District of Columbia Federal Court of Appeals ruled that the SEC had not fully complied with some provisions of the Administrative Procedures Act when it required that the boards of investment companies managing mutual funds have at least 75% of their membership and the Chairman be independent directors. In preparation for renewed rule making, the Office of Economic Analysis of the SEC prepared a Power Study to respond to an industry-sponsored report claiming that the returns of funds with independent boards and chairs are not superior to funds with boards dominated by management. The Power Study concluded that the available studies on the effectiveness of independent board members do not have sufficient statistical power to detect a meaningful difference in the returns of the two types of funds. This paper demonstrates that the method used by the SEC in their power calculation is not correct, unless a very restrictive condition that rarely occurs in practice holds. When the appropriate power formulas are used, the expected power of studies of the same size as the ones examined by the SEC is actually lower than the corresponding results of the SEC. Thus, the results in the paper actually strengthen the argument that the SEC is advocating. The relevance of both the SEC and the industry studies to the main issue in the case is also questioned in the discussion.
Keywords: comparing two groups; hypothesis tests; indicator variables; regression; statistical power
Presented as part of the Seventh International Conference on Forensic Inference and Statistics, The University of Lausanne, Switzerland, 21st to 23rd August, 2008.