来源：百度文库 编辑：神马文学网 时间：2024/04/25 22:18:34
How to Read a PaperS. KeshavDavid R. Cheriton School of Computer Science, University of WaterlooWaterloo, ON, Canadakeshav@uwaterloo.caABSTRACTResearchers spend a great deal of time reading research pa-pers. However, this skill is rarely taught, leading to muchwasted effort. This article outlines a practical and efficientthree-pass method for reading research papers. I also de-scribe how to use this method to do a literature survey.Categories and Subject Descriptors: A.1 [Introductoryand Survey]General Terms: Documentation.Keywords: Paper, Reading, Hints.1. INTRODUCTIONResearchers must read papers for several reasons: to re-view them for a conference or a class, to keep current intheir field, or for a literature survey of a new field. A typi-cal researcher will likely spend hundreds of hours every yearreading papers.Learning to efficiently read a paper is a critical but rarelytaught skill. Beginning graduate students, therefore, mustlearn on their own using trial and error. Students wastemuch effort in the process and are frequently driven to frus-tration.For many years I have used a simple approach to efficientlyread papers. This paper describes the ‘three-pass’ approachand its use in doing a literature survey.2. THE THREE-PASS APPROACHThe key idea is that you should read the paper in up tothree passes, instead of starting at the beginning and plow-ing your way to the end. Each pass accomplishes specificgoals and builds upon the previous pass: The first passgives you a general idea about the paper. The second passlets you grasp the paper’s content, but not its details. Thethird pass helps you understand the paper in depth.2.1 The first passThe first pass is a quick scan to get a bird’s-eye view ofthe paper. You can also decide whether you need to do anymore passes. This pass should take about five to ten minutesand consists of the following steps:1. Carefully read the title, abstract, and introduction2. Read the section and sub-section headings, but ignoreeverything else3. Read the conclusions4. Glance over the references, mentally ticking off theones you’ve already readAt the end of the first pass, you should be able to answerthe five Cs:1. Category: What type of paper is this? A measure-ment paper? An analysis of an existing system? Adescription of a research prototype?2. Context: Which other papers is it related to? Whichtheoretical bases were used to analyze the problem?3. Correctness: Do the assumptions appear to be valid?4. Contributions: What are the paper’s main contribu-tions?5. Clarity: Is the paper well written?Using this information, you may choose not to read fur-ther. This could be because the paper doesn’t interest you,or you don’t know enough about the area to understand thepaper, or that the authors make invalid assumptions. Thefirst pass is adequate for papers that aren’t in your researcharea, but may someday prove relevant.Incidentally, when you write a paper, you can expect mostreviewers (and readers) to make only one pass over it. Takecare to choose coherent section and sub-section titles andto write concise and comprehensive abstracts. If a reviewercannot understand the gist after one pass, the paper willlikely be rejected; if a reader cannot understand the high-lights of the paper after five minutes, the paper will likelynever be read.2.2 The second passIn the second pass, read the paper with greater care, butignore details such as proofs. It helps to jot down the keypoints, or to make comments in the margins, as you read.1. Look carefully at the figures, diagrams and other illus-trations in the paper. Pay special attention to graphs.Are the axes properly labeled? Are results shown witherror bars, so that conclusions are statistically sig-nificant? Common mistakes like these will separaterushed, shoddy work from the truly excellent.2. Remember to mark relevant unread references for fur-ther reading (this is a good way to learn more aboutthe background of the paper).ACM SIGCOMM Computer Communication Review83Volume 37, Number 3, July 2007
Page 2 The second pass should take up to an hour. After thispass, you should be able to grasp the content of the paper.You should be able to summarize the main thrust of the pa-per, with supporting evidence, to someone else. This level ofdetail is appropriate for a paper in which you are interested,but does not lie in your research speciality.Sometimes you won’t understand a paper even at the endof the second pass. This may be because the subject matteris new to you, with unfamiliar terminology and acronyms.Or the authors may use a proof or experimental techniquethat you don’t understand, so that the bulk of the pa-per is incomprehensible. The paper may be poorly writtenwith unsubstantiated assertions and numerous forward ref-erences. Or it could just be that it’s late at night and you’retired. You can now choose to: (a) set the paper aside, hopingyou don’t need to understand the material to be successfulin your career, (b) return to the paper later, perhaps afterreading background material or (c) persevere and go on tothe third pass.2.3 The third passTo fully understand a paper, particularly if you are re-viewer, requires a third pass. The key to the third passis to attempt to virtually re-implement the paper: that is,making the same assumptions as the authors, re-create thework. By comparing this re-creation with the actual paper,you can easily identify not only a paper’s innovations, butalso its hidden failings and assumptions.This pass requires great attention to detail. You shouldidentify and challenge every assumption in every statement.Moreover, you should think about how you yourself wouldpresent a particular idea. This comparison of the actualwith the virtual lends a sharp insight into the proof andpresentation techniques in the paper and you can very likelyadd this to your repertoire of tools. During this pass, youshould also jot down ideas for future work.This pass can take about four or five hours for beginners,and about an hour for an experienced reader. At the endof this pass, you should be able to reconstruct the entirestructure of the paper from memory, as well as be able toidentify its strong and weak points. In particular, you shouldbe able to pinpoint implicit assumptions, missing citationsto relevant work, and potential issues with experimental oranalytical techniques.3. DOING A LITERATURE SURVEYPaper reading skills are put to the test in doing a literaturesurvey. This will require you to read tens of papers, perhapsin an unfamiliar field. What papers should you read? Hereis how you can use the three-pass approach to help.First, use an academic search engine such as Google Scholaror CiteSeer and some well-chosen keywords to find three tofive recent papers in the area. Do one pass on each pa-per to get a sense of the work, then read their related worksections. You will find a thumbnail summary of the recentwork, and perhaps, if you are lucky, a pointer to a recentsurvey paper. If you can find such a survey, you are done.Read the survey, congratulating yourself on your good luck.Otherwise, in the second step, find shared citations andrepeated author names in the bibliography. These are thekey papers and researchers in that area. Download the keypapers and set them aside. Then go to the websites of thekey researchers and see where they’ve published recently.That will help you identify the top conferences in that fieldbecause the best researchers usually publish in the top con-ferences.The third step is to go to the website for these top con-ferences and look through their recent proceedings. A quickscan will usually identify recent high-quality related work.These papers, along with the ones you set aside earlier, con-stitute the first version of your survey. Make two passesthrough these papers. If they all cite a key paper that youdid not find earlier, obtain and read it, iterating as neces-sary.4. EXPERIENCEI’ve used this approach for the last 15 years to read con-ference proceedings, write reviews, do background research,and to quickly review papers before a discussion. This dis-ciplined approach prevents me from drowning in the detailsbefore getting a bird’s-eye-view. It allows me to estimate theamount of time required to review a set of papers. More-over, I can adjust the depth of paper evaluation dependingon my needs and how much time I have.5. RELATED WORKIf you are reading a paper to do a review, you should alsoread Timothy Roscoe’s paper on “Writing reviews for sys-tems conferences” [1]. If you’re planning to write a technicalpaper, you should refer both to Henning Schulzrinne’s com-prehensive web site [2] and George Whitesides’s excellentoverview of the process [3].6. A REQUESTI would like to make this a living document, updating itas I receive comments. Please take a moment to email meany comments or suggestions for improvement. You can alsoadd comments at CCRo, the online edition of CCR [4].7. ACKNOWLEDGMENTSThe first version of this document was drafted by my stu-dents: Hossein Falaki, Earl Oliver, and Sumair Ur Rahman.My thanks to them. I also benefited from Christophe Diot’sperceptive comments and Nicole Keshav’s eagle-eyed copy-editing.This work was supported by grants from the NationalScience and Engineering Council of Canada, the CanadaResearch Chair Program, Nortel Networks, Microsoft, IntelCorporation, and Sprint Corporation.8. REFERENCES[1] T. Roscoe, “Writing Reviews for SystemsConferences,”http://people.inf.ethz.ch/troscoe/pubs/review-writing.pdf.[2] H. Schulzrinne, “Writing Technical Articles,”http://www.cs.columbia.edu/ hgs/etc/writing-style.html.[3] G.M. Whitesides, “Whitesides’ Group: Writing aPaper,”http://www.che.iitm.ac.in/misc/dd/writepaper.pdf.[4] ACM SIGCOMM Computer Communication ReviewOnline, http://www.sigcomm.org/ccr/drupal/.
神马文学网