Project Guide
Design choices
Is the motivation for the study clearly explained? Were alternative designs considered? Do you have a clear understanding of why the final design was chosen over alternative designs? Why were treatment levels chosen as they were? Are the blocking variables important or do they seem arbitrary? Were other important sources of variation excluded? Is the randomization carefully explained?
Experiment
Was the experiment conducted according to the design? Was the experiment randomized properly? Were other blocking variables introduced over the course of the experiment? If changes were made in the design, have the experimenters explained the reason for these changes? In what way do these changes affect the analysis? Did any other complications arise over the course of the experiment? How were these complications handled and how might they affect the analysis?
Analysis
Was the correct model chosen for analysis? Are random and fixed effects correctly specified? Is any exploratory data analysis conducted? Is the final model different from the initial model? Is the process that led to the final model carefully explained? Do you agree with the process that led to the final model? Are model diagnostics run? Are proper adjustments made to the data and model in light of the diagnostic results? Are any final recommendations presented?
Presentation
Are graphs and tables easy to refer to? Are too many graphs and tables present? Are there any major mechanical (spelling, grammar, etc.) problems? Are there any major stylistic problems (poor organization, lack of transition elements, excessive use of passive voice)?