- Monday 21 September 2015: Read:
- Tutorial: Choosing what to model - Conceptual modeling for simulation, Robinson, S., Simulation Conference (WSC), Proceedings of the 2012 Winter, 9-12 Dec. 2012, Page(s): 1 - 12.
- So you have your model: what to do next. A tutorial on simulation output analysis, Martha A. Centeno and M. Florencia Reyes, WSC '98 Proceedings of the 30th conference on Winter simulation, Pages 23-30.

- Based on these two papers, what are the steps involved in doing a computer simulation project?

If you have not used Western's digital library before, you may have difficulty downloading the papers. If you are working from a computer with a Western IP address, then access should direct. However, if you are using a computer with a non-Western IP address, then you will most likely need to use the library's proxy server to access the papers. The login page for it is at http://www.lib.uwo.ca/. If you have trouble with that, either use the Library's help chat feature to find out what the difficulty is or visit the information desk at any of the University libraries.

- For Monday 28 September 2015 read:
- Simulation model verification and validation, Robert G. Sargent, WSC '91 Proceedings of the 23rd conference on Winter simulation, Pages 37-47.
- NetLogo implementation of an evacuation scenario, Almeida, J.E. ; Kokkinogenis, Z. ; and Rossetti, R.J.F., Information Systems and Technologies (CISTI), 2012 7th Iberian Conference on, 20-23 June 2012, Page(s): 1 - 4.

- To the list of steps associated with performing a simulation experiment that derived from last week's papers, what new steps do the verification and validation paper add to the process?
- Given the list of steps we now have for a simulation experiment, which of these steps do you see being reported in the `evacuation scenario' paper?
- Do you see any steps being taken in the `evacuation scenario' that haven't yet been discussed in the list of steps built up so far? If so, what steps are we still missing?

Note: the verification and validation paper also talks about confidence intevals. To get a sense of what it will mean to calculate them using R, look at 9. Calculating confidence intervals.

- For Monday 5 October 2015, read:
- AgriVillage: A Game to Foster Awareness of the Environmental Impact of Agriculture, Rui Prada, Helmut Prendinger, Panita Yongyuth, Arturo Nakasoneb, and Asanee Kawtrakulc, Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment, Volume 12 Issue 2, Summer 2014, 18 pages.

- In previous articles, there has been discussion of the need for the customer to believe in the simulation results and their relevance to the customer's concerns in order for the simulation to have been worth doing. Indicate where (page numbers) these concerns have appeared in past papers and how that relates to the simulation constructed in this paper.
- In order to build this simulation, conceptual models of farming and the environment had to be constructed. Where did the implementers get the necessary information so that they believed the model was providing the customer with useful information?
- Initially, the authors had a goal of improving people's understanding of the environmental impact of agriculture. What evidence did they provide that they actually accomplished this goal? What further work did they propose that might increase the evidence for the success of the project?
- What are the three most important points that this paper tells us about how to do this kind of simulation successfully?

- For Monday 26 October 2015 read:
- A network science approach to modelling and predicting empathy, Jayant Venkatanathan, Evangelos Karapanos, Vassilis Kostakos, and Jorge Goncalves, ASONAM '13 Proceedings of the 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, Pages 1395-1400.
- Errors and Artefacts in Agent-Based Modelling, Jose Manuel Galan, Luis R. Izquierdo, Segismundo S. Izquierdo, Jose Ignacio Santos, Ricardo del Olmo, Adolfo Lopez-Paredes and Bruce Edmonds (2009), Journal of Artificial Societies and Social Simulation vol. 12, no. 1 1.

- When I am looking at Figure 4 in the empathy paper and I see a dot that has a value of of -2 as the z value of number of friends, what does that mean? What is the difference between having a z value of number of friends of -2 and having -2 friends? [you may need to do some library or Internet searching to find the answer to this as the article doesn't explain what z values are.]
- If you were doing a simulation of communication in facebook friendship networks, how could you use the information in Figures 1, 2, 3, and 4 to validate your generated networks?
- In Section 3.20 of Errors and Artefacts, one suggestion is to ``apply the simulation model to relatively well understood and predictable situations to check that the obtained results are in agreement with the expected behavior''. In your simulation project for this course, are there such situations you could use for checking your simulation? If so, where can you find them? [If you haven't settled on an exact simulation, are there sources for such situations in your area? If so, where can you find them?]
- In Section 3.21 of Errors and Artefacts, it is suggested that you try different random number generators. What changes to the random number generator does NetLogo support?
- In Section 3.22 of Errors and Artefacts, it is suggested that you try extreme cases where the results are well understood. Are there examples of such cases relevant to your simulation project in this course?
- Can you list some of the accessory assumptions that your simulation will be making? If so, what are they?

- For Monday 2 November 2015:, read:
- Integrating BDI reasoning into agent based modeling and simulation, Lin Padgham, David Scerri, Gaya Jayatilleke, and Sarah Hickmott, Integrating BDI reasoning into agent based modeling and simulation, WSC '11 Proceedings of the Winter Simulation Conference, Pages 345-356.
- User understanding of cognitive processes in simulation: a tool for exploring and modifying, David Scerri, Sarah Hickmott, and Lin Padgham, WSC '12 Proceedings of the Winter Simulation Conference, Article No. 240, 12 pages.

- In Section 5 of the AgriVillage paper, the system architecture of AgriVillage is described. What issues are addressed in that section that also arise in the 2011 Integrating BDI Reasoning Into Agent Based Modelling and Simulation paper? What are the main differences in terms of how these two systems are structured? What are their similarities? [three paragraphs should be plenty here, one for each of these questions.]
- In the first paragraph of Section 4.2 of the 2012 User Understanding of Cognitive Processes in Simulation: A Tool for Exploring and Modifying, we have the quote: ``It is well understood that control is an important aspect of immersion, which improves the likelihood of learning''. How is this same point made in the AgriVillage paper?
- How is the `user' learning in the 2012 paper and how does this differ from how the `user' learns in the AgriVillage paper? Which way would you prefer to learn?

- Monday 9 November 2015: Please read:
- Statistical analysis of simulation output, Nakayama, M.K., Simulation Conference, 2008. WSC 2008. Winter, 7-10 Dec. 2008, Page(s): 62 - 72
- Prospects and Pitfalls of Statistical Testing: Insights from Replicating the Demographic Prisoner's Dilemma, Wolfgang Radax and Bernhard Rengs (2010), Journal of Artificial Societies and Social Simulation 13 (4) 1.

- Referring to the Nakayama paper, lets assume we do 100 i.i.d. runs
and every time we get the result 50. Show your calculations for the following:
- What is the sample mean of my results?
- What is the sample standard deviation of my results?
- what is the value of the half width of the confidence interval that covers the true mean 95% of the time?
- If I want to be with 0.1 of the average with 95% chance, what how many runs do I need to make?

- Referring to the Nakayama paper, lets assume we do 100 i.i.d. runs
and fifty times I get 49 and fifty times I get 51. Show your calculations
for the following:
- What is the sample mean of my results?
- What is the sample standard deviation of my results?
- what is the value of the half width of the confidence interval that covers the true mean 95% of the time?
- If I want to be with 0.1 of the average with 95% chance, what how many runs do I need to make?

- What limitations does the paper place on the useful of its confidence interval calculations for transient measures? What, on the web, can you find out about what to do when the method in this paper is inaccurate?
- Consider the NetLogo dining philosopher's simulation and the modifications I made to it to determine whether or not it stopped. Given the issues raised in the prospects and pitfalls paper and that the solution isn't just to turn over the source listing, what information am I going to need to gather so that I can report on the `average time for the dining philosophers with no cooperation and 10 philosophers' to deadlock in a way that others can replicate my work?

- Monday 23 November 2015: Please read:
- Visualization of complex data relationships and maps: using the BLOOM platform to provide business insights, Frank Horsfall, Stoyan Tanev, Boyan Bontchev, Todor Gigilev, and Angel Gruev, CompSysTech '11 Proceedings of the 12th International Conference on Computer Systems and Technologies, Pages 266-272.
- Modeling and Visualization Individual and Collective Opinions towards Extremism in a Society, Vinicius Nonnenmacher, Luiz Paulo L. de Oliveira, Marta B. Villamil, , Bardo E.J. Bodmann, 2014 International Conference on Computational Science, Procedia Computer Science, Volume 29, 2014, Pages 2412-2421.

- Which of these two papers did you find most interesting? Why?
- What do you think the authors of the other paper (the one you don't find most interesting) should have done to make their paper more interesting?