EMMAA Models Page

The models page contains detailed information about the selected model in four tabs: Model, Tests, Papers, and Curation. At the top of the page the selected model is shown in a drop-down menu. Another model can also be selected and loaded from the menu.

Model Tab

The model tab contains model info with the model description, the date the model was last updated and the date when the displayed state of the model was generated. By default the latest available state of the model is displayed but the user has an option to explore earlier states by clicking on an earlier time point on any of the time plots across the tabs (for more details see: Load Previous State of Model). Links to the NDEx website where a network view of the model can be examined and to the Twitter account if available are provided. It is possible to download the models in various formats and the corresponding buttons are placed next.

The page also displays properties of the current state of the model, namely, the distribution of statement types, the top 10 agents in the model, the distribution of knowledge sources (reading systems and databases) of model statements and the statements with the most support from various knowledge bases. The table with most supported statements also has a button “All statements” clicking on which a user can be redirected to a page showing all statements in the model: EMMAA All Statements Page. Further, the page shows how the number of statements in the model has evolved over time, and which statements were added to the model during the most recent update.

../_images/aml_model_tab.png

The top of the model tab

Tests Tab

At the top of the tests tab, a drop down menu displays which test corpus was used for the currently displayed test results. Clicking on the drop down menu will display all available test corpora for the current model. Clicking “Load Test Results” will load the test results for the selected test corpus.

../_images/test_corpus_selection_cropped.png

The results from different test corpora can be loaded. Here “Rasmodel Tests”, “Skcm tests”, “Rasmachine Tests”, and “Large Corpus Tests” are available.

The tests tab contains two related plots: one showing the evolution over time of the percentage of applicable tests that passed, and another showing the absolute number of tests that were applied to the model and the number of tests that passed in each of supported model types. For the first few months of the project, the tests were only run on a PySB model assembled from EMMAA model statements. Later three additional model types were added, namely, PyBEL graph, signed directed graph and unsigned directed graph.

../_images/rasmachine_tests_tab_top.png

The top of the tests tab showing the percentage of tests passed together with applied and passed tests in different model types

If any new tests were applied in the latest test run of the model they are shown under New Applied Tests. A green check mark is shown for tests that passed and a red cross is shown for the tests that did not. The marks can be clicked on and link to a detailed test results page where the detailed path(s) or a reason for the model not having passed the test will be shown. To read more about the detailed test results page, see: EMMAA Detailed Test or Query Results.

../_images/new_applied_tests.png

If new tests were applied, they will be shown together with a breakdown of a test status per each model type

New tests that passed for any of the model types are shown under New Passed Tests along with the top path found. The statements supporting the path are can be seen by clicking on a path which links out to the detailed test results page for the test.

../_images/new_passed_tests.png

If new tests were passed, they will be shown together with a top path

Further down, all tests applied to the model are shown. Similarly to new applied tests, this table also contains green and red marks indicating the test status, linking to detailed test results page.

../_images/all_test_results.png

Part of the list showing all applied tests with a status indicator for passed/failed

Papers Tab

The Papers tab shows statistics for both processed papers and papers that support assembled model statements. At the top of the Papers tab the time series plot shows the changes in the counts of both paper groups over time.

../_images/papers_over_time.png

Number of processed papers and papers with assembled model statements over time

Further down, papers with the largest number of assembled statements are shown. The statements extracted for each paper can be viewed by clicking on a paper title (see: EMMAA Individual Paper Page).

Finally, a list of papers processed after the previos update is displayed. The table is sorted first by the number of assembled statements and then by the number of raw statements extracted from the paper. One or both of these numbers can be zero. Zero assembled statements with a positive number of raw statements means that the raw statements were filtered from the model during the assembly process. Two zeros mean that the paper was processed but no statements were extracted from it. The second column in this table provides a link to the original publication as an external resource.

../_images/new_papers.png

Example of new processed papers table

Curation Tab

The Curation tab summarizes statistics related to curations for statements that are part of the model. At the top of the tab two barplots show the counts of evidences and assembled statements curated by individual curators.

../_images/curators.png

Counts of evidences and statements curated by individual curators

The next plot shows the number of curations grouped by type.

../_images/curation_types.png

Curations grouped by type

Finally, the number of curated statements and evidences over time is shown.

../_images/curation_over_time.png

Curations over time

Load Previous State of Model

To view the state of the selected model together with the test results for a particualar date, click on any data point for the desired date in any of the time series shown on either the Model tab, the Tests tab or the Papers tab.

../_images/time_machine_selection_cropped.png

Clicking on a data point in any time series will link to the state of the model and the test results for the associated date.

Clicking the data point will link back to the same models page with data loaded for the selected date. The model info section displays the selected date as well as the date for the most recent data. Any time series show data up to the selected date. Any section showing new updates, such as “New Passed Tests”, shows what was new on the selected date while “All Test Results” shows the state of the results were in. Clicking on “Go To Latest” on the top panel will link back to the most recent state of the model.

../_images/previous_date_cropped.png

When the state of the model for a previous date is shown, the date is diplayed in “Data Displayed”. Clicking on “Go To Latest” on the top panel will link back to the most recent state of the model