DBpedia Release Evaluation: Difference between revisions

From Mediawiki1
Jump to navigationJump to search
No edit summary
No edit summary
Line 9: Line 9:
|-
|-
! Category
! Category
! Cases
! DBpedia 3.5.1
! DBpedia 3.5.1
! DBpedia 3.6
! DBpedia 3.6
Line 14: Line 15:
|-
|-
| Total
| Total
| 1504
| 45,7%
| 45,7%
| 60,2%
| 60,2%
Line 19: Line 21:
|-
|-
| Plain Property
| Plain Property
| 514
| 80,5%
| 80,5%
| 83,7%
| 83,7%
Line 24: Line 27:
|-
|-
| Number-Unit
| Number-Unit
| 51
| 68,6%
| 68,6%
| 68,6%
| 68,6%
Line 29: Line 33:
|-
|-
| Coordinate
| Coordinate
| 36
| 100,0%
| 100,0%
| 100,0%
| 100,0%
| 100,0%
| 100,0%
|- style="background: orange"
|-  
| Interval
| Interval
| 22
| 72,7%
| 72,7%
| 68,2%
| 68,2%
Line 39: Line 45:
|-
|-
| List
| List
| 478
| 33,9%
| 33,9%
| 75,7%
| 75,7%
Line 44: Line 51:
|-
|-
| One-Property-Table
| One-Property-Table
| 242
| 5,4%
| 5,4%
| 5,8%
| 5,8%
Line 49: Line 57:
|-
|-
| Multi-Poprty-Table
| Multi-Poprty-Table
| 83
| 0,0%
| 0,0%
| 0,0%
| 0,0%
Line 54: Line 63:
|-
|-
| Open Property
| Open Property
| 13 | style="background: orange" |
| 23,1%
| 23,1%
| 23,1%
| 23,1%
Line 59: Line 69:
|-
|-
| Open Property Table
| Open Property Table
| 0
| na
| na
| na
| na
Line 64: Line 75:
|-
|-
| Internal Template
| Internal Template
| 58
| 8,6%
| 8,6%
| 10,3%
| 10,3%
Line 69: Line 81:
|-
|-
| Merged Properties
| Merged Properties
| 7
| 57,1%
| 57,1%
| 57,1%
| 57,1%

Revision as of 15:08, 14 September 2011

DBpedia Release Evaluation

The Quality Assessment Framework (QAF) is developed to document the quality of the knowledge base and furthermore the progress of DBpedia's extraction framework. The main idea of the QAF is a comparison between a manually created best-case dataset and the output from DBpedia's ontology based extraction. The QAF estimates the precision of the extraction framework and the completeness (recall) of DBpedia compared to its source Wikipedia.

Evaluation Results

Completeness / Recall (fixed mappings from 3.5.1)
Category Cases DBpedia 3.5.1 DBpedia 3.6 DBpedia 3.7
Total 1504 45,7% 60,2% 61,8%
Plain Property 514 80,5% 83,7% 86,0%
Number-Unit 51 68,6% 68,6% 66,7%
Coordinate 36 100,0% 100,0% 100,0%
Interval 22 72,7% 68,2% 72,7%
List 478 33,9% 75,7% 77,8%
One-Property-Table 242 5,4% 5,8% 5,8%
Multi-Poprty-Table 83 0,0% 0,0% 0,0%
Open Property style="background: orange" | 23,1% 23,1% 30,8%
Open Property Table 0 na na na
Internal Template 58 8,6% 10,3% 10,3%
Merged Properties 7 57,1% 57,1% 71,4%
Precision (fixed mappings from 3.5.1)
Category DBpedia 3.5.1 DBpedia 3.6 DBpedia 3.7
Total 91,2% 92,3% 92,4%
Plain Property 96,3% 96,6% 97,4%
Number-Unit 85,4% 85,4% 85,0%
Coordinate 100,0% 100,0% 100,0%
Interval 100,0% 100,0% 88,9%
List 91,5% 92,8% 93,2%
One-Property-Table 32,5% 36,8% 34,1%
Multi-Poprty-Table na na na
Open Property 100,0% 100,0% 100,0%
Open Property Table na na na
Internal Template 83,3% 75,0% 75,0%
Merged Properties 80,0% 80,0% 100,0%
Retrieved from "https://mediawiki1.informatik.uni-mannheim.de/index.php?title=DBpedia_Release_Evaluation&oldid=15123"