DBpedia datasets: Difference between revisions
From Mediawiki1
Jump to navigationJump to search
No edit summary |
(use some extractors for all languages, not just en) |
||
| Line 21: | Line 21: | ||
|article-categories<!-- | |article-categories<!-- | ||
ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ||
| | |yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes | ||
|- | |- | ||
|[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/CategoryLabelExtractor.scala CategoryLabelExtractor] | |[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/CategoryLabelExtractor.scala CategoryLabelExtractor] | ||
|category-labels<!-- | |category-labels<!-- | ||
ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ||
| | |yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes | ||
|- | |- | ||
|[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/DisambiguationExtractor.scala DisambiguationExtractor] | |[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/DisambiguationExtractor.scala DisambiguationExtractor] | ||
| Line 36: | Line 36: | ||
|external-links<!-- | |external-links<!-- | ||
ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ||
| | |yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes | ||
|- | |- | ||
|[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/GeoExtractor.scala GeoExtractor] | |[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/GeoExtractor.scala GeoExtractor] | ||
| Line 76: | Line 76: | ||
|page-links<!-- | |page-links<!-- | ||
ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ||
| | |yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes | ||
|- | |- | ||
|[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/PageLinksExtractor.scala PageLinksExtractor] | |[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/PageLinksExtractor.scala PageLinksExtractor] | ||
| Line 96: | Line 96: | ||
|redirects<!-- | |redirects<!-- | ||
ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ||
| | |yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes | ||
|- | |- | ||
|[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/RevisionIdExtractor.scala RevisionIdExtractor] | |[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/RevisionIdExtractor.scala RevisionIdExtractor] | ||
|revisions<!-- | |revisions<!-- | ||
ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ||
| | |yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes | ||
|- | |- | ||
|[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/SkosCategoriesExtractor.scala SkosCategoriesExtractor] | |[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/SkosCategoriesExtractor.scala SkosCategoriesExtractor] | ||
|skos-categories<!-- | |skos-categories<!-- | ||
ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ar bg bn ca cs de el en es eu fr ga hi hr hu it ja ko nl pl pt ru sl tr all --> | ||
| | |yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes||yes | ||
|- | |- | ||
|[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/WikiPageExtractor.scala WikiPageExtractor] | |[http://dbpedia.hg.sourceforge.net/hgweb/dbpedia/extraction_framework/file/default/core/src/main/scala/org/dbpedia/extraction/mappings/WikiPageExtractor.scala WikiPageExtractor] | ||
Revision as of 16:46, 15 May 2012
In the main DBpedia release, which extractors run for which language?
Combinations that are not explicitly set to no may be useful but are currently not used in the main DBpedia release.
You can add settings here, but be aware that they will not automatically have an effect on any extraction process. The real settings are in the repository in dump/extract.default.properties. One fine day, the extraction framework will read configuration pages similar to this one from the mappings wiki, but not yet. Not for a while. If you add or change settings here, please also send a message to dbpedia-developers@lists.sourceforge.net.
This matrix was mostly generated from dump/extract.default.properties, with some manual additions.
| Extractor | Files | ar | bg | bn | ca | cs | de | el | en | es | eu | fr | ga | hi | hr | hu | it | ja | ko | nl | pl | pt | ru | sl | tr | all |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AbstractExtractor | long-abstracts short-abstracts |
yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
| ArticleCategoriesExtractor | article-categories | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
| CategoryLabelExtractor | category-labels | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
| DisambiguationExtractor | disambiguation-links | yes | yes | yes | yes | yes | yes | yes | yes | yes | ||||||||||||||||
| ExternalLinksExtractor | external-links | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
| GeoExtractor | geo-coordinates | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
| HomepageExtractor | homepages | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | ||||||||||||||
| ImageExtractor | images | yes | yes | yes | yes | yes | yes | |||||||||||||||||||
| InfoboxExtractor | infoboxes infobox-properties |
yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
| InterLanguageLinksExtractor | same-as | yes | yes | yes | yes | yes | ||||||||||||||||||||
| LabelExtractor | labels | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
| MappingExtractor | ontology-types ontology-properties specific-properties |
yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | no |
| PageIdExtractor | page-links | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
| PageLinksExtractor | page-links | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
| PersondataExtractor | persondata | yes | yes | |||||||||||||||||||||||
| PndExtractor | pnd | yes | yes | |||||||||||||||||||||||
| RedirectExtractor | redirects | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
| RevisionIdExtractor | revisions | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
| SkosCategoriesExtractor | skos-categories | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
| WikiPageExtractor | links-to-wikipedia-article | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes | yes |
