User:LuisVilla/sandbox/citoidtest

From Wikipedia, the free encyclopedia

List of sites tested[edit]

List of top enwiki sources drawn from overlap of WebEmpires data and ad-hoc internal query

  1. books.google.com
  2. web.archive.org
  3. www.imdb.com
  4. news.bbc.co.uk
  5. youtube.com
  6. nytimes.com
  7. guardian.co.uk
  8. webcitation.org

And a few others from just one of the two searches, to capture some sources that are widely used in particular groups or otherwise might be useful to capture:

  1. allmusic.com
  2. sports-reference.com
  3. bbc.co.uk (in case there is a better parser for one of the sites from news.bbc.co.uk)
  4. amazon.com

Some sites that were in a top list, but that I didn't test:

  1. viaf (appears to be mostly from templates; tested anyway but both tools do basically nothing)
  2. toolserver.org (no standardized layout/metadata)
  3. stat.gov.pl (first 10-20 links I found were all 404, so hard to know what is typical)
  4. insee.fr (hard to know what "typical" page is on this site, but in first test page I found Citoid had a bug)
  5. iucnredlist.org (appears to be mostly from templates; Citoid is very minimally better in quick testing)

Next batch of news sites to test (from WebEmpires to 20-30):

  1. time.com
  2. independent.co.uk
  3. washingtonpost.com
  4. billboard.com (also on internal query list)

Other sites from SQL query (probably from templates, so not tested in first round)

  1. worldcat.org (600K links)
  2. http://amigo.geneontology.org/amigo (160K links)
  3. www.ncbi.nlm.nih.gov (145K links)
  4. nrhp.focus.nps.gov (145k links)
  5. isni-url.oclc.nl (140K links)
  6. scholar.google.com (126k)
  7. www.nlm.nih.gov (121k)
  8. id.loc.gov (110k)
  9. geonames.usgs.gov (108k)

Testing[edit]

Site Refill Citoid "Winner" Comments
Google Books "Alain Locke". google.com. Buck, Christopher (2005). Alain Locke: Faith and Philosophy. Kalimat Press. ISBN 9781890688387. Citoid
Archive.org "Saving Mr. Lincoln". cia.gov. Archived from the original on 11 July 2007. "Saving Mr. Lincoln — Central Intelligence Agency". 2007-07-11. Refill Request to improve citoid's treatment of archive.org filed as [1]
IMDB Mino (21 November 1990). "Predator 2 (1990)". IMDb. Predator 2, 21 Nov 1990 - Push because of weird/incorrect author data from IMDB (and inconsistent - gave me different results on different runs), poor data from Citoid. Lack of citoid publisher information is filed as [2]
News.bbc.co.uk "BBC News - BUSINESS - WTO intervenes in Havana rum clash". bbc.co.uk. "WTO intervenes in Havana rum clash". BBC. 2002/01/02. {{cite news}}: Check date values in: |date= (help) Citoid Push because of date value bug; Citoid is obviously better otherwise.

Older page, may not be representative; date value bug is filed as [3]

Youtube Werner Herzog Eats His Shoe (1980). YouTube. 7 September 2011. Werner Herzog Eats His Shoe (1980), 2011-09-07 Refill Lack of publisher in citoid is filed as [4]
NY Times Blacklisted Segal, David (2014-11-10). "Harold Hamm to Pay One of the Biggest Divorce Settlements in History". The New York Times. ISSN 0362-4331. Citoid
Guardian Spencer Ackerman. "The disappeared: Chicago police detain Americans at abuse-laden 'black site'". the Guardian. Chicago, Spencer Ackerman in. "The disappeared: Chicago police detain Americans at abuse-laden 'black site'". the Guardian. Refill Citoid name problem filed as [5]
Webcitation Blacklisted "WebCite query result". www.webcitation.org. {{cite web}}: Cite uses generic title (help) Citoid?
All Music Mark Deming. "Beat the Champ - The Mountain Goats - Songs, Reviews, Credits, Awards - AllMusic". AllMusic. Songs, Reviews, Credits, Awards | AllMusic"]. AllMusic. Refill Neither of these are great, but at least refill gets author information.
Sports Reference "Tim Duncan". College Basketball at Sports-Reference.com. "Tim Duncan". College Basketball at Sports-Reference.com. -
Amazon "Average Is Over: Powering America Beyond the Age of the Great Stagnation: Tyler Cowen: 9780525953739: Amazon.com: Books". amazon.com. Cowen, Tyler (September 12, 2013). Average Is Over: Powering America Beyond the Age of the Great Stagnation. Dutton. ISBN 9780525953739. Citoid
BBC.com (not news.bbc.co.uk) "'Five-legged sheep' Quinto gives birth to twins in Morpeth". BBC News. "'Five-legged sheep' Quinto gives birth to twins in Morpeth". Refill Lack of publisher is filed as [6]

Observations on testing:

  • Same-ish results for 2 sites (of 12)
    • 1 site (Sports Reference) basically same (no useful metadata in either case)
    • 1 site (IMDB) both tools are missing or screwing up some structured data
  • Refill is better in 5 of remaining 10:
    • 2 sites (AllMusic, Archive.org) Refill is significantly better (e.g., sees per-page structured data like author name that Citoid does not)
    • 2 sites (BBC, YouTube), Refill is slightly better because of missing publisher information in Citoid. (This could be easy to fix for Citoid.)
    • 1 site (Guardian), both attempt to get similar metadata, but Citoid's attempt has a bug that may be difficult to fix.
  • Citoid is better in 5 of remaining 10:
    • 3 sites (Google Books, Amazon, NYT), Citoid is vastly better (e.g., uses news or book template; draws structured data like ISBNs, publication dates, etc.)
    • 1 site (news.bbc.co.uk), Citoid is better (sees structured data Refill doesn't) but also has a fixable bug.
    • 1 site (webcitation), Citoid gets mediocre data but Refill is blacklisted, so Citoid is at least slightly better?

Raw Citoid (note that "retrieved" is removed from table above, since that is a policy choice rather than a bug/feature)[edit]

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]

[12]

Raw refs (used to test Refill)[edit]

  1. [13]
  2. [14]
  3. [15]
  4. [16]
  5. [17]
  6. [18]
  7. [19]
  8. [20]
  9. [21]
  10. [22]
  11. [23]
  12. [24]

Reference list[edit]

  1. ^ Buck, Christopher (2005). Alain Locke: Faith and Philosophy. Kalimat Press. ISBN 9781890688387. Retrieved 2015-04-11.
  2. ^ "Saving Mr. Lincoln — Central Intelligence Agency". 2007-07-11. Retrieved 2015-04-11.
  3. ^ Predator 2, 21 Nov 1990, retrieved 2015-04-11
  4. ^ "'Five-legged sheep' Quinto gives birth to twins in Morpeth". Retrieved 2015-04-11.
  5. ^ Werner Herzog Eats His Shoe (1980), 2011-09-07, retrieved 2015-04-11
  6. ^ Segal, David (2014-11-10). "Harold Hamm to Pay One of the Biggest Divorce Settlements in History". The New York Times. ISSN 0362-4331. Retrieved 2015-04-11.
  7. ^ Chicago, Spencer Ackerman in. "The disappeared: Chicago police detain Americans at abuse-laden 'black site'". the Guardian. Retrieved 2015-04-11.
  8. ^ "WebCite query result". www.webcitation.org. Retrieved 2015-04-11. {{cite web}}: Cite uses generic title (help)
  9. ^ "Beat the Champ - The Mountain Goats | Songs, Reviews, Credits, Awards | AllMusic". AllMusic. Retrieved 2015-04-11.
  10. ^ "Tim Duncan". College Basketball at Sports-Reference.com. Retrieved 2015-04-11.
  11. ^ Cowen, Tyler (September 12, 2013). Average Is Over: Powering America Beyond the Age of the Great Stagnation. Dutton. ISBN 9780525953739. Retrieved 2015-04-11.
  12. ^ "WTO intervenes in Havana rum clash". BBC. 2002/01/02. Retrieved 2015-04-11. {{cite news}}: Check date values in: |date= (help)
  13. ^ http://books.google.com/books?id=JR_DF2MRlsIC&pg=PA64
  14. ^ https://web.archive.org/web/20070711073824/https://www.cia.gov/library/publications/additional-publications/civil-war/SML.htm
  15. ^ http://www.imdb.com/title/tt0100403/?ref_=nv_sr_3
  16. ^ http://www.bbc.com/news/uk-england-tyne-31552307
  17. ^ https://www.youtube.com/watch?v=CGcWTIWYDMQ
  18. ^ http://www.nytimes.com/2014/11/11/business/harold-hamm-oklahoma-oilman-billion-dollar-divorce.html?partner=socialflow&smid=tw-nytimesbusiness&_r=0&gwh=E4DA2DFD939D74AD598A1EBC2F5C1FA5&gwt=pay&assetType=nyt_now
  19. ^ http://www.theguardian.com/us-news/2015/feb/24/chicago-police-detain-americans-black-site
  20. ^ http://www.webcitation.org/query?url=http://www.geocities.com/mepleasant.geo/mep.html&date=2009-10-26+02:31:19
  21. ^ http://www.allmusic.com/album/beat-the-champ-mw0002834089
  22. ^ http://www.sports-reference.com/cbb/players/tim-duncan-1.html
  23. ^ http://www.amazon.com/dp/0525953736/
  24. ^ http://news.bbc.co.uk/2/hi/business/1739589.stm
Retrieved from "https://en.wikipedia.org/w/index.php?title=User:LuisVilla/sandbox/citoidtest&oldid=1066547185"