Code

Added JORS scraper and tests#28

Code

Open

npch wants to merge 119 commits intoContentMine:masterContentMine/journal-scrapers:masterfrom npch:masternpch/journal-scrapers:masterCopy head branch name to clipboard

+6,873-69

Commits

Commits on May 26, 2014

• Update README.md

  blahah

  committed
  1ecac9e

Commits on May 27, 2014

• update example

  blahah

  committed
  e05e2a3

• fix README formatting and typo

  blahah

  committed
  a35fecd

Commits on May 29, 2014

• add html and text special attributes to README

  blahah

  committed
  acb9e7c

Commits on Jun 1, 2014

• Update README.md

  blahah

  committed
  a2a6d26

Commits on Jun 19, 2014

• Create science_direct.json

  Show description for ebea30a
  ianthe

  committed
  ebea30a

• Merge pull request ContentMine#5 from ianthe/master

  Show description for f6380f9
  blahah

  committed
  f6380f9

Commits on Jun 22, 2014

• travis setup

  

  Richard Smith

  committed
  40b80a4

• auto test generation script

  

  Richard Smith

  committed
  13ef95b

• move scrapers to subdir

  

  Richard Smith

  committed
  073a4da

• test generator script fixes

  

  Richard Smith

  committed
  4962bab

• self-populating tests and peerj example

  

  Richard Smith

  committed
  cdb542b

• Merge branch 'master' of github.com:ContentMine/journal-scrapers

  

  Richard Smith

  committed
  3118404

• move sciencedirect to scrapers

  

  Richard Smith

  committed
  0ee30be

• fix tmpdir use

  

  Richard Smith

  committed
  c1cafdd

• debug test generator tmpdir error

  

  Richard Smith

  committed
  1cdbd3b

• test set for peerj scraper

  

  Richard Smith-Unna

  committed
  9c82fa0

• fix test generator - now working

  

  Richard Smith-Unna

  committed
  4e94869

• fix test runner - now working

  

  Richard Smith-Unna

  committed
  ad734f3

• attempted fix for travis dependency install

  

  Richard Smith-Unna

  committed
  86c3735

• remove unneeded prints from tests

  

  Richard Smith-Unna

  committed
  1ce66d6

• tests for plos scraper

  

  Richard Smith-Unna

  committed
  bf2c926

• another attempted travis install fix

  

  Richard Smith

  committed
  9b1f20d

• delete wayward results file

  

  Richard Smith

  committed
  aa0cfc6

• add .gitignore

  

  Richard Smith

  committed
  998b0de

• add travis badge and explanation to README

  

  Richard Smith

  committed
  fb463a8

• tidy formatting in README

  blahah

  committed
  ab88faf

• add science direct tests

  

  Richard Smith-Unna

  committed
  8e9d287

• Merge branch 'master' of https://github.com/ContentMine/journal-scrapers

  

  Richard Smith-Unna

  committed
  04902e3

Commits on Jun 23, 2014

• add CC0 license

  blahah

  committed
  da2a0f2

• matching badges

  

  Richard Smith

  committed
  5ce546e

• fix badge address

  

  Richard Smith

  committed
  d1f3ddf

• coverage reporting for scrapers

  

  Richard Smith

  committed
  d5f7b08

• fix coverage reporting

  

  Richard Smith

  committed
  ac46bc2

• another coveralls fix

  

  Richard Smith

  committed
  29b9cce

• another coveralls fix

  

  Richard Smith

  committed
  ed42173

• mend broken curl command

  

  Richard Smith

  committed
  622191f

• remove empty file

  

  Richard Smith

  committed
  1a82584

• fix coveralls CURL command

  

  Richard Smith

  committed
  396b658

• add coveralls to README

  

  Richard Smith

  committed
  641c260

• make travis badges consistent

  

  Richard Smith

  committed
  a443c18

• another CURL cmd fix

  

  Richard Smith

  committed
  09c6410

• add contribution instructions

  

  Richard Smith

  committed
  04d5300

• fix typo; finalise self-testing (fixes ContentMine#4)

  

  Richard Smith

  committed
  3d6e3a7

• add TOC to README

  

  Richard Smith

  committed
  2340fa3

• prettify TOC

  

  Richard Smith

  committed
  222a00a

• tidy TOC

  

  Richard Smith

  committed
  9d189bc

Commits on Jun 24, 2014

• coveralls submission recognises travis environment

  

  Richard Smith

  committed
  9ffe438

• typo

  

  Richard Smith

  committed
  34c4606

Commits on Jul 2, 2014

• peerj scraper now implements all ContentMine fields

  

  Richard Smith

  committed
  e60fe56

• fix contributing doc links

  blahah

  committed
  7317635

Commits on Jul 3, 2014

• run tests in debug mode

  

  Richard Smith

  committed
  905c04c

• Merge branch 'master' of github.com:ContentMine/journal-scrapers

  

  Richard Smith

  committed
  4370307

Commits on Jul 4, 2014

• install libfontconfig before running travis tests

  

  Richard Smith

  committed
  7198106

Commits on Jul 13, 2014

• fix broken peerj tests

  blahah

  committed
  a5746a3

• link out to scraperJSON

  

  Richard Smith

  committed
  2901ab4

• handle mac MD5hash

  

  Richard Smith

  committed
  3746fcc

• MDPI full

  

  Richard Smith

  committed
  187846b

Commits on Jul 16, 2014

• Extract abstract from PLOS pages

  CristianCantoro

  committed
  4f239fa

Commits on Jul 17, 2014

• Merge pull request ContentMine#9 from CristianCantoro/master

  Show description for 62752cd
  blahah

  committed
  62752cd

• add renaming to all scrapers

  

  Richard Smith

  committed
  f64dd8d

• make test line counting more accurate

  

  Richard Smith

  committed
  cec7cf3

• Merge branch 'master' of github.com:ContentMine/journal-scrapers

  

  Richard Smith

  committed
  a736045

• update PLOS with fulltext xml and new tests

  

  Richard Smith

  committed
  dd8f6e0

• add fulltext_xml to MDPI

  

  Richard Smith

  committed
  f50850e

• add fulltext xml to compatible scrapers

  

  Richard Smith

  committed
  edb7635

• generate tests for MDPI

  blahah

  committed
  0ecc002

• elife scraper

  

  Richard Smith

  committed
  fac1fdc

• Merge branch 'master' of github.com:ContentMine/journal-scrapers

  

  Richard Smith

  committed
  ab4c14b

• elife tests

  blahah

  committed
  1c3648c

• update test coverage calculation with element names only

  

  Richard Smith

  committed
  0f25cdc

• Merge branch 'master' of github.com:ContentMine/journal-scrapers

  

  Richard Smith

  committed
  d5f611d

Commits on Jul 22, 2014

• Use Ruby Digest::MD5 instead of md5sum

  Show description for 34dafb0
  mcs07

  committed
  34dafb0

• added Acta Cryst E scraper; probably works with other IUCr journals but not tested

  petermr

  committed
  d0a3652

Commits on Jul 23, 2014

• added ACS(JACS) scraper; fails on resolving relative/absolute links

  petermr

  committed
  aa5a6dd

Commits on Jul 24, 2014

• remove broken scrapers to PRs

  

  Richard Smith

  committed
  1cf4191

Commits on Sep 1, 2014

• ACS Scraper - requires relative URL parsing from quickscrape

  pbulsink

  committed
  0803636

• AAAS (Science) Scraper - requires relative URL parsing from quickscrape

  pbulsink

  committed
  db82379

• Nature Scraper - requires relative URL parsing from quickscrape

  pbulsink

  committed
  a9e20aa

• Additional use of meta tags

  pbulsink

  committed
  6c721ff

• Wiley Scraper

  pbulsink

  committed
  79bbf52

Commits on Sep 2, 2014

• removed renames from download - doesn't properly work in urllist cases

  pbulsink

  committed
  6194072

• Added Springer Scraper

  pbulsink

  committed
  16da68f

• Taylor & Francis Scraper - Requires relative paths from quickscrape

  pbulsink

  committed
  957baa2

• URLLists for written scrapers

  pbulsink

  committed
  f124a0a

• Built test .json files

  pbulsink

  committed
  c9ef714

• Nature updates & Test

  pbulsink

  committed
  53700b0

• Removed Nature, ready for pull

  pbulsink

  committed
  d99cece

• Removed all new scrapers except for Nature

  pbulsink

  committed
  e6d6636

Commits on Sep 3, 2014

• Added PNAS scraper & test

  pbulsink

  committed
  b6ba671

• RSC Scrapers

  pbulsink

  committed
  159ec31

• JAMA and related sub-journal scraper

  pbulsink

  committed
  e6c738d

Commits on Sep 9, 2014

• Merge pull request ContentMine#23 from pbulsink/ready_to_pull

  Show description for 6ab5d56
  

  Richard Smith-Unna

  committed
  6ab5d56

Commits on Oct 2, 2014

• Merge pull request ContentMine#24 from pbulsink/nature

  Show description for 709796c
  

  Richard Smith-Unna

  committed
  709796c

• acs must be headless

  blahah

  committed
  062c419

• Merge pull request ContentMine#17 from mcs07/filehash

  Show description for f1b7463
  

  Richard Smith-Unna

  committed
  f1b7463

• Merge branch 'master' of github.com:ContentMine/journal-scrapers

  Show description for 97efc91
  blahah

  committed
  97efc91

• Merge branch 'master' of github.com:ContentMine/journal-scrapers

  blahah

  committed
  b211d99

• temporarily remove broken jama scraper

  blahah

  committed
  38d63e0

• remove broken science direct scraper

  blahah

  committed
  15bd207

• update tests for latest quickscrape

  blahah

  committed
  03dfee1

• specify quickscrape version

  blahah

  committed
  fbfc8c5

Commits on Oct 6, 2014

• bump quickscrape dependency

  

  Richard Smith-Unna

  committed
  f0f8c10

• don't include file hash results in coverage

  blahah

  committed
  28c7415

• Merge branch 'master' of github.com:ContentMine/journal-scrapers

  blahah

  committed
  f5c22d0

Commits on Oct 7, 2014

• migrate to nvm

  

  Richard Smith-Unna

  committed
  83d7ee0

• restart bash after nvm install

  

  Richard Smith-Unna

  committed
  a59d3f3

• travis comes with nvm!

  

  Richard Smith-Unna

  committed
  d0bf3f1

• need latest 0.10.32

  

  Richard Smith-Unna

  committed
  5a0ede7

• use latest npm

  

  Richard Smith-Unna

  committed
  e32730b

Commits on Jan 11, 2015

• peerj scraper is complete - showcase of latest scraperJSON

  blahah

  committed
  15e7f35

• Merge branch 'master' of github.com:ContentMine/journal-scrapers

  blahah

  committed
  b5992bb

• bump quickscrape dependency version

  blahah

  committed
  6dba241

• fix license path, improve copyright

  blahah

  committed
  120cd2a

• tests for license and copyright improvements

  blahah

  committed
  8bb4071

Commits on Jan 12, 2015

• added bmc and trialsjournal scrapers

  petermr

  committed
  23cbdd4

Commits on Feb 4, 2015

• updated plos scraper

  blahah

  committed
  bd636a5

• Merge branch 'master' of github.com:ContentMine/journal-scrapers

  blahah

  committed
  2b62bb4

Commits on Mar 30, 2015

• Added JORS scraper and tests

  npch

  committed
  f789f19