Skip to content
This repository has been archived by the owner on Oct 29, 2019. It is now read-only.

Finalize and test customcrawls data together endpoint #17

Open
ebenp opened this issue Oct 27, 2017 · 2 comments
Open

Finalize and test customcrawls data together endpoint #17

ebenp opened this issue Oct 27, 2017 · 2 comments
Labels
doc-sprint ready

Comments

@ebenp
Copy link
Collaborator

ebenp commented Oct 27, 2017

Associated with datatogether/roadmap#63
@jeffreyliu
Copy link
Collaborator

TODO: Create a test scraper on morph that has saved various test files of different types onto the morph db tables, and then ensure that they are replicated correctly on the DT side.

test files - feel free to add suggestions: an image, text file, large binary, duplicate files, compressed file

@ebenp ebenp mentioned this issue Oct 31, 2017
Closed
@b5 b5 added the ready label Nov 2, 2017
@b5 b5 added in progress and removed ready labels Nov 27, 2017
@b5
Copy link
Member

b5 commented Nov 27, 2017

yo yo! So quick update on this, we now have an operational endpoint at api.archivers.co/customcrawls read for testing!

@dcwalk dcwalk added ready and removed in progress labels Feb 15, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
doc-sprint ready
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@b5 @jeffreyliu @ebenp @dcwalk