|
Poster:
|
bookdev |
Date:
|
October 06, 2009 05:17:51pm |
|
Forum:
|
texts
|
Subject:
|
Re: How to download all titles |
Could someone please be so kind as to suggest how to download all text titles/contributors, if you don't mind? I have tried using the advanced search in CSV, XML and JSON formats. But each of them dies after one or two hundred thousand titles (depending on the format chosen). I have also tried to break the database down into small sets using ranges but haven't found a criteria that will do that. Date ranges, for example, seem to produce unexpected results for me.
|
Poster:
|
Time Traveller |
Date:
|
October 06, 2009 07:01:25pm |
|
Forum:
|
texts
|
Subject:
|
Re: How to download all titles |
you are taking about 1.5 million items, you will never be able to read all the title details in your life time certainly not the full texts.
Just why do you want to download all that, seeing that stuff is just as accessible when left on the Archive.
You are talking about having it on your PC, so what will happen when 2 hours later, you database is out of date, seeing uploads are happening every minute 24/7
|
Poster:
|
stbalbach |
Date:
|
October 06, 2009 08:48:21pm |
|
Forum:
|
texts
|
Subject:
|
Re: How to download all titles |
I've never tried it:
this post describes how. But it sounds like you've already seen it, I'm linking to it in case not. It is odd that advanced search bombs out after a limit.
Stephen
|
Poster:
|
bookdev |
Date:
|
October 07, 2009 12:32:07pm |
|
Forum:
|
texts
|
Subject:
|
Re: How to download all titles |
Thanks for the link. Unfortunately, the method described only works on small exports. And when I try to reduce the size of the export by adding "<" or ">" I usually get the error:
"Search engine returned invalid information or was unresponsive. We are working to resolve this issue."
|
Poster:
|
stbalbach |
Date:
|
October 07, 2009 02:00:02pm |
|
Forum:
|
texts
|
Subject:
|
Re: How to download all titles |
That's usually the error I get when I made a syntax error in the search string. Not saying that is the case here, but sometimes the search strings can be very complex. If you want to post a sample one here I'd be happy to take a second look.
TVNews
OpenLibrary