Page 1 of 1

suggestion: a way to download the entire database

PostPosted: Thu Jan 09, 2020 1:50 am
by yumri23
A way to download the entire database of community made asset as an option will be nice. Having it as an option not as the only way keeping the way it is right now that you can pick and choose which while having the option to get the entire thing will be good. I get that some people's internet is not good. Maybe a large portion of people's internet of the community isn't but having it as an option will give us the option to do that if we want while keeping the other option of picking them one by one open to us as well.

I know making an extra button will be hard and might break something but having that 1 button will be nice to have. Another to say sync the entire database downloaded instead of having to go along to each and every item downloaded will also be good.

Re: suggestion: a way to download the entire database

PostPosted: Thu Jan 09, 2020 6:39 am
by joepal

Re: suggestion: a way to download the entire database

PostPosted: Tue Mar 03, 2020 12:48 pm
by azajali43
Ways of downloading the entire database:
1. Getleft has a new, modern feel to its interface.
2. Cyotek WebCopy.
3. Wikipedia Dumps.
4. SiteSucker.
5. Web2Disk Downloader.

Re: suggestion: a way to download the entire database

PostPosted: Tue Mar 03, 2020 1:38 pm
by SaltyCowdawg
I was looking around in my "software junk drawer" trying to find the Ruby script I wrote to do just that. I was nice about it though and put some logic in to have the download process "take a break" every once in a while limiting the load on the server.

I'd actually advise against downloading the entire database. It is one of those things that can cause enough of a load on a server to raise eyebrows of the folks that run the server.

When I wrote my script the asset database was small enough that it wasn't that big a deal. Nowadays the database is HUGE so I am myself personally not wanting the whole thing especially given there are a lot of resources on it that I won't use anway. Why do I need assets to make a character look Celtic when the scenes I'm trying to create are of a science fiction nature? :-) I'm not writing Star Trek stuff where barely dressed babes in togas are going to be running around.

just saying...