Change Log:
- – Add option always put delay in batch download.
- – Add delay for download tags (follow Batch Download Delay).
- – Update flash parser for Sankaku (already implemented from the previous version).
Download link for Danbooru Downloader 20140126, source code in GitHub.
I’m getting illegal file path errors from Sankaku Complex as well. Images downloaded fine the other night, but today, it seems to be pulling URLs very strangely.
[DoBatchJob] Processing Batch Job#0
[DoBatchJob] Downloading list: http://chan.sankakucomplex.com/post/index?tags=wink+rating:safe&limit=1000&page=1
[DoBatchJob] Getting file_url from http://chan.sankakucomplex.com/post/show/3580186
[DoBatchJob] Download: http://cs.sankakucomplex.com/data/7f/a6/7fa68394be8980dc053ca58cd633e636.png?3580186
[DoBatchJob] Error Download Batch Image (0 of 20): Illegal characters in path. Wait for 30s.
It’s probably failing due to the fact it’s now putting a questionmark and then the image ID.
Seems like Sankaku has pulled another one on us..
Sankaku batch download not working. I’m getting ‘Illegal characters in path’ error.
System.Net.WebException: An exception occurred during a WebClient request. —> System.ArgumentException: Illegal characters in path.
at System.IO.Path.CheckInvalidPathChars(String path, Boolean checkAdditional)
at System.IO.FileStream.Init(String path, FileMode mode, FileAccess access, Int32 rights, Boolean useRights, FileShare share, Int32 bufferSize, FileOptions options, SECURITY_ATTRIBUTES secAttrs, String msgPath, Boolean bFromProxy, Boolean useLongPath, Boolean checkHost)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access, FileShare share, Int32 bufferSize, FileOptions options, String msgPath, Boolean bFromProxy)
at System.IO.FileStream..ctor(String path, FileMode mode, FileAccess access)
at System.Net.WebClient.DownloadFile(Uri address, String fileName)
— End of inner exception stack trace —
at System.Net.WebClient.DownloadFile(Uri address, String fileName)
at DanbooruDownloader3.FormMain.DoDownloadBatch(String targetUrl, DanbooruBatchJob job, DanbooruPost post, String filename)
As per exception, you have illegal character in the filename. What is your save path? What is the query used? What is the downloaded url?
Save path: F:BooruSanChan1..1000000
Query: date:YYYY-MM-DD order:id
Example DL URL: http://cs.sankakucomplex.com/data/4c/87/4c87c7e5fbda5e0c2eda1bd0797a008e.jpg?136708
It was working fine until yesterday.
Filename Format: %id%
I usually get the error “index was out of range” when downloading from sankaku, so there are often missing pages when the download is over, here’s the example
Query: ichikawa_noa
System.ArgumentOutOfRangeException: Index was out of range. Must be non-negative and less than the size of the collection.
Parameter name: index
at HtmlAgilityPack.HtmlNodeCollection.get_Item(Int32 index)
at DanbooruDownloader3.Engine.SankakuComplexParser.Parse(String data, DanbooruSearchParam searchParam)
at DanbooruDownloader3.DAO.DanbooruPostDao..ctor(Stream input, DanbooruPostDaoOption option)
at DanbooruDownloader3.FormMain.GetBatchImageList(String url, String query, DanbooruBatchJob job)
at DanbooruDownloader3.FormMain.DoBatchJob(BindingList`1 batchJob)
Try to set up a batch job delay (e.g. 2000ms) when downloading from Sankaku.
I tried already, but nothing improved, you can try the batch download with tag = mikoto_akemi, Limit = 10000, Start page = 3, Rating = All, Source = Sankaku Complex
If Start page = 1, it’ll download just fine until reachs page 3
Since you aren’t interested in coding support for it yourself, would you mind if I hired another developer to add support for derpibooru, and if I did get the code written would you consider adding the new code to your version?
As long it doesn’t interference with the other functionality and I can understand the code, why not?
If possible, try to implement it in another .cs file. Just fork the version in GitHub and issue a pull request.
Thanks a lot! Could you please close issues on GitHub?
You can do that yourself, just hit the Close button in the comment box.
Working great. Thanks!