danbooru downloader 201501429

Change Log for DanbooruDownloader20150429

  • Implement Feature #51: Allow option to ignore/blacklist only for General tags.
  • Fix Issue #57: Replace tags if over the limit with ‘multiple_tag_type’.
  • Implement Feature #57: Take tags only the specified limit option.

Download link for danbooru downloader 20150429, source code in GitHub.

Donation Link on the side bar ==> 😀

44 thoughts on “danbooru downloader 201501429”

  1. I happened to notice another issue. I’m not sure if it’s just me, but this version of doesn’t create folders as needed when saving files in batch mode.

    If I do a search and have the save folder something like %artist%/%id% if a folder of the artist(s) didn’t already exist, it would fail to create and find the .!tmp file, and in turn fail to download.

  2. There’s a problem with Sankaku and Full Batch Mode, it doesn’t download any image

    2015-09-17 22:40:29,722 INFO – [DoBatchJob] Processing Batch Job#0
    2015-09-17 22:40:29,772 INFO – [DoBatchJob] Downloading list: http://chan.sankakucomplex.com/post/index?tags=hatsune_miku+-rating:safe&limit=1000&page=1
    2015-09-17 22:40:40,621 INFO – [DoBatchJob] No more image.
    2015-09-17 22:40:40,712 INFO – [DoBatchJob] Batch Job #0: Done

    it was working some days ago

    1. Seems like Sankakucomplex gives a error when you use &limit= in the query without being logged in.

    1. Seems like Sankaku Complex got busted again. Neither the HTTP or HTTPS versions of it fetch anything.

  4. Gelbooru hasn’t been working for me in quite a while, I’m getting errors like this. Is anyone else experiencing this?

    2015-09-01 00:07:58,130 ERROR – [DoBatchJob] Error: There is an error in XML document (2, 2).
    Inner: was not expected.
    Stack Trace:
    at System.Xml.Serialization.XmlSerializer.Deserialize(XmlReader xmlReader, String encodingStyle, XmlDeserializationEvents events)
    at DanbooruDownloader3.DAO.DanbooruTagsDao..ctor(String xmlTagFile)
    at DanbooruDownloader3.Helper.ParseTags(String p, DanbooruProvider provider)
    at DanbooruDownloader3.DAO.DanbooruPostDao.ProcessXML(String rawData)
    at DanbooruDownloader3.DAO.DanbooruPostDao..ctor(Stream input, DanbooruPostDaoOption option)
    at DanbooruDownloader3.FormMain.GetBatchImageList(String url, String query, DanbooruBatchJob job)
    at DanbooruDownloader3.FormMain.DoBatchJob(BindingList`1 batchJob)

  5. Tried making a clean install of Windows 10 but that didn’t solve the problem. I end up getting the same error after processing exactly 300 or 400 links. Tried running the app as admin and played around with the settings but I’m still getting the same error. And yes the link loads find under Microsoft Edge. Could it be from the user agent?

  6. Ever since I started using Windows 10, I’ve been getting the following error when trying to DL via https from Sankaku:

    Could not create SSL/TLS secure channel.

    Any ideas?

        1. [DoBatchJob] Error: The request was aborted: Could not create SSL/TLS secure channel.
          Stack Trace:
          at System.Net.WebClient.DownloadFile(Uri address, String fileName)
          at DanbooruDownloader3.FormMain.DoDownloadBatch(String targetUrl, DanbooruBatchJob job, DanbooruPost post, String filename)
          at DanbooruDownloader3.FormMain.DoBatchJob(BindingList`1 batchJob)
          Query: date:2013-04-06 order:id

          1. I’m not using Win10 yet, most likely this is due to certificate error. Try to open the page in Microsoft Edge browser first? See if there is any cert error, and retry?

  7. It appears there’s an issue with how it handles TheDoujin.com. Both searching the site, and even checking the site for tags, it throws an error.

    Attempting to continue from the error in tag downloads, provides a tags.xml file that appears to be a webpage, rather than a taglist.

    Continuing from the search produces no results, though the activity bar still shows it is trying. “Loading downloaded list…”

    Tag Download:
    —————————–
    was not expected.

    ************** Exception Text **************
    System.InvalidOperationException: was not expected.
    at Microsoft.Xml.Serialization.GeneratedAssembly.XmlSerializationReaderDanbooruTagCollection.Read5_tags()
    —————————–

    Search:
    —————————–
    The “img” start tag on line 24 position 19 does not match the end tag of ‘a’. Line 24, position 94.

    ************** Exception Text **************
    System.Xml.XmlException: The ‘img’ start tag on line 24 position 19 does not match the end tag of ‘a’. Line 24, position 94.
    at System.Xml.XmlTextReaderImpl.Throw(Exception e)
    at System.Xml.XmlTextReaderImpl.ThrowTagMismatch(NodeData startTag)
    at System.Xml.XmlTextReaderImpl.ParseEndElement()
    at System.Xml.XmlTextReaderImpl.ParseElementContent()
    at DanbooruDownloader3.DAO.DanbooruPostDao.ProcessXML(String rawData)
    at DanbooruDownloader3.DAO.DanbooruPostDao..ctor(Stream input, DanbooruPostDaoOption option)
    at DanbooruDownloader3.FormMain.backgroundWorker1_DoWork(Object sender, DoWorkEventArgs e)
    at System.ComponentModel.BackgroundWorker.WorkerThreadStart(Object argument)
    —————————–

    There is more to the errors, but it’s pretty much all system information. I can provide the rest of it if necessary. I can also provide the search dump.

    Thanks for your hard work! It’s a great program.

      1. It creates a tags.xml, but the file is wrong, it is not a real tag list.

          2. Normally no, but thedoujin.com doesn’t have danbooru api enabled (not like gelbooru.com), so the application cannot get the list of the images.

  9. Hey I’m having a problem where the previews of the pictures won’t load and instead it just comes up with a red cross. I can right click and reload the picture to make it work but this only works one at a time so it’s a bit of pain. Any way to fix this or reload all the pictures at once?

  10. First of all, thank you for making this program. Seems a far cry above from the Firefox add-on, which is a bit tedious to work with now due to how Danbooru changed. That being said, I’m trying to get it to do something but keeps missing the mark.

    Subfolders. I want the file path to be similar to how Cubeknight’s Danbooru add-on sorted things. First provider, then copyright, and finally the file. I give it the Full Batch Mode a test run by downloading 20 Pokemon pics. Which it does. The Danbooru folder shows up but beyond that, images. I expected another folder named after the copyright tag (Pokemon in this case) but I see images instead. I want things to be organized, so I read the readme and came to the conclusion that the path needs to be something like “%provider%%copyright%rating% – %id% – %tags%”.

    It works. Just not the way I wanted it. In fact, I daresay it works too well.

    This might be just Pokemon’s problem but where I expected one subfolder I bumped into nine. It turns out the “%copyright%” in the folder-filename string takes into account ALL copyright tags, so instead of 20 pics in a single “Pokemon” folder I end up with 20 pics split across folders like “bishoujo_senshi_sailor_moon pokemon”, “kantai_collection pokemon”, “pokemon pokemon_(game) pokemon_bw”, “pokemon pokemon_(game) pokemon_xy’, and so on. Now I went to the settings tab and noticed that I can limit the group tags. I set Copyright to 1 and try again.

    Good news? The pics went into a single subfolder!
    Bad news? It has the wrong name. “multiple_copyrights”.

    Long story short, it does what I want but not 100% precisely as I want. If I want pics from say…Pokemon or Mahou Shoujo Madoka Magica, I expect the batch to make two subfolders in the Danbooru folder.

    What I expected: http://imgur.com/jZcwEtS
    What I got: http://imgur.com/tMtgMK8

    tl;dr I want each SINGLE copyright tag to have its own folder as opposed to one folder per copyright group. How do I do this?

    1. not possible, because it doesn’t know which copyright tags to be used.

      If you know which tag to be used as the copyright folder, then just use %provider%\rating% – %id% – %tags%, for example, %provider%Pokemonrating% – %id% – %tags% when you search for pokemon related images.

      1. IT WORKS!! This time for sure! I guess some things have to be done manually but it works!! Even took it a step farther and added an extra folder for when I want to batch download pics of a specific character! Like “%provider%PokemonMisty%rating% – %id%”. Thank you very much!!

        But I did find something odd. An error that only happens with Sankaku Complex. I know some tags have over a thousand pics there but the batch process only gets 180 before it turns red. Siphons much more of them at Danbooru and Gelbooru.

        1. Sankaku Complex have a lot of checking to avoid downloading (they use customized danbooru). Is it possible to upload the log file? It should be on the application folder

  11. Any way to fix memory leaks? Program start to consume a lot of RAM while downloading big lists like 1000+ items. It eat up to 5 Gb RAM on my PC , for example (and of course Windows just crash it after that). So I need to close and open it again (thus I can download only ~100 images at once). It is not that I do this every day, but still annoying.

  12. Hi, I do not speak English so I’ll use Google Translate.
    I really wanted to learn how to use Pixiv Downloader and danbooru Downloader, but I can not do anything in the progam. If possible you could give me a very detailed tutorial (in English may be the same), explained how to properly use it correctly. If all goes well I will make a donation as a way of thanks.

    1. Hiya,

      I don’t have any specific tutorial for both application, but just read the readme.txt for instruction and run the application.
      If you still have question, you can always leave a comment here.

    1. You can modify the DanbooruProviderList.xml to change the base url for danbooru to https using text editor.

  16. On batch downloading what you think of looking ahead the next page list at the same the program is downloading images? Then when the last image on a page is downloaded it starts to download the next page immediately.

Comments are closed.