danbooru downloader 20160117

Change Log for DanbooruDownloader20160117

  • Fix Issue #70: Update url handler for rule34.xxx.
  • Fix Issue #68: Update gelbooru tags downloader, need cookie for login.

Remember to key in cookie for Gelbooru login (see the readme.txt).

Download link for danbooru downloader 20160117, source code in GitHub.

Donation Link on the side bar ==> 😀

90 thoughts on “danbooru downloader 20160117”

  2. nandaka i have a problem with
    sankaku complex everytime if i want to download the tags on batch mode
    it gives me an error that danbooru has stop working.
    please tell me how to fix this problem…:(

  3. I got an alert from Norton360 on a large amount of outgoing data leaking from Danbooru Downloader. It next asked my to run Norton Power Eraser, and a cloud scan showed the exe as bad, with the recommended action being to remove it.

    Are we sure it’s safe?

      1. Figured it out. I added the “rating:e” and “rating:q” variables, which I assume Sankaku and Gelbooru don’t use. Removing them did the trick. Either that or I needed to put a “+” where spaces would be on the actual booru.

      2. Actually, there’s a new problem and this time I honestly can’t see what’s wrong. I did key in my login information. Want batch downloads of “loli+shota” from Danbooru, Gelbooru, and Sankaku. The first two outright don’t work while the pics from Sankaku manage to come in just fine as I type this. When testing batches of the tags individually (“loli” and “shota”), it works. For some reason trying to get pics with BOTH tags flat out won’t work. Why?!

          1. Another problem solved. Thank you. Unfortunatlely, another came up for Sankaku. It refuses to snag pics past page 50, and I know the “loli+shota” tag harbors a lot more. About 3,000. And it only managed to get 990. Is it a limitation of the program itself?

    1. annymous and cookie is not working so i change it to userpass, it worked

      1. increase the delay to 300s. Anyway, I won’t recommend you to update the tags.xml from sankaku as it will take thousands pages.

  7. Hey, my question doesn’t exactly has to do something with your app, but rather with the workflow after having downloaded the images.

    The standard file name pattern should be “%provider%%rating% – %id% – %tags%” what results in something like that: e – 216003 – breasts brown_eyes brown_hair long_hair mobile_suit_gundam mobile_suit_gundam_00 nipples pussy sumeragi_lee_noriega tadano_akira.png.

    How do you extract these tags to actually use them? (e.g. in a picture organizing software; I use PaintShop Pro, that organizes your photo collection, too). I can think of at least one problem that will occur. If it’s a *.jpg you can just copy the tags from the file name into the meta data field, so this should be doable somehow. *.png images don’t support meta data though, so I guess you have to use an external software which can read these file name tags and save them in a database. So, my question is, how do you solve this problem, or don’t you use the tags at all? Are there any software tools that can help me with my problem?

    It would be such a shame to not being able to use the tags to their full potential.

  8. Hi there!
    I was wondering if anyone could tell me how to log in to Sankaku Complex (HTTPS) so I could go up to 1000 pages instead of the regular 20. i know the log in information needs to be added to the DanbooruProviderList, but I’m awful with HTML.
    Cheers!
    LB

    1. you need to login to the sankaku page using browser and get the cookie value.
      See Q7: How to login to Gelbooru/get cookie value? in readme.txt

  9. Every time I switch provider to gelbooru.com I get a weird error, so I effectively can’t use the app with it.

    http://imgbox.com/MBkJ9MuS

    Any help would be much appreciated. Here is a dump of the log from the window:

    See the end of this message for details on invoking
    just-in-time (JIT) debugging instead of this dialog box.

    ************** Exception Text **************
    System.IndexOutOfRangeException: Index was outside the bounds of the array.
    at DanbooruDownloader3.Helper.ParseCookie(String cookiesStr, String url)
    at DanbooruDownloader3.Entity.DanbooruProvider.GetQueryUrl(DanbooruSearchParam searchParam)
    at DanbooruDownloader3.FormMain.GetQueryUrl()
    at DanbooruDownloader3.FormMain.UpdateStatus()
    at DanbooruDownloader3.FormMain.cbxProvider_SelectedIndexChanged(Object sender, EventArgs e)
    at System.Windows.Forms.ComboBox.OnSelectedIndexChanged(EventArgs e)
    at System.Windows.Forms.ComboBox.WmReflectCommand(Message& m)
    at System.Windows.Forms.ComboBox.WndProc(Message& m)
    at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)

    ************** Loaded Assemblies **************
    mscorlib
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.18444 built by: FX451RTMGDR
    CodeBase: file:///C:/Windows/Microsoft.NET/Framework64/v4.0.30319/mscorlib.dll
    —————————————-
    DanbooruDownloader3
    Assembly Version: 3.2016.1.17
    Win32 Version: 3.2016.01.17
    CodeBase: file:///C:/Users/lordvr/Desktop/DanbooruDownloader20160117/DanbooruDownloader3.exe
    —————————————-
    System
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.34238 built by: FX452RTMGDR
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System/v4.0_4.0.0.0__b77a5c561934e089/System.dll
    —————————————-
    System.Windows.Forms
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.34251 built by: FX452RTMGDR
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Windows.Forms/v4.0_4.0.0.0__b77a5c561934e089/System.Windows.Forms.dll
    —————————————-
    System.Drawing
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Drawing/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Drawing.dll
    —————————————-
    log4net
    Assembly Version: 1.2.11.0
    Win32 Version: 1.2.11.0
    CodeBase: file:///C:/Users/lordvr/Desktop/DanbooruDownloader20160117/log4net.DLL
    —————————————-
    System.Configuration
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Configuration/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Configuration.dll
    —————————————-
    System.Xml
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.34234 built by: FX452RTMGDR
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Xml/v4.0_4.0.0.0__b77a5c561934e089/System.Xml.dll
    —————————————-
    Accessibility
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/Accessibility/v4.0_4.0.0.0__b03f5f7f11d50a3a/Accessibility.dll
    —————————————-
    System.Web
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.34249 built by: FX452RTMGDR
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_64/System.Web/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Web.dll
    —————————————-
    System.Core
    Assembly Version: 4.0.0.0
    Win32 Version: 4.0.30319.18408 built by: FX451RTMGREL
    CodeBase: file:///C:/Windows/Microsoft.Net/assembly/GAC_MSIL/System.Core/v4.0_4.0.0.0__b77a5c561934e089/System.Core.dll
    —————————————-

    ************** JIT Debugging **************
    To enable just-in-time (JIT) debugging, the .config file for this
    application or computer (machine.config) must have the
    jitDebugging value set in the system.windows.forms section.
    The application must also be compiled with debugging
    enabled.

    For example:

    When JIT debugging is enabled, any unhandled exception
    will be sent to the JIT debugger registered on the computer
    rather than be handled by this dialog box.

      1. no error but once it downloaded 1000 imgs, it stopped, i dont know why…last time i used to download tag with 2000+ result, it worked but now…only 1000img downloaded even when i set limit is 22222 or 99999 (sankaku account logged too)

          1. Sure, it allowed more than 1000+ result.

            But in Main tab Danbooru Downloader, when i put Page : 60, seem like it can’t get 60+ page. I use Version 2016.01.17

          2. so it’s new version bug or something ?…because i remember….software can easy download up to 1000+ images

          3. which site? sankaku? I didn’t change the download logic, so most likely the site limit the download.

    1. No idea. The site doesn’t look like any danbooru/gelbooru/shimmie site that I know.

      Maybe they changed the board engine?

          2. sankaku complex tag is bit problematic as they don’t provide api to download the list. The application need to parse the html individually and will take long time to completely iterate thousand of pages. ==> Not recommended.

          6. thats weird, are you logged to Sankaku? If you didn’t provide the login cookie, it will limit the query result to 1000 images only (see readme to get the cookie value).

  13. Hi Nandaka,

    Could you point me to instructions for adding in the login information and password for Sankaku Complex? I keep encountering the: (403) Forbidden error, please check your login information message.

    Thanks!

    1. It should be similar like gelbooru, you need to use cookies.
      Check the readme.txt Q7: How to login to Gelbooru/get cookie value?

  14. How long should I set the batch delay for sankaku complex and does it apply to the Download List and Download Tags section?

  15. Hi
    i have a problem if donwload the downloader frome here but ther is no EXE file to open
    I search in every folder but nothing
    Do i need somtink or i am just to stupid to find it ? (sorry for my dab english)

  16. Hello! I’ve been having trouble downloading from e621.net lately. Before your most recent update, it worked fine. But even when I tried getting pics from e621 with the older version, it didn’t work! Here’s an image from the Log of what’s been happening:
    http://i.imgur.com/OqUxAPv.png

  17. Thank you for your great app.
    Could you consider to add “wait (and retry later)” option to avoid “The remote server returned an error: (429) Too many requests”.

    For example, I tried to download hundreds pics from sankakucomplex, the log shows “The remote server returned an error: (429) Too many requests – please slow down….”.

  18. The readme is fucking useless, I had to read the source code to figure out how to use the Cookie login for Gelbooru. First follow the steps from the readme, and put your cookie data between _then_ (something that is clearly missing from the readme) change the “LoginType” to “Cookie” and do not change “UseAuth” (or add it) in any way.

  19. Unable to download tags.xml for gelbooru, I get an empty XML and a new text file with “Our API is being abused at the moment and is disabled to anonymous users.”, any way to have it download the tags while logged in?

    1. You need to login to gelbooru and supply the cookie from your browser to the provider list. See the “Q7: How to get cookie value?” in readme.txt.

  20. Getting same issue, can’t open the options for gelbooru to add my cookie value, it brings up an error message. Clicking continue lets me get to the options and add the cookie, but that’s it, batch option doesn’t work. Worked fine in the previous version I used (couple of months ago). Error from the log file:

    2016-01-19 05:17:55,632 INFO – Logging Enabled
    2016-01-19 05:17:56,858 INFO – Starting up Danbooru Downloader 3.2016.01.17
    2016-01-19 05:17:56,863 DEBUG – Loading provider list.
    2016-01-19 05:17:56,897 DEBUG – Provider list loaded.
    2016-01-19 05:17:56,915 DEBUG – Danbooru Downloader 3.2016.01.17 loaded.
    2016-01-19 05:18:07,552 ERROR – Input string was not in a correct format.
    System.FormatException: Input string was not in a correct format.
    at System.Number.StringToNumber(String str, NumberStyles options, NumberBuffer& number, NumberFormatInfo info, Boolean parseDecimal)
    at System.Number.ParseInt32(String s, NumberStyles style, NumberFormatInfo info)
    at System.Convert.ChangeType(Object value, Type conversionType, IFormatProvider provider)
    at DanbooruDownloader3.FormProvider.GetValues(Int32 index)
    2016-01-19 05:18:07,562 ERROR – Input string was not in a correct format.
    System.FormatException: Input string was not in a correct format.
    at System.Number.StringToNumber(String str, NumberStyles options, NumberBuffer& number, NumberFormatInfo info, Boolean parseDecimal)
    at System.Number.ParseInt32(String s, NumberStyles style, NumberFormatInfo info)
    at System.Convert.ChangeType(Object value, Type conversionType, IFormatProvider provider)
    at DanbooruDownloader3.FormProvider.GetValues(Int32 index)
    2016-01-19 05:18:07,568 ERROR – Invalid cast from ‘System.String’ to ‘DanbooruDownloader3.Entity.DanbooruTagCollection’.
    System.InvalidCastException: Invalid cast from ‘System.String’ to ‘DanbooruDownloader3.Entity.DanbooruTagCollection’.
    at System.Convert.DefaultToType(IConvertible value, Type targetType, IFormatProvider provider)
    at System.Convert.ChangeType(Object value, Type conversionType, IFormatProvider provider)
    at DanbooruDownloader3.FormProvider.GetValues(Int32 index)
    2016-01-19 05:18:07,583 ERROR – Invalid cast from ‘System.String’ to ‘DanbooruDownloader3.Entity.DanbooruTagCollection’.
    System.InvalidCastException: Invalid cast from ‘System.String’ to ‘DanbooruDownloader3.Entity.DanbooruTagCollection’.
    at System.Convert.DefaultToType(IConvertible value, Type targetType, IFormatProvider provider)
    at System.Convert.ChangeType(Object value, Type conversionType, IFormatProvider provider)
    at DanbooruDownloader3.FormProvider.GetValues(Int32 index)

      1. I have same problem. Getting error when trying to change gelbooru options, and even when trying to update tags after changed login type.
        Also i want to ask, do you save settings in register? Because when i delete DD, and then unpack DD in same path i have saved setting, but not default settings. Only path changing help. WTF? How it’s work? 😀 If i want to reset settings, i need to change path to new one newer used before.

        That’s the log:
        http://pastebin.com/vTPmg7V9

        I’am using win 8.1 x64 rus.
        If need, i can try to translate to eng.

        1. > from log file: “No tags.xml, need to download!”
          check the readme for how to download tags.xml.

          Settings stored using user settings, so it should be in C:Users\AppDataLocalNandaka.

          Just delete the folder to reset.

          1. Not tags, but settings reset fixed my problem.
            Maybe you can add “Reset settings” button?
            Also can you modify readmy a bit? Need to see final result more clear at image, just fill with fake number like 11111 or smting?
            Thanks for the help and program 🙂

          3. I’am about screenshot. This one http://i.imgur.com/rCCjnPs.png
            Can you remove black boxes? I’am asking about this because from browser we copy separated info. Like only user_id, only numbers of that id, not in hm “final form” “user_id=; pass_hash=”. When in readme you says that we get cookie in “final form”, so i was confused how i must enter cookie in DD, with spaces betwen them or like what?
            Hope you understand what i’am trying to say, 2hard for me to describe my thoughts in understandable form because of bad English.
            If you not understand, then just remove that black boxes from screenshot, that will help idiots like me. 🙂

          4. just put merge all the cookies together into single line. At least for gelbooru, you only need to use this:

            user_id=######; pass_hash=xxxxxx.

          1. Oh, thanks for that very quick replied 🙂
            I’ve solved that problems thanks to you.
            but i’ve a question: Did DbrD auto get page forward or i’ve manualy drag the bar until the end of the page for it to load the next page? (Annoying anyway)

          3. I’m not sure, because the offset value come from the server and it does nothing (just information).

            Which provider you are downloading from? Remember that some provider put a limit on how many images you can download (e.g. even if the tag count show 100k+, sankaku limit to the first 1000 page (around 2000images) if you are registered. I think danbooru also have the same limit (not sure for the paid user).

        1. then, can you upload the log file to pastebin. It should be in the application folder with name like log-2016-04-11.txt. If you are not sure which log file, just delete all and recreate the error and upload that file.

Comments are closed.