danbooru downloader 2013019

Change Log:

Add Gelbooru HTML parser.
Add new provider: lolibooru (NSFW).
Update prev/next button logic.

Download link for danbooru downloader 2013019, source code.

Latest tags.xml from Danbooru.

22 thoughts on “danbooru downloader 2013019”

tced says:

January 26, 2013 at 13:15

When trying to do anyting on lolibooru

See the end of this message for details on invoking
just-in-time (JIT) debugging instead of this dialog box.

************** Exception Text **************
System.InvalidOperationException: was not expected.
at Microsoft.Xml.Serialization.GeneratedAssembly.XmlSerializationReaderDanbooruTagCollection.Read5_tags()

************** Loaded Assemblies **************
mscorlib
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.296 (RTMGDR.030319-2900)
CodeBase: file:///C:/WINDOWS/Microsoft.NET/Framework/v4.0.30319/mscorlib.dll
—————————————-
DanbooruDownloader3
Assembly Version: 3.2013.1.19
Win32 Version: 3.2013.01.19
CodeBase: file:///C:/Documents%20and%20Settings/User/My%20Documents/Downloads/DanbooruDownloader20130119%20(1)/DanbooruDownloader3.exe
—————————————-
log4net
Assembly Version: 1.2.11.0
Win32 Version: 1.2.11.0
CodeBase: file:///C:/Documents%20and%20Settings/User/My%20Documents/Downloads/DanbooruDownloader20130119%20(1)/log4net.DLL
—————————————-
System.Windows.Forms
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.1001 built by: RTMGDR
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Windows.Forms/v4.0_4.0.0.0__b77a5c561934e089/System.Windows.Forms.dll
—————————————-
System.Drawing
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.1001 built by: RTMGDR
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Drawing/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Drawing.dll
—————————————-
System
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.1001 built by: RTMGDR
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System/v4.0_4.0.0.0__b77a5c561934e089/System.dll
—————————————-
System.Configuration
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.1 (RTMRel.030319-0100)
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Configuration/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Configuration.dll
—————————————-
System.Xml
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.233 built by: RTMGDR
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Xml/v4.0_4.0.0.0__b77a5c561934e089/System.Xml.dll
—————————————-
Accessibility
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.1 built by: RTMRel
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/Accessibility/v4.0_4.0.0.0__b03f5f7f11d50a3a/Accessibility.dll
—————————————-
System.Core
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.233 built by: RTMGDR
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System.Core/v4.0_4.0.0.0__b77a5c561934e089/System.Core.dll
—————————————-
HtmlAgilityPack
Assembly Version: 1.4.6.0
Win32 Version: 1.4.6.0
CodeBase: file:///C:/Documents%20and%20Settings/User/My%20Documents/Downloads/DanbooruDownloader20130119%20(1)/HtmlAgilityPack.DLL
—————————————-
System.Web
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.272 built by: RTMGDR
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_32/System.Web/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Web.dll
—————————————-
xg5mqohy
Assembly Version: 3.2013.1.19
Win32 Version: 4.0.30319.1001 built by: RTMGDR
CodeBase: file:///C:/WINDOWS/Microsoft.Net/assembly/GAC_MSIL/System/v4.0_4.0.0.0__b77a5c561934e089/System.dll
—————————————-

************** JIT Debugging **************
To enable just-in-time (JIT) debugging, the .config file for this
application or computer (machine.config) must have the
jitDebugging value set in the system.windows.forms section.
The application must also be compiled with debugging
enabled.

For example:

When JIT debugging is enabled, any unhandled exception
will be sent to the JIT debugger registered on the computer
rather than be handled by this dialog box.
1. nandaka says:
  
  January 26, 2013 at 13:23
  
  Doesn’t happen to me, can you open the lolibooru website first? Any query I can use?
  1. tced says:
    
    January 27, 2013 at 19:08
    
    I think the problem is that the lolibooru website is looking for a cookie stating that you have accepted the terms of the site.
    
    When I go to the default link for the lolibooru site form the download tags piece (http://lolibooru.com/index.php?page=dapi&s=tag&q=index&limit=0) but get redirected to lolibooru.com//
lolibooru says:

January 24, 2013 at 19:46

i get this message
See the end of this message for details on invoking
just-in-time (JIT) debugging instead of this dialog box.

************** Exception Text **************
System.ArgumentOutOfRangeException: Value of ‘-13’ is not valid for ‘Maximum’. ‘Maximum’ must be greater than or equal to 0.
Parameter name: Maximum
at System.Windows.Forms.ProgressBar.set_Maximum(Int32 value)
at System.Windows.Forms.ToolStripProgressBar.set_Maximum(Int32 value)
at DanbooruDownloader3.FormMain.UpdateUi(Int32 current, Int32 total)

************** Loaded Assemblies **************
mscorlib
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.17929 built by: FX45RTMREL
CodeBase: file:///C:/Windows/Microsoft.NET/Framework/v4.0.30319/mscorlib.dll
—————————————-
DanbooruDownloader3
Assembly Version: 3.2013.1.19
Win32 Version: 3.2013.01.19
CodeBase: file:///N:/DanbooruDownloader20121006/DanbooruDownloader3.exe
—————————————-
log4net
Assembly Version: 1.2.11.0
Win32 Version: 1.2.11.0
CodeBase: file:///N:/DanbooruDownloader20121006/log4net.DLL
—————————————-
System.Windows.Forms
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.17929 built by: FX45RTMREL
CodeBase: file:///C:/windows/Microsoft.Net/assembly/GAC_MSIL/System.Windows.Forms/v4.0_4.0.0.0__b77a5c561934e089/System.Windows.Forms.dll
—————————————-
System.Drawing
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.17929 built by: FX45RTMREL
CodeBase: file:///C:/windows/Microsoft.Net/assembly/GAC_MSIL/System.Drawing/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Drawing.dll
—————————————-
System
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.17929 built by: FX45RTMREL
CodeBase: file:///C:/windows/Microsoft.Net/assembly/GAC_MSIL/System/v4.0_4.0.0.0__b77a5c561934e089/System.dll
—————————————-
System.Configuration
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.17929 built by: FX45RTMREL
CodeBase: file:///C:/windows/Microsoft.Net/assembly/GAC_MSIL/System.Configuration/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Configuration.dll
—————————————-
System.Xml
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.17929 built by: FX45RTMREL
CodeBase: file:///C:/windows/Microsoft.Net/assembly/GAC_MSIL/System.Xml/v4.0_4.0.0.0__b77a5c561934e089/System.Xml.dll
—————————————-
Accessibility
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.17929 built by: FX45RTMREL
CodeBase: file:///C:/windows/Microsoft.Net/assembly/GAC_MSIL/Accessibility/v4.0_4.0.0.0__b03f5f7f11d50a3a/Accessibility.dll
—————————————-
System.Core
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.17929 built by: FX45RTMREL
CodeBase: file:///C:/windows/Microsoft.Net/assembly/GAC_MSIL/System.Core/v4.0_4.0.0.0__b77a5c561934e089/System.Core.dll
—————————————-
Microsoft.GeneratedCode
Assembly Version: 1.0.0.0
Win32 Version: 4.0.30319.17929 built by: FX45RTMREL
CodeBase: file:///C:/windows/Microsoft.Net/assembly/GAC_MSIL/System.Xml/v4.0_4.0.0.0__b77a5c561934e089/System.Xml.dll
—————————————-
HtmlAgilityPack
Assembly Version: 1.4.6.0
Win32 Version: 1.4.6.0
CodeBase: file:///N:/DanbooruDownloader20121006/HtmlAgilityPack.DLL
—————————————-
System.Xml.Linq
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.17929 built by: FX45RTMREL
CodeBase: file:///C:/windows/Microsoft.Net/assembly/GAC_MSIL/System.Xml.Linq/v4.0_4.0.0.0__b77a5c561934e089/System.Xml.Linq.dll
—————————————-
System.Web
Assembly Version: 4.0.0.0
Win32 Version: 4.0.30319.17929 built by: FX45RTMREL
CodeBase: file:///C:/windows/Microsoft.Net/assembly/GAC_32/System.Web/v4.0_4.0.0.0__b03f5f7f11d50a3a/System.Web.dll
—————————————-

************** JIT Debugging **************
To enable just-in-time (JIT) debugging, the .config file for this
application or computer (machine.config) must have the
jitDebugging value set in the system.windows.forms section.
The application must also be compiled with debugging
enabled.

For example:

When JIT debugging is enabled, any unhandled exception
will be sent to the JIT debugger registered on the computer
rather than be handled by this dialog box.
1. nandaka says:
  
  January 24, 2013 at 19:59
  
  I’ll see about it.
hluu says:

January 22, 2013 at 12:22

Cant download many files at once from sankaku. Sorry If this is commonly known already, Just discovered this tool today. Nice work btw
1. nandaka says:
  
  January 22, 2013 at 13:25
  
  That’s weird, I just download 200+ images from Sankaku using batch mode yesterday, more details please (screen shot, log file, query used, etc)?
  
  Fyi, Sankaku put a rate limiter, so if you running multiple instance of the application, most likely the server will ban you. If you are using shared public ip, then this might also the problem.
  1. hluu says:
    
    January 22, 2013 at 13:43
    
    Tag query used was footjob order:score . And http://www.mediafire.com/?3rbhbnc6au55voo is my log.
    
    thanks for responding so fast to this.
    1. nandaka says:
      
      January 22, 2013 at 14:05
      
      Based on log files, the server returned error: (429) Too many requests. The server refuses to serve the page and the application cannot parse the post and download the images.
      
      If you are using proxy, please specify your own proxy (try to google for open/free proxy, but usually the speed is slow).
      
      Most likely, I need to introduce a delay for each downloaded images. I’ll check it later.
2. kasake says:
  
  January 24, 2013 at 18:28
  
  I can confirm this problem. For example, I look up something that has 160+ images, the program only looks up 40-60, and it goes onto the next search query.
  1. kasake says:
    
    January 24, 2013 at 18:29
    
    Also, I’m unable to get the Sankaku tag index. I get a 403 error.
    1. nandaka says:
      
      January 24, 2013 at 19:41
      
      403 is forbidden, cannot help you there.
  2. nandaka says:
    
    January 24, 2013 at 19:42
    
    Sankaku apply rate limiter, so I need to put a delay when downloading.
    
    Can I have the query you are using?
  3. kasake says:
    
    January 25, 2013 at 16:42
    
    search query was “gravion”
lolipop says:

January 20, 2013 at 23:31

thankyou nandaca, i can collect my geijutsu at last
wibbcat says:

January 20, 2013 at 19:22

The_Simpsons, Lisa_Simpson, Marge_Simpson are a few I’ve come across with the error.
On a different note: would it be possible to automatically load the next page without having to scroll to the bottom of the list till there are no more posts to display? if a query has say 20+ pages it takes a while to manually scroll and wait to load all the posts before adding to the DL list.
Thanks.
1. nandaka says:
  
  January 20, 2013 at 19:42
  
  Nope, try to enable Append List/Auto Load Next Page and press the ‘>’ button after getting the first page. I’ll check the ntilde later on.
wibbcat says:

January 19, 2013 at 21:43

no more support for http://rule34.paheal.net ?
1. nandaka says:
  
  January 19, 2013 at 22:32
  
  What is the problem? The provider still in the list and I can still get the images from it.
  1. wibbcat says:
    
    January 20, 2013 at 18:43
    
    sorry, thought it was removed from the list, however i am getting an error when searching on it
    
    ‘ Unhandled exception has occurred in your application, Reference to undeclared entity ‘ntilde’. line 420, position 63′
    
    is it a server problem or a client problem?
    1. nandaka says:
      
      January 20, 2013 at 18:55
      
      More to the client side, as the xml sent by server contains unsupported entity. Can you give me the query you are using?
Quick_Man says:

January 19, 2013 at 18:06

Wow, good job on the lolibooru comrade.
That sure was quick!

Comments are closed.