53 thoughts on “pixiv downloader 20150218 – Happy Lunar New Year”

  1. Do you know why it keeps saying “No more images” “done” …?

    Thanks for the great program, but I’m having trouble using it

  2. agree, dosn’t loading too by tags ( R-18, original (jp of course) and other)

  3. Hello !
    Sorry to bother you, but it seems that something changed on PIxiv today and is impacting the download by tags (individually ou by tag list). It worked yesterday, but now it stops immediately saying “No more images”, without downloading anything or any visible error. Download by member id is ok πŸ˜‰

  4. hmm
    a little help? the tag function is not working properly…
    I try to batch download on pixiv with tag : ラブラむブ!, bookmark count : 1, start page : 1, end page : 100
    but it show “no more images”

    something like this

    Searching for: (ラブラむブ!) %E3%83%A9%E3%83%96%E3%83%A9%E3%82%A4%E3%83%96%21
    Looping… for http://www.pixiv.net/search.php?s_mode=s_tag_full&word=%E3%83%A9%
    E3%83%96%E3%83%A9%E3%82%A4%E3%83%96%21&p=1&order=date_d
    No more images

    when i check pixiv, nothing unusual. Downloading by illustration ID also works fine too
    thanks

  5. Hello,

    I’d like to use crontab to download pics by tags list daily. However, I noticed that it did not execute successfully. After check log file (pixivutil.log), I found that the program terminated after “Using Proxy”. I’ve checked the arguments by directly execute it in shell manually, and it run well. Do you have any idea?

    Thanks you for your help.

      1. Hello,

        I go back to see the readme file again, found that FAQ A.Q4. Trying to add “PYTHONIOENCODING=utf-8” into a script to run PixivUtil, and put it to crontab again, everything looks well now. πŸ™‚

        Thank you for your development about this useful tool.

  8. 2015-03-12 02:34:09,638 – PixivUtil20150218-Happy Lunar New Year – ERROR – Unknown Error: global name ‘FILE_NOT_EXISTS_OR_NO_READ_PERMISSION’ is not defined
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1680, in main
    File “PixivModel.pyc”, line 794, in parseTagsList
    NameError: global name ‘FILE_NOT_EXISTS_OR_NO_READ_PERMISSION’ is not defined

    This happened after trying to use list.txt and tags.txt. Any fixes?

    1. Sorry never mind I was trying to use blacklist_tags.txt and named it tags.txt instead.

  9. Hi nandaka,
    I can’t log in. I’ve messed up with config.ini and tried to fix it myself but it seems like a code reading issue.
    Here’s my error’s log.

    Log in using form.
    Error at pixiv_login():(, IncompleteRead(3021 by
    tes read, 5171 more expected), )
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1718, in main
    File “PixivBrowserFactory.pyc”, line 183, in loginHttp
    File “mechanize_mechanize.pyc”, line 541, in submit
    File “mechanize_mechanize.pyc”, line 203, in open
    File “mechanize_mechanize.pyc”, line 249, in _mech_open
    File “mechanize_mechanize.pyc”, line 308, in _set_response
    File “mechanize_html.pyc”, line 623, in set_response
    File “mechanize_response.pyc”, line 190, in read
    File “socket.pyc”, line 351, in read
    File “httplib.pyc”, line 549, in read
    File “httplib.pyc”, line 609, in _read_chunked
    File “httplib.pyc”, line 666, in _safe_read
    IncompleteRead: IncompleteRead(3021 bytes read, 5171 more expected)
    press enter to exit.

    Any ideas ?
    Thanks again for this amazing piece of software πŸ˜‰

  10. Hi,

    I’ve encountered a SSL error during the log in process. From the log file:

    2015-03-09 13:17:17,078 – PixivUtil20150218-Happy Lunar New Year – INFO – ###############################################################
    2015-03-09 13:17:17,078 – PixivUtil20150218-Happy Lunar New Year – INFO – Starting…
    2015-03-09 13:17:17,140 – PixivUtil20150218-Happy Lunar New Year – INFO – Setting log level to: DEBUG
    2015-03-09 13:17:17,140 – PixivUtil20150218-Happy Lunar New Year – INFO – No default cookie jar available, creating…
    2015-03-09 13:17:17,155 – PixivUtil20150218-Happy Lunar New Year – INFO – Only process member where day last updated >= 7
    2015-03-09 13:17:17,155 – PixivUtil20150218-Happy Lunar New Year – INFO – Using Username: xxxxxxx
    2015-03-09 13:17:17,155 – PixivUtil20150218-Happy Lunar New Year – INFO – Log in using form.
    2015-03-09 13:17:19,108 – PixivUtil20150218-Happy Lunar New Year – ERROR – Error at pixiv_login():(, URLError(SSLError(1, u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:581)’),), )
    2015-03-09 13:17:19,108 – PixivUtil20150218-Happy Lunar New Year – ERROR – Error at pixiv_login(): (, URLError(SSLError(1, u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:581)’),), )
    Traceback (most recent call last):
    File “PixivBrowserFactory.pyc”, line 175, in loginHttp
    File “mechanize_mechanize.pyc”, line 203, in open
    File “mechanize_mechanize.pyc”, line 230, in _mech_open
    File “mechanize_opener.pyc”, line 204, in open
    File “mechanize_urllib2_fork.pyc”, line 457, in http_response
    File “mechanize_opener.pyc”, line 221, in error
    File “mechanize_urllib2_fork.pyc”, line 332, in _call_chain
    File “mechanize_urllib2_fork.pyc”, line 571, in http_error_302
    File “mechanize_mechanize.pyc”, line 203, in open
    File “mechanize_mechanize.pyc”, line 230, in _mech_open
    File “mechanize_opener.pyc”, line 193, in open
    File “mechanize_urllib2_fork.pyc”, line 344, in _open
    File “mechanize_urllib2_fork.pyc”, line 332, in _call_chain
    File “mechanize_urllib2_fork.pyc”, line 1170, in https_open
    File “mechanize_urllib2_fork.pyc”, line 1118, in do_open
    URLError:
    2015-03-09 13:17:19,140 – PixivUtil20150218-Happy Lunar New Year – ERROR – Unknown Error:
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1718, in main
    File “PixivBrowserFactory.pyc”, line 175, in loginHttp
    File “mechanize_mechanize.pyc”, line 203, in open
    File “mechanize_mechanize.pyc”, line 230, in _mech_open
    File “mechanize_opener.pyc”, line 204, in open
    File “mechanize_urllib2_fork.pyc”, line 457, in http_response
    File “mechanize_opener.pyc”, line 221, in error
    File “mechanize_urllib2_fork.pyc”, line 332, in _call_chain
    File “mechanize_urllib2_fork.pyc”, line 571, in http_error_302
    File “mechanize_mechanize.pyc”, line 203, in open
    File “mechanize_mechanize.pyc”, line 230, in _mech_open
    File “mechanize_opener.pyc”, line 193, in open
    File “mechanize_urllib2_fork.pyc”, line 344, in _open
    File “mechanize_urllib2_fork.pyc”, line 332, in _call_chain
    File “mechanize_urllib2_fork.pyc”, line 1170, in https_open
    File “mechanize_urllib2_fork.pyc”, line 1118, in do_open
    URLError:
    2015-03-09 13:18:47,390 – PixivUtil20150218-Happy Lunar New Year – INFO – EXIT
    2015-03-09 13:18:47,390 – PixivUtil20150218-Happy Lunar New Year – INFO – ###############################################################

    May I have your advice on what might be the problem?

      1. Hi Nandaka,

        I’ve tried the program on my friend’s PC running on Windows 8 and it worked fine.

        You mentioned that the issue might be with my certificate store. Is there any suggestions to rectify this, like perhaps clearing some existing certificates? Just to add on, my computer is an old one, running on Windows XP, and the 20150105 version of the program used to work until the login issue came up.

        1. hmm, not sure in winxp. try to update your windows or google it? another way, try to open on internet explore or google chrome and try to login using secure login (don’t use firefox, as it uses its own cert store).

          1. Hi,

            thank you for the very useful advice! I was logging in using Firefox all these while, and I tried using SSL login in Internet Explorer, it solves the certficate error when I use your downloader.

            Anyway, sent a small donation to you via paypal. Please keep up the good work!

          2. I had the same problem on WinServer 2008 (after upgrading from 2003) and this has solved it, thanks.

      1. Yeah, usually I use function 8 (new pics from bookmarked artists) every few days but sometimes pics that were already there just vanish. Usually I rectify that with function 1 but this time it wouldn’t work. Is it normal to have to delete db.sqlite every now and then. It was about 2MB before it got replaced.

        That aside, it worked. Thank you.

        1. the other way, try to set alwayscheckfilesize = True in config.ini, so it will compare the saved file and the server file size, so if your local file is missing, it will redownload the file.

  12. For some reason I can’t download using the tag list using 2 or more tags. For example if I use γ‚’γƒŠγ‚Ήγ‚Ώγ‚·γ‚’ γ‚’γ‚€γƒ‰γƒ«γƒžγ‚Ήγ‚ΏγƒΌγ‚·γƒ³γƒ‡γƒ¬γƒ©γ‚¬γƒΌγƒ«γ‚Ί nothing is found but I know for sure that something should be there

          3. Nothing changed when using the wildcard option. I noticed that the url generated by the downloader adds a ‘+’ between the tags while just searching on pixiv gives a url with a space between tags. I guess pixiv changed how the urls are generated?

          4. It should change the url to use s_mode=s_tag not the s_mode=s_tag_full

            See my console output
            Input: 3
            Tags: γ‚’γƒŠγ‚Ήγ‚Ώγ‚·γ‚’ γ‚’γ‚€γƒ‰γƒ«γƒžγ‚Ήγ‚ΏγƒΌγ‚·γƒ³γƒ‡γƒ¬γƒ©γ‚¬γƒΌγƒ«γ‚Ί
            Bookmark Count:
            Use Wildcard[y/n]: y
            Oldest first[y/n]:
            Start Page (default=1):
            End Page (default=0, 0 for no limit):
            Start Date [YYYY-MM-DD]:
            End Date [YYYY-MM-DD]:

  13. But I DID use wildcard… And pixiv website shows 500+ pages for exactly same tag, not 6.

      1. Really weird, when I follow your link, it’s showing only 6 pages, but when I go to pixiv main page and type FF6 in search (bar? window? sorry for my weak english, well, where you usually type in tags for searching), I get this result:

        http://imgur.com/LHTUnH3

        I’m totally confused.

        1. most likely because you enter the start and end date on the application, just leave it empty to search all.

          On Wed, Mar 4, 2015 at 5:41 PM, 何だか's Blog wrote:

          >

          1. Thank you, it helps! Tested twice, all working, I’m super happy:)
            May I please ask for future advice – what should I do if I’ll need to download pics of certain period of time, how should I specify dates to avoid the same error?

  14. Happy Lunar New Year and thank you for such useful. tine-saving software!
    But it’s my first tim using this kind of program, and I have a problem, can you help, please?

    I try to download tag FF6 (11245 entries, 500+ pages). But pixivutil downloads only 7 pages than stops.
    “@2015-02-27 02:31:29,763 – PixivUtil20150218-Happy Lunar New Year – INFO – Last page: 7”, it says.
    Oldiest or newest first, with or without wildcard, same result.
    What could be wrong and how to fix it?
    Thank you very much in advance.

      1. My config.ini has no cookie values at all, “cookie = “. It was application’s first run.
        And please forgive me my ignorance, but what do you mean by “generated url for the page”, where in log file should I search for it?

        1. try to find the lines containing “Looping for xxx”

          On Sat, Feb 28, 2015 at 1:22 AM, 何だか's Blog wrote:

          >

          1. Got it!

            2015-03-03 23:34:02,571 – PixivUtil20150218-Happy Lunar New Year – INFO – Looping… for http://www.pixiv.net/search.php?s_mode=s_tag&p=1&word=FF6&scd=2007-09-14&ecd=2015-03-02&order=date
            2015-03-03 23:34:15,898 – PixivUtil20150218-Happy Lunar New Year – DEBUG – Sanitized Filename: D:Portablepixivutil20150218γ‚ˆγγ‚γ‚‹εε­— (7805580)48466333_p0.jpg
            2015-03-03 23:34:15,903 – PixivUtil20150218-Happy Lunar New Year – INFO – Using Referer: http://www.pixiv.net/member_illust.php?mode=medium&illust_id=48466333

            Tested today, this time only 6 pages are found regardless of settings.
            This problem occurs only when I try to download by tag, when I tried to download someone’s bookmarks (2000+ entries), task was completed fully and perfectly.

            This is my config.ini too, maybe some mistakes there?
            [Settings]
            proxyaddress =
            useproxy = False
            useragent = Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.124 Safari/537.36
            debughttp = False
            userobots = True
            filenameformat = %artist% (%member_id%)%image_id%
            filenamemangaformat = %artist% (%member_id%)%urlFilename%
            timeout = 60
            uselist = False
            processfromdb = True
            overwrite = False
            tagsseparator = ,
            daylastupdated = 0
            rootdirectory = .
            retry = 3
            retrywait = 5
            createdownloadlists = False
            downloadlistdirectory = .
            irfanviewpath = C:Program FilesIrfanView
            startirfanview = False
            startirfanslide = False
            alwayscheckfilesize = False
            checkupdatedlimit = 0
            downloadavatar = True
            createmangadir = False
            usetagsasdir = False
            useblacklisttags = False
            usesuppresstags = False
            tagslimit = -1
            writeimageinfo = False
            datediff = 0
            backupoldfile = False
            loglevel = DEBUG
            enabledump = True
            skipdumpfilter =
            dumpmediumpage = False
            writeugoirainfo = False

            [Pixiv]
            numberofpage = 0
            r18mode = False

  15. Hello,
    Thank you for your amazing program.

    It’s not urgent, but in the next update could you add the ability to download multiple bookmark lists (Option 11)?

      1. Well in Option 1 you can enter multiple member IDs separated by spaces and the program will then process them one after another. Can the same be done for Option 11: enter multiple member IDs separated by spaces so all of their bookmarked images can be downloaded?

        The readme file says this can be done, but I think the code to parse multiple IDs is missing.

  16. Greetings! First of all I would like to thank you for Pixiv Downloader, it is such an useful application! Also… I like to request some support if possible, would really appreciate it… The situation is that I downloaded this version and all seemed to work quite fine for some time… But now suddenly I can’t log in from such software (I have checked my user and password, can access normally to the website)… I get the following message…

    2015-02-23 20:03:55,443 – PixivUtil20150218-Happy Lunar New Year – INFO – Starting…
    2015-02-23 20:03:55,454 – PixivUtil20150218-Happy Lunar New Year – INFO – Setting log level to: DEBUG
    2015-02-23 20:03:55,457 – PixivUtil20150218-Happy Lunar New Year – INFO – No default cookie jar available, creating…
    2015-02-23 20:03:55,473 – PixivUtil20150218-Happy Lunar New Year – INFO – Only process member where day last updated >= 7
    2015-02-23 20:04:06,338 – PixivUtil20150218-Happy Lunar New Year – INFO – Log in using form.
    2015-02-23 20:04:10,392 – PixivUtil20150218-Happy Lunar New Year – INFO – Logging in, return url: https://www.secure.pixiv.net/login.php
    2015-02-23 20:04:10,663 – PixivUtil20150218-Happy Lunar New Year – ERROR – Server Reply: pixiv IDγ€γΎγŸγ―γƒ‘γƒΌγƒ«γ‚’γƒ‰γƒ¬γ‚Ήγ€γƒ‘γ‚Ήγƒ―γƒΌγƒ‰γŒζ­£γ—γ„γ‹γƒγ‚§γƒƒγ‚―γ—γ¦γγ γ•γ„γ€‚
    2015-02-23 20:04:10,673 – PixivUtil20150218-Happy Lunar New Year – ERROR – Server Reply: pixiv IDγ€γΎγŸγ―γƒ‘γƒΌγƒ«γ‚’γƒ‰γƒ¬γ‚Ήγ€γƒ‘γ‚Ήγƒ―γƒΌγƒ‰γŒζ­£γ—γ„γ‹γƒγ‚§γƒƒγ‚―γ—γ¦γγ γ•γ„γ€‚
    2015-02-23 20:04:10,687 – PixivUtil20150218-Happy Lunar New Year – ERROR – Error at pixiv_login():(, TypeError(“cannot concatenate ‘str’ and ‘NoneType’ objects”,), )
    2015-02-23 20:04:10,687 – PixivUtil20150218-Happy Lunar New Year – ERROR – Error at pixiv_login(): (, TypeError(“cannot concatenate ‘str’ and ‘NoneType’ objects”,), )
    Traceback (most recent call last):
    File “PixivBrowserFactory.pyc”, line 184, in loginHttp
    File “PixivBrowserFactory.pyc”, line 229, in processLoginResult
    TypeError: cannot concatenate ‘str’ and ‘NoneType’ objects
    2015-02-23 20:04:10,693 – PixivUtil20150218-Happy Lunar New Year – ERROR – Unknown Error: cannot concatenate ‘str’ and ‘NoneType’ objects
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1718, in main
    File “PixivBrowserFactory.pyc”, line 184, in loginHttp
    File “PixivBrowserFactory.pyc”, line 229, in processLoginResult
    TypeError: cannot concatenate ‘str’ and ‘NoneType’ objects
    2015-02-23 20:04:23,299 – PixivUtil20150218-Happy Lunar New Year – INFO – EXIT
    2015-02-23 20:04:23,299 – PixivUtil20150218-Happy Lunar New Year – INFO – ###############################################################
    2015-02-24 23:57:57,415 – PixivUtil20150218-Happy Lunar New Year – INFO – ###############################################################

    1. The server said either your username or password is wrong (Server Reply: pixiv IDγ€γΎγŸγ―γƒ‘γƒΌγƒ«γ‚’γƒ‰γƒ¬γ‚Ήγ€γƒ‘γ‚Ήγƒ―γƒΌγƒ‰γŒζ­£γ—γ„γ‹γƒγ‚§γƒƒγ‚―γ—γ¦γγ γ•γ„γ€‚)

      The error because of the incomplete handling when server return error.

      Try to key in the username/password correctly or directly in config.ini. If still cannot log in, try the cookie method (check readme.txt).

    1. nope, you cant download more than 1000 pages, the website itself limit the number of pages you can browse (site limitation).

  18. ζ„Ÿθ°’ζ›΄ζ–°οΌŒηΊ’εŒ…ε·²ε‘οΌŒθ―·ζŸ₯paypal。

    Thanks for the update,send you a HongBao,check your paypal.
    πŸ™‚

Comments are closed.