Pixiv Downloader 20110729 (updated)

Change log:

  • add auto save cookie from login
  • refactor parsing logic to the PixivModel
  • updating Python version to 2.7.2
  • updating mechanize version to 0.2.5
  • updating BeautifulSoup version to 3.2.0
  • add unittest for the parsing (only in source code)
  • fix 404 in big_manga mode (20110729b)

Download link here here(20110729b), source code here here(20110729b), and unit test here. You can get the latest source in the public repo.

39 thoughts on “Pixiv Downloader 20110729 (updated)”

  1. I tried upgrading, been a while, I was previously running 20101024, which seems to work mostly (I think it’s not getting some/all of the newer manga which is why I was looking to upgrade), but the upgrade was a real mess. The old version doesn’t try to download pictures it’s already downloaded in the past, it gives the “Already downloaded” message for them. The new one? Tries to download ever single picture all over again. I did some searching and saw some suggestions for the config.ini, and added those, and even copied the database over from my backup to start fresh and… it continues to try to download every freaking image all over again. This is a MAJOR problem for me, as I use the filenameformat of %member_id% (%artist%)%image_id% – %title%, and some of the artists in my database change their nick fairly often. I don’t want to download all their images all over again every time they do (not to mention it takes about twice as long for the program to fail out on file exists than it does for it to just skip it as already downloaded). Here’s the config.ini for the new version:

    [Settings]
    proxyaddress =
    useproxy = False
    useragent = Mozilla/5.0 (X11; U; Unix i686; en-US; rv:1.9.0.1) Gecko/2008071615 Fedora/3.0.1-1.fc9 Firefox/3.0.1
    debughttp = False
    userobots = True
    filenameformat = %member_id% (%artist%)%image_id% – %title%
    timeout = 60
    uselist = True
    processfromdb = True
    overwrite = False
    tagsseparator = ,
    daylastupdated = 7
    rootdirectory =
    retry = 3
    retrywait = 5
    rootdirectory = M:ImagesPixiv
    createdownloadlists = False
    downloadlistdirectory = ..
    irfanviewpath = C:Program FilesIrfanView
    startirfanview = False
    startirfanslide = False
    alwayscheckfilesize = True
    checkUpdatedLimit = 10

    [Pixiv]
    numberofpage = 0

    Hopefully you can tell me what’s wrong, as I’d like to upgrade and get the images the older version misses, but not badly enough to risk redownloading ~5GB of stuff. 🙁 Oh yes, I’ve tried checkUpdatedLimit both mixed case and all lowercase as the program added it to the config in the first place. Neither worked.

    1. Also, what happened to the feature where it would automatically save it to a folder with the artist’s name and ID?

    2. check your config.ini and read the readme.txt. try to run it from cmd and paste the error message. All is fine in my side.

      1. I’ve read the readme, and I understand.
        What I’m saying is that it does not seem to save the galleries to their respected folders, but instead saves it all to a folder named “_”
        This is with these settings:

        [Settings]
        proxyaddress =
        useproxy = False
        useragent = Mozilla/5.0 (X11; U; Unix i686; en-US; rv:1.9.0.1) Gecko/2008071615 Fedora/3.0.1-1.fc9 Firefox/3.0.1
        debughttp = False
        userobots = True
        filenameformat = %artist% (%member_id%)%image_id% – %title%
        timeout = 60
        uselist = False
        processfromdb = False
        overwrite = False
        tagsseparator = ,
        daylastupdated = 7
        rootdirectory =
        retry = 3
        retrywait = 5
        createdownloadlists = True
        downloadlistdirectory = V:Pixiv Batch Downloader
        irfanviewpath = C:Program FilesIrfanView
        startirfanview = False
        startirfanslide = False
        alwayscheckfilesize = True
        checkupdatedlimit = 0

        I know it says in the readme that you can specify a directory for each ID, but is that totally necessary for each gallery to be saved to their specific folders? That was not a requirement in the previous versions so I assumed it isn’t a requirement in this one.
        My list goes as such:

        1234
        5678
        91011

        ###END-OF-FILE###

          1. and retype your filenameformat, the dash sign is not the standard one (it long one/em dash), replace it with the – sign

      2. Like I said, the program will not open when “uselist = True”.
        It closes as soon as the window pops up.
        I’m running Windows 7 64-bit if that helps.

        1. set “uselist = True” and try to run it from the console/cmd and paste the output or just paste the log file (log.txt)

      3. Ah, ok. I found the problem through the cmd method. Apparently you can’t have spaces in the list.
        1234
        5678
        91011
        ***LIKE HERE***
        ###END-OF-FILE###
        Thanks =)

  5. I am getting this after i enter in a pixiv member id

    reading config file…done

    page 1

    ‘NoneType’ object has no attribute ‘ul’
    1 2 3 4
    ‘NoneType’ object has no attribute ‘ul’
    1 2 3 4

    and it continues.

    1. Never mind I misunderstood the directions, I thought it was the User ID not the number.

      1. ERROR – Error at downloadImage(): Cannot save http://img16.pixiv.net/img/paxa_600/21011065_big_p0.jpg to G:pixiv(263522) 21011065 -name――_big_p0.jpg (, IOError(2, ‘No such file or directory’), )
        2011-08-13 18:36:11,355 – PixivUtil20110729 – ERROR – Error at downloadImage(): (, WindowsError(3, ”), )
        2011-08-13 18:36:15,536 – PixivUtil20110729 – ERROR – Error at downloadImage(): Cannot save http://img16.pixiv.net/img/paxa_600/21011065_big_p0.jpg to G:pixiv(263522) 21011065 – name――_big_p0.jpg (, IOError(2, ‘No such file or directory’), )
        2011-08-13 18:36:17,940 – PixivUtil20110729 – ERROR – Error at downloadImage(): (, WindowsError(3, ”), )
        2011-08-13 18:36:22,137 – PixivUtil20110729 – ERROR – Error at downloadImage(): Cannot save http://img16.pixiv.net/img/paxa_600/21011065_big_p0.jpg to G:pixiv(263522) 21011065 – name――_big_p0.jpg (, IOError(2, ‘No such file or directory’), )
        2011-08-13 18:36:24,562 – PixivUtil20110729 – ERROR – Error at downloadImage(): (, WindowsError(3, ”), )

        1. there is a problem with the filename, can I see your filename format in the config.ini? probably it is because your os doesn’t support japanese character, what is your os? try to change the format to %member_id%%image_id%.

          I have tried to download it in different pc, and it is working.

  7. For some reason, Pixiv Downloader closes for me when I run it. I’m sure I’m putting in the correct password, but it always closes. It always closes before I can read the error message or make a screenshot. Does anybody else have this problem?

    For my username and password, I have tried both inputting normally and typing it in the config.ini. I do not have capslock turned on and I am absolutely sure I’m not using the wrong username and password. Did Pixiv change something lately so Pixiv Download can’t connect?

    1. Okay, I managed to get a screenshot and here is the error message I get:

      Wrong username or password.
      Traceback (most recent call last):
      File “PixivUtil2.py”, line 887, in
      File “PixivUtil2.py”, line 882, in main
      UnboundLocalError: local variable ‘selection’ referenced before assignment

      1. Okay, some of the error message didn’t get through, so I’ll type it out again:

        Wrong username or password.
        Traceback (most recent call last):
        File “PixivUtil2.py”, line 887, in
        File “PixivUtil2.py”, line 882, in main
        UnboundLocalError: local variable ‘selection’ referenced before assignment

        (“module” doesn’t have spaces between the brackets, it’s just that typing them together doesn’t show up in the comment.)

      2. I tried it now and it’s working again. I don’t know why it wasn’t an hour ago. It may be a connection error or something.

        Thanks for this great software, it saves me a lot of time and the features are excellent.

    1. it is because of different filename schema, previously the page marker (_p0) is after the image_id, now it is on the last before the file extension.

  9. I have a very strange problem with this version where I can enter my username but when typing password, nothing is typed in the command line.

    1. it is normal, I think this is already implemented since the last few version. Anyway, if you not sure, you can always edit config.ini and fill the username and password in the Authentication section.

Comments are closed.