41 thoughts on “pixiv downloader 20140126”

  1. Thank you for this fantastic program.
    But one problem occurs on my computer.
    When I use [3. Download by tags] function, I want to limit the number of bookmarks and I input the number.
    Then the program skips all the images, and I can see all the images have bookmark number “-1”.
    How can I solve it?

  2. Fantastic. Thank you very much for this, and sorry for my earlier blunder using the wrong tool for the job… It’s working perfectly.

  3. somehow there is some problem with the bookmark count…
    everytime i download with tags, put a bookmark count.. for example ( bookmark count : 20 )
    but all of the pic bookmark count become -1 / 0
    any solution

  4. Could you make it so that the author, title, tags, and description can be downloaded as metadata?

    1. As the picture metadata, no. As text extra file, yes (set writeimageinfo = True in config.ini).
      I don’t want to modify the exif in the image itself.

      1. I was thinking it could be an interesting option to enhance browsing, however you obviously have a good reason that I’m not aware of.

  5. Hey I just want to ask, is there a feature for downloading new illustrations from favorite users where I can “bookmark” one of the pictures so that next time when I use the downloaded I know exactly which page to start from? I don’t use Pixiv often so sometimes I might be 30+ pages behind and as a result, it’s very pain in the ass to find the last downloaded picture.

    1. No feature for that. Anyway, the downloader will skip the image if it is already downloaded. Just make sure you set overwrite = False and alwayscheckfilesize = False in config.ini

  6. I look danbooru downloader 20140204
    Are you Chinese?
    Maybe I could tell you Chinese Language…….

  7. Downloads no more work.

    I always get the message:

    Press enter to retry
    Image url not found

    1. Please give more details, including the log file (pixivutil.log). you can upload it to pastebin.

      Tested with the latest version and I can download by member id/image id.

  8. Hi!

    First thing first: I really appreciate your work you have done for us ๐Ÿ™‚

    Second: I found an interesting “feature” while downloading by multiple tags. Sometimes after the “Processing image ID” line it says “Not enough storage is available to process this command.”, then it downloads the image without issue.
    Picture:
    http://imgur.com/tMXGSg4

    How I caused this:
    I didn’t use the “download from tags list” function exactly as it was intended. As many of the tags I’m currently searching for overlaps I used the format pixiv uses when searching as “Includes any of these words”. So the (A_keyword OR B_keyword OR C_Keyword) format.
    Right now I happened to overdo this as I have 14 similar keywords. So the content of my tags txt file is the following:
    (ใ‚ขใƒฉใ‚ฏใƒ OR ใ‚ใ‚‰ใใญ OR ใ‚ขใƒซใ‚ฑใƒ‹ใƒผ OR ใ‚ใ‚‹ใ‘ใซใƒผ OR Arachne OR Arakune OR spider_girl OR ๅฅณ้ƒŽ่œ˜่›› OR ใ˜ใ‚‡ใ‚ใ†ใใ‚‚ OR ็ตกๆ–ฐๅฉฆ OR ่œ˜่››ๅจ˜ OR ใใ‚‚ใ‚€ใ™ใ‚ OR ่œ˜่››ๅฅณ OR ใใ‚‚ใŠใ‚“ใช)
    In the log it looks like this:
    %28%E3%82%A2%E3%83%A9%E3%82%AF%E3%83%8D+OR+%E3%81%82%E3%82%89%E3%81%8F%E3%81%AD+OR+%E3%82%A2%E3%83%AB%E3%82%B1%E3%83%8B%E3%83%BC+OR+%E3%81%82%E3%82%8B%E3%81%91%E3%81%AB%E3%83%BC+OR+Arachne+OR+Arakune+OR+spider_girl+OR+%E5%A5%B3%E9%83%8E%E8%9C%98%E8%9B%9B+OR+%E3%81%98%E3%82%87%E3%82%8D%E3%81%86%E3%81%90%E3%82%82+OR+%E7%B5%A1%E6%96%B0%E5%A9%A6+OR+%E8%9C%98%E8%9B%9B%E5%A8%98+OR+%E3%81%8F%E3%82%82%E3%82%80%E3%81%99%E3%82%81+OR+%E8%9C%98%E8%9B%9B%E5%A5%B3+OR+%E3%81%8F%E3%82%82%E3%81%8A%E3%82%93%E3%81%AA%29

    I don’t really know if this is an issue or not, what is actually causing it or it how it affects the download, but thought I’d notify you.

    Sincerely,
    gorsmaster

    1. Not sure what is the reasons. Checking google, it looks like related to the memory (RAM) issues on 32 bit OS, not on the disk space.

      1. More than half of my 4GB Memory is free and I’m using a 64 bit OS.
        I tried changing several values in my registry suggested around the internet, none of them helped.

        But I was thinking (sorry if the question is stupid, I don’t know anything about python programming): is it possible that the program runs out of allocated memory?

  9. Hello!
    first it is a great tool but i wanted to ask if it possible to download more than one images at a time?

  10. My English is not good ……
    I hope to have “TAG ๆœ€ๆ—ง้ †ๅบ ใ™ในใฆใฎๆœŸ้–“”
    PIXIV have this function

    Because it avoids skipped pictures
    You know, In Search TAG, System Update Image ,Skip will occur
    Sorry I do not express

  11. You can add new functionality?
    I hope to have a sequence to start the search from the oldest
    Avoid updated pictures, sequence changes occur

    thank you

    1. >> I hope to have a sequence to start the search from the oldest
      Not possible, as pixiv doesn’t expose the capability. What I can add is limited by the options on the Advanced Search.

      >> Avoid updated pictures
      This already implemented, make sure you set alwayscheckfilesize = False

      >> sequence changes occur
      Not clear what you want here.

  12. D:

    Error at pixiv_login(): (, <
    httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x2af45
    70 whose wrapped object = <closeable_response at 0x2af9bc0 whose fp = >>, )
    failed
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1746, in main
    File “PixivUtil2.py”, line 258, in pixiv_login
    File “mechanize_mechanize.pyc”, line 203, in open
    File “mechanize_mechanize.pyc”, line 255, in _mech_open
    httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
    press enter to exit.

  13. Hi! I got strange happenings when downloading by tag:
    It happens suddenly and without warning, in the middle of process.

    Image #1271
    Image Id: 39912521
    Bookmark Count: 1
    Processing Image Id: 39912521
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 615, in process_image
    image = PixivImage(iid=image_id, page=parse_medium_page, parent=artist, fromBookmark=bookmark)
    File “/home/nho/workshop/PixivUtil2/PixivModel.py”, line 240, in __init__
    self.artist = PixivArtist(page=page, fromImage=True)
    File “/home/nho/workshop/PixivUtil2/PixivModel.py”, line 49, in __init__
    self.ParseInfo(page, fromImage)
    File “/home/nho/workshop/PixivUtil2/PixivModel.py”, line 63, in ParseInfo
    temp = str(avatarBox.find(‘a’)[‘href’])
    AttributeError: ‘NoneType’ object has no attribute ‘find’
    Error at process_image(): (, AttributeError(“‘NoneType’ object has no attribute ‘find'”,), )
    Dumping html to: Error Medium Page for image 39912521.html
    Error at process_tags(): (, AttributeError(“‘NoneType’ object has no attribute ‘find'”,), )
    Error at process_tags_list(): (, AttributeError(“‘NoneType’ object has no attribute ‘find'”,), )
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1774, in main
    menu_download_from_tags_list(mode, op_is_valid, args)
    File “PixivUtil2.py”, line 1511, in menu_download_from_tags_list
    process_tags_list(mode, filename, page, end_page)
    File “PixivUtil2.py”, line 972, in process_tags_list
    process_tags(mode, tag, page=page, end_page=end_page, use_tags_as_dir=__config__.useTagsAsDir)
    File “PixivUtil2.py”, line 924, in process_tags
    process_image(mode, None, item.imageId, search_tags=search_tags, title_prefix=title_prefix)
    File “PixivUtil2.py”, line 615, in process_image
    image = PixivImage(iid=image_id, page=parse_medium_page, parent=artist, fromBookmark=bookmark)
    File “/home/nho/workshop/PixivUtil2/PixivModel.py”, line 240, in __init__
    self.artist = PixivArtist(page=page, fromImage=True)
    File “/home/nho/workshop/PixivUtil2/PixivModel.py”, line 49, in __init__
    self.ParseInfo(page, fromImage)
    File “/home/nho/workshop/PixivUtil2/PixivModel.py”, line 63, in ParseInfo
    temp = str(avatarBox.find(‘a’)[‘href’])
    AttributeError: ‘NoneType’ object has no attribute ‘find’

  14. can i batch download image from list image id (not member id)?
    example: 38489045, 38542690, 40248263, …………………………etc

  15. Hey, I keep getting the “AttributeError: ‘NoneType’ object has no attribute ‘ul'” error when I run pixivutil.
    I have system locale set to Japanese, and checked my username/password.

    Here’s the full errormessage:

    Traceback (most recent call last):
    File “PixivUtil2.py”, line 418, in process_member
    File “PixivModel.pyc”, line 46, in __init__
    File “PixivModel.pyc”, line 122, in ParseImages
    AttributeError: ‘NoneType’ object has no attribute ‘ul’
    2014-01-31 09:59:37,546 – PixivUtil20131218 – ERROR – Dumping html to: Error page for member 23267.html
    2014-01-31 09:59:37,548 – PixivUtil20131218 – ERROR – Error at process_bookmark(): (, AttributeError(“‘NoneType’ object has no attribute ‘ul'”,), )
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1063, in process_bookmark
    File “PixivUtil2.py”, line 418, in process_member
    File “PixivModel.pyc”, line 46, in __init__
    File “PixivModel.pyc”, line 122, in ParseImages
    AttributeError: ‘NoneType’ object has no attribute ‘ul’
    2014-01-31 09:59:37,548 – PixivUtil20131218 – ERROR – Unknown Error: ‘NoneType’ object has no attribute ‘ul’
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1766, in main
    File “PixivUtil2.py”, line 1466, in menu_download_from_online_user_bookmark
    File “PixivUtil2.py”, line 1063, in process_bookmark
    File “PixivUtil2.py”, line 418, in process_member
    File “PixivModel.pyc”, line 46, in __init__
    File “PixivModel.pyc”, line 122, in ParseImages
    AttributeError: ‘NoneType’ object has no attribute ‘ul’
    2014-01-31 13:01:27,461 – PixivUtil20131218 – INFO – EXIT
    2014-01-31 13:01:27,463 – PixivUtil20131218 – INFO – ###############################################################

    1. Ensure the language settings in Pixiv website is set to English or Japanese.
      Upload the dump page to mediafire if still happen.

      FYI, it is working in my pc.

        1. The dump page ‘Error page for member 74093.html’ says you are not logged in. Somehow pixiv reject your login info.

          Q3. I cannot login to pixiv!
          – Check your password.
          – Try to login to the Pixiv Website.
          – Try to use the config.ini on the [Authentication] section.
          – Check your date and time setting (e.g.: http://www.timeanddate.com/)
          – Disable Daylight Saving Time and try again.
          – Copy your session values from browser:
          1. Open Firefox.
          2. Go to Pixiv website and login, remember to enable [Remember Me]
          check box.
          3. Right click the page and select View Page Info.
          4. Click the Security tab.
          5. Click the View Cookies button.
          6. Look for Cookie named = PHPSESSID.
          7. Copy the content value.
          8. Open config.ini, go to [Authentication] section, paste the value
          to cookie, set keepsignedin = 1.

          The 1004 is valid, as no images in the page.

          1. Fixed, thank you very much.

            Will I have to redo this if I clear all history from firefox?

Comments are closed.