41 thoughts on “pixiv downloader 20141006”

  1. I get this error every time I try to pass a certain image

    Image #2544
    Processing Image Id: 40789252
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 608, in process_image
    File “PixivModel.pyc”, line 224, in __init__
    File “PixivModel.pyc”, line 281, in ParseInfo
    AttributeError: ‘NoneType’ object has no attribute ‘findAll’
    Error at process_image(): (, AttributeError(“‘
    NoneType’ object has no attribute ‘findAll'”,),
    )
    Error at process_image_bookmark(): (, Attribut
    eError(“‘NoneType’ object has no attribute ‘findAll'”,), )
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1792, in main
    File “PixivUtil2.py”, line 1598, in main_loop
    File “PixivUtil2.py”, line 1461, in menu_download_from_online_image_bookmark
    File “PixivUtil2.py”, line 968, in process_image_bookmark
    File “PixivUtil2.py”, line 608, in process_image
    File “PixivModel.pyc”, line 224, in __init__
    File “PixivModel.pyc”, line 281, in ParseInfo
    AttributeError: ‘NoneType’ object has no attribute ‘findAll’
    press enter to exit.

  2. So, I am getting this after download by tag list gets done:

    Error at process_tags(): (, TypeError(“cannot concatenate ‘str’ and ‘int’ objects”,), )
    Cannot dump page for search tags:マイリトルポニー
    Error at process_tags_list(): (, UnboundLocalError(“local variable ‘search_page’ referenced before assignment”,), )
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1679, in main
    np_is_valid, op_is_valid, selection = main_loop(ewd, mode, op_is_valid, selection, np_is_valid, args)
    File “PixivUtil2.py”, line 1487, in main_loop
    menu_download_from_tags_list(mode, op_is_valid, args)
    File “PixivUtil2.py”, line 1362, in menu_download_from_tags_list
    process_tags_list(mode, filename, page, end_page)
    File “PixivUtil2.py”, line 818, in process_tags_list
    process_tags(mode, tag, page=page, end_page=end_page, use_tags_as_dir=__config__.useTagsAsDir)
    File “PixivUtil2.py”, line 804, in process_tags
    if search_page is not None:
    UnboundLocalError: local variable ‘search_page’ referenced before assignment

  3. thx very much for keep the gadget updated.
    I have 2 tiny problems that the first one is that program doesn’t download anything whether I try to use list.txt or download by member_id or anything, the thread stops at “processing image id: XXXXXXX”.
    and the second one is that even thought i set in config.ini “daylastupdated = 1” or “daylastupdated = 0” not every member’s folders or images are updated. I notice that some keeps un-updated for months. I wonder what could be the cause.

  4. 2014-10-29 04:35:50,444 – PixivUtil20141006 – INFO – Found file with different file size, removing old file (old: 154675 vs new: -1)
    2014-10-29 04:35:50,868 – PixivUtil20141006 – DEBUG – Sanitized Filename: C:MiscPixiv ArtistsTiv (35081)35345456_big_p14 – 政宗くんのリベンジ　らくがきまとめ.jpg
    2014-10-29 04:35:51,154 – PixivUtil20141006 – INFO – Found file with different file size, removing old file (old: 126565 vs new: -1)
    2014-10-29 04:35:51,444 – PixivUtil20141006 – DEBUG – Sanitized Filename: C:MiscPixiv ArtistsTiv (35081)35345456_big_p15 – 政宗くんのリベンジ　らくがきまとめ.jpg
    2014-10-29 04:35:51,763 – PixivUtil20141006 – INFO – Found file with different file size, removing old file (old: 94366 vs new: -1)
    2014-10-29 04:35:52,000 – PixivUtil20141006 – DEBUG – Sanitized Filename: C:MiscPixiv ArtistsTiv (35081)35345456_big_p16 – 政宗くんのリベンジ　らくがきまとめ.jpg
    2014-10-29 04:35:52,282 – PixivUtil20141006 – INFO – Found file with different file size, removing old file (old: 135143 vs new: -1)
    2014-10-29 04:35:52,546 – PixivUtil20141006 – DEBUG – Sanitized Filename: C:MiscPixiv ArtistsTiv (35081)35345456_big_p17 – 政宗くんのリベンジ　らくがきまとめ.jpg
    2014-10-29 04:35:52,822 – PixivUtil20141006 – INFO – Found file with different file size, removing old file (old: 118165 vs new: -1)
    2014-10-29 04:35:53,102 – PixivUtil20141006 – DEBUG – Sanitized Filename: C:MiscPixiv ArtistsTiv (35081)35345456_big_p18 – 政宗くんのリベンジ　らくがきまとめ.jpg
    2014-10-29 04:35:53,381 – PixivUtil20141006 – INFO – Found file with different file size, removing old file (old: 162096 vs new: -1)
    2014-10-29 04:35:53,736 – PixivUtil20141006 – DEBUG – Sanitized Filename: C:MiscPixiv ArtistsTiv (35081)35345456_big_p19 – 政宗くんのリベンジ　らくがきまとめ.jpg
    2014-10-29 04:35:54,012 – PixivUtil20141006 – INFO – Found file with different file size, removing old file (old: 110901 vs new: -1)
    2014-10-29 04:35:54,335 – PixivUtil20141006 – DEBUG – Sanitized Filename: C:MiscPixiv ArtistsTiv (35081)35345456_big_p20 – 政宗くんのリベンジ　らくがきまとめ.jpg
    2014-10-29 04:35:54,638 – PixivUtil20141006 – INFO – Found file with different file size, removing old file (old: 206034 vs new: -1)
    2014-10-29 04:35:55,056 – PixivUtil20141006 – DEBUG – Sanitized Filename: C:MiscPixiv ArtistsTiv (35081)35345456_big_p21 – 政宗くんのリベンジ　らくがきまとめ.jpg
    2014-10-29 04:35:55,335 – PixivUtil20141006 – INFO – Found file with different file size, removing old file (old: 356247 vs new: -1)
    2014-10-29 04:35:55,845 – PixivUtil20141006 – DEBUG – Sanitized Filename: C:MiscPixiv ArtistsTiv (35081)35345456_big_p22 – 政宗くんのリベンジ　らくがきまとめ.jpg
    2014-10-29 04:35:56,173 – PixivUtil20141006 – INFO – Found file with different file size, removing old file (old: 247796 vs new: -1)
    2014-10-29 04:35:56,934 – PixivUtil20141006 – DEBUG – Sanitized Filename: C:MiscPixiv ArtistsTiv (35081)35345456_big_p23 – 政宗くんのリベンジ　らくがきまとめ.jpg
    2014-10-29 04:35:57,203 – PixivUtil20141006 – INFO – Found file with different file size, removing old file (old: 138398 vs new: -1)
    2014-10-29 04:35:57,523 – PixivUtil20141006 – DEBUG – Sanitized Filename: C:MiscPixiv ArtistsTiv (35081)35345456_big_p24 – 政宗くんのリベンジ　らくがきまとめ.jpg
    2014-10-29 04:35:57,792 – PixivUtil20141006 – INFO – Found file with different file size, removing old file (old: 160606 vs new: -1)

    It all replaced the high res image to low res image.
    I knew this would happen sooner.
    It says the new file size is -1.
    Dunno why it keeps getting a -1 value.

  5. Input: 1
    Member ids: 2229834
    Start Page (default=1):
    End Page (default=0, 0 for no limit):
    Processing Member Id: 2229834
    Reading C:UsersllstDownloadspixivutil20141006config.ini …
    done.
    Page 1
    Member Url: http://www.pixiv.net/member_illust.php?id=2229834&p=1
    Member Name : KWS
    Member Avatar: http://i1.pixiv.net/img59/profile/kgprojec/2030325.jpg
    Member Token : kgprojec
    Using Referer: http://www.pixiv.net/member_illust.php?id=2229834&p=1
    Start downloading… File exist! (Identical Size)
    #1
    Processing Image Id: 46036586
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 608, in process_image
    File “PixivModel.pyc”, line 226, in __init__
    File “PixivModel.pyc”, line 325, in ParseWorksData
    UnicodeEncodeError: ‘ascii’ codec can’t encode character u’ub144′ in position 4
    : ordinal not in range(128)
    Error at process_image(): (, UnicodeEncode
    Error(‘ascii’, u’2014ub1449uc6d417uc77c 21:36′, 4, 5, ‘ordinal not in range(1
    28)’), )
    Stuff happened, trying again after 2 second ( 1 )
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 506, in process_member
    File “PixivUtil2.py”, line 608, in process_image
    File “PixivModel.pyc”, line 226, in __init__
    File “PixivModel.pyc”, line 325, in ParseWorksData
    —- my clipping — End this comment
    “Giving up image_id: 46036586”

    The errors appearing when you enter the Pixiv ID 2229834
    Enter the same number, and even other members of the same settings as above also haejueo comments.
    Please check problem

    1. tried to run in my pc, and it is working OK.

      Try to set your windows Languange for Non-Unicode to Japanese in Control Panel’s Regional Settings.

    2. I have same problem.
      I changed my system locale setting to Japanese.
      but I still get the same error message…

  7. First, thank you of ‘pixivutil’
    But When i download image using [Download by image_id] i get a Error

    2014-10-26 15:42:02,782 – PixivUtil20141006 – ERROR – Error at process_image(): (, UnicodeEncodeError(‘ascii’, u’2008ub1442uc6d413uc77c 02:21′, 4, 5, ‘ordinal not in range(128)’), )
    2014-10-26 15:42:02,782 – PixivUtil20141006 – ERROR – Error at process_image(): 425184
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 608, in process_image
    File “PixivModel.pyc”, line 226, in __init__
    File “PixivModel.pyc”, line 325, in ParseWorksData
    UnicodeEncodeError: ‘ascii’ codec can’t encode character u’ub144′ in position 4: ordinal not in range(128)
    2014-10-26 15:42:02,788 – PixivUtil20141006 – ERROR – Unknown Error: ‘ascii’ codec can’t encode character u’ub144′ in position 4: ordinal not in range(128)
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1792, in main
    File “PixivUtil2.py”, line 1590, in main_loop
    File “PixivUtil2.py”, line 1329, in menu_download_by_image_id
    File “PixivUtil2.py”, line 608, in process_image
    File “PixivModel.pyc”, line 226, in __init__
    File “PixivModel.pyc”, line 325, in ParseWorksData
    UnicodeEncodeError: ‘ascii’ codec can’t encode character u’ub144′ in position 4: ordinal not in range(128)

    Can you get it fixed?

    1. not manga ….

      problem is – ERROR – Unknown Error: ‘ascii’ codec can’t encode character u’ub144′ in position 4: ordinal not in range(128)
      Traceback (most recent call last):

      the pixiv image was an experiment with, this error continues to pop up.

    2. It is working in my pc, try to set your windows Regional Settings -> Language for Non-Unicode to Japanese in Control Panel?

  8. How does PixivUtil download from the list?
    I tried using the download from list feature.
    I have multiple memberid but it doesn’t start at the top nor at the bottom.
    Currently, I have downloaded from 5 members and the only pattern I see is that, it sorts memberid and it started from the lowest value. Is it possible to start it with the order in the list.txt?

  9. Can you tell me how to delete all list member_id (list.txt) in database, because I want to update my list but db.sqlite still saving the old list.txt , thank you.

    1. 3 ways:
      1. Open the application and choose Manage Database (d) then select delete Member by Member Id
      2. Open the database (db.sqlite) directly using sqlite browser and use sql command to delete it.
      3. If you are downloading using Download from List.txt (3), you can create ignore_list.txt to skip the member id.

      1. Yes, it’s works. But…
        1. Must put id one by one.
        2. I don’t know how to do it.
        3. How can I extract list.txt that I don’t want to download from db.sqlite

        So, I try to use “usedatabase = False” to not use db.sqlite and yeah it’s work.
        Unfortunately, these method can’t resume my download from my last downloaded.
        Fortunately, these method still saving data of image that I have downloaded.

  12. I have found that if an image has been set to private in Pixiv, when pixivdownloader tries to retrieve the image, it returns the following error:

    PixivUtil20141004c – ERROR – Error at process_image_bookmark(): (, AttributeError(“‘NoneType’ object has no attribute ‘findAll'”,), )

    My current fix was to find the corresponding image and remove my bookmark before resuming my downloads, however that might not work for some who may have a bunch of privatized images. (Luckily I have only ran into one such error myself)

  13. Thanks for quick updates!

    I was wondering if you could add an option to skip download if a file with a higher size is existing.
    I stroll over some of the downloads and saw that some files downloaded are a bit pixelated.
    I thought it was normal.
    On the next day, PixivUtil says on the logs that a file with different size already exists and it downloaded the image again. There’s where I saw the difference.
    The image became clear.
    I don’t know if it is related in pixiv’s ever-changing layout.
    Or I don’t know if it is related in this part.

    Q1: HTTPError: HTTP Error 404: Not Found
    – This is because the file doesn’t exists in the pixiv server, usually
    because there is no big images version for the manga mode (currently the
    apps will try to download the big version first then try the normal size
    if failed, this is only for the manga mode and it is normal).

    But I was also thought what if an image with higher resolution already exist but pixiv changed their layout again and PixivUtil overwrite the High Resolution Picture with the Normal One? I don’t know if it is possible but in case that pixivUtil overwrites high resolution files with low resolution files, it would be better if an option to skip download on existing files with higher file size would be available.
    Just a thought :))

    1. Oh, and I saw this in the logs.
      INFO – Found file with different file size, removing old file (old: 35767 vs new: 109013)
      The old file is 35767 bytes and the new one is 109013 bytes.
      It’s good that it is replacing the lower one with a higher one.
      But what if it replace the higher one with the lower one?

      2. You should always set “backupoldfile” to True just to be safe. I’ve had newer versions of images replace higher res stuff before but with that option set it saves both images.

  14. Kind of curious, does the “download new illus from bookmark” feature take pixiv premium’s 5k image limit into account? I started out at page 99 and ended at 0, but it caps out at 2,000 images (I got premium recently though).

  15. Can you apply setting that ‘download from user bookmark WITH Tag settings’?

      1. This is so weird that is it currently working for me.
        Thanks for the quick update, as usual. 🙂

Comments are closed.