pixiv downloader 20120803

Change log:

  • Fix config.ini path resolution to the actual path where the script reside, not the working dir.
  • Update page parser and unittest.
  • Append 0 for %page_number% depending on total manga page.

Download link for PixivUtil20120803, and source code. Donation link on the sidebar 🙂

EDIT: updated to handle unicode for manga page

EDIT2: update to handle unicode in works date

25 thoughts on “pixiv downloader 20120803”

    1. start -> run -> cmd. Go to the app folder and run it, it should show the error, or check what is in the log file. Mine also set in Japanese locale, but all ok.

    1. set the save the folder without special character, rather extract the whole archive in folder without special character. Somehow got problem if the app folder have it.

  1. Sometimes, downloader writes into downloaded list multiple instances of one picture from manga. I do not know why.

      1. filenamemangaformat = %member_id%%image_id% – %title%_%page_index%

        and it looks like
        G:confpixiv453537629130190 – 絵チャ1_0.png
        G:confpixiv453537629130190 – 絵チャ1_1.png
        G:confpixiv453537629130190 – 絵チャ1_2.png
        G:confpixiv453537629130190 – 絵チャ1_3.png
        G:confpixiv453537629130190 – 絵チャ1_4.png
        G:confpixiv453537629130190 – 絵チャ1_5.png
        G:confpixiv453537629130190 – 絵チャ1_6.png
        G:confpixiv453537629130190 – 絵チャ1_7.png
        G:confpixiv453537629130190 – 絵チャ1_8.png
        G:confpixiv453537629130190 – 絵チャ1_9.png
        G:confpixiv453537629130190 – 絵チャ1_1.png
        G:confpixiv453537629130190 – 絵チャ1_1.png
        G:confpixiv453537629130190 – 絵チャ1_1.png
        G:confpixiv453537629130190 – 絵チャ1_1.png
        G:confpixiv453537629130190 – 絵チャ1_1.png
        G:confpixiv453537629130190 – 絵チャ1_1.png
        G:confpixiv453537629130190 – 絵チャ1_1.png
        G:confpixiv453537629130190 – 絵チャ1_1.png
        G:confpixiv453537629130190 – 絵チャ1_1.png
        G:confpixiv453537629130190 – 絵チャ1_1.png

  2. Still gives errors for me.

    Input: 8
    Start Page (default=1):
    End Page (default=0, 0 for no limit):
    Processing New Illust from bookmark
    Page #1
    Image #1
    Processing Image Id: 29104686
    Title: 狐さんペロペロ
    Tags : R-18, オリジナル, 狐っ娘
    Mode : big
    Image URL : http://i1.pixiv.net/img07/img/chikin6744/29104686.jpg
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 650, in processImage
    File “PixivHelper.pyc”, line 79, in makeFilename
    UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xe5 in position 4: ordinal
    not in range(128)
    Error at processImage(): (, UnicodeDecodeE
    rror(‘ascii’, ‘2012xe5xb9xb408xe6x9cx8804xe6x97xa5 02:19’, 4, 5, ‘ordin
    al not in range(128)’), )
    Dumping html to: Error Medium Page for image 29104686.html
    Cannot dump page for image_id: 29104686
    Error at processNewIllustFromBookmark(): (,
    UnboundLocalError(“local variable ‘parseBigImage’ referenced before assignment”
    ,), )
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1426, in main
    File “PixivUtil2.py”, line 1228, in menuDownloadNewIllustFromBookmark
    File “PixivUtil2.py”, line 942, in processNewIllustFromBookmark
    File “PixivUtil2.py”, line 708, in processImage
    UnboundLocalError: local variable ‘parseBigImage’ referenced before assignment
    press enter to exit.

    Error medium page.. http://puu.sh/Ois9

  3. filenameformat = %member_id% (%member_token%)%urlFilename%
    filenamemangaformat = %member_id% (%member_token%)%image_id%%urlFilename%
    createmangadir = False

    Sry, for triple post ^_^ delete if needed

      1. – PixivUtil20120803 – INFO – Starting…
        2012-08-03 18:56:11,017 – PixivUtil20120803 – INFO – Only process member where day last updated >= 7
        2012-08-03 18:56:11,017 – PixivUtil20120803 – INFO – Using Username: test56
        2012-08-03 18:56:11,017 – PixivUtil20120803 – INFO – logging in with saved cookie
        2012-08-03 18:56:11,017 – PixivUtil20120803 – INFO – Trying to log with saved cookie
        2012-08-03 18:56:15,142 – PixivUtil20120803 – INFO – Cookie already expired/invalid.
        2012-08-03 18:56:15,142 – PixivUtil20120803 – INFO – Log in using form.
        2012-08-03 18:56:22,378 – PixivUtil20120803 – INFO – Logged in
        2012-08-03 18:56:36,003 – PixivUtil20120803 – INFO – Member id mode.
        2012-08-03 18:56:44,158 – PixivUtil20120803 – INFO – Processing Member Id: 414162
        2012-08-03 18:56:51,533 – PixivUtil20120803 – INFO – Creating directory: C:DL Image Packs414162 (s_f_nov17)
        2012-08-03 18:57:39,174 – PixivUtil20120803 – ERROR – Error at processImage(): (, UnicodeDecodeError(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not in range(128)’), )
        2012-08-03 18:57:39,190 – PixivUtil20120803 – ERROR – Dumping html to: Error Medium Page for image 27884824.html
        2012-08-03 18:57:39,190 – PixivUtil20120803 – ERROR – Cannot dump page for image_id: 27884824
        2012-08-03 18:57:45,315 – PixivUtil20120803 – ERROR – Error at processImage(): (, UnicodeDecodeError(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not in range(128)’), )
        2012-08-03 18:57:45,315 – PixivUtil20120803 – ERROR – Dumping html to: Error Medium Page for image 27884824.html
        2012-08-03 18:57:45,315 – PixivUtil20120803 – ERROR – Cannot dump page for image_id: 27884824
        2012-08-03 18:57:53,565 – PixivUtil20120803 – ERROR – Error at processImage(): (, UnicodeDecodeError(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not in range(128)’), )
        2012-08-03 18:57:53,565 – PixivUtil20120803 – ERROR – Dumping html to: Error Medium Page for image 27884824.html
        2012-08-03 18:57:53,565 – PixivUtil20120803 – ERROR – Cannot dump page for image_id: 27884824
        2012-08-03 18:57:59,799 – PixivUtil20120803 – ERROR – Error at processImage(): (, UnicodeDecodeError(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not in range(128)’), )
        2012-08-03 18:57:59,799 – PixivUtil20120803 – ERROR – Dumping html to: Error Medium Page for image 27884824.html
        2012-08-03 18:57:59,799 – PixivUtil20120803 – ERROR – Cannot dump page for image_id: 27884824
        2012-08-03 18:58:05,924 – PixivUtil20120803 – ERROR – Error at processImage(): (, UnicodeDecodeError(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not in range(128)’), )
        2012-08-03 18:58:05,924 – PixivUtil20120803 – ERROR – Dumping html to: Error Medium Page for image 27884824.html
        2012-08-03 18:58:05,924 – PixivUtil20120803 – ERROR – Cannot dump page for image_id: 27884824
        2012-08-03 18:58:05,940 – PixivUtil20120803 – ERROR – Giving up image_id: 27884824

  4. Doesn’t download manga:

    PixivDownloader2 version 20120803
    https://nandaka.wordpress.com/tag/pixiv-downloader/
    Reading V:Program FilesPixivDconfig.ini …
    done.
    Creating database… done.
    Only process member where day last updated >= 7
    Using Username: test56
    logging in with saved cookie
    Trying to log with saved cookie
    Cookie already expired/invalid.
    Log in using form.
    done.
    new cookie value: 2022ff8c48f0195e19619324f5e2a7ee
    Writing config file… done.
    PixivDownloader2 version 20120803
    https://nandaka.wordpress.com/tag/pixiv-downloader/
    1. Download by member_id
    2. Download by image_id
    3. Download by tags
    4. Download from list
    5. Download from online user bookmark
    6. Download from online image bookmark
    7. Download from tags list
    8. Download new illust from bookmark
    9. Download by Title/Caption
    10. Download by Tag and Member Id
    ————————
    d. Manage database
    e. Export online bookmark
    x. Exit
    Input: 1
    Member id: 414162
    Start Page (default=1):
    End Page (default=0, 0 for no limit):
    Processing Member Id: 414162
    Reading V:Program FilesPixivDconfig.ini …
    done.
    Page 1
    Member Name : ???
    Member Avatar: http://i1.pixiv.net/img21/profile/s_f_nov17/4691647.jpg
    Member Token : s_f_nov17
    #1
    Processing Image Id: 29041335
    Title: Reinschneiden
    Tags : ?????? ???
    Mode : big
    Image URL : http://i1.pixiv.net/img21/img/s_f_nov17/29041335.jpg?1343828563
    Filename : C:DL Image Packs414162 (s_f_nov17)29041335.jpg
    Start downloading… 598694 of 598694 Bytes Complete.
    done.

    #2
    Processing Image Id: 28977049
    Title: ?????????
    Tags : C82, ???????
    Mode : big
    Image URL : http://i1.pixiv.net/img21/img/s_f_nov17/28977049.jpg
    Filename : C:DL Image Packs414162 (s_f_nov17)28977049.jpg
    Start downloading… 577112 of 577112 Bytes Complete.
    done.

    #3
    Processing Image Id: 28762438
    Title: Favour
    Tags : C82, ???? ?????? ????????????????? ???????? ?? ??? ??????? ?? ??
    Mode : big
    Image URL : http://i1.pixiv.net/img21/img/s_f_nov17/28762438.jpg?1342803439
    Filename : C:DL Image Packs414162 (s_f_nov17)28762438.jpg
    Start downloading… 519509 of 519509 Bytes Complete.
    done.

    #4
    Processing Image Id: 27884824
    Title: ??????????
    Tags : ????? ???? ??????????? ??????????? ????? ???? ??? ????? ???????????
    Mode : manga
    Image URL : http://i1.pixiv.net/img21/img/s_f_nov17/27884824_big_p0.jpg
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 649, in processImage
    File “PixivHelper.pyc”, line 81, in makeFilename
    UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xd0 in position 0: ordinal
    not in range(128)
    Error at processImage(): (, UnicodeDecodeE
    rror(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not
    in range(128)’), )
    Dumping html to: Error Medium Page for image 27884824.html
    Cannot dump page for image_id: 27884824
    Stuff happened, trying again after 2 second ( 1 )
    local variable ‘parseBigImage’ referenced before assignment
    Processing Image Id: 27884824
    Title: ??????????
    Tags : ????? ???? ??????????? ??????????? ????? ???? ??? ????? ???????????
    Mode : manga
    Image URL : http://i1.pixiv.net/img21/img/s_f_nov17/27884824_big_p0.jpg
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 649, in processImage
    File “PixivHelper.pyc”, line 81, in makeFilename
    UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xd0 in position 0: ordinal
    not in range(128)
    Error at processImage(): (, UnicodeDecodeE
    rror(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not
    in range(128)’), )
    Dumping html to: Error Medium Page for image 27884824.html
    Cannot dump page for image_id: 27884824
    Stuff happened, trying again after 2 second ( 2 )
    local variable ‘parseBigImage’ referenced before assignment
    Processing Image Id: 27884824

  5. an error while I am downloading new illust from bookmark when meet manga mode.

    ===
    2012-08-03 22:54:33,726 – PixivUtil20120803 – INFO – ###############################################################
    2012-08-03 22:54:33,726 – PixivUtil20120803 – INFO – Starting…
    2012-08-03 22:54:33,743 – PixivUtil20120803 – INFO – Only process member where day last updated >= 7
    2012-08-03 22:54:33,743 – PixivUtil20120803 – INFO – Using Username: rogerlhc
    2012-08-03 22:54:33,747 – PixivUtil20120803 – INFO – logging in with saved cookie
    2012-08-03 22:54:33,753 – PixivUtil20120803 – INFO – Trying to log with saved cookie
    2012-08-03 22:54:42,453 – PixivUtil20120803 – INFO – Logged in using cookie
    2012-08-03 22:54:44,099 – PixivUtil20120803 – INFO – New Illust from Bookmark mode.
    2012-08-03 22:55:00,121 – PixivUtil20120803 – ERROR – Error at processImage(): (, UnicodeDecodeError(‘ascii’, ‘xe6xbcxabxe7x94xbb 2P’, 0, 1, ‘ordinal not in range(128)’), )
    2012-08-03 22:55:00,134 – PixivUtil20120803 – ERROR – Dumping html to: Error Medium Page for image 29095819.html
    2012-08-03 22:55:00,141 – PixivUtil20120803 – ERROR – Cannot dump page for image_id: 29095819
    2012-08-03 22:55:00,154 – PixivUtil20120803 – ERROR – Error at processNewIllustFromBookmark(): (, UnboundLocalError(“local variable ‘parseBigImage’ referenced before assignment”,), )
    2012-08-03 22:55:00,168 – PixivUtil20120803 – ERROR – Unknown Error: local variable ‘parseBigImage’ referenced before assignment
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1424, in main
    File “PixivUtil2.py”, line 1226, in menuDownloadNewIllustFromBookmark
    File “PixivUtil2.py”, line 940, in processNewIllustFromBookmark
    File “PixivUtil2.py”, line 706, in processImage
    UnboundLocalError: local variable ‘parseBigImage’ referenced before assignment
    2012-08-03 22:55:02,259 – PixivUtil20120803 – INFO – EXIT
    2012-08-03 22:55:02,260 – PixivUtil20120803 – INFO – ###############################################################
    ===

    dump file: http://www.mediafire.com/view/?bohsi8u9ymok46w

    Thank you!

Comments are closed.