pixiv downloader 20120803

Change log:

Fix config.ini path resolution to the actual path where the script reside, not the working dir.
Update page parser and unittest.
Append 0 for %page_number% depending on total manga page.

Download link for PixivUtil20120803, and source code. Donation link on the sidebar 🙂

EDIT: updated to handle unicode for manga page

EDIT2: update to handle unicode in works date

25 thoughts on “pixiv downloader 20120803”

Inori says:

August 6, 2012 at 01:36

The soft don’t work in japanese local setings (It opens and closes so early…)
1. nandaka says:
  
  August 6, 2012 at 07:10
  
  start -> run -> cmd. Go to the app folder and run it, it should show the error, or check what is in the log file. Mine also set in Japanese locale, but all ok.
  1. nandaka says:
    
    August 6, 2012 at 07:11
    
    Also before that, save your config.ini using utf-8 encoding using notepad.
  2. Inori says:
    
    August 6, 2012 at 17:59
    
    Thanks, that works !
Inori says:

August 6, 2012 at 01:34

Ok I put the member id and I have an error message :

http://i.imgur.com/He0G3.png
1. nandaka says:
  
  August 6, 2012 at 07:08
  
  set the save the folder without special character, rather extract the whole archive in folder without special character. Somehow got problem if the app folder have it.
NHO says:

August 5, 2012 at 19:46

Sometimes, downloader writes into downloaded list multiple instances of one picture from manga. I do not know why.
1. nandaka says:
  
  August 5, 2012 at 20:11
  
  what is your filename manga format?
  1. NHO says:
    
    August 6, 2012 at 02:07
    
    filenamemangaformat = %member_id%%image_id% – %title%_%page_index%
    
    and it looks like
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_0.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_1.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_2.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_3.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_4.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_5.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_6.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_7.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_8.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_9.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_1.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_1.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_1.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_1.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_1.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_1.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_1.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_1.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_1.png
    G:confpixiv453537629130190 – çµµãƒãƒ£ï¼‘_1.png
    1. nandaka says:
      
      August 6, 2012 at 21:18
      
      Confirmed as bug, the problem is in the %page_number% zero-padding. I will fix it ASAP
Inori says:

August 5, 2012 at 18:28

Don’t work 🙁

http://i.imgur.com/d8ZMq.png
1. nandaka says:
  
  August 5, 2012 at 18:34
  
  use the id (the number one) not the name. See readme.txt
repu says:

August 4, 2012 at 01:31

Still gives errors for me.

Input: 8
Start Page (default=1):
End Page (default=0, 0 for no limit):
Processing New Illust from bookmark
Page #1
Image #1
Processing Image Id: 29104686
Title: 狐さんペロペロ
Tags : R-18, オリジナル, 狐っ娘
Mode : big
Image URL : http://i1.pixiv.net/img07/img/chikin6744/29104686.jpg
Traceback (most recent call last):
File “PixivUtil2.py”, line 650, in processImage
File “PixivHelper.pyc”, line 79, in makeFilename
UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xe5 in position 4: ordinal
not in range(128)
Error at processImage(): (, UnicodeDecodeE
rror(‘ascii’, ‘2012xe5xb9xb408xe6x9cx8804xe6x97xa5 02:19’, 4, 5, ‘ordin
al not in range(128)’), )
Dumping html to: Error Medium Page for image 29104686.html
Cannot dump page for image_id: 29104686
Error at processNewIllustFromBookmark(): (,
UnboundLocalError(“local variable ‘parseBigImage’ referenced before assignment”
,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1426, in main
File “PixivUtil2.py”, line 1228, in menuDownloadNewIllustFromBookmark
File “PixivUtil2.py”, line 942, in processNewIllustFromBookmark
File “PixivUtil2.py”, line 708, in processImage
UnboundLocalError: local variable ‘parseBigImage’ referenced before assignment
press enter to exit.

Error medium page.. http://puu.sh/Ois9
1. nandaka says:
  
  August 4, 2012 at 02:12
  
  Try this one: http://www.mediafire.com/?2d13uqzf7hmqst0
nandaka says:

August 3, 2012 at 23:54

updated: http://www.mediafire.com/?7q2d1co659s3sa1
1. Owyn says:
  
  August 3, 2012 at 23:57
  
  Works great 🙂
  1. nandaka says:
    
    August 4, 2012 at 00:04
    
    >> Works great 🙂
    
    donate button on the left :p
2. soji says:
  
  August 4, 2012 at 00:12
  
  Thank you!
Owyn says:

August 3, 2012 at 23:04

filenameformat = %member_id% (%member_token%)%urlFilename%
filenamemangaformat = %member_id% (%member_token%)%image_id%%urlFilename%
createmangadir = False

Sry, for triple post ^_^ delete if needed
1. nandaka says:
  
  August 3, 2012 at 23:36
  
  can upload the log file? somehow it is parsed correctly in my pc (27884824)
  1. soji says:
    
    August 3, 2012 at 23:47
    
    Did you see my post and try 29095819?
  2. Owyn says:
    
    August 3, 2012 at 23:55
    
    – PixivUtil20120803 – INFO – Starting…
    2012-08-03 18:56:11,017 – PixivUtil20120803 – INFO – Only process member where day last updated >= 7
    2012-08-03 18:56:11,017 – PixivUtil20120803 – INFO – Using Username: test56
    2012-08-03 18:56:11,017 – PixivUtil20120803 – INFO – logging in with saved cookie
    2012-08-03 18:56:11,017 – PixivUtil20120803 – INFO – Trying to log with saved cookie
    2012-08-03 18:56:15,142 – PixivUtil20120803 – INFO – Cookie already expired/invalid.
    2012-08-03 18:56:15,142 – PixivUtil20120803 – INFO – Log in using form.
    2012-08-03 18:56:22,378 – PixivUtil20120803 – INFO – Logged in
    2012-08-03 18:56:36,003 – PixivUtil20120803 – INFO – Member id mode.
    2012-08-03 18:56:44,158 – PixivUtil20120803 – INFO – Processing Member Id: 414162
    2012-08-03 18:56:51,533 – PixivUtil20120803 – INFO – Creating directory: C:DL Image Packs414162 (s_f_nov17)
    2012-08-03 18:57:39,174 – PixivUtil20120803 – ERROR – Error at processImage(): (, UnicodeDecodeError(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not in range(128)’), )
    2012-08-03 18:57:39,190 – PixivUtil20120803 – ERROR – Dumping html to: Error Medium Page for image 27884824.html
    2012-08-03 18:57:39,190 – PixivUtil20120803 – ERROR – Cannot dump page for image_id: 27884824
    2012-08-03 18:57:45,315 – PixivUtil20120803 – ERROR – Error at processImage(): (, UnicodeDecodeError(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not in range(128)’), )
    2012-08-03 18:57:45,315 – PixivUtil20120803 – ERROR – Dumping html to: Error Medium Page for image 27884824.html
    2012-08-03 18:57:45,315 – PixivUtil20120803 – ERROR – Cannot dump page for image_id: 27884824
    2012-08-03 18:57:53,565 – PixivUtil20120803 – ERROR – Error at processImage(): (, UnicodeDecodeError(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not in range(128)’), )
    2012-08-03 18:57:53,565 – PixivUtil20120803 – ERROR – Dumping html to: Error Medium Page for image 27884824.html
    2012-08-03 18:57:53,565 – PixivUtil20120803 – ERROR – Cannot dump page for image_id: 27884824
    2012-08-03 18:57:59,799 – PixivUtil20120803 – ERROR – Error at processImage(): (, UnicodeDecodeError(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not in range(128)’), )
    2012-08-03 18:57:59,799 – PixivUtil20120803 – ERROR – Dumping html to: Error Medium Page for image 27884824.html
    2012-08-03 18:57:59,799 – PixivUtil20120803 – ERROR – Cannot dump page for image_id: 27884824
    2012-08-03 18:58:05,924 – PixivUtil20120803 – ERROR – Error at processImage(): (, UnicodeDecodeError(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not in range(128)’), )
    2012-08-03 18:58:05,924 – PixivUtil20120803 – ERROR – Dumping html to: Error Medium Page for image 27884824.html
    2012-08-03 18:58:05,924 – PixivUtil20120803 – ERROR – Cannot dump page for image_id: 27884824
    2012-08-03 18:58:05,940 – PixivUtil20120803 – ERROR – Giving up image_id: 27884824
Owyn says:

August 3, 2012 at 23:00

Dump file for page: http://www.mediafire.com/?21oi6jm5a16sdw6
Owyn says:

August 3, 2012 at 22:58

Doesn’t download manga:

PixivDownloader2 version 20120803
https://nandaka.wordpress.com/tag/pixiv-downloader/
Reading V:Program FilesPixivDconfig.ini …
done.
Creating database… done.
Only process member where day last updated >= 7
Using Username: test56
logging in with saved cookie
Trying to log with saved cookie
Cookie already expired/invalid.
Log in using form.
done.
new cookie value: 2022ff8c48f0195e19619324f5e2a7ee
Writing config file… done.
PixivDownloader2 version 20120803
https://nandaka.wordpress.com/tag/pixiv-downloader/
1. Download by member_id
2. Download by image_id
3. Download by tags
4. Download from list
5. Download from online user bookmark
6. Download from online image bookmark
7. Download from tags list
8. Download new illust from bookmark
9. Download by Title/Caption
10. Download by Tag and Member Id
————————
d. Manage database
e. Export online bookmark
x. Exit
Input: 1
Member id: 414162
Start Page (default=1):
End Page (default=0, 0 for no limit):
Processing Member Id: 414162
Reading V:Program FilesPixivDconfig.ini …
done.
Page 1
Member Name : ???
Member Avatar: http://i1.pixiv.net/img21/profile/s_f_nov17/4691647.jpg
Member Token : s_f_nov17
#1
Processing Image Id: 29041335
Title: Reinschneiden
Tags : ?????? ???
Mode : big
Image URL : http://i1.pixiv.net/img21/img/s_f_nov17/29041335.jpg?1343828563
Filename : C:DL Image Packs414162 (s_f_nov17)29041335.jpg
Start downloading… 598694 of 598694 Bytes Complete.
done.

#2
Processing Image Id: 28977049
Title: ?????????
Tags : C82, ???????
Mode : big
Image URL : http://i1.pixiv.net/img21/img/s_f_nov17/28977049.jpg
Filename : C:DL Image Packs414162 (s_f_nov17)28977049.jpg
Start downloading… 577112 of 577112 Bytes Complete.
done.

#3
Processing Image Id: 28762438
Title: Favour
Tags : C82, ???? ?????? ????????????????? ???????? ?? ??? ??????? ?? ??
Mode : big
Image URL : http://i1.pixiv.net/img21/img/s_f_nov17/28762438.jpg?1342803439
Filename : C:DL Image Packs414162 (s_f_nov17)28762438.jpg
Start downloading… 519509 of 519509 Bytes Complete.
done.

#4
Processing Image Id: 27884824
Title: ??????????
Tags : ????? ???? ??????????? ??????????? ????? ???? ??? ????? ???????????
Mode : manga
Image URL : http://i1.pixiv.net/img21/img/s_f_nov17/27884824_big_p0.jpg
Traceback (most recent call last):
File “PixivUtil2.py”, line 649, in processImage
File “PixivHelper.pyc”, line 81, in makeFilename
UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xd0 in position 0: ordinal
not in range(128)
Error at processImage(): (, UnicodeDecodeE
rror(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not
in range(128)’), )
Dumping html to: Error Medium Page for image 27884824.html
Cannot dump page for image_id: 27884824
Stuff happened, trying again after 2 second ( 1 )
local variable ‘parseBigImage’ referenced before assignment
Processing Image Id: 27884824
Title: ??????????
Tags : ????? ???? ??????????? ??????????? ????? ???? ??? ????? ???????????
Mode : manga
Image URL : http://i1.pixiv.net/img21/img/s_f_nov17/27884824_big_p0.jpg
Traceback (most recent call last):
File “PixivUtil2.py”, line 649, in processImage
File “PixivHelper.pyc”, line 81, in makeFilename
UnicodeDecodeError: ‘ascii’ codec can’t decode byte 0xd0 in position 0: ordinal
not in range(128)
Error at processImage(): (, UnicodeDecodeE
rror(‘ascii’, ‘xd0x9cxd0xb0xd0xbdxd0xb3xd0xb0 10P’, 0, 1, ‘ordinal not
in range(128)’), )
Dumping html to: Error Medium Page for image 27884824.html
Cannot dump page for image_id: 27884824
Stuff happened, trying again after 2 second ( 2 )
local variable ‘parseBigImage’ referenced before assignment
Processing Image Id: 27884824
soji says:

August 3, 2012 at 22:55

an error while I am downloading new illust from bookmark when meet manga mode.

===
2012-08-03 22:54:33,726 – PixivUtil20120803 – INFO – ###############################################################
2012-08-03 22:54:33,726 – PixivUtil20120803 – INFO – Starting…
2012-08-03 22:54:33,743 – PixivUtil20120803 – INFO – Only process member where day last updated >= 7
2012-08-03 22:54:33,743 – PixivUtil20120803 – INFO – Using Username: rogerlhc
2012-08-03 22:54:33,747 – PixivUtil20120803 – INFO – logging in with saved cookie
2012-08-03 22:54:33,753 – PixivUtil20120803 – INFO – Trying to log with saved cookie
2012-08-03 22:54:42,453 – PixivUtil20120803 – INFO – Logged in using cookie
2012-08-03 22:54:44,099 – PixivUtil20120803 – INFO – New Illust from Bookmark mode.
2012-08-03 22:55:00,121 – PixivUtil20120803 – ERROR – Error at processImage(): (, UnicodeDecodeError(‘ascii’, ‘xe6xbcxabxe7x94xbb 2P’, 0, 1, ‘ordinal not in range(128)’), )
2012-08-03 22:55:00,134 – PixivUtil20120803 – ERROR – Dumping html to: Error Medium Page for image 29095819.html
2012-08-03 22:55:00,141 – PixivUtil20120803 – ERROR – Cannot dump page for image_id: 29095819
2012-08-03 22:55:00,154 – PixivUtil20120803 – ERROR – Error at processNewIllustFromBookmark(): (, UnboundLocalError(“local variable ‘parseBigImage’ referenced before assignment”,), )
2012-08-03 22:55:00,168 – PixivUtil20120803 – ERROR – Unknown Error: local variable ‘parseBigImage’ referenced before assignment
Traceback (most recent call last):
File “PixivUtil2.py”, line 1424, in main
File “PixivUtil2.py”, line 1226, in menuDownloadNewIllustFromBookmark
File “PixivUtil2.py”, line 940, in processNewIllustFromBookmark
File “PixivUtil2.py”, line 706, in processImage
UnboundLocalError: local variable ‘parseBigImage’ referenced before assignment
2012-08-03 22:55:02,259 – PixivUtil20120803 – INFO – EXIT
2012-08-03 22:55:02,260 – PixivUtil20120803 – INFO – ###############################################################
===

dump file: http://www.mediafire.com/view/?bohsi8u9ymok46w

Thank you!

Comments are closed.