Change Log:
- Fix issue #36: Member illustration parser update.
- Fix issue #37: Bookmark parser update.
- Update artist token parser (20140621)
Download link for pixiv downloader 20140621, source code in GitHub.
Donation Link on the side bar ==> 😀
EDIT: Update the program, go donate now @.@
New to the nijie downloader and just tried to use it and I keep getting “The device is not ready” when I download. I made sure to download Microsoft SQL Compact 4.0 and I changed root directory download settings to a different location after I login. But I keep getting this error.
Usually because of the application cannot write to the destination folder. Can you run as admin or run on other pc.
Also delete the old log file, replicate the error and upload the log file to pastebin
I tried to run it as admin but no luck and I don’t have another PC to run this on. Here is a log file: http://s000.tinyupload.com/?file_id=42655330928080025737
Hmm, it tried to save to this folder: D:TempNijie. Do you have created the root directory?
Are there any plans of add Pixiv animation download support? Or is it even possible?
Added in the github, weekend to release (still testing, so far ok). It will download the full screen zip file.
Oh, another happy-happy joy-joy bit:
http://pastebin.com/jceeL2Pf
is this the new fancy-dancy animated image one?
Hi
new image format,looks like gif…
http://www.mediafire.com/view/zzmcx7ju1907f5j/Error_Medium_Page_for_image_44310287.html
Thanks.
=======
Image #5
Processing Image Id: 44310287
Traceback (most recent call last):
File “PixivUtil2.py”, line 619, in process_image
File “PixivModel.pyc”, line 219, in __init__
File “PixivModel.pyc”, line 277, in ParseInfo
AttributeError: ‘NoneType’ object has no attribute ‘group’
Error at process_image(): (, AttributeError(“‘
NoneType’ object has no attribute ‘group'”,), )
Dumping html to: Error Medium Page for image 44310287.html
Error at process_new_illust_from_bookmark(): (
, AttributeError(“‘NoneType’ object has no attribute ‘group'”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1850, in main
File “PixivUtil2.py”, line 1659, in main_loop
File “PixivUtil2.py”, line 1543, in menu_download_new_illust_from_bookmark
File “PixivUtil2.py”, line 1134, in process_new_illust_from_bookmark
File “PixivUtil2.py”, line 619, in process_image
File “PixivModel.pyc”, line 219, in __init__
File “PixivModel.pyc”, line 277, in ParseInfo
AttributeError: ‘NoneType’ object has no attribute ‘group’
press enter to exit.
=====
I got this error :O
Traceback (most recent call last):
File “PixivUtil2.py”, line 515, in process_member
File “PixivUtil2.py”, line 619, in process_image
File “PixivModel.pyc”, line 221, in __init__
File “PixivModel.pyc”, line 314, in ParseWorksData
File “_strptime.pyc”, line 325, in _strptime
ValueError: time data ‘5 26 2014 02:00’ does not match format ‘%Y-%m-%d %H:%M’
Can you help me ? 🙁
Change your pixiv website language to english or japanese.
A tag that seems to lead reliably to the new animations is this:
http://www.pixiv.net/search.php?s_mode=s_tag_full&word=%E3%81%86%E3%81%94%E3%82%A4%E3%83%A9
You’re right, the “ugoira” tag seems mandatory for pics using the new system. I tried to blacklist it but unfortunately the software processes the image_id (and then crashes) before eventually skipping because of a blacklisted tag.
I have to correct myself, while most animations posted so far use that tag, there are some that doesn’t, so it cannot be used as a safe workaround in any case.
2014-06-25 22:58:01,967 – PixivUtil20140621 – INFO – ###############################################################
2014-06-25 22:58:01,967 – PixivUtil20140621 – INFO – Starting…
2014-06-25 22:58:01,967 – PixivUtil20140621 – INFO – Setting log level to: DEBUG
2014-06-25 22:58:01,967 – PixivUtil20140621 – INFO – No default cookie jar available, creating…
2014-06-25 22:58:01,967 – PixivUtil20140621 – INFO – Only process member where day last updated >= 7
2014-06-25 22:58:01,967 – PixivUtil20140621 – INFO – Using Username: sjssoz@naver.com
2014-06-25 22:58:01,967 – PixivUtil20140621 – INFO – logging in with saved cookie
2014-06-25 22:58:01,967 – PixivUtil20140621 – INFO – Trying to log with saved cookie
2014-06-25 22:58:02,842 – PixivUtil20140621 – INFO – Logged in using cookie
2014-06-25 22:58:03,530 – PixivUtil20140621 – INFO – New Illust from Bookmark mode.
2014-06-25 22:58:08,250 – PixivUtil20140621 – DEBUG – Sanitized Filename: H:When They CrypixivBookmark丸汰いつき (448151)44308601 – 6_29 我、夜戦に突入す!カット.jpg
2014-06-25 22:58:08,358 – PixivUtil20140621 – INFO – Creating directory: H:When They CrypixivBookmark丸汰いつき (448151)
2014-06-25 22:58:10,280 – PixivUtil20140621 – ERROR – Error at process_image(): (, AttributeError(“‘NoneType’ object has no attribute ‘group'”,), )
2014-06-25 22:58:10,280 – PixivUtil20140621 – ERROR – Error at process_image(): 44308598
Traceback (most recent call last):
File “PixivUtil2.py”, line 619, in process_image
File “PixivModel.pyc”, line 219, in __init__
File “PixivModel.pyc”, line 277, in ParseInfo
AttributeError: ‘NoneType’ object has no attribute ‘group’
2014-06-25 22:58:10,328 – PixivUtil20140621 – ERROR – Dumping html to: Error Medium Page for image 44308598.html
2014-06-25 22:58:10,328 – PixivUtil20140621 – ERROR – Error at process_new_illust_from_bookmark(): (, AttributeError(“‘NoneType’ object has no attribute ‘group'”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1134, in process_new_illust_from_bookmark
File “PixivUtil2.py”, line 619, in process_image
File “PixivModel.pyc”, line 219, in __init__
File “PixivModel.pyc”, line 277, in ParseInfo
AttributeError: ‘NoneType’ object has no attribute ‘group’
2014-06-25 22:58:10,342 – PixivUtil20140621 – ERROR – Unknown Error: ‘NoneType’ object has no attribute ‘group’
Traceback (most recent call last):
File “PixivUtil2.py”, line 1850, in main
File “PixivUtil2.py”, line 1659, in main_loop
File “PixivUtil2.py”, line 1543, in menu_download_new_illust_from_bookmark
File “PixivUtil2.py”, line 1134, in process_new_illust_from_bookmark
File “PixivUtil2.py”, line 619, in process_image
File “PixivModel.pyc”, line 219, in __init__
File “PixivModel.pyc”, line 277, in ParseInfo
AttributeError: ‘NoneType’ object has no attribute ‘group’
2014-06-25 22:58:12,030 – PixivUtil20140621 – INFO – EXIT
2014-06-25 22:58:12,030 – PixivUtil20140621 – INFO – ###############################################################
I got this error.
Pixiv has introduced a new function that allows animations: http://www.pixiv.net/info.php?id=2476. The software cannot obviously process the new format (I don’t know if they cannot even be saved on disk, it seems all based on Javascript), so every time it reaches an image_id that uses it, it shuts down. There are already several of my bookmarked artists that have started using it, so option 8 has become unusable, and it’ll extend to other functions once the new format takes a stronger foothold.
A solution, or at least a temporary one, may be have the software skip the image_id once it finds there is no “traditional” image.
Just an addition: I tried to get a look into the page source of some new images, and found they seems to lead to zip files that contain the individual animation frames.
For example, for
http://www.pixiv.net/member_illust.php?mode=medium&illust_id=44301046
I find
{“src”:”http://i1.pixiv.net/img-zip-ugoira/img/2014/06/25/17/58/59/44301046_ugoira600x600.zip”
“src”:”http://i1.pixiv.net/img-zip-ugoira/img/2014/06/25/17/58/59/44301046_ugoira1920x1080.zip”
(I took only these and not the commands that follow, regulating the delay of each individual frame)
Baside skipping, managing to get these may be the “key”.
Can you log this to the github issue tracker: https://github.com/Nandaka/PixivUtil2/issues?state=open
Done, I’ve transcribed most of what I wrote there.
Hi!
Encountered another error : http://prntscr.com/3voqh2 .
I read the comments above but the solution given by camil1505 doesn’t solve it, it makes this error pop out http://prntscr.com/3vor0q.
This error seems to appear only in certain users, mostly ones that don’t have a profile image, but anything besides that is perfect! thanks for the fast fix of the page layout 😀
use the updated one 😛 (20140621)
Fixed ~ hahaha, thank you!
Hi! I got a comedy of errors here:
http://pastebin.com/6yBUwdyS
Some members are processed well, some are… Not.
use the 20140621 version?
… I missed that last 1. Sorry. Thank you.
Many THANKS for the fast release!
I got this error. 🙁
Error at pixiv_login(): (, <
httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x2a4eb
90 whose wrapped object = <closeable_response at 0x2a63a30 whose fp = >>, )
failed
Traceback (most recent call last):
File “PixivUtil2.py”, line 1842, in main
File “PixivUtil2.py”, line 260, in pixiv_login
File “mechanize_mechanize.pyc”, line 203, in open
File “mechanize_mechanize.pyc”, line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
press enter to exit.
See Readme.txt on FAQ section C.Q6
Hi, I met another problem involving unicode(…maybe)
2014-06-21 18:17:16,132 – PixivUtil20140621 – ERROR – Error at process_member(): (, UnicodeEncodeError(‘ascii’, u’2014ub1444uc6d44uc77c 21:10′, 4, 5, ‘ordinal not in range(128)’), ) Member Id: 1253754
Traceback (most recent call last):
File “PixivUtil2.py”, line 515, in process_member
File “PixivUtil2.py”, line 619, in process_image
File “PixivModel.pyc”, line 221, in __init__
File “PixivModel.pyc”, line 314, in ParseWorksData
UnicodeEncodeError: ‘ascii’ codec can’t encode character u’ub144′ in position 4: ordinal not in range(128)
Could you please give me an advice?
Try to set you pixiv website settings to either english or japanese
Works really well now, thank you so much~
Note : Btw, aku baru tahu yang punya blog orang Indo juga wwwww
Yap, so pilih no #2
doing bookmarks, I got this error:
Processing Member Id: 9833003
Reading C:pixivutilspixivutil20110205 (5)config.ini …
done.
Page 1
Member Url: http://www.pixiv.net/member_illust.php?id=9833003&p=1
Traceback (most recent call last):
File “PixivUtil2.py”, line 422, in process_member
File “PixivModel.pyc”, line 49, in __init__
File “PixivModel.pyc”, line 67, in ParseInfo
File “PixivModel.pyc”, line 120, in ParseToken
AttributeError: type object ‘PixivException’ has no attribute ‘PARSE_TOKEN_NO_IMAGES’
Error at process_member(): (, AttributeError(“type objec
t ‘PixivException’ has no attribute ‘PARSE_TOKEN_NO_IMAGES'”,), )
No Dump
Dumping html to: Error page for member 9833003.html
Error at process_bookmark(): (, AttributeError(“type obj
ect ‘PixivException’ has no attribute ‘PARSE_TOKEN_NO_IMAGES'”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1850, in main
File “PixivUtil2.py”, line 1653, in main_loop
File “PixivUtil2.py”, line 1491, in menu_download_from_online_user_bookmark
File “PixivUtil2.py”, line 1088, in process_bookmark
File “PixivUtil2.py”, line 422, in process_member
File “PixivModel.pyc”, line 49, in __init__
File “PixivModel.pyc”, line 67, in ParseInfo
File “PixivModel.pyc”, line 120, in ParseToken
AttributeError: type object ‘PixivException’ has no attribute ‘PARSE_TOKEN_NO_IMAGES’
press enter to exit.
I got the same error. I’m pretty sure it has to do with the fact that that artist doesn’t have a custom image (so the software can’t determine the member token based on the URL of that).
I have a problem Log:
2014-06-20 19:52:22,075 – PixivUtil20140620 – INFO – ###############################################################
2014-06-20 19:52:22,075 – PixivUtil20140620 – INFO – Starting…
2014-06-20 19:52:22,079 – PixivUtil20140620 – INFO – Setting log level to: DEBUG
2014-06-20 19:52:22,081 – PixivUtil20140620 – INFO – No default cookie jar available, creating…
2014-06-20 19:52:22,086 – PixivUtil20140620 – DEBUG – Sanitized Filename: UsersCamiloDownloadsCompressedGestorespixivutil20131218Nuevos
2014-06-20 19:52:22,086 – PixivUtil20140620 – DEBUG – Sanitized Filename: UsersCamiloDownloadsCompressedGestorespixivutil20131218Nuevos
2014-06-20 19:52:22,088 – PixivUtil20140620 – DEBUG – Sanitized Filename: UsersCamiloDownloadsCompressedGestorespixivutil20131218Nuevos
2014-06-20 19:52:22,088 – PixivUtil20140620 – DEBUG – Sanitized Filename: UsersCamiloDownloadsCompressedGestorespixivutil20131218Nuevos
2014-06-20 19:52:22,088 – PixivUtil20140620 – DEBUG – Sanitized Filename: UsersCamiloDownloadsCompressedGestorespixivutil20131218Nuevos
2014-06-20 19:52:22,088 – PixivUtil20140620 – DEBUG – Sanitized Filename: UsersCamiloDownloadsCompressedGestorespixivutil20131218Nuevos
2014-06-20 19:52:22,088 – PixivUtil20140620 – DEBUG – Sanitized Filename: UsersCamiloDownloadsCompressedGestorespixivutil20131218Nuevos
2014-06-20 19:52:22,111 – PixivUtil20140620 – INFO – Only process member where day last updated >= 7
2014-06-20 19:52:22,111 – PixivUtil20140620 – INFO – Using Username: giraldo1505
2014-06-20 19:52:22,112 – PixivUtil20140620 – INFO – logging in with saved cookie
2014-06-20 19:52:22,114 – PixivUtil20140620 – INFO – Trying to log with saved cookie
2014-06-20 19:52:25,250 – PixivUtil20140620 – INFO – Logged in using cookie
2014-06-20 19:53:55,854 – PixivUtil20140620 – INFO – Batch mode.
2014-06-20 19:53:55,857 – PixivUtil20140620 – INFO – Processing from database.
2014-06-20 19:53:55,865 – PixivUtil20140620 – INFO – Processing Member Id: 7641
2014-06-20 19:53:55,921 – PixivUtil20140620 – INFO – Member Url: http://www.pixiv.net/member_illust.php?id=7641&p=1
2014-06-20 19:53:58,309 – PixivUtil20140620 – INFO – Unable to parse Artist Token from image list, try to parse from the first image
2014-06-20 19:53:58,318 – PixivUtil20140620 – ERROR – Error at process_member(): (, AttributeError(“type object ‘PixivException’ has no attribute ‘PARSE_TOKEN_NO_IMAGES'”,), )
2014-06-20 19:53:58,319 – PixivUtil20140620 – ERROR – Error at process_member(): 7641
Traceback (most recent call last):
File “PixivUtil2.py”, line 422, in process_member
File “PixivModel.pyc”, line 49, in __init__
File “PixivModel.pyc”, line 67, in ParseInfo
File “PixivModel.pyc”, line 120, in ParseToken
AttributeError: type object ‘PixivException’ has no attribute ‘PARSE_TOKEN_NO_IMAGES’
2014-06-20 19:53:58,328 – PixivUtil20140620 – ERROR – Dumping html to: Error page for member 7641.html
2014-06-20 19:54:00,334 – PixivUtil20140620 – INFO – Processing Member Id: 7641
2014-06-20 19:54:00,400 – PixivUtil20140620 – INFO – Member Url: http://www.pixiv.net/member_illust.php?id=7641&p=1
2014-06-20 19:54:02,691 – PixivUtil20140620 – INFO – Unable to parse Artist Token from image list, try to parse from the first image
2014-06-20 19:54:02,700 – PixivUtil20140620 – ERROR – Error at process_member(): (, AttributeError(“type object ‘PixivException’ has no attribute ‘PARSE_TOKEN_NO_IMAGES'”,), )
2014-06-20 19:54:02,701 – PixivUtil20140620 – ERROR – Error at process_member(): 7641
Traceback (most recent call last):
File “PixivUtil2.py”, line 422, in process_member
File “PixivModel.pyc”, line 49, in __init__
File “PixivModel.pyc”, line 67, in ParseInfo
File “PixivModel.pyc”, line 120, in ParseToken
AttributeError: type object ‘PixivException’ has no attribute ‘PARSE_TOKEN_NO_IMAGES’
2014-06-20 19:54:02,711 – PixivUtil20140620 – ERROR – Dumping html to: Error page for member 7641.html
2014-06-20 19:54:04,717 – PixivUtil20140620 – INFO – Processing Member Id: 7641
2014-06-20 19:54:04,782 – PixivUtil20140620 – INFO – Member Url: http://www.pixiv.net/member_illust.php?id=7641&p=1
2014-06-20 19:54:07,055 – PixivUtil20140620 – INFO – Unable to parse Artist Token from image list, try to parse from the first image
2014-06-20 19:54:07,061 – PixivUtil20140620 – ERROR – Error at process_member(): (, AttributeError(“type object ‘PixivException’ has no attribute ‘PARSE_TOKEN_NO_IMAGES'”,), )
2014-06-20 19:54:07,062 – PixivUtil20140620 – ERROR – Error at process_member(): 7641
Traceback (most recent call last):
File “PixivUtil2.py”, line 422, in process_member
File “PixivModel.pyc”, line 49, in __init__
File “PixivModel.pyc”, line 67, in ParseInfo
File “PixivModel.pyc”, line 120, in ParseToken
AttributeError: type object ‘PixivException’ has no attribute ‘PARSE_TOKEN_NO_IMAGES’
I solve it again playing with the config file that:
[Settings]
proxyaddress =
useproxy = False
useragent = Mozilla/5.0 (X11; U; Unix i686; en-US; rv:1.9.0.1) Gecko/2008071615 Fedora/3.0.1-1.fc9 Firefox/3.0.1
debughttp = False
userobots = False <- FIRST CHAGE THIS TO FALSE
filenameformat = %artist% (%member_id%)%urlFilename% – %title%
filenamemangaformat = %artist% (%member_id%)%urlFilename% – %title%
timeout = 60
uselist = True <- SECON CHAGE THIS TO TRUE
processfromdb = True
overwrite = False
tagsseparator = ,
daylastupdated = 7
rootdirectory = .
retry = 3
retrywait = 5
createdownloadlists = False
downloadlistdirectory = .
irfanviewpath = C:Program FilesIrfanView
startirfanview = False
startirfanslide = False
alwayscheckfilesize = False
checkupdatedlimit = 0
downloadavatar = True
createmangadir = False
usetagsasdir = False
useblacklisttags = False
usesuppresstags = False
tagslimit = -1
writeimageinfo = False
datediff = 0
backupoldfile = False
loglevel = DEBUG
enabledump = True
skipdumpfilter =
dumpmediumpage = False
[Pixiv]
numberofpage = 0
r18mode = False
[Authentication]
username = <- THREE WRITE YOUR USER HERE
password = <- FOUR WRITE YOUR PASWORD HERE
cookie =
usessl = False
keepsignedin = 0
Wow thanks for the quick fix!
Thanks for the fast release!