Change log:
- Fix login method to use correct form.
- Add option to compact database.
- Format %works_date*% to use dash ‘-‘, instead of slash ‘/’.
Download link for pixiv downloader 20120921, source code in GitHub. Donation link on the left 🙂
24 thoughts on “pixiv downloader 20120921”
Comments are closed.
I was about to make an error report here about the same issue, but I guess I’ve been beaten to it. You’re an absolute machine to tackle these issues as quickly as you are. Keep up the good work! :3!
2012-09-26 22:57:04,232 – PixivUtil20120921 – INFO – ###############################################################
2012-09-26 22:57:04,233 – PixivUtil20120921 – INFO – Starting…
2012-09-26 22:57:04,250 – PixivUtil20120921 – INFO – Only process member where day last updated >= 7
2012-09-26 22:57:04,250 – PixivUtil20120921 – INFO – Using Username: rogerlhc
2012-09-26 22:57:04,255 – PixivUtil20120921 – INFO – logging in with saved cookie
2012-09-26 22:57:04,259 – PixivUtil20120921 – INFO – Trying to log with saved cookie
2012-09-26 22:57:13,520 – PixivUtil20120921 – INFO – Logged in using cookie
2012-09-26 22:57:15,354 – PixivUtil20120921 – INFO – New Illust from Bookmark mode.
2012-09-26 22:57:30,237 – PixivUtil20120921 – ERROR – Error at processImage(): (, AttributeError(“‘NoneType’ object has no attribute ‘findAll'”,), )
2012-09-26 22:57:30,239 – PixivUtil20120921 – ERROR – Error at processImage(): 30392635
Traceback (most recent call last):
File “PixivUtil2.py”, line 548, in processImage
File “PixivModel.pyc”, line 189, in __init__
File “PixivModel.pyc”, line 260, in ParseTags
AttributeError: ‘NoneType’ object has no attribute ‘findAll’
2012-09-26 22:57:30,246 – PixivUtil20120921 – ERROR – Dumping html to: Error Medium Page for image 30392635.html
2012-09-26 22:57:30,252 – PixivUtil20120921 – ERROR – Error at processNewIllustFromBookmark(): (, AttributeError(“‘NoneType’ object has no attribute ‘findAll'”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 940, in processNewIllustFromBookmark
File “PixivUtil2.py”, line 548, in processImage
File “PixivModel.pyc”, line 189, in __init__
File “PixivModel.pyc”, line 260, in ParseTags
AttributeError: ‘NoneType’ object has no attribute ‘findAll’
2012-09-26 22:57:30,265 – PixivUtil20120921 – ERROR – Unknown Error: ‘NoneType’ object has no attribute ‘findAll’
Traceback (most recent call last):
File “PixivUtil2.py”, line 1427, in main
File “PixivUtil2.py”, line 1226, in menuDownloadNewIllustFromBookmark
File “PixivUtil2.py”, line 940, in processNewIllustFromBookmark
File “PixivUtil2.py”, line 548, in processImage
File “PixivModel.pyc”, line 189, in __init__
File “PixivModel.pyc”, line 260, in ParseTags
AttributeError: ‘NoneType’ object has no attribute ‘findAll’
2012-09-26 22:58:03,996 – PixivUtil20120921 – INFO – EXIT
2012-09-26 22:58:03,996 – PixivUtil20120921 – INFO – ###############################################################
I think they changed the page again…
will do in weekend 🙂
got it,Thank you!
There seems to be also a problem similar to the above, but instead in memberid mode.
2012-09-25 20:37:14,937 – PixivUtil20120921 – INFO – Processing Member Id: 920720
2012-09-25 20:37:20,742 – PixivUtil20120921 – ERROR – Error at processImage(): (, AttributeError(“‘NoneType’ object has no attribute ‘findAll'”,), )
2012-09-25 20:37:20,743 – PixivUtil20120921 – ERROR – Error at processImage(): 11164869
Traceback (most recent call last):
File “PixivUtil2.py”, line 548, in processImage
File “PixivModel.pyc”, line 189, in __init__
File “PixivModel.pyc”, line 260, in ParseTags
AttributeError: ‘NoneType’ object has no attribute ‘findAll’
2012-09-25 20:37:20,759 – PixivUtil20120921 – ERROR – Dumping html to: Error Medium Page for image 11164869.html
2012-09-25 20:37:24,625 – PixivUtil20120921 – ERROR – Error at processImage(): (, AttributeError(“‘NoneType’ object has no attribute ‘findAll'”,), )
2012-09-25 20:37:24,627 – PixivUtil20120921 – ERROR – Error at processImage(): 11164869
Traceback (most recent call last):
File “PixivUtil2.py”, line 548, in processImage
File “PixivModel.pyc”, line 189, in __init__
File “PixivModel.pyc”, line 260, in ParseTags
AttributeError: ‘NoneType’ object has no attribute ‘findAll’
2012-09-25 20:37:24,644 – PixivUtil20120921 – ERROR – Dumping html to: Error Medium Page for image 11164869.html
2012-09-25 20:37:28,595 – PixivUtil20120921 – ERROR – Error at processImage(): (, AttributeError(“‘NoneType’ object has no attribute ‘findAll'”,), )
2012-09-25 20:37:28,596 – PixivUtil20120921 – ERROR – Error at processImage(): 11164869
Traceback (most recent call last):
File “PixivUtil2.py”, line 548, in processImage
File “PixivModel.pyc”, line 189, in __init__
File “PixivModel.pyc”, line 260, in ParseTags
AttributeError: ‘NoneType’ object has no attribute ‘findAll’
2012-09-25 20:37:28,615 – PixivUtil20120921 – ERROR – Dumping html to: Error Medium Page for image 11164869.html
2012-09-25 20:37:32,671 – PixivUtil20120921 – ERROR – Error at processImage(): (, AttributeError(“‘NoneType’ object has no attribute ‘findAll'”,), )
2012-09-25 20:37:32,671 – PixivUtil20120921 – ERROR – Error at processImage(): 11164869
Traceback (most recent call last):
File “PixivUtil2.py”, line 548, in processImage
File “PixivModel.pyc”, line 189, in __init__
File “PixivModel.pyc”, line 260, in ParseTags
AttributeError: ‘NoneType’ object has no attribute ‘findAll’
2012-09-25 20:37:32,690 – PixivUtil20120921 – ERROR – Dumping html to: Error Medium Page for image 11164869.html
2012-09-25 20:37:36,573 – PixivUtil20120921 – ERROR – Error at processImage(): (, AttributeError(“‘NoneType’ object has no attribute ‘findAll'”,), )
2012-09-25 20:37:36,573 – PixivUtil20120921 – ERROR – Error at processImage(): 11164869
Traceback (most recent call last):
File “PixivUtil2.py”, line 548, in processImage
File “PixivModel.pyc”, line 189, in __init__
File “PixivModel.pyc”, line 260, in ParseTags
AttributeError: ‘NoneType’ object has no attribute ‘findAll’
2012-09-25 20:37:36,592 – PixivUtil20120921 – ERROR – Dumping html to: Error Medium Page for image 11164869.html
2012-09-25 20:37:36,594 – PixivUtil20120921 – ERROR – Giving up image_id: 11164869
they change the page again :(, I’ll check it.
EDIT: Source code in github updated, I’ll upload the binary in weekend
Thanks you for your efforts.
Hopefully next week I’ll be able to recharge my credit card and finally make at least a little donation. You deserve it.
New problem. I’m trying to download stuff by tags, and I keep getting an error message. I haven’t tried any of the artist ID yet, so I’m not sure what will happen there. I did try a fresh download, but that didn’t give me any better results. Anyway here is the error message I got.
Image Id: 15038942
Bookmark Count: 480
Processing Image Id: 15038942
Traceback (most recent call last):
File “PixivUtil2.py”, line 548, in processImage
File “PixivModel.pyc”, line 189, in __init__
File “PixivModel.pyc”, line 260, in ParseTags
AttributeError: ‘NoneType’ object has no attribute ‘findAll’
Error at processImage(): (, AttributeError(“‘N
oneType’ object has no attribute ‘findAll'”,), )
Dumping html to: Error Medium Page for image 15038942.html
Error at processTags(): (, AttributeError(“‘No
neType’ object has no attribute ‘findAll'”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1416, in main
File “PixivUtil2.py”, line 1119, in menuDownloadByTags
File “PixivUtil2.py”, line 784, in processTags
File “PixivUtil2.py”, line 548, in processImage
File “PixivModel.pyc”, line 189, in __init__
File “PixivModel.pyc”, line 260, in ParseTags
AttributeError: ‘NoneType’ object has no attribute ‘findAll’
press enter to exit.
Is there a way to download from artist_id’s in list.txt AND set a specific tag?
So a combo of #4 and #10?
Hi…I found a bug about manga mode (./PixivConfig.py +135):
if _filenameMangaFormat.find(‘%urlFilename%’) == -1:
if _filenameMangaFormat.find(‘%page_index%’) == -1 and _filenameMangaFormat.find(‘%page_index%’) == -1:
print ‘No page identifier, appending %page_index% to the filename manga format.’
_filenameMangaFormat = _filenameMangaFormat + unicode(‘ %page_index%’)
print “_filenameMangaFormat =”, _filenameMangaFormat
haveError = True
Cannot set manga mode to “%artist% (%member_id%)%artist% (%member_id%) – %title% (%image_id%) – p%page_number%”, I like use this format 😛 (Not using index(0-base) but number(1-base))
this code will insert %page_index% to my filenamemangaformat in config.ini
and throw out below message:
No page identifier, appending %page_index% to the filename manga format
Source Code updated: https://github.com/Nandaka/PixivUtil2/blob/master/PixivConfig.py#L136 😀
Disregard all above errors. Pixiv is working normally, now.
I’m not live English-speaking countries … so i’m not good speak English TT… please understand me 🙂
i’m always feel thanks to you and this program! 🙂
Until very recently, I’ve used the version pixivutil20120806b
but 20120806b get this error:
Traceback (most recent call last):
File “PixivUtil2.py”, line 1398, in main
File “PixivUtil2.py”, line 286, in pixivLogin
File “mechanize_form.pyc”, line 2780, in __setitem__
File “mechanize_form.pyc”, line 3101, in find_control
File “mechanize_form.pyc”, line 3185, in _find_control
ControlNotFoundError: no control matching name ‘pixiv_id’
so i’ve used pixiv downloader 20120921
but today running the 20120921 utility
get this error:
HTTP Error 502: Bad Gateway
502
1 2 3 4
HTTP Error 502: Bad Gateway
502
1 2 3 4
HTTP Error 502: Bad Gateway
502
1 2 3 4
HTTP Error 502: Bad Gateway
502
Traceback (most recent call last):
File “PixivUtil2.py”, line 665, in processImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 106, in downloadImage
File “mechanize_mechanize.pyc”, line 203, in open
File “mechanize_mechanize.pyc”, line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 502: Bad Gateway
Error at processImage(): (,
What should I do?…
Hi, I tried to open the image_id from the lot (26373909) in my PC. I’m also encounter the same problem using the application or through browser (502 Bad Gateway). I suspect the pixiv server have some problem for the 3rd image.
I’ll update the program so at least the error can be handled gracefully/skip the bad images.
I was about to ask about this since the issue was occurring from the previous version of the program, but I wanted to make sure the issue wasn’t on my end first. Anyway, since others are mentioning it, here’s the error I’m getting. I doubt any new information will be given, but just in case…
HTTP Error 502: Bad Gateway
502
1 2 3 4
HTTP Error 502: Bad Gateway
502
1 2 3 4
HTTP Error 502: Bad Gateway
502
1 2 3 4
HTTP Error 502: Bad Gateway
502
Traceback (most recent call last):
File “PixivUtil2.py”, line 667, in processImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 106, in downloadImage
File “mechanize_mechanize.pyc”, line 203, in open
File “mechanize_mechanize.pyc”, line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 502: Bad Gateway
Error at processImage(): (,
<httperror_seek_wrapper (urllib2.HTTPError instance) at 0x30c23e8 whose wrapped
object = <closeable_response at 0x2755be8 whose fp = <response_seek_wrapper at 0
x2764f30 whose wrapped object = <closeable_response at 0x2764a58 whose fp = >>>>, )
Dumping html to: Error Medium Page for image 11626700.html
Cannot dump page for image_id: 11626700
Error at processTags(): (, UnboundLocalErro
r(“local variable ‘parseBigImage’ referenced before assignment”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1416, in main
File “PixivUtil2.py”, line 1119, in menuDownloadByTags
File “PixivUtil2.py”, line 784, in processTags
File “PixivUtil2.py”, line 706, in processImage
UnboundLocalError: local variable ‘parseBigImage’ referenced before assignment
press enter to exit.
Hello! Thanks a bunch for this Pixiv downloader, can’t say it enough.
However, this one has been giving me some errors…
This is what pixivutil.txt shows me:
2012-09-22 16:40:09,750 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:40:14,851 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:40:19,961 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:40:25,065 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:40:25,084 – PixivUtil20120921 – ERROR – Error at processImage(): (, <httperror_seek_wrapper (urllib2.HTTPError instance) at 0x28c6ae8 whose wrapped object = <closeable_response at 0x32753c8 whose fp = <response_seek_wrapper at 0x3364440 whose wrapped object = <closeable_response at 0x3364508 whose fp = >>>>, )
2012-09-22 16:40:25,084 – PixivUtil20120921 – ERROR – Error at processImage(): 26373909
Traceback (most recent call last):
File “PixivUtil2.py”, line 665, in processImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 106, in downloadImage
File “mechanize_mechanize.pyc”, line 203, in open
File “mechanize_mechanize.pyc”, line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 502: Bad Gateway
2012-09-22 16:40:25,088 – PixivUtil20120921 – ERROR – Dumping html to: Error Medium Page for image 26373909.html
2012-09-22 16:40:25,088 – PixivUtil20120921 – ERROR – Cannot dump page for image_id: 26373909
2012-09-22 16:40:56,628 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:41:01,734 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:41:06,855 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:41:11,963 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:41:11,979 – PixivUtil20120921 – ERROR – Error at processImage(): (, <httperror_seek_wrapper (urllib2.HTTPError instance) at 0x348f180 whose wrapped object = <closeable_response at 0x34a5f58 whose fp = <response_seek_wrapper at 0x34a3d00 whose wrapped object = <closeable_response at 0x34a3df0 whose fp = >>>>, )
2012-09-22 16:41:11,979 – PixivUtil20120921 – ERROR – Error at processImage(): 26373909
Traceback (most recent call last):
File “PixivUtil2.py”, line 665, in processImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 106, in downloadImage
File “mechanize_mechanize.pyc”, line 203, in open
File “mechanize_mechanize.pyc”, line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 502: Bad Gateway
2012-09-22 16:41:11,982 – PixivUtil20120921 – ERROR – Dumping html to: Error Medium Page for image 26373909.html
2012-09-22 16:41:11,983 – PixivUtil20120921 – ERROR – Cannot dump page for image_id: 26373909
2012-09-22 16:41:32,681 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:41:37,786 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:41:42,984 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:41:48,095 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:41:48,114 – PixivUtil20120921 – ERROR – Error at processImage(): (, <httperror_seek_wrapper (urllib2.HTTPError instance) at 0x29f5618 whose wrapped object = <closeable_response at 0x29a7fa8 whose fp = <response_seek_wrapper at 0x29b6468 whose wrapped object = <closeable_response at 0x29b6828 whose fp = >>>>, )
2012-09-22 16:41:48,114 – PixivUtil20120921 – ERROR – Error at processImage(): 26373909
Traceback (most recent call last):
File “PixivUtil2.py”, line 665, in processImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 106, in downloadImage
File “mechanize_mechanize.pyc”, line 203, in open
File “mechanize_mechanize.pyc”, line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 502: Bad Gateway
2012-09-22 16:41:48,118 – PixivUtil20120921 – ERROR – Dumping html to: Error Medium Page for image 26373909.html
2012-09-22 16:41:48,118 – PixivUtil20120921 – ERROR – Cannot dump page for image_id: 26373909
2012-09-22 16:42:11,801 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:42:16,934 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:42:22,010 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:42:27,112 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:42:27,125 – PixivUtil20120921 – ERROR – Error at processImage(): (, <httperror_seek_wrapper (urllib2.HTTPError instance) at 0x35cfab0 whose wrapped object = <closeable_response at 0x2a00c38 whose fp = <response_seek_wrapper at 0x34c7b70 whose wrapped object = <closeable_response at 0x34c7d78 whose fp = >>>>, )
2012-09-22 16:42:27,125 – PixivUtil20120921 – ERROR – Error at processImage(): 26373909
Traceback (most recent call last):
File “PixivUtil2.py”, line 665, in processImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 106, in downloadImage
File “mechanize_mechanize.pyc”, line 203, in open
File “mechanize_mechanize.pyc”, line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 502: Bad Gateway
2012-09-22 16:42:27,130 – PixivUtil20120921 – ERROR – Dumping html to: Error Medium Page for image 26373909.html
2012-09-22 16:42:27,131 – PixivUtil20120921 – ERROR – Cannot dump page for image_id: 26373909
2012-09-22 16:42:49,204 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:42:54,338 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:42:59,453 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:43:04,569 – PixivUtil20120921 – ERROR – HTTPError: HTTP Error 502: Bad Gateway(http://i1.pixiv.net/img05/img/focus/26373909_big_p2.jpg)
2012-09-22 16:43:04,584 – PixivUtil20120921 – ERROR – Error at processImage(): (, <httperror_seek_wrapper (urllib2.HTTPError instance) at 0x391df48 whose wrapped object = <closeable_response at 0x38f1850 whose fp = <response_seek_wrapper at 0x335d260 whose wrapped object = <closeable_response at 0x335d580 whose fp = >>>>, )
2012-09-22 16:43:04,584 – PixivUtil20120921 – ERROR – Error at processImage(): 26373909
Traceback (most recent call last):
File “PixivUtil2.py”, line 665, in processImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 211, in downloadImage
File “PixivUtil2.py”, line 106, in downloadImage
File “mechanize_mechanize.pyc”, line 203, in open
File “mechanize_mechanize.pyc”, line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 502: Bad Gateway
2012-09-22 16:43:04,588 – PixivUtil20120921 – ERROR – Dumping html to: Error Medium Page for image 26373909.html
2012-09-22 16:43:04,588 – PixivUtil20120921 – ERROR – Cannot dump page for image_id: 26373909
2012-09-22 16:43:04,589 – PixivUtil20120921 – ERROR – Giving up image_id: 26373909
Is it an error on my part or not?
thank you
you’re really a historical figure!
pointing to donation link ==> 😀
Works just fine, thank you.
Now it refuses to log in using form.
Tells me that i use wrong username or password. I could still log in using them manually from browser.
try to set usessl = True in config.ini
Thanks for the update.
But I found it changed some settings in the config.ini file,such as filenameformat filenamemangaformat .
can you give me more details please?
THX for updating! you’re awesome!