Change log:
- add auto save cookie from login
- refactor parsing logic to the PixivModel
- updating Python version to 2.7.2
- updating mechanize version to 0.2.5
- updating BeautifulSoup version to 3.2.0
- add unittest for the parsing (only in source code)
- fix 404 in big_manga mode (20110729b)
Download link here here(20110729b), source code here here(20110729b), and unit test here. You can get the latest source in the public repo.
I tried upgrading, been a while, I was previously running 20101024, which seems to work mostly (I think it’s not getting some/all of the newer manga which is why I was looking to upgrade), but the upgrade was a real mess. The old version doesn’t try to download pictures it’s already downloaded in the past, it gives the “Already downloaded” message for them. The new one? Tries to download ever single picture all over again. I did some searching and saw some suggestions for the config.ini, and added those, and even copied the database over from my backup to start fresh and… it continues to try to download every freaking image all over again. This is a MAJOR problem for me, as I use the filenameformat of %member_id% (%artist%)%image_id% – %title%, and some of the artists in my database change their nick fairly often. I don’t want to download all their images all over again every time they do (not to mention it takes about twice as long for the program to fail out on file exists than it does for it to just skip it as already downloaded). Here’s the config.ini for the new version:
[Settings]
proxyaddress =
useproxy = False
useragent = Mozilla/5.0 (X11; U; Unix i686; en-US; rv:1.9.0.1) Gecko/2008071615 Fedora/3.0.1-1.fc9 Firefox/3.0.1
debughttp = False
userobots = True
filenameformat = %member_id% (%artist%)%image_id% – %title%
timeout = 60
uselist = True
processfromdb = True
overwrite = False
tagsseparator = ,
daylastupdated = 7
rootdirectory =
retry = 3
retrywait = 5
rootdirectory = M:ImagesPixiv
createdownloadlists = False
downloadlistdirectory = ..
irfanviewpath = C:Program FilesIrfanView
startirfanview = False
startirfanslide = False
alwayscheckfilesize = True
checkUpdatedLimit = 10
[Pixiv]
numberofpage = 0
Hopefully you can tell me what’s wrong, as I’d like to upgrade and get the images the older version misses, but not badly enough to risk redownloading ~5GB of stuff. 🙁 Oh yes, I’ve tried checkUpdatedLimit both mixed case and all lowercase as the program added it to the config in the first place. Neither worked.
set
alwayscheckfilesize
to FalseThanks, that seems to have fixed it! 😀
there somekind message not defined
http://www.pixiv.net/member_illust.php?mode=medium&illust_id=19683261
該当作品の公開レベルにより閲覧できません。
Public works can not be viewed by the appropriate level.
you need to add new message.
Thx for develope 😀
thanks for the info, btw which page is it?
http://img143.imageshack.us/img143/663/61159947.png
i thinks there a appropriate level to view in each Region or Country something.
it’s necessity in inquire to Pixiv.
From danbooru discussion: http://danbooru.donmai.us/forum/show/50128
No problem here. Message displayed properly. 🙂
Thank you very much, I’ll eagerly wait for the patch.
Why is it that every time I set uselist = True, the program wont start
Also, what happened to the feature where it would automatically save it to a folder with the artist’s name and ID?
when using lists that is.
check your config.ini and read the readme.txt. try to run it from cmd and paste the error message. All is fine in my side.
I’ve read the readme, and I understand.
What I’m saying is that it does not seem to save the galleries to their respected folders, but instead saves it all to a folder named “_”
This is with these settings:
[Settings]
proxyaddress =
useproxy = False
useragent = Mozilla/5.0 (X11; U; Unix i686; en-US; rv:1.9.0.1) Gecko/2008071615 Fedora/3.0.1-1.fc9 Firefox/3.0.1
debughttp = False
userobots = True
filenameformat = %artist% (%member_id%)%image_id% – %title%
timeout = 60
uselist = False
processfromdb = False
overwrite = False
tagsseparator = ,
daylastupdated = 7
rootdirectory =
retry = 3
retrywait = 5
createdownloadlists = True
downloadlistdirectory = V:Pixiv Batch Downloader
irfanviewpath = C:Program FilesIrfanView
startirfanview = False
startirfanslide = False
alwayscheckfilesize = True
checkupdatedlimit = 0
I know it says in the readme that you can specify a directory for each ID, but is that totally necessary for each gallery to be saved to their specific folders? That was not a requirement in the previous versions so I assumed it isn’t a requirement in this one.
My list goes as such:
1234
5678
91011
###END-OF-FILE###
uselist = True
rootdirectory = your download path directory (C:Pixiv Images)
and retype your
filenameformat
, the dash sign is not the standard one (it long one/em dash), replace it with the – signLike I said, the program will not open when “uselist = True”.
It closes as soon as the window pops up.
I’m running Windows 7 64-bit if that helps.
set “uselist = True” and try to run it from the console/cmd and paste the output or just paste the log file (log.txt)
Ah, ok. I found the problem through the cmd method. Apparently you can’t have spaces in the list.
1234
5678
91011
***LIKE HERE***
###END-OF-FILE###
Thanks =)
I am getting this after i enter in a pixiv member id
reading config file…done
page 1
‘NoneType’ object has no attribute ‘ul’
1 2 3 4
‘NoneType’ object has no attribute ‘ul’
1 2 3 4
and it continues.
Never mind I misunderstood the directions, I thought it was the User ID not the number.
🙂
There was a problem in the adult picture illust_id=21011065
all fine in my side, what is the error?
ERROR – Error at downloadImage(): Cannot save http://img16.pixiv.net/img/paxa_600/21011065_big_p0.jpg to G:pixiv(263522) 21011065 -name――_big_p0.jpg (, IOError(2, ‘No such file or directory’), )
2011-08-13 18:36:11,355 – PixivUtil20110729 – ERROR – Error at downloadImage(): (, WindowsError(3, ”), )
2011-08-13 18:36:15,536 – PixivUtil20110729 – ERROR – Error at downloadImage(): Cannot save http://img16.pixiv.net/img/paxa_600/21011065_big_p0.jpg to G:pixiv(263522) 21011065 – name――_big_p0.jpg (, IOError(2, ‘No such file or directory’), )
2011-08-13 18:36:17,940 – PixivUtil20110729 – ERROR – Error at downloadImage(): (, WindowsError(3, ”), )
2011-08-13 18:36:22,137 – PixivUtil20110729 – ERROR – Error at downloadImage(): Cannot save http://img16.pixiv.net/img/paxa_600/21011065_big_p0.jpg to G:pixiv(263522) 21011065 – name――_big_p0.jpg (, IOError(2, ‘No such file or directory’), )
2011-08-13 18:36:24,562 – PixivUtil20110729 – ERROR – Error at downloadImage(): (, WindowsError(3, ”), )
there is a problem with the filename, can I see your filename format in the config.ini? probably it is because your os doesn’t support japanese character, what is your os? try to change the format to
%member_id%%image_id%
.I have tried to download it in different pc, and it is working.
For some reason, Pixiv Downloader closes for me when I run it. I’m sure I’m putting in the correct password, but it always closes. It always closes before I can read the error message or make a screenshot. Does anybody else have this problem?
For my username and password, I have tried both inputting normally and typing it in the config.ini. I do not have capslock turned on and I am absolutely sure I’m not using the wrong username and password. Did Pixiv change something lately so Pixiv Download can’t connect?
Okay, I managed to get a screenshot and here is the error message I get:
Wrong username or password.
Traceback (most recent call last):
File “PixivUtil2.py”, line 887, in
File “PixivUtil2.py”, line 882, in main
UnboundLocalError: local variable ‘selection’ referenced before assignment
Okay, some of the error message didn’t get through, so I’ll type it out again:
Wrong username or password.
Traceback (most recent call last):
File “PixivUtil2.py”, line 887, in
File “PixivUtil2.py”, line 882, in main
UnboundLocalError: local variable ‘selection’ referenced before assignment
(“module” doesn’t have spaces between the brackets, it’s just that typing them together doesn’t show up in the comment.)
I have tested using my account and It is working correctly, have you tried to log in the pixiv website?
I tried it now and it’s working again. I don’t know why it wasn’t an hour ago. It may be a connection error or something.
Thanks for this great software, it saves me a lot of time and the features are excellent.
Manga mode checks filesize even when disabled.
it is because of different filename schema, previously the page marker (_p0) is after the image_id, now it is on the last before the file extension.
It is possible to ask a way to fix this?
it can be done, i will update it next week
I have a very strange problem with this version where I can enter my username but when typing password, nothing is typed in the command line.
it is normal, I think this is already implemented since the last few version. Anyway, if you not sure, you can always edit config.ini and fill the username and password in the Authentication section.
Sweet work, thank you.
you’re welcome.