Change Log for 20160319
- Fix unicode decode error when downloading image.
- Implement #107: add option to specify different database.
- Fix Issue #108: parse total image count.
- Fix Issue #109: update parser for title and caption.
- Update readme.txt
Download link for latest version, source code in GitHub.
Error at pixiv_login_ssl(): (, URLError(SSLError(1, u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)’),), )
Error at doLogin(): (, URLError(SSLError(1, u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)’),), )
SSL error?
i tried logging in this morning and got this error (copy & paste from cmd)
PixivDownloader2 version 20160319
https://nandaka.wordpress.com/tag/pixiv-downloader/
Reading C:UsersChrisDesktoppixivutil20160319config.ini …
done.
using default DB Path: C:UsersChrisDesktoppixivutil20160319db.sqlite
Creating database… done.
Only process member where day last updated >= 7
Using Username: chaosrealm93
Trying to log with saved cookie
Cookie already expired/invalid.
Log in using secure form.
Error at pixiv_login_ssl(): (, URLError(SSLError(1, u’
[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)’),), )
Error at doLogin(): (, URLError(SSLError(1, u'[SSL: CE
RTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)’),), )
Cannot Login!
press enter to exit.
i also tried extracting a fresh copy of the program and logging in again, but got the same error.
maybe pixiv changed their logins security?
Log in using secure form
Error at pixiv_login_ssl: <, URLError<SSLError<1, u'
[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed ‘>,>,
Error at dologin: <, URLError<SSLError<1, u'
[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed ‘>,>,
Cannot Login!
→Please save me! I can’t solve this probem.
Currently seeing this error when trying to connect right now: ERROR – Error at pixiv_login_ssl(): (, URLError(SSLError(1, u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)’),), )
2016-04-20 05:11:04,335 – PixivUtil20160415-beta2 – ERROR – Error at doLogin(): (, URLError(SSLError(1, u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)’),), )
2016-04-20 05:11:04,339 – PixivUtil20160415-beta2 – ERROR – Cannot Login!
———————————————————————————————————————–
Hello, sir/madam. I cannot login and it shows this message:
Error at doLogin: <, URLError,
)
Cannot Login!
press enter to exit
What is this meaning?
Limit pixiv’s daily download? mistaked by its programing? my account got ban by pixiv system?
Thank you for helping me.
———————————————————————————————————————–
I had same problem.
Non problem in website visit and login by browser(chrome,firefox).
Can you explain this message?
###############################################################
2016-04-20 19:29:54,539 – PixivUtil20160319 – INFO – Starting…
2016-04-20 19:29:54,545 – PixivUtil20160319 – INFO – Setting log level to: DEBUG
2016-04-20 19:29:54,546 – PixivUtil20160319 – INFO – No default cookie jar available, creating…
2016-04-20 19:29:54,551 – PixivUtil20160319 – INFO – using default DB Path: D:picpicturedb.sqlite
2016-04-20 19:29:54,571 – PixivUtil20160319 – INFO – Using Username: xxx
2016-04-20 19:29:54,572 – PixivUtil20160319 – INFO – Log in using secure form.
2016-04-20 19:29:55,415 – PixivUtil20160319 –
ERROR – Error at pixiv_login_ssl(): (, URLError(SSLError(1, u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)’),), )
2016-04-20 19:29:55,420 – PixivUtil20160319 – ERROR – Error at doLogin(): (, URLError(SSLError(1, u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)’),), )
2016-04-20 19:29:55,423 – PixivUtil20160319 – ERROR – Cannot Login!
2016-04-20 19:30:01,576 – PixivUtil20160319 – INFO – EXIT: 1005
2016-04-20 19:30:01,578 – PixivUtil20160319 – INFO – ###############################################################
Thanks for your work.
how do i download all the images for a particular tag?
i tried creating a “tags.txt” file with the tag i want downloaded, but it didnt work
the program asked me for a “wildcard y/n” and also start/end dates and pages
i answered 1 for start page and 0 for end page, and i just pressed enter for both start and end date to skip it, but the images that were downloaded were not the ones i requested
i read the readme but couldnt find the answers
it also asked for a “bookmark count” and i couldnt find anything in the readme to help me understand what it meant
download by tags.txt => Use option 7
bookmark count = star count in the tags search page.
Hello, sir/madam. I cannot login and it shows this message:
Error at doLogin: <, URLError<error,>,
)
Cannot Login!
press enter to exit
What is this meaning?
Limit pixiv’s daily download? mistaked by its programing? my account got ban by pixiv system?
Thank you for helping me.
What is the URLError details? Usually this is related to network issue, can you open the site in browser and login?
Starting to get this error too. Tried relogging on the site and it worked fine. Also tried deleting login info/cookie information from config. Here is the log: http://pastebin.com/8NFgnFSc
Disregard last post, ended up fixing itself. Must have been a network issue like you said.
Sorry about incomplete message, sir/madam. The problem is my anti-virus (AVG) blocked the application due to its may be a virus, and I decided to fix it by setting AVG’s firewall. It completely fixed.
P.S. Sorry again for lately respond.
I had same problem.
visit and login pixiv by browser is ok.(chrome, firefox)
here is error log
###############################################################
2016-04-20 19:11:54,242 – PixivUtil20160319 – INFO – Starting…
2016-04-20 19:11:54,250 – PixivUtil20160319 – ERROR – Error at loadConfig()
Traceback (most recent call last):
File “PixivConfig.pyc”, line 444, in loadConfig
File “ConfigParser.pyc”, line 340, in get
NoOptionError: No option ‘dbPath’ in section: ‘Settings’
2016-04-20 19:11:54,286 – PixivUtil20160319 – INFO – Setting log level to: DEBUG
2016-04-20 19:11:54,286 – PixivUtil20160319 – INFO – No default cookie jar available, creating…
2016-04-20 19:11:54,292 – PixivUtil20160319 – INFO – using default DB Path: D:picturepixivutil20160319db.sqlite
2016-04-20 19:11:54,309 – PixivUtil20160319 – INFO – Using Username: XXXXX
2016-04-20 19:11:54,311 – PixivUtil20160319 – INFO – Log in using secure form.
2016-04-20 19:11:55,092 – PixivUtil20160319 – ERROR – Error at pixiv_login_ssl(): (, URLError(SSLError(1, u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)’),), )
2016-04-20 19:11:55,098 – PixivUtil20160319 – ERROR – Error at doLogin(): (, URLError(SSLError(1, u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)’),), )
2016-04-20 19:11:55,101 – PixivUtil20160319 – ERROR – Cannot Login!
2016-04-20 19:20:41,822 – PixivUtil20160319 – INFO – ###############################################################
Can you explain this?
*nice util. thanks for your work
Hi, is your downloader compatible with danbooru API? I can’t figure out because I’m a pleb. I’m talking about being able to paste the api key from “My Account” section on danbooru so you can download with your account’s permissions without having to enter user and pass
I don’t think so. API Key only for danbooru API version 2, right?
If you don’t want to use username/pass, you can use the cookie method (check the readme).
Hi. How can I download using tags? What should I put in the value of bookmark count if I wanted it to consider all images?
just key in the tag like you do in pixiv search bar. If you want to key in japanese text, remember to change Language for non-unicode to Japanese in control panel (google it).
Leave bookmark count as blank if you want to download all.
hey,
windows no longer asks me “if im sure i want to run the program”
is that part of the update?
Most likely because the file is marked as downloaded from internet, that’s why it show that. Normally it won’t, as I put it into archive.
Anyway, you can try to scan it using virustotal.com
Hey
Before the update ( 2015-06-05 ), config.ini was set to name file %urlFilename% – %title% ( default ) but my files were named “ID of picture_px – nothing here / blank”, which is close to the format when you save the picture from a browser.
Ex : “12345678_p0 -” instead of “1234567_p0 – FancyJapaneseTitle” ( saving from broswer give “1234567_p0” ).
Since the update, I didn’t changed the config.ini file and file name was still set to be %urlFilename% – %title%, and now give me “ID of picture_px – title in japanese _ [artist name] [pixiv]”.
Ex : “1234567_p0 – FancyJapaneseTitle _ [artist name] [pixiv]”
Is the artist name and [pixiv] added by the soft of is it from the pixiv website ?
Also, if I download all pictures from one artist and delete some, I usually just use “1. Download by member ID” to make the soft recheck the folder and download the missing files but it only download new pictures. I guess the soft look in pixivutil.log, so it explain why deleted files are not downloaded again but only new ones, right ?
So I set alwayscheckfilesize = True.
Even since I got wrong named files before the update, I expected this to only check file size but it download all files anyway, regardless of the actual size. Is that normal ?
Just as a note, what would have make the soft not write correctly the files name ( %title% ) ? It worked fine before.
Folder name on the other hand was always correctly written ( %artist% (%member_id%) )
Have a good day.
Btw : name of the post is wrong ( 02 instead of 03 ).
> Is the artist name and [pixiv] added by the soft of is it from the pixiv website ?
It should not behave like that. I’m tested it. Can you give me the member id/image id?
> Even since I got wrong named files before the update, I expected this to only check file size but it download all files anyway, regardless of the actual size. Is that normal ?
Yes, because the application cannot see the old file, so it cannot compare with the old file size.
> what would have make the soft not write correctly the files name ( %title% ) ?
well, if pixiv changes something in the website, then most likely something will break as I don’t use their API.
> name of the post is wrong ( 02 instead of 03 ).
updated.
Members id : 1569160, 3054186, 14320305, 450777, 2702224, etc.
For some, whatever version I use, it only download news pictures. For other, it downloads all pictures as if there was nothing before, making double.
Anyway, it always add the artist name and [pixiv] as extra.
“> what would have make the soft not write correctly the files name ( %title% ) ?
well, if pixiv changes something in the website, then most likely something will break as I don’t use their API.”
I was thinking : this problem can happen to me in local, after a modification of some regional character use or anything related ? Or can it only be due to pixiv changing its behavior ? ( making my pictures to be named “12345678_p0 -” with blank after the – instead of “1234567_p0 – FancyJapaneseTitle” )
The pictures title started to have that blank after the – months ago until I updated the soft this week. Using back the old version now write the title correctly as well as the updated one, but I ask again because it really would be a nice coincidence to happen right when I update the soft. Do you understand my question ?
This issue just annoy me because I have pictures not named correctly and need to be re-downloaded again, plus checking if the artist made modification or deleted some. It’s not crucial, this question is more for my curiosity.
“For some, whatever version I use, it only download news pictures. For other, it downloads all pictures as if there was nothing before, making double.”
Forget about this part, the fact that the soft sometimes make double or not is because the pixivutil.log I used was still the old. I kept deleting the new one when switching version and so didn’t kept info about the new downloads I made. That way, I downloaded double for the most recent batches.
The rest is valid, artist name and [pixiv] is added as extra, whatever version I use.
I cannot replicate you issue. I tried with fresh installation and it produce the correct result. Are you sure the correct config.ini is used? Are you using the -c/–config switch when running the application?
Config.ini :
[Settings]
filenameformat = %artist% (%member_id%)%urlFilename% – %title%
filenamemangaformat = %artist% (%member_id%)%urlFilename% – %title%
Did not touched it since I use it, except “[Authentification] cookie =” because of login error at the very beginning.
I don’t know if it’s the “correct” config.ini to use you think about though.
“Are you using the -c/–config switch when running the application?” : no.
Can you tell me how you usually update an old version to a new one correctly to be sure I do it the good way btw ?
> filenameformat = %artist% (%member_id%)%urlFilename% – %title%
> filenamemangaformat = %artist% (%member_id%)%urlFilename% – %title%
Based on your config.ini, it is expected to add title to the filename. Remove – %title% from it, refer to readme.txt for more details.
> updates
Usually I backup the config.ini before extracting the new version. Also, you need to keep on updating the version. If you skip some release, usually it will overwrite the config.ini.
Good, I update the right way then.
%title% wasn’t the problem, problem was the automatic add of [pixiv] + [artist name] without touching the config.ini, but the problem solved itself now. I could not replicate the issue either, with both version I used. So everything’s fine now ! Thank
Hi!
How to keep original last modified date for downloaded image? It’s better to manage.
thx
no feature for that one.
I’ve found that some captions are still not being saved.
(r-18) http://www.pixiv.net/member_illust.php?mode=medium&illust_id=48133713 and some other works by the same artist are downloading but the caption field is left blank in the imageinfo file despite there being a caption on pixiv.net. This was happening with another artist as well but I can’t find their page now.
Can you log it to GitHub with the sample pages?
Sorry for a really late reply, but by sample pages do you just want a list of affected pages, or download logs/meta info as well?
List of the affected image_id will do, but you can upload the actual pages too if you are not using English/Japanese language in pixiv website.