Changelog:
- Add option to disable html dump and skipDumpFilter. See readme.txt for more details.
- Update console title for download by member and download by tags.
- Add download by group id.
Download link for pixiv downloader 20130912, source code in GitHub.
Donation link in sidebar ==> 😀
Processing Image Id: 38752261
Traceback (most recent call last):
File “PixivUtil2.py”, line 579, in processImage
File “PixivModel.pyc”, line 269, in __init__
File “PixivModel.pyc”, line 369, in ParseWorksData
File “_strptime.pyc”, line 325, in _strptime
ValueError: time data ‘2013-09-26 12:Sep’ does not match format ‘%m-%d-%Y %H:%M’
Error at processImage(): (, ValueError(“time data ‘2013-09-26 12:Sep’ does not m
atch format ‘%m-%d-%Y %H:%M'”,), )
Dumping html to: Error Medium Page for image 38752261.html
Error at processNewIllustFromBookmark(): (, ValueError(“time data ‘2013-09-26 12
:Sep’ does not match format ‘%m-%d-%Y %H:%M'”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1647, in main
File “PixivUtil2.py”, line 1411, in menuDownloadNewIllustFromBookmark
File “PixivUtil2.py”, line 1044, in processNewIllustFromBookmark
File “PixivUtil2.py”, line 579, in processImage
File “PixivModel.pyc”, line 269, in __init__
File “PixivModel.pyc”, line 369, in ParseWorksData
File “_strptime.pyc”, line 325, in _strptime
ValueError: time data ‘2013-09-26 12:Sep’ does not match format ‘%m-%d-%Y %H:%M’
Weird, what is your language settings in Pixiv? Try to set it to English or japanese.
Got this error, it is bug from Pixiv server.
They return wrong date information.
I can add exception catching here, but the date/time will be wrong.
so what should i do?
well language setting is english..
should i change it?
if it’s a bug any way to repair this?
or will pixiv repair the bug
thanks for the reply 🙂
I’m getting the bug too. I’d say it’s more important to have the images download at all than to absolutely have the correct time, so I hope you do add the fix.
Fixed in GitHub, I’ll release in the week end.
Thanks 🙂
I experienced that bug too and it happens inconsistently, you may experience it after just a few images downloaded, or after several.
so i am downloading for about 140 page at once in pixiv..
when i reach the page 142, suddenly i get this :
Traceback (most recent call last):
File “PixivUtil2.py”, line 579, in processImage
File “PixivModel.pyc”, line 269, in __init__
File “PixivModel.pyc”, line 369, in ParseWorksData
File “_strptime.pyc”, line 325, in _strptime
ValueError: time data ‘2013-08-07 16:Aug’ does not match format ‘%m-%d-%Y %H:%M’
Error at processImage(): (, ValueError(“time data
‘2013-08-07 16:Aug’ does not match format ‘%m-%d-%Y %H:%M'”,), )
Dumping html to: Error Medium Page for image 37623127.html
Error at processTags(): (, ValueError(“time data ‘
2013-08-07 16:Aug’ does not match format ‘%m-%d-%Y %H:%M'”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1636, in main
File “PixivUtil2.py”, line 1303, in menuDownloadByTags
File “PixivUtil2.py”, line 863, in processTags
File “PixivUtil2.py”, line 579, in processImage
File “PixivModel.pyc”, line 269, in __init__
File “PixivModel.pyc”, line 369, in ParseWorksData
File “_strptime.pyc”, line 325, in _strptime
ValueError: time data ‘2013-08-07 16:Aug’ does not match format ‘%m-%d-%Y %H:%M’
any help? thanks 🙂
Hi!!!, great job with the downloader!!!
I have a question, there´s an option to disable the download of the thumbnails of the mangas?
Are you using the latest version? It should not download the thumbnail of the manga anymore.
I see xD, i downloaded the latest version, but there’s any way to save the list of the artists that I have downloaded?
backup your db.sqlite, all the data are there.
Thank you very much!!!
Some time ago I whined a bit about PixivUtil working from local terminal on Linux box but not working when I used SSH with PuTTY.
I found the case and the solution: export LANG=en_US.UTF-8 . PuTTY does not set locales right, when they are not set, python does not know what to write.
Hope would be useful.
Added to FAQ
Soooo…is it impossible to get this to re-download pictures it has already downloaded?
If you want to redownload deleted images => Go to DB Manager (d), and select Clean Up Database (c). After that you can redownload the missing images.
If you always want to redownload any images => set alwaysCheckFileSize to True.
Sweet! Thanks!
So I’ve been messing around with the settings a little and I have a question. Is there a way to use the manga directory option but have the images within named differently? Like instead of just being “_page1” or something like that I want to use “artist_name_page”.
Check the filenameformat on the readme.txt. maybe you can use %artist%_page_%page_number%
My current settings are
filenameformat = %artist% – %title%
filenamemangaformat = %artist% – %title% %urlFilename%
I tried doing what you were saying but the results is the same. Just to make myself clear, I meant that I still want the downloader to save the manga in it’s own directory but I just want to do it while the files inside are also named after the folder instead of _p0.jpg.
set createmangadir = False
Still not entirely what I mean but thanks anyway. I assume there’s no way to do what I want then.
Say I want to save a specific tag, with manga mode set to True it saves normal images in the root directory and manga in their own folder with the pictures inside named as _p1.jpg and so on. What I wanted to do is to have the downloader keep saving normal images in one folder and manga in their each individual folder only with the name of the folder being applied to the files inside of it as well.
To illustrate what I mean.
http://i41.tinypic.com/vhrvgn.jpg
If it’s impossible then I’ll just rename the files myself or learn to live with it so it’s not a big deal. Thanks for replying.
Try this way?
set
createmangadir = False
in config.ini and use 2 different format for the filename.filenameformat = %artist% – %title%
filenamemangaformat = %artist% – %title%%title% - %urlFilename%
That worked! Thank you very much and keep up the good work.
Hi nandaka
i love this fine software, but i have a question
how I (write) download by tags in non-japanese system?, example: “R-18″ tag are fine, but “Boobs” or “Chubby” or anything else don’t work because are write in hiragana
Regards!
See the readme.txt, use the 2nd option for your case (url-encode the search term)
Q1. How to paste japanese tags to the console window?
- Click the top-left icon -> select Edit -> Paste (Cannot use Ctrl-V), if
it show up as question mark -> Change the Language for non-Unicode
program to Japanese (google it).
- or use online url encoder (http://meyerweb.com/eric/tools/dencoder/)
and paste the encoded tag back to the console.
- or paste it to tags.txt and select download by tags list. Separate each
tags with space, and separate with new line for new query.
I might be stupid, or this might not even exist. I looked in the readme and I cannot find a way to get separate user’s pictures into one folder so all of the pictures are in one place. Instead when there are multiple users and pictures it turns into this. http://imgur.com/xrmUncQ
Change your
rootdirectory
to the target folder. If not working, upload your config.ini to pastebin.Did I do it wrong?
http://pastebin.com/0D541jAt
Should be OK
Awesome. I was hoping of more of all the pictures are stored in one folder instead of one folder to hold all the other folders. Works great either way though. Thanks!
remove the folder separator
the
filenameformat
andfilenamemangaformat
inconfig.ini
, e.g.:filenameformat = %artist% (%member_id%) %urlFilename% - %title%
filenamemangaformat = %artist% (%member_id%) %urlFilename% - %title%
See readme.txt for more file naming option.
Thank you! Wish I found this earlier would have made getting a lot of these pictures easier.
Hi there, thank you very much for your wonderful software ^^
Actually recently I always have this kind of error and I don’t know what happened http://i.imgur.com/bkL9QRb.jpg
Looks like you got connection problem, somehow the response from the server is empty (no header, no body content).
Try to use on other internet connection?
thanks for the reply, I’ll try using other internet connection and see if it’s working. Thank you very much
Question about Command Line Options: there is nothing said in readme about ability to do
>python PixivUtil2.py -s 7 tags.txt 0 100 -x
for example, only starting page. Would it work? If not, can it be added?
I am an idiot.