see the readme.txt for the available start action.
Why didn’t I think of that?
Zillion thanks!
Firstly, thanks for this awesome time saving program. I really appreciate it.
I did notice something though, when selecting “5 – Download from user bookmark” and also exporting online bookmarks every entry is doubled. So instead of ending up with let’s say 100 bookmarks, it doubles to 200. Not quite sure if this is a new issue or not. Obviously it increases download times and also hits the Pixiv servers twice which isn’t a good thing.
For anyone else who is having the same problem…I solved it by exporting the online bookmarks, copy pasting the list into http://textop.us/Lines-tools/Delete-Duplicate-Lines to remove duplicates and then using the “uselist” config setting for Pixiv Downloader instead. Just thought i’d let you know and everyone else so we can all responsibly connect to Pixiv and minimize our bandwidth consumption.
I’d also like to see this permanently fixed. It takes a really long time to download when it has to parse through everything instead of instantly detecting the pictures that have already been downloaded.
It shouldn’t parse everything before try to download. It will check the db if the image_id already exist or not (except if alwaysCheckFileSize value to is True), if not then parse the image page and check if the filename is exist or not.
The message should be like “Already Downloaded: #image_id#”, not “File exist! (Identical Size)” or “Found file with different filesize…”
>>It shouldn’t parse everything before try to download. It will check the db if the image_id already exist or not (except if alwaysCheckFileSize value to is True), if not then parse the image page and check if the filename is exist or not.
The message should be like “Already Downloaded: #image_id#”, not “File exist! (Identical Size)” or “Found file with different filesize…”
Yeah it says “Already Downloaded: #image_id#” sometimes, but other times it seems to arbitrarily choose to switch to parse mode and say “File exist! (Identical Size)” for each file. The alwaysCheckFileSize is set to False. Any idea why it would do that?
It means the image_id is not in the DB. As why it is not updated in the DB, I’m don’t know? Do you run the multiple program in the same time?
Another thing, the overwrite must be set to False.
The overwrite value is false and I don’t run multiple programs.
When I check/export the database list it is blank, so that would explain why it does that. How does your program update the database?
>>How does your program update the database?
Ff you use list.txt, every time the program is started, the content will be imported to DB.
If you manually enter the member_id, the member_id is not inserted to DB, only update the status and name if exist.
Before starting download the image page, the image_id is checked from DB, and every time an image is completely downloaded, the image_id will be inserted to DB.
You can see the source code for more detail.
You can try to delete the db.sqlite, it might be corrupted/locked?
Download every image that user’s favorite users has posted till this date, feature request?
I think my earlier report is because the image and/or user is missing/deleted
it says “該当ユーザーは既に退会したか、存在しないユーザーIDです。” when I visit the page
it is because of bug in the program, will be fixed in the next release.
got an error when download from tag list when encountered an image with a blacklisted tag
Image Id: xxxxxxxx
Bookmark Count: 11
Processing Image Id: xxxxxxxx
Skipping image_id: xxxxxxxx because contains blacklisted tags: 3D
Traceback (most recent call last):
File “PixivUtil2.py”, line 656, in processImage
UnboundLocalError: local variable ‘viewPage’ referenced before assignment
Error at processImage(): (, UnboundLocalErr
or(“local variable ‘viewPage’ referenced before assignment”,), )
Cannot dump page for image_id: 27377905
Error at processTags(): (, UnboundLocalErro
r(“local variable ‘mediumPage’ referenced before assignment”,), )
Error at processTagsList(): (, UnboundLocal
Error(“local variable ‘mediumPage’ referenced before assignment”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1372, in main
File “PixivUtil2.py”, line 1166, in menuDownloadFromTagsList
File “PixivUtil2.py”, line 779, in processTagsList
File “PixivUtil2.py”, line 743, in processTags
File “PixivUtil2.py”, line 668, in processImage
UnboundLocalError: local variable ‘mediumPage’ referenced before assignment
press enter to exit.
Got a big problem here: when I download pictures with Pixiv Downloader some of the files are corrupted. (Here’s an example: http://dl.dropbox.com/u/10112397/22559097.jpg) I’m sure it’s not a problem with my computer’s memory and sometimes other downloads get corrupted. (Files downloaded in Firefox, Internet Download Manager, etc.)
Got any idea how to fix this? Please respond.
usually it is because the file is not completely downloaded/the download process is timed-out. If the cause is because of the computer’s memory, then check you ram and replace it.
no other choice beside redownloading the image, you can set alwayscheckfilesize to True to compare the downloaded filesize to the filesize information given from pixiv server.
Thanks for the reply. I can’t diagnose the problem I have. I think I’m receiving bad packets/modem is busted/drivers are malfunctioning/etc. It’s affecting other downloads as well. (Files I download are occasionally corrupted.)
Setting alwayscheckfilesize doesn’t help when the file size doesn’t change. (The corrupted files have the exact same file size as an ordinary file.) Thanks for the suggestion though. I’ve tried checking my RAM with Memtest86, but nothing out of the ordinary came up.
There’s nothing wrong with your software, it’s just on my end. Don’t worry about it. Thanks for developing Pixiv Download/Danbooru Downloader regularly!
You may need to check the hdd too, maybe your hdd is going bad.
It’s not my HDD. This problem seems to affect all downloads. (ZIPs/RARs/videos get corrupted, pictures in browsers get corrupted, etc.) I can’t diagnose what the problem is, which is very infuriating.
I even phoned my ISP and they didn’t detect any problems with my connection. Looks like the only thing I can do is fully reinstall Windows 7.
Really Thanks for this amazing program!
can I ask a little suggestion?
when finish a batch donwload job, can the program display a message or sound advert?
Regards!
create batch file to call PixivUtil2.exe with the specified start action, then call another program to show notification, for example:
pixivUtil2.exe -s3 member_id -x
c:pathtothecompletemessage.txt
c:pathtothecompletesound.wav
see the readme.txt for the available start action.
Why didn’t I think of that?
Zillion thanks!
Firstly, thanks for this awesome time saving program. I really appreciate it.
I did notice something though, when selecting “5 – Download from user bookmark” and also exporting online bookmarks every entry is doubled. So instead of ending up with let’s say 100 bookmarks, it doubles to 200. Not quite sure if this is a new issue or not. Obviously it increases download times and also hits the Pixiv servers twice which isn’t a good thing.
For anyone else who is having the same problem…I solved it by exporting the online bookmarks, copy pasting the list into http://textop.us/Lines-tools/Delete-Duplicate-Lines to remove duplicates and then using the “uselist” config setting for Pixiv Downloader instead. Just thought i’d let you know and everyone else so we can all responsibly connect to Pixiv and minimize our bandwidth consumption.
I’d also like to see this permanently fixed. It takes a really long time to download when it has to parse through everything instead of instantly detecting the pictures that have already been downloaded.
It shouldn’t parse everything before try to download. It will check the db if the image_id already exist or not (except if alwaysCheckFileSize value to is True), if not then parse the image page and check if the filename is exist or not.
The message should be like “Already Downloaded: #image_id#”, not “File exist! (Identical Size)” or “Found file with different filesize…”
>>It shouldn’t parse everything before try to download. It will check the db if the image_id already exist or not (except if alwaysCheckFileSize value to is True), if not then parse the image page and check if the filename is exist or not.
The message should be like “Already Downloaded: #image_id#”, not “File exist! (Identical Size)” or “Found file with different filesize…”
Yeah it says “Already Downloaded: #image_id#” sometimes, but other times it seems to arbitrarily choose to switch to parse mode and say “File exist! (Identical Size)” for each file. The alwaysCheckFileSize is set to False. Any idea why it would do that?
It means the image_id is not in the DB. As why it is not updated in the DB, I’m don’t know? Do you run the multiple program in the same time?
Another thing, the overwrite must be set to False.
The overwrite value is false and I don’t run multiple programs.
When I check/export the database list it is blank, so that would explain why it does that. How does your program update the database?
>>How does your program update the database?
Ff you use list.txt, every time the program is started, the content will be imported to DB.
If you manually enter the member_id, the member_id is not inserted to DB, only update the status and name if exist.
Before starting download the image page, the image_id is checked from DB, and every time an image is completely downloaded, the image_id will be inserted to DB.
You can see the source code for more detail.
You can try to delete the db.sqlite, it might be corrupted/locked?
Download every image that user’s favorite users has posted till this date, feature request?
I think my earlier report is because the image and/or user is missing/deleted
it says “該当ユーザーは既に退会したか、存在しないユーザーIDです。” when I visit the page
it is because of bug in the program, will be fixed in the next release.
got an error when download from tag list when encountered an image with a blacklisted tag
Image Id: xxxxxxxx
Bookmark Count: 11
Processing Image Id: xxxxxxxx
Skipping image_id: xxxxxxxx because contains blacklisted tags: 3D
Traceback (most recent call last):
File “PixivUtil2.py”, line 656, in processImage
UnboundLocalError: local variable ‘viewPage’ referenced before assignment
Error at processImage(): (, UnboundLocalErr
or(“local variable ‘viewPage’ referenced before assignment”,), )
Cannot dump page for image_id: 27377905
Error at processTags(): (, UnboundLocalErro
r(“local variable ‘mediumPage’ referenced before assignment”,), )
Error at processTagsList(): (, UnboundLocal
Error(“local variable ‘mediumPage’ referenced before assignment”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1372, in main
File “PixivUtil2.py”, line 1166, in menuDownloadFromTagsList
File “PixivUtil2.py”, line 779, in processTagsList
File “PixivUtil2.py”, line 743, in processTags
File “PixivUtil2.py”, line 668, in processImage
UnboundLocalError: local variable ‘mediumPage’ referenced before assignment
press enter to exit.
Got a big problem here: when I download pictures with Pixiv Downloader some of the files are corrupted. (Here’s an example: http://dl.dropbox.com/u/10112397/22559097.jpg) I’m sure it’s not a problem with my computer’s memory and sometimes other downloads get corrupted. (Files downloaded in Firefox, Internet Download Manager, etc.)
Got any idea how to fix this? Please respond.
usually it is because the file is not completely downloaded/the download process is timed-out. If the cause is because of the computer’s memory, then check you ram and replace it.
no other choice beside redownloading the image, you can set alwayscheckfilesize to True to compare the downloaded filesize to the filesize information given from pixiv server.
Thanks for the reply. I can’t diagnose the problem I have. I think I’m receiving bad packets/modem is busted/drivers are malfunctioning/etc. It’s affecting other downloads as well. (Files I download are occasionally corrupted.)
Setting alwayscheckfilesize doesn’t help when the file size doesn’t change. (The corrupted files have the exact same file size as an ordinary file.) Thanks for the suggestion though. I’ve tried checking my RAM with Memtest86, but nothing out of the ordinary came up.
There’s nothing wrong with your software, it’s just on my end. Don’t worry about it. Thanks for developing Pixiv Download/Danbooru Downloader regularly!
You may need to check the hdd too, maybe your hdd is going bad.
It’s not my HDD. This problem seems to affect all downloads. (ZIPs/RARs/videos get corrupted, pictures in browsers get corrupted, etc.) I can’t diagnose what the problem is, which is very infuriating.
I even phoned my ISP and they didn’t detect any problems with my connection. Looks like the only thing I can do is fully reinstall Windows 7.