56 thoughts on “pixiv downloader 20130316”

  1. Right now it’s skipping some images (tried with several member_ids), it says “file url not found” but it’s probably an issue with Pixiv’s servers – when I go to the pages of those pictures, the mid-sized version is present but not the big one when I click.

    Anyway, a very minor feature I’d like to suggest (since you are going to update again soon, as I read): what about a simple command, for example CTRL+S, to skip the image or manga the program is currently downloading or checking? Of course, the point of the program is to automate the collecting of the pics while you can do other things, however, sometimes I think of such a command when (especially during bookmark updating) the program has to go through an entire long manga it has already downloaded. Just one of those “not necessary but appreciated” things.

    Should I post it in the GIthub like last time?

    1. better do that, most likely you need to use Ctrl-C (break) cos I don’t catch for a specific keystroke in console. Dunno if I can capture keyboard event in console application…

  2. Hey there. New user here.

    Using the commandline thing, when I try to enter username and password, I get a “Wrong username, [enter] to exit” message.

    I try to manually enter the username and password into the config file as well, and I STILL get the wrong username message! What? Do I need to log out first or something?

    I appreciate your effort in developing this software, and I want to experience firsthand your handywork.

        1. yap, same issue. Pixiv redirect to index.php, rather than mypage.php. I think they doing A/B testing for the interface. Anyway, I’ll update this on the weekend.

  3. it says that my account is incorrect, i tried at pixiv page and it work, tried also in the config file and nothing, what could it be? its happening since the last version

    1. Try to temporary change the password to simpler one (e.g.: abc) and retest? Mine is working. Do you use special character, or even non-ascii username/password?

      Do you enter the password through console, or written in config.ini?

      1. Well you see, my account is very simple, tried and changed the password two or three times, with four letters and two numbers, still not working xD

        I entered the password through the console, also in config.ini but the error remains there: “wrong username or password”

        I also downoaded the files a couple of times, but they’re not working, maybe a bad configuration on my internet conection?

        1. Can you set debughttp = True and paste the result to pastebin? You should see GET http://www.pixiv.net/mypage.php after the login succeed.

        1. I think I know why. I’m expecting it will forward me to mypage.php directly, but somehow it redirect me to index.php. I’ll update it in the weekend.

  4. Thank you very much for this. May I ask if its possible to download Submitted Novels ?

  5. It takes like, three minutes to download one single image. Is there some kind of delay between downloading images or is pixiv throttling my speeds? I can load images normally in browsers and other image downloaders (that don’t do the job as well as pixivutil does). Thank you for creating and maintaining this app, nandaka.

    1. no throttling from my application, the download section didn’t change. Try to change the useragent in config.ini or try to use proxy.

      1. Alright, will do. It’s not beyond the point of unbearable, though. Thanks, nandka.

  7. I hadn’t used Pixiv Downloader for a while and decided to update to the latest version as I was intending to use it now and I now I’m unable to download more than a few files, since the script starts to trip up afterwards.

    Here’s a log for when I tried to download all images by a certain user. http://pastebin.com/NeuTcJRb

    I’m using OS X 10.8.3 with Python 2.7.3

  8. Oh, thank you, the cleanup worked! Also, it does appear that pixiv is now throttling my IP. The proxy is much faster.

  9. Has downloading been throttled? I used to be able to update my “tags” folder in 1 to 2 hours. I’m currently at hour 57 of the program running.

      1. Alright. I’m getting a lot of timeouts, retries, and some downloads are just taking 2-3 minutes for a file less than 500kb in size. I haven’t noticed anything odd on my connection, unless pixiv themselves are throttling my account.

          1. Alright, let me get a working one, but how do I cancel PixivUtil2 without adding an image to database without downloading it? I’ve had this happen before and needed to delete the whole database as a result.

          2. You means adding the image to db without downloading it, or downloading the image without adding it to db?
            The first one is not possible, it will only add the image if the download is completed successfully (https://github.com/Nandaka/PixivUtil2/blob/master/PixivUtil2.py#L713).
            The second one, you can backup the db, do the download, and then restore the db again.

            There is an option do DB Manager to clean up (delete the image id) the db from missing image (based on the saved path in DB). Press ‘d’, then ‘c’.

          3. Oh, I got that error again that messed up my entire pixiv tags folder. “Error at loadConfig(): (, No Option ‘datediff; in section: ‘Settings’, )

            And then it wrote another config file, but deleted my filepath settings. Is there any way to prevent this in future versions? I downloaded about 40 gigs extra because of that.

  10. I’m trying to download via list, but when I type in 4 and hit enter, it just goes back to the menu.
    I have all the links in a list.txt file in the PixivUtil folder.

    1. check your config.ini, set:
      uselist = True
      processfromdb = True

      If still not fixed, upload your config.ini and log to pastebin

        1. config looks ok, can you upload your list.txt to pastebin?

          It should be save in the same folder with the application and it should contain the member id (all numeric) separated by new line. Any line with # in the front (1st char) will be ignored.

      2. Oh, my list only contains the links.
        You say member id? Would illustration ID work?
        I have this huge list of illustrations I want to download, not artists.

        So would this work, for example (illustration IDs):
        34008137
        33644593

  11. bug report:
    pixiv downloader 20130316
    ###############################################################
    2013-03-18 21:27:56,605 – PixivUtil20130316 – INFO – Starting…
    2013-03-18 21:27:56,621 – PixivUtil20130316 – INFO – Only process member where day last updated >= 7
    2013-03-18 21:28:02,456 – PixivUtil20130316 – INFO – Log in using form.
    2013-03-18 21:28:16,933 – PixivUtil20130316 – INFO – Logged in
    2013-03-18 21:28:18,461 – PixivUtil20130316 – INFO – New Illust from Bookmark mode.
    2013-03-18 21:28:26,931 – PixivUtil20130316 – ERROR – Error at processImage(): (, UnicodeEncodeError(‘ascii’, u’2013u5e743u670818u65e5 21:47′, 4, 5, ‘ordinal not in range(128)’), )
    2013-03-18 21:28:26,931 – PixivUtil20130316 – ERROR – Error at processImage(): 34348534
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 576, in processImage
    File “PixivModel.pyc”, line 226, in __init__
    File “PixivModel.pyc”, line 308, in ParseWorksData
    UnicodeEncodeError: ‘ascii’ codec can’t encode character u’u5e74′ in position 4: ordinal not in range(128)
    2013-03-18 21:28:26,931 – PixivUtil20130316 – ERROR – Dumping html to: Error Medium Page for image 34348534.html
    2013-03-18 21:28:26,947 – PixivUtil20130316 – ERROR – Error at processNewIllustFromBookmark(): (, UnicodeEncodeError(‘ascii’, u’2013u5e743u670818u65e5 21:47′, 4, 5, ‘ordinal not in range(128)’), )
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 992, in processNewIllustFromBookmark
    File “PixivUtil2.py”, line 576, in processImage
    File “PixivModel.pyc”, line 226, in __init__
    File “PixivModel.pyc”, line 308, in ParseWorksData
    UnicodeEncodeError: ‘ascii’ codec can’t encode character u’u5e74′ in position 4: ordinal not in range(128)
    2013-03-18 21:28:26,963 – PixivUtil20130316 – ERROR – Unknown Error: ‘ascii’ codec can’t encode character u’u5e74′ in position 4: ordinal not in range(128)
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1510, in main
    File “PixivUtil2.py”, line 1303, in menuDownloadNewIllustFromBookmark
    File “PixivUtil2.py”, line 992, in processNewIllustFromBookmark
    File “PixivUtil2.py”, line 576, in processImage
    File “PixivModel.pyc”, line 226, in __init__
    File “PixivModel.pyc”, line 308, in ParseWorksData
    UnicodeEncodeError: ‘ascii’ codec can’t encode character u’u5e74′ in position 4: ordinal not in range(128)
    2013-03-18 21:28:30,552 – PixivUtil20130316 – INFO – EXIT
    2013-03-18 21:28:30,552 – PixivUtil20130316 – INFO – ###############################################################

    file :
    http://www.mediafire.com/view/?wkp2gx41gzgdjrp

    20130222c don’t have this problem…

    1. This is because you using japanese ui in Pixiv, and in the new version the application expecting the date format in English format.
      For time being, set your user settings in Pixiv to use English language.

      1. Thanks for the reply , I’m using Chinese S ui in pixiv.

        I will use 20130222c instead…

  12. Due to stuff, i lost database. Now downloader wants to check all pictures instead of first five as checkupdatedlimit tells it. Basically, instead of downloading all new images, finding that next five files exist and going to next artist, it checks all images of an artist.
    What do?

    1. set checkUpdatedLimit = 0 and maybe you want to set daylastupdated = 0 so it will go through all the listed members to rebuild the db.

      1. I meant, what to so it would stop after finding that next five files exist and instead of continuing rebuild would go to next listed member?

  13. Thanks for implementing my suggestion! I’ll test the new option asap πŸ˜€ So, it works like I imagined, e.g. the number corresponds to how many days before the current date a work is old, before the programs stops downloading from a profile?

    Just a little note: the changelog explains the new option but readme.txt not, it could use an update with the next version.

    1. The idea would be to have a setting in the .ini so that the downloader gets only pictures that were posted X days before the system date. So, value 0 would be no limit, 7 would be only pics that are a week old or newer, 60 only from the last two months, and so on.

      The date is from work date, and dateDIff is the number of date diff from today

      3. Okay, never mind.
        Apparently the problem was with the tags I was using (even though I copied them straight from pixiv)
        Thanks for the update.

Comments are closed.