50 thoughts on “pixiv downloader 20131218”

  1. Hello, I’m having a trouble like below.

    2014-01-23 16:28:10,374 – PixivUtil20131218 – INFO – ###############################################################
    2014-01-23 16:28:10,374 – PixivUtil20131218 – INFO – Starting…
    2014-01-23 16:28:10,377 – PixivUtil20131218 – INFO – Setting log level to: DEBUG
    2014-01-23 16:28:10,377 – PixivUtil20131218 – INFO – No default cookie jar available, creating…
    2014-01-23 16:28:10,380 – PixivUtil20131218 – INFO – Only process member where day last updated >= 7
    2014-01-23 16:28:17,520 – PixivUtil20131218 – INFO – logging in with saved cookie
    2014-01-23 16:28:17,522 – PixivUtil20131218 – INFO – Trying to log with saved cookie
    2014-01-23 16:28:18,269 – PixivUtil20131218 – INFO – Logged in using cookie
    2014-01-23 16:28:19,354 – PixivUtil20131218 – INFO – tags mode.
    2014-01-23 16:28:37,003 – PixivUtil20131218 – INFO – Searching for: (魔法少女まどか☆マギカ) %E9%AD%94%E6%B3%95%E5%B0%91%E5%A5%B3%E3%81%BE%E3%81%A9%E3%81%8B%E2%98%86%E3%83%9E%E3%82%AE%E3%82%AB&scd=2014-01-20&ecd=2014-01-22
    2014-01-23 16:28:37,003 – PixivUtil20131218 – INFO – Looping… for http://www.pixiv.net/search.php?s_mode=s_tag&p=1&word=%E9%AD%94%E6%B3%95%E5%B0%91%E5%A5%B3%E3%81%BE%E3%81%A9%E3%81%8B%E2%98%86%E3%83%9E%E3%82%AE%E3%82%AB&scd=2014-01-20&ecd=2014-01-22
    2014-01-23 16:28:37,710 – PixivUtil20131218 – ERROR – Error at process_tags(): (, ValueError(“invalid literal for int() with base 10: ””,), )
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 894, in process_tags
    File “PixivModel.pyc”, line 657, in parseTags
    ValueError: invalid literal for int() with base 10: ”
    2014-01-23 16:28:37,711 – PixivUtil20131218 – ERROR – Unknown Error: invalid literal for int() with base 10: ”
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1762, in main
    File “PixivUtil2.py”, line 1392, in menu_download_by_tags
    File “PixivUtil2.py”, line 894, in process_tags
    File “PixivModel.pyc”, line 657, in parseTags
    ValueError: invalid literal for int() with base 10: ”

    I hope that this error fixed.

  2. Would there be a way to blacklist by image ID? I want to be able to go through new downloads before adding them to my collection, but also don’t want to download the entire set of images every time. Thanks.

    1. Nope, but if an Image is already downloaded, it shouldn’t be re-downloaded again (even after being deleted) unless u set overwrite or alwaysCheckFileSize to True or do DB Clean Up.

  3. How can i download more two tags in batch? for example ブレイブル バレット is there any way to download the results of both tags?

  4. I’ve got this error :
    Member Url: http://www.pixiv.net/member_illust.php?id=59317&p=1
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 418, in process_member
    File “BeautifulSoup.pyc”, line 1519, in __init__
    File “BeautifulSoup.pyc”, line 1144, in __init__
    File “BeautifulSoup.pyc”, line 1186, in _feed
    File “sgmllib.pyc”, line 104, in feed
    File “sgmllib.pyc”, line 143, in goahead
    File “sgmllib.pyc”, line 320, in parse_endtag
    File “sgmllib.pyc”, line 358, in finish_endtag
    UnicodeEncodeError: ‘ascii’ codec can’t encode character u’xe9′ in position 11:
    ordinal not in range(128)
    Error at processing Artist Info: (, Unicod
    eEncodeError(‘ascii’, u’end_span a xe9txe9 approuvxe9e.n{{#if more}}’, 11, 1
    2, ‘ordinal not in range(128)’), )

    1. Do you change your Regional Settings (Language for non-Unicode programs) to Japanese?
      Also ensure you Pixiv settings to English/Japan.

        1. You have networking issues, probably an incorrect proxy setting.
          I’ve tested it in my pc with no issue (.exe windows version, no proxy)

          2. Are using the script version (from github directly) or the exe version (from mediafire)?

            If you are using script version, maybe the python/library version have problem.

            Try to enable proxy, maybe your ISP is blocking you? Can you open the website in browser?

          3. I can reach the site in my browser, what I can’t do is reach it with the exe version with either my normal internet, or my mobile tether, both are showing the same error.

          5. Turned off my Antivirus and firewall, still doing it, I think something got in my computer and is playing police officer …

          6. ok, I just tried a fresh install, that works fine, but when i dump my config and list in, it breaks.

        2. I have resolved the problem, something was messed up in the config file, so i remade it and now it works fine, I don’t see what happened to cause this, to the eye, both files are the same.

          2. Sadly I already removed it, I was using a rather old version when it broke, I thought updating would fix it.

          1. Not mine just having trouble getting it working and was wondering if you might know what’s wrong with it since you know how Pixiv works.

          5. I don’t know, as I don’t use the API. My pixiv downloader working by parsing the html page and simulate the click like in the browser.

  8. In a computer download thousands of pictures, in other many other different images.
    How I can combine the database?

    Thanks for your hard work.
    The program is great.

  9. Hello,
    I’d like to have more options in the command lines switches.
    Having the same option in -s 5 as -s 3 would be great (start page, end page)!

    1. Not all command lines are fully documented. Try if start page, end page thing works before asking here, say results.

  10. … I was under assumption that this github repository is the linux version. Irrelevant.

    Either way, from archive, last lines in changelog are:
    >20131218
    >- Add 403 handler when processing member.
    >- Fix Japanese worksdate parser.

    In github:
    >20131214
    >- Add 404 handler when processing member.
    >- Reset selection when Ctrl-C pressed.
    >- Reindent and encode source code to UTF-8.

    You forgot to push update to github, at the very least.

  11. Are you sure you put changes into github?
    Because cloned version is still 20131214.

    WIndows one is ok, yes.

  12. Hello, I’m having trouble logging in to the program, I’m sure I’m using the correct data but still get error, attached the error, exept my personal data.

    Thank you.

    ###############################################################
    2013-12-23 20:06:51,594 – PixivUtil20131218 – INFO – ###############################################################
    2013-12-23 20:06:51,594 – PixivUtil20131218 – INFO – Starting…
    2013-12-23 20:06:51,619 – PixivUtil20131218 – INFO – Setting log level to: DEBUG
    2013-12-23 20:06:51,619 – PixivUtil20131218 – INFO – No default cookie jar available, creating…
    2013-12-23 20:06:51,625 – PixivUtil20131218 – INFO – Only process member where day last updated >= 7
    2013-12-23 20:06:51,627 – PixivUtil20131218 – INFO – Using Username: *****************
    2013-12-23 20:06:51,627 – PixivUtil20131218 – INFO – Log in using form.
    2013-12-23 20:06:55,137 – PixivUtil20131218 – ERROR – Error at pixiv_login(): (, <httperror_seek_wrapper (mechanize._http.RobotExclusionError instance) at 0x2421490 whose wrapped object = <closeable_response at 0x2424620 whose fp = >>, )
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 258, in pixiv_login
    File “mechanize_mechanize.pyc”, line 203, in open
    File “mechanize_mechanize.pyc”, line 255, in _mech_open
    httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
    2013-12-23 20:06:55,138 – PixivUtil20131218 – ERROR – Unknown Error: HTTP Error 403: request disallowed by robots.txt
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1742, in main
    File “PixivUtil2.py”, line 258, in pixiv_login
    File “mechanize_mechanize.pyc”, line 203, in open
    File “mechanize_mechanize.pyc”, line 255, in _mech_open
    httperror_seek_wrapper: HTTP Error 403: request disallowed by robots.txt
    2013-12-23 20:26:48,226 – PixivUtil20131218 – INFO – EXIT

Comments are closed.