pixiv downloader 20170220

Changelog:

  • Update test cases.
  • Fix Issue #178: Unbound variable upon error handling.
  • Fix Issue #192: Syntax error :P.
  • Fix Issue #195: Update imageio library url.
  • Fix Issue #196: Allow any whitespace after memberid in list.txt
  • Fix Issue #200: Update tag parsing.

Donate http://bit.ly/PixivUtilDonation

Download link for latest version, source code in GitHub.

14 thoughts on “pixiv downloader 20170220”

  1. Hello! A lot of thanks to developer(s) for this amazing program!
    I’ve just started to use the downloader and I would like to know if it is possible to download pictures by tags, but with certain popularity. For example download images according to “tags.txt” witch were bookmarked at least 500 times by other users. If not, is it possible that such feature will appear in later release?

  2. Argh…I just found out what was wrong. I had this exact same issue back in August 31, 2012. How do I know that precise date…because I found the post related to it. I tried to google this earlier, and unfortunately, couldn’t find it. Turns out though when I changed the exact wording from “multiple tags” to “more than one tag” bam…very first one. That’s not saying much when there is only two search results being displayed.

    Well…long story short apparently you renamed it from wildcard to partial match. Changed that one variable, and it started working again as it should. Apparently when you haven’t used a program in a couple of years you forget stuff…makes playing previously played video games a lot more fun though I can tell you that much. /lol

    Anyway you might want to delete everything I posted in this thread since the problem is fixed now. Also, while reading my four year old post, I was reminded of my Logitech profile…Logitech no longer uses that file extension, and in fact, the file is useless now with modern scripts since the format has changed a little. If you want, I can forward you a copy of the Pixiv script I’m using for Logitech’s macro keyboards. It’s nothing fancy, but I am sure more most people will agree that they do not want to type in the precise keystrokes to do a tag search ten times in a row. Only goes up to 50, though it is easy to edit that one small part, since the majority of the work has been done with.

    I’m not sure how you would, but if you want, you could post it somewhere on your site as a separate download for others to use, or since it is only 4KB in size, maybe include it in future releases…just a thought. The only problem I have though is that you need to buy a Logitech keyboard/mouse/left handed controller, and frankly, I really don’t like the idea of shilling for a company even if indirectly/unintentionally. I originally made it for my own personal use, but I have no problem if other people are using and sharing it…as long as people are helped out, and it is freely distributed, I could care less. 🙂

    1. You can always create a github account and upload it there?

      Personally, I don’t have Logitech keyboard with macros, so it doesn’t have any use for me 😛

  3. No idea what happened with the tags…I guess anything with brackets get edited out for some odd reason. The format, sans brackets, is tag1,tag2. Anyway sorry for double posting, but I love your programs…makes batch downloading for those go-to sites you normally visit possible.

  4. Downloading multiple tags don’t seem to work. I changed the tag separator to %space%, so I could copy/paste the tags from Pixiv directly. Didn’t work, so I changed the separator back to what it was, and redid it as ,, and that doesn’t seem to work either. Here is the log message of what has gone on.

    2017-02-25 23:53:19,786 – PixivUtil20170220 – INFO – ###############################################################
    2017-02-25 23:53:19,786 – PixivUtil20170220 – INFO – Starting…
    2017-02-25 23:53:19,789 – PixivUtil20170220 – INFO – Setting log level to: DEBUG
    2017-02-25 23:53:19,789 – PixivUtil20170220 – INFO – No default cookie jar available, creating…
    2017-02-25 23:53:19,792 – PixivUtil20170220 – INFO – using default DB Path: C:\Users\Ande\Desktop\Pixiv Tags\db.sqlite
    2017-02-25 23:53:19,792 – PixivUtil20170220 – INFO – Only process member where day last updated >= 7
    2017-02-25 23:53:19,792 – PixivUtil20170220 – INFO – Using Username: Ande85
    2017-02-25 23:53:19,792 – PixivUtil20170220 – INFO – Trying to log with saved cookie
    2017-02-25 23:53:22,089 – PixivUtil20170220 – INFO – Login successfull.
    2017-02-25 23:53:22,089 – PixivUtil20170220 – INFO – Logged in using cookie
    2017-02-25 23:53:23,068 – PixivUtil20170220 – INFO – tags mode.
    2017-02-25 23:53:23,289 – PixivUtil20170220 – INFO – Searching for: (ロリ 授乳) %E3%83%AD%E3%83%AA+%E6%8E%88%E4%B9%B3
    2017-02-25 23:53:23,289 – PixivUtil20170220 – INFO – Looping… for http://www.pixiv.net/search.php?s_mode=s_tag_full&word=%E3%83%AD%E3%83%AA+%E6%8E%88%E4%B9%B3&p=1&r18=1&order=date_d
    2017-02-25 23:53:24,148 – PixivUtil20170220 – DEBUG – Sanitized Filename: Dump for SearchTags %E3%83%AD%E3%83%AA+%E6%8E%88%E4%B9%B3.html
    2017-02-25 23:53:24,158 – PixivUtil20170220 – ERROR – Error at process_tags(): (, AttributeError(“‘NoneType’ object has no attribute ‘extract'”,), )
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 797, in process_tags
    File “PixivBrowserFactory.pyc”, line 482, in getSearchTagPage
    File “PixivModel.pyc”, line 868, in parseTags
    AttributeError: ‘NoneType’ object has no attribute ‘extract’
    2017-02-25 23:53:24,161 – PixivUtil20170220 – ERROR – Unknown Error: ‘NoneType’ object has no attribute ‘extract’
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 1867, in main
    File “PixivUtil2.py”, line 1652, in main_loop
    File “PixivUtil2.py”, line 1373, in menu_download_by_tags
    File “PixivUtil2.py”, line 797, in process_tags
    File “PixivBrowserFactory.pyc”, line 482, in getSearchTagPage
    File “PixivModel.pyc”, line 868, in parseTags
    AttributeError: ‘NoneType’ object has no attribute ‘extract’
    2017-02-25 23:53:24,161 – PixivUtil20170220 – INFO – EXIT: -1
    2017-02-25 23:53:24,161 – PixivUtil20170220 – INFO – ###############################################################

  5. Hi.

    I’ve been having some issue with this program, but first, I want to say thank you very much for all the hard work you’ve done. I’ve been using this for close to a year now (I think) and have been a big fan since then. Again, thank you very much.

    Now for the problem: In one of the earlier versions that I had, I had an error involving the extraction of images, to say the least. So because of that, I went ahead and updated to this latest version. Now, the window only stays open for less than a second and then proceeds to close immediately. Opening it in “cmd.exe” keeps the error message up though, which follows:

    Traceback (most recent call last):
    File “PixivUtil2.py”, line 12, in
    File “urllib2.pyc”, line 94, in
    File “httplib.pyc”, line 80, in
    File “mimetools.pyc”, line 6, in
    File “tempfile.pyc”, line 35, in
    File “random.pyc”, line 885, in
    File “random.pyc”, line 97, in __init__
    File “random.pyc”, line 113, in seed
    WindowsError: [Error -2146893795] Provider DLL failed to initialize correctly

    For reference sake, I’m running Windows Vista 32bit (Don’t ask).

    1. Not sure why, the error shown when the app loading the urllib2 library (out of my scope). Looking around, google said it related to your pc environment variable for the SystemRoot is not set

      You can check by typing ‘SET’ on the cmd console and look for ‘SystemRoot=C:\WINDOWS’. I think you can set it by ‘SET SystemRoot=C:\WINDOWS’

      reference: http://bugs.python.org/msg248951

      1. Looking at it, it seems to already be set to that, as far as I can see.

        There was something interesting that I forgot to mention on my last post. One of my friends brought over his laptop running Windows 10, and I tried the program out on his. It ran instantly.

        I’m not quite sure what to make of it, could it just be an update issue?

    2. What of the config file? Has it been altered in some unknown way? Since it is a fresh download I am assuming you didn’t replace the previous config file with an older one. I don’t know if this will help, but if it’s not the config file, I fail to see what other customizations you can make. 🙁

      1. No changes of the config.ini structure.

        Are you asking about the SET command? That one is windows configuration related.

Comments are closed.