Pixiv Downloader 20100908

Latest Update here.

Changelog:

  • Add command line option and other bug by Yavos.
  • Fix download by tags. A little note: somehow I can’t use kana for the search query (it gives encoding error), work fine for romaji.
  • Add readme.txt and changelog.txt, please read.
  • Changed rootdirectory option behaviour, you need to fill it or it will goes to C:

Known bugs:

  • Download by tags need additional step if you want to use kana (kanji/hiragana/katakana). Example: if you looking for 秋山澪, you need to copy the query part (after word=) from the url from your browser (http://www.pixiv.net/search.php?s_mode=s_tag&word=%E7%A7%8B%E5%B1%B1%E6%BE%AA ) and paste it to the console. I’ve tried to encode it using urllib.quote/quote_plus but the resulting string is different. Any solution?

Download link is here, and the source code is here.

On side notes: To Yavos and other contributors, should I put the source code to googleproject /other online versioning site? Any experience or comments? And somehow when using WinMerge to merge the codes, they messing up with the encoding… Know better (free) alternative?

20 thoughts on “Pixiv Downloader 20100908”

  1. Hi Nandaka!

    I just need a little help..
    How do I make the program skip downloading the images that i already downloaded before?
    I usually update the members’ gallery but everytime i input a member’s id again, it downloads his whole gallery all over again.

      1. Sry but how do i install Yavos update? i extracted the files under the same folder as the pixivutil, but i didnt notice any change to the config.ini file.
        Anyway thx this program is a lifesaver

  2. Hi nandaka.

    I have a new version of your pixivUtil.
    Download here

    Changes made by myself:
    – added commandline-option: [-n number] to temporarily overwrite config-settings for [numberofpage]
    – added new options in config.ini (for details see readme.txt)
    ([createDownloadLists], [downloadListDirectory], [startIrfanView], [startIrfanSlide], [IrfanViewPath])
    – added commandline-option [-i] to automatically start IrfanView with list of downloaded Images
    (this option only takes effect when [startIrfanView] and [startIrfanSlide] from config.ini are not set True)
    – images will get the extension [.pixiv] until they are complete (prevent incomplete image-downloads)
    – fix: all downloaded images will be added in DB (until now it was limited to images downloaded by member_id/list of member_ids)
    (note: you can reset it again by setting [Yavos = False] in sourcecode line 27)
    – added feature: when (directly or indirectly) set in config.ini pixivUtil will create lists of your downloaded images in [Downloaded_on_YYYY_MM_DD.txt] (using date when pixivUtil is launched)
    – added feature: start IrfanView when exiting pixivUtil (Slideshow will be started before normal IrfanView-Window)
    – added feature: typing [-all] in menu will temporarily activate/deactivate pagelimit set in config.ini (it will set commandline-option [-n 0])

    PS:
    I think the compare-script in notepad++ works fine to see all changes.

  3. Hey nandaka,
    If I change the daylastupdated value in the config file to anything but 7 I get all kinds of weird errors. Anywhere from it not being able to read the config, or it resetting what my root directory is.

    I had the same problem with the username and password values in the config too.

  4. Hello, Nandaka.

    Pixiv Downloader doesn’t work in Ubuntu Linux 10.04. (I use Pixiv Downloader’s python source code. And I installed two python modules – mechanize, BeautifulSoup)

    Error Message :

    Error at processMember(): (, AttributeError(“‘NoneType’ object has no attribute ‘findAll'”,), )
    failed
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 745, in main
    processMember(mode, member_id)
    File “PixivUtil2.py”, line 343, in processMember
    linkList = parseList.find(‘div’, PixivConstant.PIXIV_CSS_LIST_ID).findAll(‘a’)
    AttributeError: ‘NoneType’ object has no attribute ‘findAll’
    press enter to exit.
    Traceback (most recent call last):
    File “PixivUtil2.py”, line 788, in
    main()
    File “PixivUtil2.py”, line 780, in main
    __log__.error(‘traceback:n’+traceback.print_last())
    File “/usr/lib/python2.6/traceback.py”, line 246, in print_last
    print_exception(sys.last_type, sys.last_value, sys.last_traceback,
    AttributeError: ‘module’ object has no attribute ‘last_type’

    Can you fix it?

    1. I don’t have linux installed, but from the error message it says that it cannot find the html tag div with specified id. Can you give me the member id and try with other member id for testing?

  5. Hey nandaka,

    I’m not sure if this is a bug, but when I try to use the Pixiv Downloader from scratch (as in I didn’t copy the new files over my old ones), the program doesn’t read my list.txt.

    Here is my process:

    – Extract “Pixiv Downloader 20100908”, into it’s own folder
    – Create a list.txt (put in some pixiv ID’s)
    – Start Pixiv Downloader
    – Press 4, enter.

    Then the program says,
    “Processing list from database.
    done.
    PixivDownloader2 version 20100908
    http://bit.ly/pixivDownloader
    1. Download by member_id
    2. Download by image_id
    3. …
    4. …”

    Basically it just says done, then shows the menu again. Now when I go into my config.ini and change the “processfromdb” to false, then it starts reading my list.txt.

    Does Pixiv2 read ID’s solely on the database file? I’m asking this because I’m always adding new Pixiv ID’s to the list.txt file, and I’m wondering if those new ID’s are being downloaded.

    1. Set uselist to True in config.ini.

      If processfromdb also set into True, the list will be imported first then using database for downloading.

  6. Hi Nandaka
    It’s really awkward but I don’t how to paste anything to the console.orz
    When I press ‘Ctrl+v’ it only displays ‘^V’ instead of what I pasted before.

    1. Windows console doesn’t accept ctrl+v for paste, just right click and select paste or if you enable Quick Edit mode on your console, just right click.

      1. Right click doesn’t works for me on console.
        Maybe my system is old and still I can type everything directly.Thanks anyway 🙂

        1. On the console window, press alt+space to open the menu and select Properties. On the Options tab, at Edit Options enable QuickEdit mode. It will enable you to use right click to paste.

  7. I actually never contributed to someone elses sourcecode, so I can’t help you with it.
    All I could do was commenting my work so you can recognize it and include it within your source. I don’t know any better way. xD

Comments are closed.