pixiv downloader 20130927

15 thoughts on “pixiv downloader 20130927”

1. Pixiv has probably changed something about their pages or they’re bugging out, but the downloader is fetching every page with the title of “pixiv Premium is the best way to enjoy what pixiv has to offer!”

   The title shows up in the prompt with every fetched image and if you have the filenames to save the title as well, in every saved picture. This happens to me on OS X, with a build that has previously worked just fine and on my Linux server.

   1. Try to get the latest source code in GitHub. Tried in my pc, I can parse the title correctly.

      1. I ran ‘git pull’ on both machines and they’re both up-to-date. Yet, they both parse the title exactly the same way.

         Here’s the output, if you’re interested: http://i.imgur.com/VzRNCTQ.png

         1. Weird, mine is parsed correctly. I’ve tried to use the same member_id (1006311) with you.
            http://i.imgur.com/oxVyv8u.png
            http://i.imgur.com/bj4INNu.png

            Can you upload the actual page being downloaded from your linux shell? What is your version of python and BeautifulSoup library? Mine is python 2.72 and BeautifulSoup 3.2

            1. On OS X: Python 2.7.2 (provided by Apple), BeautifulSoup 3.2.0. It worked fine earlier today, but when I tried it a few hours later, it stopped parsing correctly.
               On Linux: Python 2.7.5 (provided by ActivePython), BeautifulSoup 3.2.1.

               Is there a way to make the downloader dump the html pages?

            2. 2 way:
               – The easiest one is by using Fiddler(http://fiddler2.com/get-fiddler) to act as a http proxy.
               or
               – Modify the script to dump the html:
               1. PixivHelper.dumpHtml(filename, page) https://github.com/Nandaka/PixivUtil2/blob/master/PixivHelper.py#L325
               2. Insert the dumpHtml() after parsing the image. PixivHelper.dumpHtml(dump_filename, medium_page.get_data())
               https://github.com/Nandaka/PixivUtil2/blob/master/PixivUtil2.py#L610

            3. The modified script only spits out 0B Error pages. Fiddler is probably not the easiest, since I’d have to somehow get Fiddler accepting connections from the other side of the country.

            4. Do I have to just wait until the next update? I can’t do any of this stuff.

   2. Seems related to using English. I had the same issue.

      Here is how I fixed it:
      Log in to pixiv and set your account language to Japanese. Close pixiv downloader and clear out the cookie from the config.ini then try again.

2. A question that I do not want to experimentally test.
   Does hash (#) comments tags out in tags.txt?

   1. Should be.

3. The link is dead. 😛

   1. Fixed the url 😛

4. Download link is broken

   1. Fixed the url 😛

Comments are closed.