pixiv downloader 20150121

Change log for 20150121:

Implement #66: Add option to download from oldest image first for Download by Tags/Tags list.

Download link for pixiv downloader 20150121, source code in GitHub.

Please Donate so I can buy T2 Art Girls “Seiya no Okurimono” Noel Chat Noir 1/6 Complete Figure

24 thoughts on “pixiv downloader 20150121”

annonymous says:

February 18, 2015 at 22:34

please update the pixivutil.
since cookie method doesn’t work for me
it works when trying to log in but not working when trying to download
thanks
xuantungaltxuantungalt says:

February 18, 2015 at 11:50

Log in using form.
Error at pixiv_login():(, ControlN
otFoundError(“no control matching name ‘pixiv_id'”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1718, in main
File “PixivBrowserFactory.pyc”, line 178, in loginHttp
File “mechanize_form.pyc”, line 2780, in __setitem__
File “mechanize_form.pyc”, line 3101, in find_control
File “mechanize_form.pyc”, line 3185, in _find_control
ControlNotFoundError: no control matching name ‘pixiv_id’
press enter to exit.

I guess pixiv changed their login form again?
soji says:

February 17, 2015 at 12:15

Seems pixiv updated something…can’t login now,passwd is right. please fix,thanks!
=============
Log in using form.
Error at pixiv_login():(, ControlN
otFoundError(“no control matching name ‘pixiv_id'”,), )
Traceback (most recent call last):
File “PixivUtil2.py”, line 1718, in main
File “PixivBrowserFactory.pyc”, line 178, in loginHttp
File “mechanize_form.pyc”, line 2780, in __setitem__
File “mechanize_form.pyc”, line 3101, in find_control
File “mechanize_form.pyc”, line 3185, in _find_control
ControlNotFoundError: no control matching name ‘pixiv_id’
press enter to exit.
==============

log file

======
2015-02-17 12:13:24,424 – PixivUtil20150121 – INFO – ###############################################################
2015-02-17 12:13:24,424 – PixivUtil20150121 – INFO – Starting…
2015-02-17 12:13:24,427 – PixivUtil20150121 – ERROR – Error at loadConfig()
Traceback (most recent call last):
File “PixivConfig.pyc”, line 90, in loadConfig
File “PixivHelper.pyc”, line 269, in OpenTextFile
File “codecs.pyc”, line 881, in open
IOError: [Errno 2] No such file or directory: u’D:\softup\pixivutil20150121\config.ini’
2015-02-17 12:13:24,430 – PixivUtil20150121 – INFO – Setting log level to: DEBUG
2015-02-17 12:13:24,430 – PixivUtil20150121 – INFO – No default cookie jar available, creating…
2015-02-17 12:13:24,440 – PixivUtil20150121 – INFO – Only process member where day last updated >= 7
2015-02-17 12:13:33,026 – PixivUtil20150121 – INFO – Log in using form.
2015-02-17 12:13:34,118 – PixivUtil20150121 – ERROR – Error at pixiv_login():(, ControlNotFoundError(“no control matching name ‘pixiv_id'”,), )
2015-02-17 12:13:34,119 – PixivUtil20150121 – ERROR – Error at pixiv_login(): (, ControlNotFoundError(“no control matching name ‘pixiv_id'”,), )
Traceback (most recent call last):
File “PixivBrowserFactory.pyc”, line 178, in loginHttp
File “mechanize_form.pyc”, line 2780, in __setitem__
File “mechanize_form.pyc”, line 3101, in find_control
File “mechanize_form.pyc”, line 3185, in _find_control
ControlNotFoundError: no control matching name ‘pixiv_id’
2015-02-17 12:13:34,121 – PixivUtil20150121 – ERROR – Unknown Error: no control matching name ‘pixiv_id’
Traceback (most recent call last):
File “PixivUtil2.py”, line 1718, in main
File “PixivBrowserFactory.pyc”, line 178, in loginHttp
File “mechanize_form.pyc”, line 2780, in __setitem__
File “mechanize_form.pyc”, line 3101, in find_control
File “mechanize_form.pyc”, line 3185, in _find_control
ControlNotFoundError: no control matching name ‘pixiv_id’

======
1. nhorus says:
  
  February 17, 2015 at 12:22
  
  Same thing.
2. jrdp_18 says:
  
  February 17, 2015 at 14:10
  
  Having this problem too.
  1. nandaka says:
    
    February 18, 2015 at 01:14
    
    Please add it to github issue tracker https://github.com/Nandaka/PixivUtil2/issues?state=open
    
    For time being, you can use cookie method:
    1. Open Firefox.
    2. Login to your pixiv, remember to enable [Remember Me] check box.
    3. Right click the page and select View Page Info.
    4. Click the Security tab.
    5. Click the View Cookies button.
    6. Look for Cookie named = PHPSESSID.
    7. Copy the content value.
    8. Open config.ini, go to [Authentication] section, paste the value to
    cookie, set ‘keepsignedin = 1’.
    1. soji says:
      
      February 18, 2015 at 09:49
      
      It’s working,Thanks!
      Added to github,name=login issue
Andre says:

February 9, 2015 at 19:00

When i use proxy i got next error:

Input: 2
Image ids: 41497781
Processing Image Id: 41497781
Title: ?????????????
Tags : ??????????????? ?????? ?????? ???? ????????? ??????????????? ????????? ??
???????
Date : 2014-02-09 15:14:00
Mode : manga
Fetching big image page: http://www.pixiv.net/member_illust.php?mode=manga_big&i
llust_id=41497781&page=0
Found: http://i4.pixiv.net/img06/img/mameshiba/41497781_big_p0.jpg
Fetching big image page: http://www.pixiv.net/member_illust.php?mode=manga_big&i
llust_id=41497781&page=1
Found: http://i4.pixiv.net/img06/img/mameshiba/41497781_big_p1.jpg
Page Count : 2
Image URL : http://i4.pixiv.net/img06/img/mameshiba/41497781_big_p0.jpg
Filename : C:UsersАндрейDesktoppixiv_download141497781_p1.jpg
Using Referer: http://www.pixiv.net/member_illust.php?mode=medium&illust_id=4149
7781
Start downloading… [download_image()] HTTP Error 502: Bad Gateway (http://i4.p
ixiv.net/img06/img/mameshiba/41497781_big_p0.jpg)
Image url not found/failed to download: 41497781

Image URL : http://i4.pixiv.net/img06/img/mameshiba/41497781_big_p1.jpg
Filename : C:UsersАндрейDesktoppixiv_download141497781_p2.jpg
Using Referer: http://www.pixiv.net/member_illust.php?mode=medium&illust_id=4149
7781
Start downloading… [download_image()] HTTP Error 502: Bad Gateway (http://i4.p
ixiv.net/img06/img/mameshiba/41497781_big_p1.jpg)
Image url not found/failed to download: 41497781

And without proxy i cannot log in, although an hour ago i logged without troubles and all was works.
1. nandaka says:
  
  February 13, 2015 at 00:15
  
  can you log in from browser? Try to copy the cookie from it?
  1. Open Firefox. 2. Login to your pixiv, remember to enable [Remember Me] check box. 3. Right click the page and select View Page Info. 4. Click the Security tab. 5. Click the View Cookies button. 6. Look for Cookie named = PHPSESSID. 7. Copy the content value. 8. Open config.ini, go to [Authentication] section, paste the value to cookie, set 'keepsignedin = 1'.
  1. Andre says:
    
    February 13, 2015 at 04:36
    
    Yes, i can. I did as you told, but nothing changed. Problem is that my provider blocks pixiv, so i use proxy in browser and have no problem, but when i use that proxy in downloader i got 502 error, regardless that i logged.
    1. nandaka says:
      
      February 13, 2015 at 22:23
      
      set the proxy in config.ini, see the readme.txt for more details.
      1. Andre says:
        
        February 13, 2015 at 23:40
        
        Ah. I told you in my first post, that i got 502 error when i set proxy.
      2. nandaka says:
        
        February 13, 2015 at 23:43
        
        Even after copying the cookie? Try to use another proxy?
qll says:

February 5, 2015 at 23:54

When I download by tags, for example say 艦これ at 2000 bookmark count (to limit the number of images downloaded), it always stops searching at page 1000. It just says done even though not all the images above 2000 bookmarks have been downloaded. Is there any way to overcome this problem?
1. nandaka says:
  
  February 7, 2015 at 20:46
  
  I can only see 1000 page? Is this pixiv premium feature? See http://www.pixiv.net/search.php?word=%E8%89%A6%E3%81%93%E3%82%8C&s_mode=s_tag_full&order=date_d&p=1000
  1. qll says:
    
    February 8, 2015 at 12:54
    
    I see. So it appears that it’s just a site wide page limit I guess. That’s rather unfortunate. I don’t think pixiv premium will do anything to fix the problem either as nothing is listed on the pixiv premium features page. Thanks for the help anyway.
2. EroOu says:
  
  February 17, 2015 at 16:59
  
  Now, I’m not sure if this actually works for pixiv, but certain boorus also have a pagelimit when searching for images. (After the first 11000 images or so, gelbooru informs me I can’t go that far.)
  
  A way around this, for boorus anyways, is to make the search more specific.
  You can search for
  tag1 tag2, then
  tag1 -tag2,
  
  as per normal set theory rules, that’s the same as looking for tag1, but you can get slightly deeper into the stash.
  
  Then just keep adding tags to make it even more specific until you reach the goal.
Seeker320 says:

January 26, 2015 at 17:08

It would be great if we could also download by user list from oldest to newest, be it a new one or one that already exists in the database. Now THAT would be great 😛
1. nandaka says:
  
  January 27, 2015 at 13:33
  
  You means download by the member id? The pixiv website doesn’t provide the sorting for this one, right?
  1. Seeker320 says:
    
    January 28, 2015 at 13:22
    
    Not that I know of; but the program could first check how many pages there are, and then start looping from the oldest to the newest. Or something like that 🙂
jrdp_18 says:

January 25, 2015 at 18:17

Thanks for answering my previous query.
Would it be possible to have the app change the folder name if the nickname changed? Or if I changed the filenaming from %artist% to %member_token%.
1. nandaka says:
  
  January 26, 2015 at 09:21
  
  nope, the application doesn’t keep track if the artist name is changed.
Naki says:

January 25, 2015 at 18:06

Is there a way to download pics into just one folder instead of it being separated by artists?
1. nandaka says:
  
  January 26, 2015 at 09:23
  
  Modify the filenameformat and filenamemangaformat. Remove the path separator if you want to save to single folder.
  
  See readme.txt for more details on filenameformat.

Comments are closed.