You are here

Tvtv.us site.ini doesn't work anymore

58 posts / 0 new
Last post
jb2504
Offline
Joined: 8 months
Last seen: 4 months

Can you post ini and xml files, so i can try with your settings?

jleiss
Offline
Joined: 5 months
Last seen: 1 month

the ini file is the same as what I posted a few messages before. I will add a smaller version of my config here as my current config has 900+ channels, feel free to direct message me and I will help you work it out.

Attachments: 
r00ty
Offline
Joined: 4 months
Last seen: 1 week

Hi all,

I actually made the tvtv.us.ini on the siteini repo originally. I'm hopefully going to update that version, which will work its way into the standard release. But, I wonder if they'll step up their game once they see we've bypassed this minor attempt to stop us (removing stationid from programme list requests and the robots.txt business).

With regard to the robots.txt issue. Is it the case that WG+ should do what it's doing? I had to attach wireshark to see what was actually happening. From what I can see, when the robots.txt had that text in there, WG+ was overriding whatever you had set in the config for user-agent, and was always sending a user-agent of "WebGrab+Plus". With that user agent the tvtv.us site will return 403. Once you remove the robots.txt, WG+ sends requests with the correct user-agent set from the config and thus you get the results you expect.

Seems weird that the robots.txt makes WG+ do this. From what I can see, the standard doesn't suggest this should be the case at all. As it is, this seems clear they don't want us scraping their data though. So I don't think this will be the last counter-measure I expect.

leadersat
Offline
Joined: 1 year
Last seen: 1 week

The tVTV.us site as stopped allowing grabbing again, Was working fine last thursday 13/02/2020, but now just getting the warning, This repeats for all the 95 channels just a few here from logs, any info would be great.

[ Info ] ( 1/95 ) TVTV.US -- chan. (xmltv_id=AMC - Eastern Feed) -- mode Force
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Error ] Unable to update channel AMC - Eastern Feed
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from AMC - Eastern Feed
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
[ Debug ]
[ Info ] ( 1/95 ) TVTV.US -- chan. (xmltv_id=American Heroes Channel) -- mode Force
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Warning ]
[Warning ] !! -- WARNING : tvtv.us doesn't allow epg grabbing !!
[Warning ] it is advised to disable this channel / site from your channel list
[Warning ]
[Error ] Unable to update channel American Heroes Channel
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from American Heroes Channel
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!

r00ty
Offline
Joined: 4 months
Last seen: 1 week
leadersat wrote:

The tVTV.us site as stopped allowing grabbing again, Was working fine last thursday 13/02/2020, but now just getting the warning, This repeats for all the 95 channels just a few here from logs, any info would be great.

Yeah, it happens from time to time that the robots file gets updated. Look at the robots/tvtv.us.robots file. If all the stuff is in there again delete it (not the file, the stuff in the file and save).

On linux I just changed the mode to make it read only and it hasn't happened since. Might be possible for you?
[/quote]

mat8861
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 9 hours

Follow instructions of site.ini (see siteini.pack)

leadersat
Offline
Joined: 1 year
Last seen: 1 week

Thank you rooty, that as sorted it a treat. working perfect again.

Pages

Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl