I think the tvtv.us site has changed again slightly. I wrote myself a little pre scraper to grab all the line up ID's using the below regex:
a_tags = divs.find_all("a", {"class": "MuiButtonBase-root MuiListItem-root MuiListItem-gutters MuiListItem-divider MuiListItem-button"})
...this no longer works and lineups that previously worked when in channel update mode no longer do. If the .ini is using the same regex that might be why.
Could someone please take a look? I've attached the WG+ log.
Attachments:
Please update wg++, then in the log seems is missing something
which area are you trying to get ?
yes I have problem too from tvtv.us
[ Info ] ( 1/244 ) TVTV.US -- chan. (xmltv_id=ESPN) -- mode Incremental
[Error ] Unable to update channel ESPN
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from ESPN
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
[ Debug ]
[ Info ] ( 1/244 ) TVTV.US -- chan. (xmltv_id=ESPNEWS) -- mode Incremental
[Error ] Unable to update channel ESPNEWS
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from ESPNEWS
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
[ Debug ]
the site is changed with different TAB for Cable satellite INTERNET
new version in git
?
new siteini? where is it
the channel on the config file are all changed?
theres' also the tvtv.ca file ini ?
I think is it:
https://github.com/SilentButeo2/webgrabplus-siteinipack/blob/master/site...
seem work with same config file but very slow
For anyone confused by Mats response - if you follow the Github link, it takes you to the updated .ini file for tvtv.us ...you can just copy paste the text from there into your local .ini file. Last modified date at the time of me posting this comment is 15 hours ago. I have run again with the updated .ini and channel grab now works again (although I haven't tried grabbing any EPG data yet...
...for tvtv.ca, the last modified date of the .ini file in the Github repo was two months ago. If the same site change has occurred for tvtv.ca as has for tvtv.us, then the tvtv.ca .ini still needs updating...
Right i will update tvtv.ca asap
Couple things i noticed, tvtv.us and tvtv.ca use same server so they can handle same request, i mean if you grab a us channel using canada siteini it will work.
Why is slow ?
1. they split a basic data and details so to have enough information, we need to grab both. That take time as 2 request are sent to grab data.
2. They use cdn (Contenent Data Network) to speed up the process the CDN server keeps the info for xx time, to make it faster if the request of data was already registred. Infact if you grab a channel first run will be 50 seconds and if you run it right after you get a very short time 0.2 seconds because the data is stored for short time on the server.
That said hope you enjoy, of course this are provider settings and there is nothing we can do about, other then explain why is "slow".
Tvtv.ca updated
thanx... tvtv.ca seem have some trouble
[ Info ] ( 1/93 ) TVTV.CA -- chan. (xmltv_id=Leafs Nation Network) -- mode Incremental
[Error ] error downloading page: Operazione o metodo non implementato. (80sec)
[Error ] retry 1 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (160sec)
[Error ] retry 2 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (240sec)
[Error ] retry 3 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (320sec)
[Error ] retry 4 of 4 times
[Error ] Unable to update channel Leafs Nation Network
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from Leafs Nation Network
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
[ Debug ]
[ Info ] ( 1/93 ) TVTV.CA -- chan. (xmltv_id=CBC Toronto) -- mode Incremental
[Error ] error downloading page: Operazione o metodo non implementato. (80sec)
[Error ] retry 1 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (160sec)
[Error ] retry 2 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (240sec)
[Error ] retry 3 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (320sec)
[Error ] retry 4 of 4 times
[Error ] Unable to update channel CBC Toronto
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from CBC Toronto
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
thanks for the explanation... so how long does the server keep the request stored as you ? how often should the request be run
Ive tested the above re using Canadian line ups using the tvtv.us .ini btw and it works. I'd rather keep my processes separate though and I'm having issues again with the .robots file. I had the same issue with tvtv.us and in the end another user had to post their .robots file for it to work for me. This seems like a trivial thing, yet I'm clearly doing something wrong. Can someone please link me a working .robots file for tvtv.ca and also tell me what the correct process is for creating a working one myself? Setting files to read only and modifying the text of the file has not worked. Nor has copying and renaming the tvtv.us .robots file...
.robots file
User-agent: *
User-agent: WebGrab+Plus
how works for you tvtv.ca.ini?
i use the last tvtv.ca in github update 3h ago... but i have problem
i try to use the tvtvt.us ini file i change name of the file to tvtv.ca and the row inside url=tvtv.ca|timezone=UTC|maxdays=7|cultureinfo=en-US|charset=UTF-8|episodesystem=onscreen|ratingsystem=US
still dont work
can you post your channel list, ?
in attach... works until two days ago
for the US channel i change only the ini file
EDITED NO LICENSE DATA !!!
the problem isnt knowing what text to copy paste into the file, it seems to be the file itself. do you have to do a write binary file create or similar? I seem to remember there was an issue with WG+ files that was along these lines.
i create on windows the file tvtv.ca.ini and paste the text from the raw file take from git.
same procedure with the tvtv.us
the underscore is not presente on the file
pics of the file ini
You cannot rename it it breaks encryption.
What i meant you can put in config channel lines from canada, but you need to rename the site="tvtv.ca" to site="tvtv.us"
Anyway tvtv.ca is uploaded, tested with some channels and works fine
its very strange because for the us file i dont make this...
so i download the file and unzip... i regenerate the robot file with line:
User-agent: *
User-agent: WebGrab+Plus withe only read
same error:
[Error ] error downloading page: Operazione o metodo non implementato. (80sec)
[Error ] retry 1 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (160sec)
[Error ] retry 2 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (240sec)
[Error ] retry 3 of 4 times
[Error ] error downloading page: Operazione o metodo non implementato. (320sec)
[Error ] retry 4 of 4 times
[Error ] Unable to update channel Leafs Nation Network
[Critical] Generic syntax exception:
[Critical] message:
[Error ] no index page data received from Leafs Nation Network
[Error ] unable to update channel, try again later
[ Info ] Existing guide data restored!
you have an old version of wg i think this happens with 3.2.x.x so update to version 4 or 5
i resolve with tvtv.us.ini file and change the site in the webgrab++ config, put the us robot file and works.
very strange.
thx for support
you intend 3.2.5 ?
Yes you should use one of these:
https://github.com/SilentButeo2/webgrabplus-siteinipack/tree/master/eval...
i suggest the new 5.0.0.1 or the latest 4.2.4.6
thx i try.
something change for Rex postprocess?
I have this but the epg now dont show the subtitle
'title'{ - 'subtitle'}
after the new tvtv.us.ini file seem that in the xml subtitle tag disappeared so the rex postprocess (title - subtitle) fail.
these are the tag grabbed:
title
desc lang="en"
date
category lang="en">News
category lang="en">Sports talk
icon src=
its possible fix this?
They have reduced all elements and made guide very simple, anyway if you post couple channel line i can check
yes but the subtitle there should be on the epg
in attach the grab of 2 channel
actualy epg show only NFL FOOTBALL
before with rex was NFL FOOTBALL - Houston texas Chicago bears
i use rex title - subtitle
thx as usualy
i dont understand seem theres subtitle(1) and sub of the subtitle(2)
will try to separate
thx for your kindness
So I did a lot of things today to get tvtv back to functional, including ordering a new server with fresh installs, etc. The one thing I did recently to finally stop the robot files form being changed was change the name of the original folder, add a new robots folder, then create new robot files and chmod them. On ubuntu:
--------------------
cd ~/.wg++
mv robots robots.OLD
mkdir robots
cd robots
nano tvtv.us.robots
*ADD THESE 2 lines to the file ONLY
User-agent: *
User-agent: WebGrab+Plus
*Save and exit
nano tvtv.ca.robots
*ADD THESE 2 lines to the file ONLY
User-agent: *
User-agent: WebGrab+Plus
*Save and exit
cd ..
chmod -R 444 robots
--------------------
Since I did that I didn't have any edits. Today I realized my tvtv wasn't running and I saw a post here on a totally different ini that fixed my issue.
I did this:
nano ~/.wg++/siteini.pack/USA/tvtv.us.ini
After all the change log and scanning instructions the first line looks like this:
**------------------------------------------------------------------------------------------------
site {url=tvtv.us|timezone=UTC|maxdays=7|cultureinfo=en-US|charset=UTF-8|episodesystem=onscreen|ratingsystem=US}
At the very beginning add compression=gzip|
It should now look like this:
**------------------------------------------------------------------------------------------------
site {compression=gzip|url=tvtv.us|timezone=UTC|maxdays=7|cultureinfo=en-US|charset=UTF-8|episodesystem=onscreen|ratingsystem=US}
My tvtv.us is scanning now as we speak. Hope this helps.
I am getting the same thing?
Did you read the solution right above your post?
You do not need compression=gzip is integrated, use update siteini.pack (yesterday i changed a bit tvtv.us but didn't change revision, so make sure looks the same as the one on git. Tvtv.ca was already fine.
After messing with it for hours I really just deployed a new server with a fresh install and fresh siteini.pack. The latest revision dates are somehow tomorrow on them and they still weren't working. Adding that text to the ini 100% is the thing that got it working for me. Maybe I just missed the revisions or something.
After messing with it for hours I really just deployed a new server with a fresh install and fresh siteini.pack. The latest revision dates are somehow tomorrow on them and they still weren't working. Adding that text to the ini 100% is the thing that got it working for me. Maybe I just missed the revisions or something.
My channels are being skipped. It gives this error:
( 1/209 ) TVTV.US -- chan. (xmltv_id=WKAQDT (WKAQ-DT)) -- skipped --> encrypted SiteIni
the previous ini file which was also encrypted didn't trigger this. Any thoughts?
I would assume you need to update your software. Not sure what distro you’re using but download the update from here http://webgrabplus.com/sites/default/files/download/SW/V3.2.0/WebGrabPlu... that’s the latest stable release, but you can click other versions from the download page for beta and eval builds). Then In your current instance, rename the bin folder. I keep all mine and rename like bin.SEP21. Then add the bin folder from the new download zip to your instance. If on Linux you can wget the download and unzip to your current instance and it will ask you which files / folders you want to overwrite.
I don't want to rush you but there is some news about missing tag of ini file?
Bad copy see FAQ please
can you post a sample of you need, I checked and seems fine.
An example
actualy epg show only NFL FOOTBALL
before with rex was NFL FOOTBALL - Houston texas Chicago bears
i use rex: 'title'{ - 'subtitle'}
Seem the subtitle tag Is Missing
Above i post the file .xml for Two channel, and a pics of a epg on the TV site
In attach a pics to show the request.
Tel me if you need other things
Updating to the latest beta version just do it. If you are a linux user like me, it has to be the latest(5.xx.xx) because dotnet5 is no longer available for download. You have to install dotnet6 and the latest beta is the only one supporting it.
Yes Matt,that also was a problem. Thank both of you, Frank & Matt.
I do still have some problem with this, I have version version V3.2.2.0 of Webgrabplus(Linux version), I also updated to the latest tvtv.us.ini, so I have"@Revision 8 - [21/09/2022] Mat8861*rewrite".
So the error I get is this:
( x/xx ) TVTV.US -- chan. (xmltv_id=CMT) -- mode Incremental
iiiiiii
Unable to update channel CMT
Generic syntax exception:
message:
no index page data received from CMT
unable to update channel, try again later
Existing guide data restored!
I would be happy to get a little help, thanks!!
I get this error any ideas? I also updated to the latest tvtv.us.ini, so I have"@Revision 8 - [21/09/2022] Mat8861*rewrite".
error downloading page: The requested address is not valid in its context. (tvtv.us:443)
Pages