You are here

New Ubuntu insall

49 posts / 0 new
Last post
syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years
New Ubuntu insall

Logged in as root

VPS
Operating system = Ubuntu 18.04
All updates installed.
Mono full installed

After downloaded to ~/ Ran install as root .

Added channels from the siteini.pack.update/USA, only added channels from tv.com.channels.xml

TO: root/.wg++#/WebGrab++.config.xml

Ran /.wg++/run.sh

Get this .

WebGrab+Plus/w MDB & REX Postprocess -- version V3.1.0.0

Jan van Straaten
Francis De Paemeleere

thanks to Paul Weterings and all the contributing users
--------------------------------------------------------------------------------

Job started at 15/11/2020 19:08:37
Checking License ..
For License request/update data, see WGLicense.log.txt
The total channel count :20 exceeds the number 20 allowed for license 'default'
The total channel count set to :20
Job finished at 15/11/2020 19:08:38 done in 0s

Unable to select the siteini: tv.com.ini.
Multiple siteini's found, with @Revision 4
(@Revision 4)/root/.wg++/siteini.pack/USA/tv.com.ini
(@Revision 4)/root/.wg++/siteini.pack/siteini.user/tv.com.ini

at WG.Common.Utils.LocateIni (System.String Folder, System.String site) [0x00215] in <896f87e576a8482c8f603908a14ec73f>:0
at  . ..ctor (System.String ) [0x00f28] in <896f87e576a8482c8f603908a14ec73f>:0
Unhandled Exception
For detailed info, see log file /root/.wg++/WebGrab++.log.txt
Execution stopped

Now I have not changed the site.whatever.com to my site, I don't know where to do that.

Please help me, I am so new to linux.

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

you have 2 site ini duplicates, remove/rename one, the one in siteiniuser i would say.
not being a donator you have a limit:
20 exceeds the number 20 allowed for license 'default'

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

ok, so I think I renamed what you are talking about. Please see the picture.

Yes, I am going to donate, I want to make sure I am up and running first.

Thank you for the info and help.

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

try to rename siteini not the folder.

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

ok, I will give it a try.

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

thank you, that work, I will go back to the manual but now I think I need to donate then put my subdomain.mydomain.com in my panel, but first I have more errors about cookies, I kind of vegly remember you have to go to a webpage and grab cookie info. Do you have to do this for each stream? Any shortcuts easy way.

Attachments: 
mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

i would use tvtv.us or another one, they work much better.

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

I am using TV.us now I get a buch of this after execution.

i
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 1 of 4 times for 5 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 2 of 4 times for 10 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 3 of 4 times for 15 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 4 of 4 times for 20 seconds before re-try.
Unable to update channel Game Show Network - East
Generic syntax exception:
message:
no index page data received from Game Show Network - East
unable to update channel, try again later
No guide data to restore
( 1/20 ) TVTV.US -- chan. (xmltv_id=Jewelry Television) -- mode Force
i
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 1 of 4 times for 5 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 2 of 4 times for 10 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 3 of 4 times for 15 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 4 of 4 times for 20 seconds before re-try.
Unable to update channel Jewelry Television
Generic syntax exception:
message:
no index page data received from Jewelry Television
unable to update channel, try again later
No guide data to restore
( 1/20 ) TVTV.US -- chan. (xmltv_id=SHOPHQ) -- mode Force
i
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 1 of 4 times for 5 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 2 of 4 times for 10 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 3 of 4 times for 15 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 4 of 4 times for 20 seconds before re-try.
Unable to update channel SHOPHQ
Generic syntax exception:
message:
no index page data received from SHOPHQ
unable to update channel, try again later
No guide data to restore
( 1/20 ) TVTV.US -- chan. (xmltv_id=QVC2) -- mode Force
i
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 1 of 4 times for 5 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 2 of 4 times for 10 seconds before re-try.
error downloading page: Error: SecureChannelFailure (The authentication or decryption has failed.)
pausing 3 of 4 times for 15 seconds before re-try.

Any ideas? I just purchased my license because at least I think I am on the right path. Now I need to make it work for my IPTV, do you have those instructions or know where to get them? Thank you, you have helped me get this far, thank you.

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

make sure mono is version 5 or greater.
Update license (see documentation)
use this sample https://github.com/SilentButeo2/webgrabplus-siteinipack/blob/master/site...
For tvtv.us also follow instruction (robots file needs to be modified and read only) see attached

Attachments: 
syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

What goes here, it looks like it is used to decrypt a sitecyfrowypolsat.pl.ek ?? There is a key there but from the sample one you linked me.

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

that is a sample of config, of course you need to add correct license data, keys and channels you need. Works fine as timeout and other settings for most of siteini's.

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

Thank you, ok now I am pulling channels down.

I want to use this with my iptv, whats next?

added picture.

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

in the forum there should be sample on how to add guide.xml to iptv

frankabagnale3rd
Offline
frankabagnale3rd's picture
Donator
Joined: 3 years
Last seen: 11 months

You need to install Apache.
https://ubuntu.com/tutorials/install-and-configure-apache#1-overview

Then you need to create a user account.
As Root
adduser USERNAME (your own username you want)
Enter New UNIX Password
Re-Enter New Unix Password
and the rest of the prompts you can leave blank.

usermod -aG sudo USERNAME
Make sure you can login with username
Add folder public_html
mkdir public_html

Set your Webgrab++.config.xml output to /home/USERNAME/public_html/guide.xml
(After fist scan you may need to edit permissions of guide.xml to be readable by others)

Run command:
sudo a2enmod userdir

Then go to your browser and type (Your IP) http:111.222.333/~USERNAME

You should see your guide.xml there now. For your panel use http:111.222.333/~USERNAME/guide.xml

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

I will give it a shot and report, thank you.

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

Unable to modify /home/USERNAME/public_html/guide.xml =

I get permission denied. I think I have to stop WebGrab, how do I do that?

frankabagnale3rd
Offline
frankabagnale3rd's picture
Donator
Joined: 3 years
Last seen: 11 months

ps aux and look for the process. There will be an if number.

Then type sudo kill -9 (process Id)

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

When I go to my panel, plug in http://myip/~username/guide.xml this is what I get below.

"DirecTV Sports 122
http://www.tvtv.us

DirecTV Sports 123
http://www.tvtv.us

"

When I go to my panel, plug in http://myip/~username/guide.xml, I am unable to pull channels etc. should I be using a port number?

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

you should output the guide to /var/www/html/

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

ok, do I need to change permissions?

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

What does the following mean.

!! -- WARNING : tvtv.us doesn't allow epg grabbing !!
it is advised to disable this channel / site from your channel list

i
Unable to update channel MHz Worldview
Generic syntax exception:
message:
no index page data received from MHz Worldview
unable to update channel, try again later
Existing guide data restored!

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

it's a warning do not worry...run a new channel list with update c that channel might have changed.

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

Modified the WebGrab++.config.xml
Changed update to c
Then ran ~/.wg++/run.sh
Modified the WebGrab++.config.xml
Changed back to f

I get ....
nd existing channel (xmltv_id=ViendoMovies) in the config file
Found existing channel (xmltv_id=De Pelicula) in the config file
Found existing channel (xmltv_id=FOROtv) in the config file
Found existing channel (xmltv_id=HITN) in the config file
Found existing channel (xmltv_id=Cine Mexicano) in the config file
Found existing channel (xmltv_id=TUDN) in the config file
Found existing channel (xmltv_id=Fox Deportes) in the config file
Found existing channel (xmltv_id=ESPN Deportes) in the config file
Found existing channel (xmltv_id=Gol TV USA) in the config file
Found existing channel (xmltv_id=TyC Sports) in the c

Then later I get a lot of the following.

Unable to update channel MHz Worldview
Generic syntax exception:
message:
no index page data received from MHz Worldview
unable to update channel, try again later
Existing guide data restored!

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

which site ini is this? tvtv.us ? if so did you set read only the robots file ? (see siteini remarks)

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

Ok, so yes, it is tvtv.us. everyone but the owner has read writes set already. I have attached a winscp picture of what is set.

Attachments: 
mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

is that for tvtv.us.robots file ? did you modified ?

Attachments: 
syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

Yes, this is the file. I may have tried to make it read only. What should the folder be and what should the file be in regards to permissions. I am fairly new user when it comes to Linux but I can get around.

I have attached a new picture of the robots file in /root/.wg++/robots/tvtv.us.robots . The permissions for the file is 0644 .

thank you for the help :)

Attachments: 
Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 8 years
Last seen: 24 min

run webgrab once(i assume u have already did).
then edit the tvtv robot txt file as mat said above.
remove write permission for even the owner...this is allowing it to be overwritten.

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

Ok, ran it once and set all to read only.

Now what am I supposed to do?

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 8 years
Last seen: 24 min

whats in your robot.txt file contain now?
when u run webgrab with write permission it should look something like this..

User-agent: *
Disallow: /tvm/
Disallow: /gn/
User-agent: WebGrab+Plus
Disallow: /

delete all except
User-agent: *

save it and make it read only

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

yes, it did look like this.

User-agent: *
Disallow: /tvm/
Disallow: /gn/
User-agent: WebGrab+Plus
Disallow: /

deleted and now has read only for directory and files in robots
User-agent: *

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

Bump, whats next please?

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

add channels to your config, see what log says

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

It's currently pulling down the channels, new shows added etc...

Thank you :) .... I should not jinx myself but I think I finally was able to do things correct. When you said to add the channels I went through the documentation and did so.

Yes, it is working

Question, I am missing some west channels, can I add more than one list, if so how would I do that?

Thank you :)

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

if you run update channel list, you can get a fresh/new list of channels. This site ini requires 2 run, one t ot get region provider, then with the line produced add to config to get the new channel list. It's all described in siteini, more info also here: http://www.webgrabplus.com/documentation/configuration/sitechannelsxml

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

When I ran it, the config.xml had the f switch for the update section. I am still missing west coast stuff for the most part. Is there a way to fill the gaps or would I have to try another list?

ok, I think it's working now so I edited this post as to not spam to much.

mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

well done !! it is pretty clear in the siteini remarks what to do for channel list creation.

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

ok, so I am still stuck, I need a good list for mainly US but also Mexico/US for now, eventually UK. Currently the channel list I am using is showing the wrong show .

frankabagnale3rd
Offline
frankabagnale3rd's picture
Donator
Joined: 3 years
Last seen: 11 months

I do one of 2 things.
1. I keep 2 WebGrab++.config.xml files and just rename as I need to. I keep my main one but also keep a "scanner" one and rename it when not in use to config.SCANNER.xml and switch back and forth.
2. if you are using tvtv.us just go to their site and you can change the channel numbers and identifier yourself in the tvt.us.channels.xml and config file. So if you have NY for instance 8490D or whatever, just choose an LA service, change the code from the browser address bar and channel number to your files.

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

ok, I have attached a picture. Where do I get the number to change in the xml file. So basically the channels I selected and added to the XML file are showing the wrong shows.

I went to tvtv.us to hopefully find the correct channels and then change them in the xml file to represent the correct channels and data.

Attachments: 
mat8861
Offline
WG++ Team memberDonator
Joined: 8 years
Last seen: 6 hours

see picture

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

Thank you for the pictures, everything is working great.

Thank you to everyone :) .

Edit, added more channels to the webgrab++.config.xml file. Then ran WebGrab+Plus with f .

Now, none of my channels come up in my EPG.

Update, changed i and then pulled the epg and everything came back and the channels I added showed up.

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

How do I automate it in ubuntu.

frankabagnale3rd
Offline
frankabagnale3rd's picture
Donator
Joined: 3 years
Last seen: 11 months

You can create cron jobs but I found that they always quit early. But I’m running 5k channels. Might be ok on a short list.

frankabagnale3rd
Offline
frankabagnale3rd's picture
Donator
Joined: 3 years
Last seen: 11 months

You can create cron jobs but I found that they always quit early. But I’m running 5k channels. Might be ok on a short list.

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

Pretty new to linux, could you give me an example of yours. Then I will look up more details going forward on the net.

Frank, thank you for this :)

frankabagnale3rd
Offline
frankabagnale3rd's picture
Donator
Joined: 3 years
Last seen: 11 months

I think for this being run as root you would need to:
sudo su
enter password
crontab -e
## Add teh following line
0 0 * * * /root/wg++/run.sh
control C , Y to save
Then type:
crontab -l

This cron will have the job run every day at midnight. You can change time, day, month, etc by following this guide
https://phoenixnap.com/kb/set-up-cron-job-linux

syebrexsr
Offline
Donator
Joined: 4 years
Last seen: 2 years

Thank you, I did it and I will give it a couple days, thanks.

ok, so I did setup the timing, but around 5 AM this morning I ran a scan with I setting. The channels pulled fine but when I came back at 3:00 PM the channels guide didn't have anything in it.

So what I did is set it to pull every six hours 1 */6 * * * .

Ok, that didn’t solve my issue. How do you know when a crib job ran successfully, where is the log in Ubuntu 18.04. ?

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 8 years
Last seen: 24 min

you have to add log output to your cond

1 */6 * * * /root/wg++/run.sh >/path/to/where/you/want/log/saved/log.txt > 2>&1

Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl