You are here

DSTV EPG

35 posts / 0 new
Last post
Uthall
Offline
Donator
Joined: 1 year
Last seen: 1 month
DSTV EPG

Hello,

Firstly, i do apologies, this is my 2rd post, and i seem like an absolute newb.

But i guess i am, and i really like some help.

Ive installed webgrab on Ubuntu, and have it running nicely for UK channels.

Im struggling with other countries tho, cant work out USA, and cant work out DSTV.

Ive tried everything ive read here on the forum with no luck, can someone please give me some pointers on both?

Thanks

Uthall
Offline
Donator
Joined: 1 year
Last seen: 1 month

Ok i have followed the instructions for DSTV, attached.

Still wont work?

"Unable to update channel dummy
Generic syntax exception:
message:
no index page data received from dummy
unable to update channel, try again later
Existing guide data restored!"

Please help!

Attachments: 
mat8861
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 16 hours

Were you able to produce country list, then bouquet and finally channels ?
you need to enable and then put back * in the 3 steps for country/bouquet/channel creation, then add one channel (not dummy) to config. Pay attention to rename files so first run country (rename to country.xml the channel_list.xml) use one of the line to produce bouquets (rename to bouquet the channel_list.xml)use one of the bouquets to produce the final channel list

Uthall
Offline
Donator
Joined: 1 year
Last seen: 1 month

Hiya, thanks for that, but i dont see anywhere in the instructions to rename the xml files. Is there an updates dstv siteini that i should be using?

mat8861
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 16 hours
Uthall wrote:

Hiya, thanks for that, but i dont see anywhere in the instructions to rename the xml files. Is there an updates dstv siteini that i should be using?

You right but that is also one of historic and complex that should still work. Require the knowledge of the steps to take and we here for that! All site.ini will be in siteini.pack except those that regular user post in the forum. Btw if doesn't work let me know and time permitting i will check, but i doubt because those done by blackbear199 "the expert" always works unless site changes.

Uthall
Offline
Donator
Joined: 1 year
Last seen: 1 month

Hi, yea ive tried this soo many times over and over. See my second post, i uploaded my ini files and log, im hoping you can have a look and tell me what im doing wrong.

Uthall
Offline
Donator
Joined: 1 year
Last seen: 1 month

So am i the ONLY one to have issues here, or has noone recently tried this site?

I have followed the instructions to the letter, even had a friend try from scratch himself, and neither of us can get it working.

mat8861
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 16 hours

I think so, i tried and every thing works. I just changed a small think in country to have also the name.

Uthall
Offline
Donator
Joined: 1 year
Last seen: 1 month

Matt, thats perfect mate, brilliant!

Is there any chance you could work you magic on the Malaysian Astro files too......i also cant get them working?

mat8861
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 16 hours

Will work if you become member...it's a very small donation. http://www.webgrabplus.com/content/support-us

Uthall
Offline
Donator
Joined: 1 year
Last seen: 1 month

Awesome, just donated!

What next?

neiliid
Offline
Donator
Joined: 3 months
Last seen: 2 months

Hi,

Would you be able to post the Web++.config file extracts and your mdb config?

Thanks a stack in advance,

N

mat8861
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 16 hours

Files are in siteini.pack (mdb folder) In config just set postprocess=mdb run=yes

neiliid
Offline
Donator
Joined: 3 months
Last seen: 2 months

Thanks for getting back so quickly

Did that, running on a Linux box and the system throws an error that ./Mdb cannot be found (the directory is ./mdb lowercase), when I create a link for ./Mdb to ./mdb the system throws the following exception.

Candidates found: 0 movie / 0 serie / 0 both

- - - Mdb Element 'mdb-title' not recognised!

- - - Mdb Element 'mdb-title' not recognised!

- - - Mdb Element 'mdb-plot' not recognised!

- - - Mdb Element 'mdb-description' not recognised!

- - - Mdb Element 'mdb-starrating' not recognised!
Unhandled Exception

This may be because the tool is not parsing the dstv popup and is not retrieving any content from the site (the program titles are followed by an (?))

mat8861
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 16 hours

Just as a basic, guide.xml > postprocess (need different output name in mdb_config.xml )> final guide.
Look into mdb.config.xml and start setting the output file, you can try to add element (productiondate, actors, description,etc. etc) one at time so you can see how it works.

Uthall
Offline
Donator
Joined: 1 year
Last seen: 1 month

Hi Matt,

Can you tell me if the files you attached were for South Africa, as im getting wrong times for most for most of the shows after i run the grab with your files.

EDIT: Actually, now the plain normal grab with your files is failing with the same above error......help!

Ive also not been able to regenerate the files from scratch following the instructions in the dstv.com text file. Keep getting a "error downloading page: Error getting response stream (ReadDoneAsync2): ReceiveFailure"

Any help would be great.

mat8861
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 16 hours

yes if you look at the country files it is for africa.This is one of the old stylish channel grab so it need 3 steps:
1. Enable country block (only) to get country list, using dummy site_id.
2. Disable country and enable providers using one(one only !!) of the country line to get providers list.
3. Disable providers and enable channels using one(one only !!) of the providers line to get channels.
Note: pay attention as wg++ every run produce a dstv.com.channels.xml so you need to rename it before next run, otherwise will be overwritten.
Follow the steps above and you should be good to go. If not post your webgrab log.

Uthall
Offline
Donator
Joined: 1 year
Last seen: 1 month

Yep, ok, got it working now.

BUT as mentioned before, the timezone is all wrong.

Ive set it as Africa/Johannesburg in the ini file, because that the timezone where the data is grabbed.

However the start times in the xml are wrong?

Is this the correct process, to enter the timezone for the source?

mat8861
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 16 hours

As per remarks of site ini You need to set to your local, not africa/johannesburg (unless you live in johannesburg).

neiliid
Offline
Donator
Joined: 3 months
Last seen: 2 months

Thanks for all the help.

Uthall
Offline
Donator
Joined: 1 year
Last seen: 1 month

Local of what Matt, of the machine running webgrab?

mat8861
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 16 hours

yes, in this case timezone of the machine running wg++ (local timezone)

Uthall
Offline
Donator
Joined: 1 year
Last seen: 1 month

Heya Matt,

No worries,but another clarification.

Is it more explicitly the timezone of the machine that was used to grab the cookie file?

I grabbed the cookie file on an gmt+8 machine, and run webgrab on a gmt+0 machine.

The programs are all grabbed with times correct as per gmt+8, noy gmt+0

mat8861
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 16 hours

Time is not set by the cookie. So it's ok.

martinconroy
Offline
Donator
Joined: 3 years
Last seen: 2 days

Hi Matt,
Thanks as always. I had been using the encrypted dstv.co.za.E version. Is that still ok, or does that need an update.
As an aside, how can we produce updated channel lists for these? I'm trying to add SuperSport 13. Using their EPG I deduced the code and added the below line, but got the message that no index page could be found?
SuperSport HD 13

Any advice appreciated, thank you!

Blackbear199
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 3 hours

this works for me(see screenshot).

Attachments: 
martinconroy
Offline
Donator
Joined: 3 years
Last seen: 2 days

Thanks Blackbear. Yes that was the line I tried (and managed to fail to paste correctly!). Still getting no shows in the index page. Re-downloaded the latest siteini to double check and still the same.

Attachments: 
Blackbear199
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 3 hours

looks like something broken,i am using my own un encrypted ini and works fine.
dunno what the encrypted one is doing so u will have to wait for mat8861.

Blackbear199
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 3 hours

all I can say is its fine for me(after creating new channel list to see supersport 13)..

WebGrab+Plus/w MDB & REX Postprocess -- version V3.0.2.0 -- (Pre release, evaluation only!)

Jan van Straaten
Francis De Paemeleere

thanks to Paul Weterings and all the contributing users
--------------------------------------------------------------------------------

Job started at 27/04/2020 06:20:36
Checking License ..
For License request/update data, see WGLicense.log.txt
found: /raid/NAS_WebGrab/siteini.user/South Africa/dstv.com.ini -- Revision 09
processing /raid/NAS_WebGrab/guide.xml ...
Found existing channel (xmltv_id=SuperSport 13) in the config file
...

i=index .=same c=change g=gab r=replace n=new

Group (0) :
update requested for - 1 - out of - 1 - channels for 1 day(s)
( 1/1 ) DSTV.COM -- chan. (xmltv_id=SuperSport 13) -- mode Force
innnnnnnnnnnnnn
0.38 sec/update

Job finished at 27/04/2020 06:20:47 done in 10s

martinconroy
Offline
Donator
Joined: 3 years
Last seen: 2 days

Thanks for confirmit Blackbear, happy to wait for matt as suggested.

mat8861
Offline
WG++ Team memberDonator
Joined: 4 years
Last seen: 16 hours

you can use the general dstv.com with site channel
update="i" site="dstv.com" site_id="5b4c4ef0-ec6f-4e35-b33a-8edbc1e0a276##13W" xmltv_id="SuperSport 13">SuperSport 13
will have a look time permitting.

martinconroy
Offline
Donator
Joined: 3 years
Last seen: 2 days

Brilliant - thanks!

martinconroy
Offline
Donator
Joined: 3 years
Last seen: 2 days

Brilliant - thanks!

conejero
Offline
Donator
Joined: 1 year
Last seen: 1 month

cant seem to get this EPG to work.
I have followed the instructions.

1. Cookies file created, specifies dst-country country=EQ&language=EN saved in ./wg++/dstv.com.cookies.txt
2. Edited ./wg++/siteini.pack/South\ Africa/dstv.com.ini and uncommented the following lines:

** ##### COUNTRY CODE FILE CREATION (only to create the xxx-channel.xml file)
**
** @auto_xml_channel_start
url_index{url|http://guide.dstv.com/CountryLanguage?_=}
index_site_id.scrub {regex||data-country-code=\\"(.*?)\\" analytics-id=\\"eventCountrySelected\\" analytics-text=\\".*?\\"||}
index_site_channel.scrub {regex||data-country-code=\\".*?\\" analytics-id=\\"eventCountrySelected\\" analytics-text=\\"(.*?)\\"||}
index_site_channel.modify{cleanup(style=jsondecode)}
** @auto_xml_channel_end

** _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

3. Edited ./wg++/WebGrab++.config.xml and left only the following line:

dummy

4.Run the script, which should generate dstv.com-channels.

>>OUTPUT
Job started at 30/06/2020 12:59:00
found: /home/hts/.wg++/./siteini.pack/South Africa/dstv.com.ini -- Revision 06

!! SiteIni dstv.com.ini in channelfile creation mode !!!

processing /home/hts/guia.xml ...
Found existing channel (xmltv_id=dummy) in the config file
...

i=index .=same c=change g=gab r=replace n=new

Group (0) :
update requested for - 1 - out of - 1 - channels for 4 day(s)
( 1/1 ) DSTV.COM -- chan. (xmltv_id=dummy) -- mode Incremental
iiii
Unable to update channel dummy
Generic syntax exception:
message:
no index page data received from dummy
unable to update channel, try again later
Existing guide data restored!

Job finished at 30/06/2020 12:59:03 done in 3s

A file named dst.com.channels.xml has been generated inside ./wg++/ with the following content:

<?xml version="1.0" encoding="UTF-8"?>

I believe I am supossed to the use the

in WebGrab++.config.xml, then modify siteini.pack/South\ Africa/dstv.com.ini and a)comment the country channel creation, b)uncomment the Country Bouquet ID File Creation section.

** ##### COUNTRY CODE FILE CREATION (only to create the xxx-channel.xml file)
**
** @auto_xml_channel_start
*url_index{url|http://guide.dstv.com/CountryLanguage?_=}
*index_site_id.scrub {regex||data-country-code=\\"(.*?)\\" analytics-id=\\"eventCountrySelected\\" analytics-text=\\".*?\\"||}
*index_site_channel.scrub {regex||data-country-code=\\".*?\\" analytics-id=\\"eventCountrySelected\\" analytics-text=\\"(.*?)\\"||}
*index_site_channel.modify{cleanup(style=jsondecode)}
** @auto_xml_channel_end

** _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
** ##### COUNTRY BOUQUET ID FILE CREATION (only to create the xxx-channel.xml file)
**
** @auto_xml_channel_start
url_index{url|http://guide.dstv.com/api/bouquet?countryCode=|channel|&productId=&language=EN&_=}
index_site_id.scrub {regex||\{"Id":"(\w+-\w+-\w+-\w+-\w+)"||}
index_site_channel.scrub {multi|"Title":"||",|",}
** @auto_xml_channel_end

and now run the script to generate a new dstv.com.channels file within ./wg++

>> OUTPUT

WebGrab+Plus/w MDB & REX Postprocess -- version V2.1.9

Jan van Straaten
Francis De Paemeleere

thanks to Paul Weterings and all the contributing users
--------------------------------------------------------------------------------

Job started at 30/06/2020 13:04:48
Job finished at 30/06/2020 13:04:49 done in 0s
Config syntax exception:
file: /home/hts/.wg++/./WebGrab++.config.xml
message:
WG.Common.InvalidConfigException: [Error ] Channel must have a name
at WGconsole.c..ctor (System.Xml.XmlElement 0) [0x00039] in :0
at WGconsole.e.3 (System.Xml.XmlElement 0) [0x00004] in :0
at WGconsole.e.0 (System.Xml.XmlNode 0) [0x0024f] in :0
at WGconsole.e..ctor (WGconsole.b 0, System.Xml.XmlNode 1) [0x00208] in :0
at WGconsole.g..ctor (System.String 0) [0x007aa] in :0
For detailed info, see log file /home/hts/.wg++/./WebGrab++.log.txt
Execution stopped

===============================
I have tried to use the "country code" variable and put "EQ", but it doesnt work.

Any help would be greatly appreciated.

Kinetix
Offline
Donator
Joined: 3 months
Last seen: 1 week

Hi there,

Create your WebGrab++.config.xml file with the following -

< channels >
< channel update="i" site="dstv.com" site_id="c35aaecd-5dd1-480b-ae24-357e600a0e4d" xmltv_id="DStv Premium" >DStv Premium< /channel >
< /channels >

In your dstv.com.ini file, comment out the "*" on the following lines -

** ##### CHANNEL FILE CREATION (only to create the xxx-channel.xml file)
**
** @auto_xml_channel_start
url_index{url|http://guide.dstv.com/api/channel/fetchChannelsByGenresInBouquet?bouquetId=|channel|&genre=all&_=}
index_variable_element.modify {set|'config_site_id'}
index_site_id.scrub {multi|"channelTag":"||",|",}
index_site_id.modify {addstart|'index_variable_element'##}
index_site_channel.scrub {multi|"channelName":"||",|",}
index_site_id.modify {cleanup(removeduplicates=equal,100 link="index_site_channel")}
** @auto_xml_channel_end

Now Run WebGrabPlus

After you have excecuted Run, you'll see file created - dstv.com.channels.xml
Now copy ALL the Channel Lines to your WebGrab++.config.xml file -

< channels >
< channel update="i" site="dstv.com" site_id="c35aaecd-5dd1-480b-ae24-357e600a0e4d##E10" xmltv_id="Dish on TV" >Dish on TV< /channel >
< channel update="i" site="dstv.com" site_id="c35aaecd-5dd1-480b-ae24-357e600a0e4d##HDT" xmltv_id="M-Net">M-Net< /channel >
< channel update="i" site="dstv.com" site_id="c35aaecd-5dd1-480b-ae24-357e600a0e4d##VAM" xmltv_id="1Magic" >1Magic< /channel >
< channel update="i" site="dstv.com" site_id="c35aaecd-5dd1-480b-ae24-357e600a0e4d##M1D" xmltv_id="M-Net Movies Premiere">M-Net Movies Premiere< /channel >
< channel update="i" site="dstv.com" site_id="c35aaecd-5dd1-480b-ae24-357e600a0e4d##MCH" xmltv_id="M-Net Movies Smile" >M-Net Movies Smile< /channel >
< channel update="i" site="dstv.com" site_id="c35aaecd-5dd1-480b-ae24-357e600a0e4d##MAP" xmltv_id="M-Net Movies Action+" >M-Net Movies Action+< /channel >

......

< channel update="i" site="dstv.com" site_id="c35aaecd-5dd1-480b-ae24-357e600a0e4d##RTP" xmltv_id="RTP Internacional" >RTP Internacional< /channel >
< channel update="i" site="dstv.com" site_id="c35aaecd-5dd1-480b-ae24-357e600a0e4d##TMI" xmltv_id="TV Moçambique Internacional" >TV Moçambique Internacional< /channel >
< channel update="i" site="dstv.com" site_id="c35aaecd-5dd1-480b-ae24-357e600a0e4d##MN1" xmltv_id="M-Net Plus 1" >M-Net Plus 1< /channel >
< /channels >

Just remember to comment back the "*" in your dstv.com.ini file.

Now Run WebGrabPlus again and the guide.xml will be populated. It will take some time to complete though...

Hope this helps?

Cheers!

Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl