Show times are all zero?

Ok, I figured-out one problem. The supplied xml config file is in DOS format (CRLF) and it has spaces in fields that I had to remove, and that is why I was getting an error when trying to use it. That only leaves the problem where my guide.xml file has all zeroes (midnight) for every show time:

Uggh, I can't for the life of me post any of the xml without the post getting messed-up. I've attached the files, including guide.xml which has all zeroes for the times.

mat8861 wrote:

The ini you are using is pretty old, if time is all zero, means the correct time is not being scrubbed. Can you try canada.com.T5L4E1 ?

Thanks - ok I gave that a try.

It produces an error:

cannot find /home/user/.wg++/canada.com.T5L4E1.cookies.txt !
loadcookie failed! ... cannot update this channel


I searched for that file and cannot find it.

Also, I'm not sure how I would use the T5L4E1 ini file, as it does not contain other stations like CKY, CKND, etc that I found in the L9H1N3 file.

Blackbear199 wrote:

siteini.pack/Canada folder
read the canada.com.howto.txt
this site will not work without a cookie file.

Thanks.
Ah yes, I see there is a set of instructions in a file called "canada.com.no-provider_info.howtocustomize".
Ok, I'm going though the instructions, and when I get to the part about the cookie, I run into a roadblock.
The instructions say:

B6. Save the cookies in the WG++ home folder as canada.com_cookies.txt
(see online documentation .. how to do that)


When I look at the online instructions, it says to install an extension for Chrome or FF, however those extensions no longer exist. How do I extract the cookie information and put it in a format that webgrab will understand?

Blackbear199 wrote:

for chrome and edge i use EditThisCookie extension.
in the settings change it so it exports the cookie in netscape format.
thats the format webgrab needs.
heres a updated ini file.
no idea what changed.
for this ini the cookie filename is canada.com.cookies.txt(no underscore used)
if you edit the ini on the site {xxx} line you will see loadcookie=xxxxx.
xxxxx is the filename,use whatever name you want.just name your cookie file to match.

Thanks for your patience. I hope you won;t regret it :-)
Ok, I've done this a couple of times.

Summary:
-I get some errors when running wg against the cookie (but they *may* not be a problem??)
-After getting past the errors, the channel file only contains one channel, when it should contain 4

When I get the cookie from the browser, it has 5 lines in it.
It is attached as file canada.comR3B1B9_cookies_orig.txt.

When I run wg against this cookie, I get errors that complain about the 2 lines with "data" in them.
For example:

The 'Value'='{"data":{"adLight":false,"adLightDisabled":true,"id":"jdksnrwe77eo03dx57y5mitqbsf0wuni","updated":1704342750598},"exp":604800000,"ts":1704342750598,"mac":-1538500571}' part of the cookie is invalid.

at System.Net.Cookie.VerifySetDefaults(CookieVariant variant, Uri uri, Boolean isLocalDomain, String localDomain, Boolean setDefault, Boolean shouldThrow)
at System.Net.CookieContainer.Add(Cookie cookie)
at System.Net.CookieContainer.Add(CookieCollection cookies)
at  .‬..ctor( , Dictionary`2,  )
at  .‥. (String[])
Unhandled Exception


So I just deleted both of those lines, and ran wg again. It ran through with no error. I attached the resulting cookie file after deleting those 2 lines:
File = canada.comR3B1B9.cookies.txt

Assuming the above is not a concern, then the final problem is that the resulting channel file only has one channel in it (it should have 4). Attached channel file = canada.com.R3B1B9.channels.xml

If I've got it right, it appears the ini file would load this URL:
https://tvmds.tvpassport.com/snippet/white_label/php/grid.php?subid=tvpa...|subpage|&wd=1905

If I put that URL in a browser, it returns a bunch of data, and I can see it includes all 4 channels (CBWT, CKY, CKND, CHMI).
However the resulting channel file only contains the first channel (CBWT).
Interestingly, the channel file has site_id=13 for that CBWT entry, which is incorrect, and happens to correspond to the last item in the returned data (CHMI is 13).

I noticed the returned data has no carriage returns, and everything is essentially on one line. Is the parser that searches for channels, expecting each channel to be on a separate line? The reason a ask, is that the one item that it finds, happens to be the first channel (CBWT), however it assigns site_id=13, which is incorrect, and happens to be the last site_id in the output.
I'm wondering if it thinks there is only one entry because there is only one line, and it grabs the first channel and last site_id.

This is all assuming I didn't make any mistakes (which would be a miracle).

I've also attached these files:
WebGrab++.config.xml
canada.com.R3B1B9.ini
hot_cookies.txt
WebGrab++.log.txt

Blackbear199 wrote:

first,good job.
looks like you did everything correctly.
for a new user..well done.
attatched is a fixed ini for your use.
i fixed the channel creation.
i included a channel list i made in the attatchment also.
i also fixed the files in the post above(no provider ini).
you will need to downgrade your webgrab version to V5.0.1
http://webgrabplus.com/download/sw/v5.0.1
this is due to a bug in V5.1.3 with date/time calculations.
if you try the ini with V5.1.3 you will see what i mean,wg will crash with a error about this.

Thanks - we're so close I can taste it.
I may be doing/seeing something wrong, because my crash experience is the opposite of what you mention.

I inserted the two new files (the channel file and the ini file).
I added the 4 channels to WebGrab++.config.xml.

Just as a sanity check, to see where I stand....I decided to run it without changing any of the dotnet stuff.
It ran completely through with no crash???
Now that I think of it though, the only changes in the new ini file are in the channel grab section, and they are commented out because we already have the channel file. The rest of the ini file is the same as before, and wg did not crash before.
It did, however, produce a guide file, but again with zero times.

I then downloaded the v5.0.1. I see it only contains a bin.net folder. So I got rid of the original bin.net folder and replaced it with the v5.0.1 bin.net folder.

Again, for sanity check, I just ran it.
It ran, with no crash, but did give the error saying that it needs dotnet version 6.

I then installed dotnet version 6.

Now when I run.... it crashes.

The output is:

Failed to create CoreCLR, HRESULT: 0x80070057


I purged the old dotnet7 package, and same crash result.
I went back to look at the download page for v5.0.1 to see if I missed anything (maybe there was special instructions due to the fact that the download only contained a bin.net folder).
It says it needs dotnet6, and the link on the page points to the same instructions for the latest version.

Blackbear199 wrote:

what did you install for dotnet 6?
all you need is the .Net Runtime(see screenshot)
u do not need sdk,net desktop runtime or asp.net core runtime.
webgrab is a console app and that all it needs.

Correct, I just installed runtime, and followed the instructions from this page:
http://webgrabplus.com/documentation/installation/linux

Of course that page says to install dotnet v7, so instead I did:
apt install dotnet-runtime-6.0

I did get rid of the old dotnet v7 with an apt purge, but just to be doubly sure, I rolled-back my VM from before the dotnet v7 install. Then did the dotnet v6 install (to be sure there are no remnants of the old v7).

This is what is currently on the machine:

===================================================================================
user@mint:/$ dpkg -l | grep dotnet
ii dotnet-host 6.0.125-0ubuntu1~22.04.1 amd64 dotNET host command line
ii dotnet-hostfxr-6.0 6.0.125-0ubuntu1~22.04.1 amd64 dotNET host resolver
ii dotnet-runtime-6.0 6.0.125-0ubuntu1~22.04.1 amd64 dotNET runtime

Learn about .NET Runtimes and SDKs:
https://aka.ms/dotnet/runtimes-sdk-info
===================================================================================

I'm looking at some of the articles about this error, but nothing is clicking with me. As mat8861 mentioned, the error usually seems to be due to having conflicting dotnet versions installed. But I'm pretty sure I've eliminated that possibility.

Ok, as the veterinarian said to professor Schrödinger about his cat "I have some good news, and some bad news".

Good news... I found a post where someone said that dotnet does not like to run on programs that have a symbolic link in the path. So I didn't have a symbolic link in the path, but the path was a file share (I was storing/running everything on a share because I was doing so many tries on different machines). Anyway, I moved everything off the share to a local folder, and it now runs dotnet v6 with no error.

The bad news...
Get ready to laugh.. we've come full circle... the guide.xml still has all zero times.

I've attached the guide.xml and output log.

Maybe I'm cursed ;-)

I assume that (fro post #8 above) if I put the url from the ini file into a browser, and I get data back... that must mean that the internets are sending me the correct channel/programs/times information?