You are here

[UPDATE] sincroguia.tv has more channels

44 posts / 0 new
Last post
nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day
[UPDATE] sincroguia.tv has more channels

Hi,

Actually sincroguia.tv has added a big number of channels to be scrapped. Could you please update it?

Thanks.

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days
nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day

Hi Blackbear,

Sorry for the late response.
I´ve uncommented the lines like in the procedure but it doesn´t generate a new *.channel.xml file. This is the section that I have in the file:

**      #####  CHANNEL FILE CREATION (only to create the xxx-channel.xml file)
**
** @auto_xml_channel_start
*url_index.headers {postdata=function=getChannelGroups&type=XML&platformLogin=inouttv&platformPwd=1n0ut&urlxslt=&level=3&idd=CA2936F9-755A-50A0-9B0A-87DE88B5FBE7&ver=1.2}
*index_site_channel.scrub {multi|<channels>|<name>|</name>|</channels>}
*index_site_id.scrub {multi|<channels>|<idChannel>|</idChannel>|</channels>}
** @auto_xml_channel_end
*
******************************************************

 I´ve removed the first asterisk on each line and also I leaved the WebGrab.config.xml with a dummy channel. But without success.

Could you help me please?

Regards

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

this ini hasnt been updated since 2013.

i had a quick loook at the site and its totally changed nad to be honest not worth rewriting.

many channel have no epg listings.

there are no channel id's to get a single channel listings,this means the channels.xml will have to be created manually.

there's plenty other spain ini's that have these channels.

 

nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day

Hi Blackbear,
I´ve taked some time to do the handmade update by my self. I´ve found the info of the channels in this page:
view-source:http://sincroguia.tv/check-in-tv

<div class="channel-item glow">
		 		<a href="http://www.webgrabplus.com/programas/programas/1Jwk_SPA/videoclips-sol-musica?e=30096381" class="trackeable" data-track-category="Check-In TV" data-track-action="Check-In TV - ‘Sol Música’ ##171##" data-track-label="7.2.1">
		 			<img src="http://cdn.sincroguia.tv/uploads/channels/logo-transparent-sol-musica-171.jpg" alt="Sol Música" title="Sol Música" class="img-responsive"/>
		 		</a>

These are all the channels available up today. The rest have been deleted.

Could you please upload it in the EPG Channels section to share it with other users?

Thanks a lot!
Regards.

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

guess i should have tested the ini,i only looked at the site and then the ini and the http links were all different and assumed the site would need a rewrite.

guess it doesnt,alot of times the old links will still work such as in this case.

i fixed the channels.xml creation.i noticed some channel in your list that mine doesnt have.no idea why this happened as it look like it gets the channel groups.one would think it would contain all the channels.

 

nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day
Blackbear199 wrote:

guess i should have tested the ini,i only looked at the site and then the ini and the http links were all different and assumed the site would need a rewrite.

guess it doesnt,alot of times the old links will still work such as in this case.

i fixed the channels.xml creation.i noticed some channel in your list that mine doesnt have.no idea why this happened as it look like it gets the channel groups.one would think it would contain all the channels.

Thank you Blackbear for update the site.ini of Sincroguia.es

I can´t tell you why there are another channels that I haven´t found in the web page when I was searching the channel id´s to generate the *.channels.xml file... but I can tell you that I´m 100% sure that my .channels.xml file work correctly, even with the old site.ini file.

Anyway I will use your recently site.ini generated to check it out and also I will try to get info of some channel that I don´t have in my channels list to see if it´s possible to get the info (even when in the webpage is not listed that channel) or not. But I have several doubts of that because some of the channels that you have like MTV Live HD, Kiss tv, etc... have dissapeared.

Best regards.

nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day

Hi @Blackbear199,

I´ve been using the new site.ini and it works well but, there are some programs that it doesn´t get the specific sinopsis or the episode number of that program and gets a generic sinopsis of the serie. This is an example:

As you can see there are some programs in BigBang that there has not sinopsis of the episode. Look in the first program starting at 14:00H. This is the info that appears in the website:

So the info is there but for some reason WebGrab is not getting it correctly. And is getting some generic info regarding the serie... nothing more:

If you need anything else of my config don´t hesitate to contact me.

Thanks a best regards
P.S.: Regarding your channels config file generated automatically the channels that don´t have in my channels list are not getting info of any programs.

 

 

nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day

Hi Blackbear199,

Did you have some spare time to check my last post? Do you think if it´s possible to rewrite the site.ini of sincroguia.tv?
I´m really interested to do this site.ini work as expected and get all the info that it´s showed in the webpage because currently it´s the only one that has all the channels of the DVB-T network in Spain and even lot of channels that are being broadcasted by pay tv platforms.

So could you help me? Or anyone else?

Best regards all.

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

i had a look at this when you first asked but got side tracked with other things and never got back to post and eventually forgot about it.

i just had another look and dont think there much that can be done.

here's the problems as i see it..

the ini files is using some sort of api,i can view all the data no problem but the episode is incorrect most of the time and when it is right its 100% by accident.the program information is actually in xml format so its very easy to view anything.it does have the season information in <season></season> tags but for the episode number the only thing there is <chapterNumber></chapterNumber>.this is what the last person to update the ini uses for the episode number and its not right.so in short there's season only available(thats correct).

if you look at the site it self on the epg grid page.

this is the only page that has the ability to change the date and it only lists some channels.if you click on a channel(icon) it will take you to a channel epg page for today(example neox channel).on this page it has the correct season/episode but as i said is only shows the programs for today.

also from the epg grid page if you click on a show to get the details it has no season/episode information.the only place i see this info is on the single channel epg page which is only for today.

at the bottom of the page where all the channels are listed again this takes you to a single channel page,again for today only.

so i cannot see any way of making anything better.

 

 

nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day
Blackbear199 wrote:

i had a look at this when you first asked but got side tracked with other things and never got back to post and eventually forgot about it.

i just had another look and dont think there much that can be done.

No problem and thank you for your interest.

Blackbear199 wrote:

here's the problems as i see it..

the ini files is using some sort of api,i can view all the data no problem but the episode is incorrect most of the time and when it is right its 100% by accident.the program information is actually in xml format so its very easy to view anything.it does have the season information in <season></season> tags but for the episode number the only thing there is <chapterNumber></chapterNumber>.this is what the last person to update the ini uses for the episode number and its not right.so in short there's season only available(thats correct).

Do you think that you could fix the ini to get also the episode number?

Blackbear199 wrote:

if you look at the site it self on the epg grid page.

this is the only page that has the ability to change the date and it only lists some channels.if you click on a channel(icon) it will take you to a channel epg page for today(example neox channel).on this page it has the correct season/episode but as i said is only shows the programs for today.

In fact it´s showing the programs scheduled with 48 hours in advance

Blackbear199 wrote:

also from the epg grid page if you click on a show to get the details it has no season/episode information.the only place i see this info is on the single channel epg page which is only for today.

Well I´ve seen serveral channels and all has programs with 48 hours in advance... but I agree with you, the details of the season/episode are only in the square of the program to clink on it and view the details but not in the details section... curious. Here an example:

Here we have the info about season/episode T1/Ep.5

And these are the details section:

Blackbear199 wrote:

at the bottom of the page where all the channels are listed again this takes you to a single channel page,again for today only.

so i cannot see any way of making anything better.

I think that the best chance i´ts grab de info from this URL where it´s showing the programs with all the details (with 48 hours in advance):

http://sincroguia.tv/programacion/channel-name
http://sincroguia.tv/programacion/cuatro

Since I have a line in my crontab to run webgrab every day it could be a good workaround to make it work.

Keep waiting your comments.

P.S.: Sorry for the Spongebob face laugh that was the example that I´ve seen more quickly to show you.

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

yes,i do see 48 hrs.

i probably wasnt looking close enough at the data.

its easy to do,have it done in hr or so.

 

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

ok,try this..

i named it different so it wouldnt get confused with the other ini.

Files removed.

 

nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day

Thank you Blackbear199!!
I´ll try it and let you know soon...

nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day

Hi,

I´ve been testing it during these days... this is what I´ve seen:

1.- In all the programs appears at the end the question mark (?). See the .xml file attached

2.- Not sure why but I can´t get info from the channel "La otra". Could you try to see if happens to you also?

3.- For some reason if the program has the information of the episode number as this "Episodio 7" this is discarded and not showed in the .xml file

That´s all. The info obtained is always the correct in all the programs.

Thank you very much!

Attachments: 
Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

ini updated above.

some channels have slightly different title tags causing the detail title to not be scrubbed causeing problem 1.

la otra works fine here.

problem 3 unless you can narrow it down to a channel not sure how i could verify this,i'm not going to go looking at 10's of channels to find it.

i can say the only thing in the ini regarding the word "Episodio" is for the subtitle.it doesnt include subtitle's with the name "Episodio" in it because the episode number is already displayed in the <episode></episode> element.it would never cause a program to not be shown in the xml.

nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day

Hi Blackbear199,
Tested with the new .ini now the info it´s showed correctly without the question mark.

By the way you were right...  I had a mistake in the channels.xml file with the xmltv-id for "la otra". Now works ok:

About the issue nr. 3 here you have an example of a program called "Gym Tony XS" that has the name as "Episodio". The channel:
http://sincroguia.tv/programacion/cuatro
And two different programs:
http://sincroguia.tv/programas/programas/8wZ9_SPA/gym-tony-xs-episodio-5...
http://sincroguia.tv/programas/programas/91qb_SPA/gym-tony-xs-episodio-7...

As you can see the episode information doesn´t appear:

If you need anything else let me know.
Keep in touch as always.

Thank you and best regards.

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

fixed.

 

nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day
Blackbear199 wrote:

fixed.

Thank you Blackbear!! During my adventure with the MDB postprocessing laugh I´ve noted an issue with a serie where the description have been omitted because there was a link before with the information (general description) of the serie:

Here is the example:

  <programme start="20161214224000 +0100" stop="20161215001500 +0100" channel="Antena 3">
    <title lang="es">Velvet</title>
    <sub-title lang="es">Y entonces llegó él</sub-title>
    <desc lang="es">Ver ficha de Velvet</desc>
    <credits>
      <director>Carlos Sedes</director>
      <actor>Paula Echevarría</actor>
      <actor>José Sacristán</actor>
      <actor>Aitana Sánchez-Gijón</actor>
      <actor>Manuela Velasco</actor>
      <actor>Marta Hazas</actor>
      <actor>Maxi Iglesias</actor>
      <actor>Tito Valverde</actor>
      <actor>Natalia Millán</actor>
      <actor>Amaia Salamanca</actor>
      <actor>Miguel Ángel Silvestre</actor>
    </credits>
    <date>2016</date>
    <category lang="es">Series dramáticas españolas</category>
    <icon src="http://www.webgrabplus.com/%3Ca%20href%3D"http://cdn.sincroguia.tv/uploads/programs/v/e/l/velvet-433087_SPA-13.jpg">http://cdn.sincroguia.tv/uploads/programs/v/e/l/velvet-433087_SPA-13.jpg" />
    <country>España</country>
    <episode-num system="onscreen">S4 E10</episode-num>
    <rating system="ES">
      <value>+12</value>
    </rating>
    <star-rating>
      <value>1.0</value>
    </star-rating>
  </programme>

This is the web page:
http://sincroguia.tv/programas/series/9Z67_SPA/velvet-y-entonces-llego-e...

If you can see where is "Ver ficha de Velvet" Is the link that I was talking about above. This is the source code of the page:

	</ul>
				</div>

				<div class="m-box-info">
					<h3 class="m-box-info__title">Sinopsis</h3>
			      			<p class="m-box-info__text"><a href="http://sincroguia.tv/programacion-series/velvet"><b>Ver ficha de Velvet</b></a></p>
					
					<p class="m-box-info__text">Ana está aturdida tras la noticia de que Alberto está vivo. Mateo lo ha encontrado en Nueva York y los dos están viajando de vuelta. Ante semejante revelación, Ana sólo puede tomar una decisión: cancelar su boda con Carlos. Le duele en el alma dar una noticia así a su prometido, pero debe ser sincera con lo que siente. Se desahoga con sus amigas y con su tío, carcomida por las dudas.<br /><br />Mientras, Alberto y Mateo viajan juntos de vuelta a España. Es el momento idóneo para que los dos amigos se pongan al día. Mateo le cuenta que se separó de Clara. Alberto, por su parte, cuenta como pasó un año recorriendo la ruta de la seda y acabó asentándose en Nueva York... pero la pregunta clave es porqué Alberto jamás contactó con ellos. Alberto asegura que les escribió siempre, tanto a Mateo como a Ana. Las cartas a Mateo iban dirigidas al antiguo piso de casado de Mateo y, por tanto, él nunca las leyó.</p>
				</div>

				<div class="m-box-info">
					<h4 class="m-box-info__title">En las redes</h4>
					<ul class="m-box-info__list">

 

Is there any way in the .ini to bypass that link in order to get the correct description?

Regards and thanks.

 

 

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

change your description.scrub line to this..part thats changed in bold.

description.scrub {multi(include=last)|<h3 class="m-box-info__title">Sinopsis</h3>|<p class="m-box-info__text">|</p>|</div>}

 

nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day
Blackbear199 wrote:

change your description.scrub line to this..part thats changed in bold.

description.scrub {multi(include=last)|<h3 class="m-box-info__title">Sinopsis</h3>|<p class="m-box-info__text">|</p>|</div>}

Ok, solved. Thank you very much!.

nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day

Hi!

I´m back with this site to comment some issues:

1.- It seems that people from Sincroguia is starting to add some url´s in the categories. I would like to ask you if it´s possible remove that including some kind of line to get only the category, not the link of it. This is an example:.

We have this in the .xml file:

<sub-title lang="es">&lt;a href="http://www.webgrabplus.com/%3Ca%20href%3D"https://sincroguia.tv/informativos/informativos">https://sincroguia.tv/informativos/informativos"&gt;Informativos &lt;/a&gt;</sub-title>
<category lang="es">&lt;a href="http://www.webgrabplus.com/%3Ca%20href%3D"https://sincroguia.tv/informativos/informativos">https://sincroguia.tv/informativos/informativos" title="Informativos"&gt;Informativos &lt;/a&gt;</category>

It´s possible to extract only the content between &gt; ---- &lt; Just to get the word "Informativos" but without to remove other urls like the icons?

<icon src="http://www.webgrabplus.com/%3Ca%20href%3D"https://cdn.sincroguia.tv/uploads/programs/l/a/-/la-noche-en-24h-116933_SPA-76.jpg">https://cdn.sincroguia.tv/uploads/programs/l/a/-/la-noche-en-24h-116933_..." />

2.- This site.ini was created with the intention of get the information of the channels 2 days ahead. But now I´m only able to get 1 day even when it seems that information is showed 7 days ahead. Here the link where are the info of the channels:

https://sincroguia.tv/programacion/antena-3

If you scroll down the page you will see that more programs are showed till reach to the 7th day.

You will find attached to this post the files site.ini; channels.xml; WebGrab++.config.xml and guide.xml file resultant. I´m using WebGrab++ version  V1.57.

If you need anything else just let me know.

Best regards.

Attachments: 
Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

they have changed the site(urls)and even though one can see  inspecting the page data(there is actually 11 days epg).when i try grabbing any page other than today i get nothing or just today.

so this will take some looking into..

 

nickiman
Offline
nickiman's picture
Donator
Joined: 2 years
Last seen: 1 day
Blackbear199 wrote:

they have changed the site(urls)and even though one can see  inspecting the page data(there is actually 11 days epg).when i try grabbing any page other than today i get nothing or just today.

so this will take some looking into..

Hi! Blackbear199

11 days? If I go to https://sincroguia.tv/ I can see only from today thursday 16 to next wednesday 22.

Same case if we select one channel: https://sincroguia.tv/programacion/antena-3 I can see programs from today till 23 thursday (not the complete day) so... where have you seen the 11 days?

You´re right when you say that "they have changed the site(urls)" I think now it make no sense has two versions of Sincroguia:
a) 2 day version (the most recent)
b) the original with the complete guide but without full details of programs

Maybe should be better to merge it updating it with the new urls. Is this possible?

What´s your opinion?

Thank you and best regards.

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

ok,i had another look and i overlooked a header for the url_index.

when i was referring to 11 days what i means was when you scroll to the bottom of the screen and additional programs load the url changes to..

first page(today) - https://sincroguia.tv/programacion/antena-3

2nd page - https://sincroguia.tv/programacion/antena-3/2?callback=masEventos

3rd page - https://sincroguia.tv/programacion/antena-3/3?callback=masEventos

ect,ect..

last page - https://sincroguia.tv/programacion/antena-3/11?callback=masEventos

when i first glanced at it i though each page was a day but looking closer its isnt(some pages are partial days).but you are correct,its is 7 days epg in total.

you can use timespan=7 as i set the maxdays= to 8.1 and you will get the few programs that are on after midnight(start or the 8th day).

 

 

 

 

hospi10
Offline
Joined: 9 months
Last seen: 7 months

Thanks a lot Blackbear199!
But when I try to grab data with the new ini,I get the message "unable to update channel" and "no index page data received".
In the case I send to you,only woks the channel "la-2".
It seems wire or maybe I'm doing something wrong(probably :( )
Thanks in advance!

Attachments: 
Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

i cannot open your files.

achive manager opens the zip ok but gives a error when i try to extract them.

Update:

i see the problem,not all channels have 11 pages like above(antenna-3).

for example telecino has 8.

this causes a problem,the one your experiencing..

 

hospi10
Offline
Joined: 9 months
Last seen: 7 months

Oops! I'm sorry!
I send u again the files

Attachments: 
hospi10
Offline
Joined: 9 months
Last seen: 7 months

Oops! I'm sorry!
I send u again the files

Attachments: 
hospi10
Offline
Joined: 9 months
Last seen: 7 months

Ok,thanks for your answer!
So,maybe a new update of the ini is needed?

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

ok,fixed.

redownload the ini above or open existing and change the subpage.format line to this..

subpage.format {number||1|<h3>UFFF! No encontrado...</h3>}

i should have though of this scenario..but didn'nt.

 

 

hospi10
Offline
Joined: 9 months
Last seen: 7 months

Thanks!
I'll take a look later after work

hospi10
Offline
Joined: 9 months
Last seen: 7 months

Proved it and works fine for me.
Thanks a lot Blackbear199 and also Nickiman who made the first request for it!
Anyways,showicons are not scrubbed,is possible to get them?
I remember weeks ago you say me is not possible because were from RSS feed but with this update it seems that is possible but I cannot find the right way :(

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

showicon.scrub line is already there but was broken.

ini updated above.

not all programs have images.

channel logo are not possible.they are present on the detail page but webgrab expect to find it on the index page so its not possible to get.

 

hospi10
Offline
Joined: 9 months
Last seen: 7 months

Nice,thanks!
Redownloaded

hospi10
Offline
Joined: 9 months
Last seen: 7 months

Sorry to come back with this .ini but some channels still don't grab any data.
Most of them do,but another ones don't.
If Blackbear199 or somebody else can take a look into it,will be apreciate it.
Thanks in advance!
Edit: I tried some kind of combinations but without any luck :(

Attachments: 
Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

this is a real SOB to try to fix.

the problem is we dont know how many pages of epg data may exist.

i though i had it with the above subpage.format change but it doesnt look to be working and thats why your getting the "no index page data error".

the problem is the page that has that message on it is different from the regular epg page(its doesnt use the "X-Requested-With=XMLHttpRequest" header.

we cannot remove this header,its either used or not used for all pages and its needed for the actual epg pages.

so i changed to to something unique on the last page that has epg data,this means that this page will be not used because of the way the subpage.format works when using this method,it expects the page with the unique string to be the next page after the last valid one.

unless i or someone else can come up with a better idea this is as good as its going to get.

this means the last page of data you see on the site will not be used,so if your seeing 7 days there only 6 will be scrubbed by webgrab.

i updated post#25 but the only change is the subpage.format..

subpage.format {number||1|"nextPage":null,}

 

 

 

hospi10
Offline
Joined: 9 months
Last seen: 7 months

As always,thanks Blackbear199 for your work and also your explanations about it!
It works fine now :)

pizzel
Offline
Joined: 5 days
Last seen: 1 day

Hi,

Is there any way to grab from Sincroguía using the former numeric site_ids? EPG for channels not listed in the website of sincroguía, for example, Betis TV (site_id=979) could be grabbed before.

Thanks.

aarronlee
Offline
Joined: 2 years
Last seen: 2 days

Hi,

i havent been able to pull from sincroguia for a few days...

 

anyone else having this issue?

 

it says No Index found.

 

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

please stop saying it simply dont work.it does absolutely nothing to solve the problem.

it works fine for me so what would you like me to do? break it so i can say it dont work also?

http://www.webgrabplus.com/node/179

i'm not saying everything listed there is needed,it does depend on the problem.

at a mininum webgrab++.config.xml and log file.

 

 

aarronlee
Offline
Joined: 2 years
Last seen: 2 days

I can clearly see this has annoyed you for some apparent reason.

its okay I will use another source or ask for help externally.

 

Blackbear199
Offline
Joined: 2 years
Last seen: 2 days

when one starts a post with "please" i would assume other wise.

but thank you as i have donated my time and created/uprdated ini for nothing for 2 years now after being in the same situation you are in now learned how to create them myself from using the manual on the downloads page.

i am being so detailed because of this..

because of ignorant fucks like you i will never post /fix another ini.

contact the admin to have me banned(i will welcome it).

today this world if not full of people that want epg for their local channels.

its full of ilegal iptv providers wanting free epg for their ilegal operations.

anyway you can go fuck yourself.have a nice day.

 

 

mat8861
Offline
Donator
Joined: 2 years
Last seen: 10 hours

It looks like some people do not know how much time is spent and do not even appreciate efforts made by other users, in particular users that do not even contribute, always complain. By the way test it...i checked only one channel

last update 17nov2017  23.00 

 

Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl