You are here

Grab EPG from Sites behind CloudFlare

3 posts / 0 new
Last post
rapidiptv
Offline
rapidiptv's picture
Joined: 8 years
Last seen: 4 months
Grab EPG from Sites behind CloudFlare

Hello,

When I try to capture data from some sites, the downloaded html is encoded (something like this: ��"*Z?<#5釀f���!??!����0s>�W�)��%?) and it's not the html I view in FireFox's source view. How can we bypass this problem using WebGrab++?

Example: radiobruno.it

Blackbear199
Offline
Blackbear199's picture
WG++ Team memberDonator
Joined: 9 years
Last seen: 2 hours

nothing special that i can see,its a monday to sunday 7.1 site.

paste this in ur browser..
view-source:https://www.radiobruno.it/palinsesto-programmi/

epg data starts at line 1567(monday)
1666 (tuesday)
1765 (wednesday)
ect
np to scrub the data with webgrab.

rapidiptv
Offline
rapidiptv's picture
Joined: 8 years
Last seen: 4 months

Nice, Thanks! Yes, this was the case. I removed br from acceptable encodings and the data appeared correctly!
This: url_index.headers {customheader=Accept-Encoding=gzip,deflate}

Log in or register to post comments

Brought to you by Jan van Straaten

Program Development - Jan van Straaten ------- Web design - Francis De Paemeleere
Supported by: servercare.nl