Page 1 of 4
Digiguide grabber detail in 3.10.00W
Posted: Mon Jun 02, 2008 12:09 pm
by b00sfuk
Love the new support for grabbing Digiguide data. Got it working but there is only basic data grabbed, is there anything I'm missing to get the full range of fields (series/episode etc.) or is this a "to do"? The associated sageTV DG2XML utility does capture all these fields.
Thanks again
Re: Digiguide grabber detail in 3.10.00W
Posted: Mon Jun 02, 2008 2:54 pm
by alanbirtles
This was something that i knocked together in a few minutes at the request of a gbpvr user. I thought that DG2XML was outputting all of the available data and the grabber simply downloads and parses it. the problem is probably due to the downloaded file not following the xmltv schema (e.g. dates are in the wrong format but the grabber should cope). I will look into it but if you are feeling brave you could fix it yourself by editing the lua
Re: Digiguide grabber detail in 3.10.00W
Posted: Mon Jun 02, 2008 2:59 pm
by alanbirtles
just checked the dg2xml package and it does output non-standard tags which will need translating by the grabber
Re: Digiguide grabber detail in 3.10.00W
Posted: Mon Jun 02, 2008 6:08 pm
by grahamleggat
Hi Alan
This is something I've wanted for a long time. Its brilliant that you've incorporated Digiguide as I've been a subscriber to it for years and its in a different league to the Radio Times listings.
I've set it up as instructed, but it hangs on the grabber with the following:
18:03:41 - Starting pass 1 of grabber UK_Digi
18:03:41 - Logging In
18:03:42 - Getting start date
18:03:42 - Downloading h t t p : / / localhost:2402/skin-DG2XML/
sid-815E9693-56BD-4094-9E31-4ECF7B6D30BB/viewmultichannelgrid?
htd=3000&dt=1211821422&chi=0&noc=1000
18:04:42 - Read timed out retrying 5 more times in 3000 ms
Could this be my firewall?
Thanks in advance
Re: Digiguide grabber detail in 3.10.00W
Posted: Mon Jun 02, 2008 6:10 pm
by alanbirtles
possibly, can you open that url in you browser. Also are you using a proxy as the grabber will try and route all communications through the proxy and that wont work for local addresses
Re: Digiguide grabber detail in 3.10.00W
Posted: Mon Jun 02, 2008 6:11 pm
by alanbirtles
or try increasing the timeouts as didiguide can take a while to generate that page if you have a lot of channels
Re: Digiguide grabber detail in 3.10.00W
Posted: Mon Jun 02, 2008 6:15 pm
by grahamleggat
Hi Alan
I placed the URL in firefox and it hung for a while then I got a looping output consisting of
50 minutes 25 minutes 5 minutes 30 minutes 27 minutes 3 minutes 30 minutes 30 minutes 1 hour and 30 minutes 10 minutes 8 minutes 2 minutes 1 hour and 55 minutes 5 minutes 1 hour 30 minutes 45 minutes 2 hours and 55 minutes 3 hours and 15 minutes 45 minutes 1 hour 30 minutes 45 minutes 45 minutes 30 minutes 15 minutes 30 minutes 45 minutes 5 minutes 25 minutes 25 minutes 10 minutes 10 minutes 20 minutes 25 minutes 15
Should it have returned the listings within the browser?
Also tried in IE7 and it just hung
Cheers
Re: Digiguide grabber detail in 3.10.00W
Posted: Mon Jun 02, 2008 6:17 pm
by grahamleggat
Sorry forgot to mention, not using a proxy
Re: Digiguide grabber detail in 3.10.00W
Posted: Mon Jun 02, 2008 7:51 pm
by b00sfuk
Alan, thanks for the replies. I'll look at the tags/grabber and have a play.
N.B. In my limited testing so far I also saw the timeouts. If I increased the defaults, allowed the port through my firewall and also restarted the GUI grabber before each grab then it seemed to work OK.
Re: Digiguide grabber detail in 3.10.00W
Posted: Mon Jun 02, 2008 8:22 pm
by alanbirtles
grahamleggat wrote:Hi Alan
I placed the URL in firefox and it hung for a while then I got a looping output consisting of
50 minutes 25 minutes 5 minutes 30 minutes 27 minutes 3 minutes 30 minutes 30 minutes 1 hour and 30 minutes 10 minutes 8 minutes 2 minutes 1 hour and 55 minutes 5 minutes 1 hour 30 minutes 45 minutes 2 hours and 55 minutes 3 hours and 15 minutes 45 minutes 1 hour 30 minutes 45 minutes 45 minutes 30 minutes 15 minutes 30 minutes 45 minutes 5 minutes 25 minutes 25 minutes 10 minutes 10 minutes 20 minutes 25 minutes 15
Should it have returned the listings within the browser?
Also tried in IE7 and it just hung
Cheers
that is the correct output. Set the timeouts to a minute or more and see if it works
Re: Digiguide grabber detail in 3.10.00W
Posted: Mon Jun 02, 2008 10:16 pm
by grahamleggat
Thanks Alan that worked.
I enabled port 4202 on my router as well.
I will test this further and let you know.
Thanks very much
)))
Re: Digiguide grabber detail in 3.10.00W
Posted: Tue Jun 03, 2008 8:10 am
by b00sfuk
I've had a look at the lua files and for some it seems to be a "simple" matter of changing the variable names in xmltv_parse.lua. However I'm stumped when trying to match multiple fields to one in the grabber (e.g. episode num equates to series-number + episode-number and probably for credits sub-fields). Any quick insights? I'm trying to read up on lua syntax but I'm limited with time sitting in front of the PC as I'm recovering from a slipped disc.
Also the channel numbers now have a "UK_Digi_" prefix? I don't know yet if I can use altchids.txt to fix this for import into GB-PVR.
thanks again
Re: Digiguide grabber detail in 3.10.00W
Posted: Tue Jun 03, 2008 9:53 am
by alanbirtles
I made some progress on this last night and have everything apart from the credits working
Re: Digiguide grabber detail in 3.10.00W
Posted: Tue Jun 03, 2008 11:24 am
by b00sfuk
alanbirtles wrote:I made some progress on this last night and have everything apart from the credits working
Wow, thanks for spending time working on this.
P.S. seen somebody has just announced your new Digiguide support in the GB-PVR forums.
Re: Digiguide grabber detail in 3.10.00W
Posted: Tue Jun 03, 2008 5:35 pm
by austinwhite
Yes, I've seen this on the GBPVR forum, and am anxious to give Digiguide a try. But, no luck, probably due to my ignorance on the related network issues.
The grabber logs on but then times out, even when set to a long timeout. In Digiguide, the web services are set up with the static IP from my router, but I cannot access them, so I think it's a firewall problem, but I don't know what to change. Any ideas?