Author Topic: AZOpen - AZBox OpenTools  (Read 1179 times)

0 Members and 1 Guest are viewing this topic.

Offline hasanze

  • Hero Member
  • *****
  • Posts: 1219
AZOpen - AZBox OpenTools
« on: March 13, 2010, 10:31:41 PM »
AZOpen - AZBox OpenTools
AZOpen - AZBox OpenTools


Code: You are not allowed to view links. Register or Login
This program downloads XMLTV data from rytec.be, and uses the control
files there to assist with the application of these data to the EPG of
the AZBox.

For users:
=========
  If you just want to use this to set your EPG, copy the contents of the bin
  directory onto your AZBox, and set up a cron job to execute it perhaps once
  per day - select a weird time, to ensure that you don't overload the
  rytec.be server.

  Edit the azepgmgr.conf file to enable the channels you want. The default
  is for the UK channels to be enabled, but you only have to remove the
  comment character "#" from the line you want, in order to enable it.
  Remember to comment out the UK entry if you don't want that.

  Run azepgmgr.sh to run the tool. It's not fast, but it should finidh in
  about 5 minutes. It tries to download the daily file form rytec.be, but
  if it hasn't been made available yet, you can specify the date yourself
  by calling it as:
      ./azepgmgr.sh YYYYMMDD
  where YYYY=year, MM=month and DD=day, e.g. today is March 7, 2010, which
  would be:
      ./azepgmgr.sh 20100307

  Of course, you don't want to download the XMLTV data every time you want to
  update your EPG. In this case, simply run:
      ./runazepg.sh
  and this will update your EPG.

  Actually, the program that does the EPG update is called azepgmgr and has
  the following parameters:
   -c ChannelsFile      Default = "rytec.channels.xml"
    The name of the file containing the channels information
   -x XMLTVData       Required - no default
    The name of the file containing the XMLTV data
   -d days          Default = 1 day (24 hours)
    The number of days for which to load the EPG
   -h hours         Default = 24 hours
    The number of hours for which to load the EPG (see -d)
   -n maxEvents       Default = 10000
    The number of events to load into the EPG
   -v
    Indicates that this should provide verbose information about the
    run. If you specify more "-v"s, you get more debug information.

  A typical run would be:
   ./azepgmgr -c rytec.channels.xml -x rytecxmltvuk
   
For developers:
===============
  Requirements to build this are:
  1. The AZBox TV SDK
  2. The AZBox Plugin SDK (optional)
  3. The AZBox toolchain
 
  The program uses libxml2 to process the XMLTV data, so the versions of
  these libraries rebuilt for the AZBox are in the bin directory, along
  with the header files in the hdr directory.

  There are a number of source files in the program:
   main.c      This contains main() and controls the run, reading the
            command-line parameters.
   dump.c      Used for debugging and to dump various items
   loadchan.c    Reads the channel.xml file, using the data to identify
            the corresponding channel in the AZBox's channel list.
   loadepg.c    Reads the EPG XMLTV data and calls the functions to
            insert the data into the EPG.
   sdkmgr.c     Calls the SDK functions. This allows all other functions
            to be tested in isolation of the SDK.
 
Known problems:
==============
  * Because of memory limitations, this only supports the addition of a
   maximum of around 10000 events.
  * The AZBox SDK displays spurious messages: this is not a function of
   this tool, but rather a function of the SDK.

History:
========
  0.2 - 2010-03-11
     This has useful defaults for the number of events and other params,
     and introduces new command-line flags to allow the specification of
     the duration in days or hours, and the maximum number of events

You are not allowed to view links. Register or Login

Offline antox

  • Ferengi
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16798
Re: AZOpen - AZBox OpenTools
« Reply #1 on: March 14, 2010, 11:02:16 AM »
AZOpen - AZBox OpenTools

This program downloads XMLTV data from rytec.be, and uses the control
files there to assist with the application of these data to the EPG of
the AZBox.

For users:
=========
If you just want to use this to set your EPG, copy the contents of the bin
directory onto your AZBox, and set up a cron job to execute it perhaps once
per day - select a weird time, to ensure that you don't overload the
rytec.be server.

Edit the azepgmgr.conf file to enable the channels you want. The default
is for the UK channels to be enabled, but you only have to remove the
comment character "#" from the line you want, in order to enable it.
Remember to comment out the UK entry if you don't want that.

Run azepgmgr.sh to run the tool. It's not fast, but it should finidh in
about 5 minutes. It tries to download the daily file form rytec.be, but
if it hasn't been made available yet, you can specify the date yourself
by calling it as:
./azepgmgr.sh YYYYMMDD
where YYYY=year, MM=month and DD=day, e.g. today is March 7, 2010, which
would be:
./azepgmgr.sh 20100307

Of course, you don't want to download the XMLTV data every time you want to
update your EPG. In this case, simply run:
./runazepg.sh
and this will update your EPG.

Actually, the program that does the EPG update is called azepgmgr and has
the following parameters:
-c ChannelsFile Default = "rytec.channels.xml"
The name of the file containing the channels information
-x XMLTVData Required - no default
The name of the file containing the XMLTV data
-d days Default = 1 day (24 hours)
The number of days for which to load the EPG
-h hours Default = 24 hours
The number of hours for which to load the EPG (see -d)
-n maxEvents Default = 10000
The number of events to load into the EPG
-v
Indicates that this should provide verbose information about the
run. If you specify more "-v"s, you get more debug information.

A typical run would be:
./azepgmgr -c rytec.channels.xml -x rytecxmltvuk

For developers:
===============
Requirements to build this are:
1. The AZBox TV SDK
2. The AZBox Plugin SDK (optional)
3. The AZBox toolchain

The program uses libxml2 to process the XMLTV data, so the versions of
these libraries rebuilt for the AZBox are in the bin directory, along
with the header files in the hdr directory.

There are a number of source files in the program:
main.c This contains main() and controls the run, reading the
command-line parameters.
dump.c Used for debugging and to dump various items
loadchan.c Reads the channel.xml file, using the data to identify
the corresponding channel in the AZBox's channel list.
loadepg.c Reads the EPG XMLTV data and calls the functions to
insert the data into the EPG.
sdkmgr.c Calls the SDK functions. This allows all other functions
to be tested in isolation of the SDK.

Known problems:
==============
* Because of memory limitations, this only supports the addition of a
maximum of around 10000 events.
* The AZBox SDK displays spurious messages: this is not a function of
this tool, but rather a function of the SDK.

History:
========
0.2 - 2010-03-12
This has useful defaults for the number of events and other params,
and introduces new command-line flags to allow the specification of
the duration in days or hours, and the maximum number of events

0.1 - 2010-03-11
Initial release
azepgmgr-0.2.zip
You are not allowed to view links. Register or Login
azepgmgr-src-0.2.zip
You are not allowed to view links. Register or Login

Offline antox

  • Ferengi
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16798
Re: AZOpen - AZBox OpenTools
« Reply #2 on: March 20, 2010, 09:46:10 PM »
AZOpen - AZBox OpenTools v 0.6
AZOpen - AZBox OpenTools v 0.6

This describes the changes made for each version. For details on hoe
to use the program, see the README file in the executables directory.
For details about development of the program, see the README file in
the source directory.

Known problems:
==============
* The AZBox SDK displays spurious messages: this is not a function of
this tool, but rather a function of the SDK.
* It's slow, taking up to 90mins to load a full set of EPG data.
* The reloader does not exit cleanly

History:
========
0.6 - 2010-03-19
- Cleaned up the reloader and it runs *much* faster than the
initial load.
- Corrected behaviour if too many -v parameters are supplied.
- Added some information to the bin/README file.
- Fixed some time calulations.

0.5 - 2010-03-17
- Rationalised the executable calls to try to remove confusion
- Added more defaults to the parameters
- Cleansed downloaded XML data
- Fixed the bug where selecting multiple bouquets caused the EPG to
be overwritten by the events from the bouquet loaded last.
- Persisted the current EPG to assist with planned performance
enhancements.
- Created a new faster reload function

0.4 - 2010-03-15
- Corrected the GMT offset: values are now subtracted instead of being
incorrectly added.
- Hard-coded the date of 2010-03-05 for the sources file since rytec
has not updated it recently.

0.3 - 2010-03-14
- The defaults for the number of days has been set to 5 days.
- Fixed a bug with the loading of texts where the data overwrote other
fields. This now allows the number of events to exceed 50000.
- Added signal traps - ctrl-C and a segmentation fault are caught to
allow the program clean up
- Improved logging - user -v multiple times to get mroe information

0.2 - 2010-03-11
- This has useful defaults for the number of events and other params,
and introduces new command-line flags to allow the specification of
the duration in days or hours, and the maximum number of events

0.1 - 2010-03-12
- Initial release.


DOWNLOAD

AzEgMgr v 0.6

You are not allowed to view links. Register or Login


AzEgMgr src v 0.6

You are not allowed to view links. Register or Login

Offline antox

  • Ferengi
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16798
Re: AZOpen - AZBox OpenTools
« Reply #3 on: March 20, 2010, 09:46:27 PM »
 v 0.7 - 2010-03-19

* Speeded the whole thing up: it now downloads the data and generates the data file in about 4 minutes. The load phase then takes about 15 minutes.
* Fixed the problem with segmentation faults at the end.

Download



AzEpgMgr

You are not allowed to view links. Register or Login



AzEpgMgr src

You are not allowed to view links. Register or Login
__________________

Offline antox

  • Ferengi
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16798
Re: AZOpen - AZBox OpenTools
« Reply #4 on: March 20, 2010, 09:48:36 PM »
AZBox OpenTools v.1.0
Changes V1.0:
- Mapped the speed updates to the main program, by inserting up to 25 events at a time. Inserting 50000 events takes about 20 minutes. I don't think this can be improved much, since this is a function of the SDK.
- Provided new command-line switches

 You are not allowed to view links. Register or Login

You are not allowed to view links. Register or Login

Offline antox

  • Ferengi
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16798
Re: AZOpen - AZBox OpenTools
« Reply #5 on: March 28, 2010, 08:23:54 AM »
AZBox OpenTools 1.1

2010-03-25

- Enable reboot and wakeup repopulation of the EPG.
- Created two scripts to reload the EPG at reboot and at wakeup
- Increased the memory usage to 20MB (that's the maximum)

You are not allowed to view links. Register or Login

Online labud

  • Administrator
  • Hero Member
  • *****
  • Posts: 9026
AZOpen - AZBox OpenTools /Azbox HD
« Reply #6 on: March 29, 2010, 05:55:13 AM »
version 1.2 28-03-2010
SRC
* Bug fixes and auto-download
* Fixed a bug with daylight savings time
* Automatically download the XML if required
* Changed default to values that definitely work
* Hide the noise messages
-----------------------------------------------








UNAUTHORIZED DECODING OF ENCRYPTED SIGNALS FROM EITHER DOMESTIC OR FOREIGN PROVIDERS IS AGAINST THE LAW !!!
INFORMATION CONTAINED IN MY POSTS ["C/P FROM ANOTHER SITE"] ARE FOR LEARNING AND EDUCATIONAL PURPOSES ONLY !!!
PLEASE, DO NOT SEND ME PRIVATE MESSAGES WITH TECHNICAL QUESTIONS, USE FORUM FOR IT !!!

Offline antox

  • Ferengi
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16798
Re: AZOpen - AZBox OpenTools
« Reply #7 on: April 02, 2010, 08:14:16 PM »
version 1.3

2010-04-01


     - Bug fixes
     - Fixed up time settings, responding correctly to daylight savings
      time
     - Responded to the issues with the spurious messages by removing
      the filter.
     - Made a number of changes to optimise the behaviour


You are not allowed to view links. Register or Login

Offline antox

  • Ferengi
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16798
Re: AZOpen - AZBox OpenTools
« Reply #8 on: April 04, 2010, 08:24:53 AM »
AZBox OpenTools Version 1.3b

03.04.2010


You are not allowed to view links. Register or Login

You are not allowed to view links. Register or Login

Offline antox

  • Ferengi
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16798
Re: AZOpen - AZBox OpenTools
« Reply #9 on: April 08, 2010, 08:44:28 AM »
AZBox OpenTools Version 1.4

2010-04-07


- Fixes and renames
- Hopefully resolved issues caused by daylight savings time.
- Renamed the executable to avoid all these problems reported by
folk not RTFM.
- Removed references to reloadepg since this has been superceded by
changes in _azepgmgr.
- Allow the system to identify the curretn DST settings, or to specify
DST as a flag (-t)

   You are not allowed to view links. Register or Login
   You are not allowed to view links. Register or Login

Online labud

  • Administrator
  • Hero Member
  • *****
  • Posts: 9026
Re: AZOpen - AZBox OpenTools
« Reply #10 on: April 09, 2010, 04:10:57 AM »
AZOpen - AZBox OpenTools 1.5


Code: You are not allowed to view links. Register or Login
  Enhancementsw
     - Added support for multiple XMLTV data files which are concatenated
      to produce one big data file.
     - Added new param (-m size) that limits the length of the text that's
      inserted into the program description. The defalt is 4096, and any
      invalid value outside the range 0-4096 will be changed to 4096.
-----------------------------------------------








UNAUTHORIZED DECODING OF ENCRYPTED SIGNALS FROM EITHER DOMESTIC OR FOREIGN PROVIDERS IS AGAINST THE LAW !!!
INFORMATION CONTAINED IN MY POSTS ["C/P FROM ANOTHER SITE"] ARE FOR LEARNING AND EDUCATIONAL PURPOSES ONLY !!!
PLEASE, DO NOT SEND ME PRIVATE MESSAGES WITH TECHNICAL QUESTIONS, USE FORUM FOR IT !!!

Offline antox

  • Ferengi
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16798
Re: AZOpen - AZBox OpenTools
« Reply #11 on: April 10, 2010, 11:54:26 AM »
AZBox OpenTools version 1.5a - 2010-04-09

Changes V1.5a:
- Fix bugs in enhancements!
- Corrected well-formedness of the generated concatenated XML data
- Fixed shell programming of multiple files in a lis
- Changed getChannels signature to use a 16-bit nid (thanks Massimo!).
azepgmgr-1.5a.zip



You are not allowed to view links. Register or Login


azepgmgr-src-1.5a.zip




You are not allowed to view links. Register or Login


Offline antox

  • Ferengi
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16798
Re: AZOpen - AZBox OpenTools
« Reply #12 on: May 22, 2010, 01:57:37 PM »
AZBox OpenTools v.1.6

Known issues:
=============
* Errors occur when committing data to the EPG - I don't know why these
happen, so need help from the dev folk. The effect is that when you
try to load the full EPG list, it loses a lot of the information.
* Some of the EPG data are not loaded - it appears that the channels are
not identified correctly. Perhaps the rytec information is inaccurate.

History:
========
1.6 - 2010-05-16 - Massimo - Fix bugs and enhancements!
- First of all I'd like to say Thank You to BPMURRAY for having started
this job and now I'm happy to help him to enhance his plugin.

- Deleted "reloadepg" and "azepgmgr" from svn bin directory because no more used.
- Added two script file in svn project "azopen_svnmk.sh" and "azopen_mk.sh"
to help to update and/or make bin file.
- Fixed detailed info for EPG event.
- Changed print info filter with new function for debugging
- Modified "azboxepg" to fix time offset issue.
- Modified "azboxepg" to display EPG update progress info with azbox display.
- Modified "azboxepg" with updated source file.
- Modified "azboxepg" with new variable to set custom channels list file.
- Modified "azboxepg" with temporary log file.
- Added in "azboxepg" more parameter for print info.

Offline antox

  • Ferengi
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16798
AZbox EPG tool
« Reply #13 on: May 24, 2010, 07:00:19 PM »
AZbox EPG tool
Not my work , just found on the net .

I had difficulty installing it , but I think thats more to me being a Linux noob ....But I've got an EPG on my box , so I must of done something correct .



If you manage to get it working , it takes a long time to download , and load the information .

AZOpen - Open source tools for the AZBox

The EPG program is now stable and works rather well, even if I say so myself. There have been a number of comments indicating that some people are confused about how to install and run it, despite the detailed instructions in the README file. This is an attempt at providing simple instructions for technophobes, so here goes ...

Installation

Download the zip file to your machine. If you're using Windows, do not unzip the file on your PC because it will corrupt the scripts.

Next, you need to copy the zip file to the AZBox: how to do this depends on whether you have a hard disk in the box or you're using a USB memory stick (USB key).

1. USB Key:

  * Copy the zip file to the key and unmount it from your PC.
  * Plug the key into the box.
  * Telnet to the box and change to the USB directory

2. Hard disk

  * Connect to your AZBox using FTP and copy the zip file to the hard disk, i.e. to /DATA/hdb1. You can do this using the ftp command-line tool, or using one of the available tools , e.g. MaZ.
  * Telnet to the box, and change to /DATA/hdb1

Now, the next part is the same for both USB and hard disk - create a new folder to contain the files, unzip the files into this and change to the bin folder: mkdir myEPG
cd myEPG
unzip ../azepgmgr_1.6.zip
cd bin

The program has now been installed.

Running the program

There are a number of possible settings you can use for the program. However, for the sake of simplicity, this will only explain the most important options. The full description is in the README file that's in the zip. Every few days, you'll need to download the latest XMLTV data, i.e. the information for the EPG. You do this by running: ./azboxepg -l # That's an "l" for "Load"

This will download the data for the next 7 days, and insert it into the EPG. Top refresh the EPG, run: ./azboxepg -d 2 # 2 days
This actually only loads two day's worth, but since the box loses entries when more than that is loaded, there's really no point in loading more.
Probably the simplest way to run the program is to use its automatic updating feature: ./azboxepg -a # Automatic updates days
This will automatically download the EPG data if required, and will load two days worth of EPG events into memory.
Problems

There are still problems with this EPG program. The ones I know of are:

  * When loading a large number of EPG entries, the box loses some of them (another reason to limit it to only a couple of days).


You are not allowed to view links. Register or Login
You are not allowed to view links. Register or Login

Offline antox

  • Ferengi
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16798
Re: AZOpen - AZBox OpenTools
« Reply #14 on: June 09, 2010, 08:21:44 AM »

AZBox OpenTools 1.6a



History:
========
1.6a- 2010-06-08 - bpmurray - Cleaned up the script, making the date
auto-detected, thereby fixing the 404 error.


You are not allowed to view links. Register or Login