diff --git a/WGLicense.log.txt b/WGLicense.log.txt deleted file mode 100644 index b52b44f9..00000000 --- a/WGLicense.log.txt +++ /dev/null @@ -1,30 +0,0 @@ -[ ] WebGrab++ license request and update log -[ ] 2021/03/09 22:37 -[ ] -[Warning ] No License request in WebGrab++.config.xml -[ Info ] Consider to add a license request , like this: -[ Info ] -[ Info ] The program will run with performance settings : 'default' -[ Info ] License check .. done -[ ] -[ ] Actual settings of the various licenses (may change from time to time) : -[ ] -[ ] default donator_license donator registered_user un_registrd_user developer -[ ] channels/ini 20 250 50 30 20 1000 -[ ] channels total 20 250 50 30 20 1000 -[ ] siteinis 2 15 10 3 2 100 -[ ] decryption keys without userkey enabled enabled enabled without userkey enabled -[ ] decryption mode legacy (V2) new (V3) & (V2) new (V3) & (V2) legacy (V2) legacy (V2) new (V3) & (V2) -[ ] index only yes no no no yes no -[ ] postprocess MDB disabled enabled enabled disabled disabled enabled -[ ] postprocess REX disabled enabled enabled enabled disabled enabled -[ ] debug False False False False False True -[ ] show details * ttd full full ttsd ttd full -[ ] update mode force all all light force all -[ ] channel delay 4 secs 0 secs 0 secs 2 secs 4 secs 0 secs -[ ] index delay 4 secs 0 secs 0 secs 4 secs 4 secs 0 secs -[ ] show delay 2 secs 0 secs 0 secs 1 secs 2 secs 0 secs -[ ] -[ ] * showdetails : 'tt = times & title, 's' = subtitle, 'd' = description -[ ] -[ ] license update interval time : 168 hours diff --git a/WebGrab++.config.example.xml b/WebGrab++.config.example.xml deleted file mode 100755 index 697ff3cb..00000000 --- a/WebGrab++.config.example.xml +++ /dev/null @@ -1,28 +0,0 @@ - - - - - - guide.xml - - rex - Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Safari/537.36 Edg/79.0.309.71 - - - on - 4 - 0 - f - - - - Example - - \ No newline at end of file diff --git a/WebGrab++.config.xml b/WebGrab++.config.xml deleted file mode 100755 index 4f5fb597..00000000 --- a/WebGrab++.config.xml +++ /dev/null @@ -1,29 +0,0 @@ - - - - - - guide.xml - - rex - Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Safari/537.36 Edg/79.0.309.71 - - - on - 4 - 2 - f - - - - 2x2 - Paramount Comedy - - diff --git a/WebGrab++.log.txt b/WebGrab++.log.txt deleted file mode 100644 index d6199465..00000000 --- a/WebGrab++.log.txt +++ /dev/null @@ -1,63 +0,0 @@ -[ ] -[ ] WebGrab+Plus/w MDB & REX Postprocess -- version V3.1.0.0 -[ ] -[ ] Jan van Straaten -[ ] Francis De Paemeleere -[ ] -[ ] thanks to Paul Weterings and all the contributing users -[ ] -------------------------------------------------------------------------------- -[ ] -[ ] Job started at 09/03/2021 22:37:11 -[ Debug ] -[ Debug ] Running on: Unix 19.6.0.0 -[ Debug ] Environment: 4.0.30319.42000 -[ Debug ] Mono version: 6.12.0.122 (2020-02/c621c35ffa0 Wed Feb 10 00:51:43 EST 2021) -[ Debug ] -[ Debug ] Loading timezone data -[ Debug ] Embedded timezones source: timezone.timezonesdata.txt -[ Debug ] Reading config file: /Users/Arhey/Code/iptv-org/epg/./WebGrab++.config.xml -[ Info ] Checking License .. -[ Info ] For License request/update data, see WGLicense.log.txt -[ Debug ] -[ Info ] found: /Users/Arhey/Code/iptv-org/epg/./siteini.pack/Russia/tv.yandex.ru.ini -- Revision 07 -[ Debug ] xmltv input file - /Users/Arhey/Code/iptv-org/epg/guide.xml - found -[ Debug ] 99 superfluous shows removed -[ Info ] Found existing channel (xmltv_id=2x2.ru) in the config file -[ Info ] Found existing channel (xmltv_id=ParamountComedy.ru) in the config file -[ Info ] -[ Info ] -[ Info ] -[ Info ] i=index .=same c=change g=gab r=replace n=new -[ Info ] -[ Info ] -[ Info ] Group (0) : -[ Info ] update requested for - 2 - out of - 2 - channels for 3 day(s) -[ Debug ] -[ Info ] ( 1/2 ) TV.YANDEX.RU -- chan. (xmltv_id=2x2.ru) -- mode Force -[Warning ] No episode-num matching -[Warning ] episode-num unchanged: 4-я - 6-я серии -[Warning ] No episode-num matching -[Warning ] episode-num unchanged: 4-я - 6-я серии -[ Debug ] skipped : fully overlapping show from 10/03/2021 01:50 -[ Debug ] to 10/03/2021 02:15 -[Warning ] No episode-num matching -[Warning ] episode-num unchanged: 1-я - 3-я серии -[Warning ] No episode-num matching -[Warning ] episode-num unchanged: 1-я - 3-я серии -[ Debug ] skipped : fully overlapping show from 11/03/2021 01:50 -[ Debug ] to 11/03/2021 02:15 -[Warning ] No episode-num matching -[Warning ] episode-num unchanged: 4-я - 6-я серии -[Warning ] No episode-num matching -[Warning ] episode-num unchanged: 4-я - 6-я серии -[ Info ] -[ Debug ] -[ Info ] ( 2/2 ) TV.YANDEX.RU -- chan. (xmltv_id=ParamountComedy.ru) -- mode Force -[ Info ] -[ Debug ] -[ Debug ] 312 shows in 2 channels -[ Debug ] 0 updated shows -[ Debug ] 312 new shows added -[ Info ] -[ Info ] -[ ] Job finished at 09/03/2021 22:37:49 done in 38s diff --git a/doc/Development - Manual.pdf b/doc/Development - Manual.pdf deleted file mode 100755 index 0be04820..00000000 Binary files a/doc/Development - Manual.pdf and /dev/null differ diff --git a/doc/QuickStartGuide.html b/doc/QuickStartGuide.html deleted file mode 100755 index a040a966..00000000 --- a/doc/QuickStartGuide.html +++ /dev/null @@ -1,101 +0,0 @@ - - - - -Quick Start - - - - - - -
- - -
-

What is WebGrab+Plus

-

-WebGrab+Plus is a generic webgrab tool that can grab tv listings from websites and create a xmltv file for it. This xmltv file can be fed to a PVR/EPG system to visualize the tv listing.
-Because WebGrab+Plus itself is generic, it will need to know how to grab a specific website. This info is packed into siteini files. -For every supported website, such a file will exist. On a website you have multiple tv channels. To know what channels are available for a specific siteini (website), you can look into the accompanying .channels.xml file. This file contains a list of channels that can be used. All those files can be found in the siteini.pack folder.
-Currently WebGrab+Plus is only a command line tool. So no GUI (Graphic User Interface) is available. -

-

A list of all features can be found on our website

- - -

How to use

- -
    -
  1. Find the config file (WebGrab++.config.xml) and open it with a simple text editor.
    2. -
  2. Locate the dummy <channel> line at the end of the file
    3. -
  3. Now look inside the siteini.pack folder and find the channels you want to grab (inside the .channels.xml files)
    4. -
  4. Replace the dummy <channel> line with the channel(s) you want to grab
    5. -
  5. Run WebGrab+Plus
    6. -
  6. You should get a xmltv file called guide.xml file with the tv listings of your channels
    7. -
  7. For more information about the configuration file, see on our website
    8. -
  8. To feed the generate xmltv file into you EPG/PVR system you can follow examples on our site
    9. -
- - -

Usefull links:

-

-Homepage
-Online documentation
-Online forum
-Online FAQ
-

- -
-
- - - - diff --git a/guide.xml b/guide.xml deleted file mode 100644 index 7d556963..00000000 --- a/guide.xml +++ /dev/null @@ -1,949 +0,0 @@ - - - - 2x2 - - http://www.tv.yandex.ru - - - Paramount Comedy - - http://www.tv.yandex.ru - - - ДП - - - Пыхчево - - - Подозрительная Сова - - - Русские мультфильмы - - - Бешеные кролики: Вторжение - - - 2X2 Music - - - Луча Андеграунд - - - 2X2 Music - - - Симпсоны - - - Симпсоны - - - Симпсоны - - - Симпсоны - - - Космические цыплята в космосе - - - Время приключений - - - Время приключений - - - Время приключений - - - Аватар: легенда о Корре - - - Аватар: легенда о Корре - - - Время приключений - - - Время приключений - - - Время приключений - - - Крайний космос - - - Крайний космос - - - Американский папаша - - - Футурама - - - Футурама - - - Симпсоны - - - Футурама - - - Футурама - - - Футурама - - - Футурама - - - Футурама - - - Футурама - - - Американский папаша - - - Американский папаша - - - Симпсоны - - - Симпсоны - - - Подозрительная Сова - - - Подозрительная Сова - - - Суперособняк - - - Проповедник - - - Южный парк - - - Внутри девятого номера - - - Гриффины - - - Бандитский Петербургер - - - Аватар: легенда о Корре - - - Аватар: легенда о Корре - - - 2X2 Music - - - ДП - - - Пыхчево - - - Подозрительная Сова - - - Русские мультфильмы - - - Бешеные кролики: Вторжение - - - 2X2 Music - - - Луча Андеграунд - - - 2X2 Music - - - Симпсоны - - - Симпсоны - - - Симпсоны - - - Симпсоны - - - Удивительный мир Гамбола - - - Удивительный мир Гамбола - - - Удивительный мир Гамбола - - - Космические цыплята в космосе - - - Аватар: легенда о Корре - - - Аватар: легенда о Корре - - - Футурама - - - Футурама - - - Симпсоны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Футурама - - - Футурама - - - Футурама - - - Американский папаша - - - Американский папаша - - - Симпсоны - - - Симпсоны - - - Нереальный Stand Up - - - Мульtouch - - - Суперособняк - - - Проповедник - - - Южный парк - - - Металлоапокалипсис - - - Шоу Кливленда - - - Шоу Кливленда - - - Шоу Кливленда - - - 2X2 Music - - - ДП - - - Пыхчево - - - Подозрительная Сова - - - Русские мультфильмы - - - Бешеные кролики: Вторжение - - - Луча Андеграунд - - - Симпсоны - - - Симпсоны - - - Симпсоны - - - СимпсоныМо" - - - Удивительный мир Гамбола - - - Удивительный мир Гамбола - - - Удивительный мир Гамбола - - - Космические цыплята в космосе - - - Аватар: легенда о Корре - - - Аватар: легенда о Корре - - - Футурама - - - Футурама - - - Футурама - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Губка Боб квадратные штаны - - - Гриффины - - - Гриффины - - - Гриффины - - - Гриффины - - - Гриффины - - - Гриффины - - - Гриффины - - - Подозрительная Сова - - - Подозрительная Сова - - - Суперособняк - - - Проповедник - - - Южный парк - - - Черепашки мутанты ниндзя - - - Черепашки мутанты ниндзя - - - Черепашки мутанты ниндзя - - - Гриффины - - - Шоу Кливленда - - - Котопёс - - - Котопёс - - - Котопёс - - - Котопёс - - - Эй, Арнольд! - - - Друзья - - - Друзья - - - Теория большого взрыва - - - Теория большого взрыва - - - Теория большого взрыва - - - Друзья - - - Друзья - - - Детство Шелдона - - - Детство Шелдона - - - Голдберги - - - Голдберги - - - Клиника - - - Друзья - - - Друзья - - - Теория большого взрыва - - - Теория большого взрыва - - - Теория большого взрыва - - - Клиника - - - Американская семейка - - - Американская семейка - - - Клиника - - - Клиника - - - Клиника - - - Детство Шелдона - - - Детство Шелдона - - - Друзья - - - Друзья - - - Голдберги - - - Голдберги - - - Теория большого взрыва - - - Теория большого взрыва - - - Теория большого взрыва - - - Друзья - - - Друзья - - - Клиника - - - Клиника - - - Клиника, 1-я часть - - - Голдберги - - - Голдберги - - - Южный парк - - - Южный парк - - - Друзья - - - Друзья - - - Стендап от Paramount Comedy - - - Стендап от Paramount Comedy - - - Американская семейка - - - Американская семейка - - - Южный парк - - - Детство Шелдона - - - Детство Шелдона - - - Американская семейка - - - Американская семейка - - - Эй, Арнольд! - - - Эй, Арнольд! - - - Котопёс - - - Котопёс - - - Котопёс - - - Котопёс - - - Эй, Арнольд! - - - Друзья - - - Друзья - - - Теория большого взрыва - - - Теория большого взрыва - - - Теория большого взрыва - - - Друзья - - - Друзья - - - Детство Шелдона - - - Детство Шелдона - - - Голдберги - - - Голдберги - - - Клиника - - - Друзья - - - Друзья - - - Теория большого взрыва - - - Теория большого взрыва - - - Теория большого взрыва - - - Клиника - - - Американская семейка - - - Американская семейка - - - Клиника - - - Клиника - - - Клиника, 1-я часть - - - Детство Шелдона - - - Детство Шелдона - - - Друзья, 1-я часть - - - Друзья, 2-я часть - - - Голдберги - - - Голдберги - - - Теория большого взрыва - - - Теория большого взрыва - - - Теория большого взрыва - - - Друзья - - - Друзья - - - Клиника, 2-я часть - - - Клиника - - - Клиника - - - Голдберги - - - Голдберги - - - Южный парк - - - Южный парк - - - Друзья - - - Друзья - - - Стендап от Paramount Comedy - - - Стендап от Paramount Comedy - - - Американская семейка - - - Американская семейка - - - Южный парк - - - Детство Шелдона - - - Детство Шелдона - - - Американская семейка - - - Американская семейка - - - Эй, Арнольд! - - - Эй, Арнольд! - - - Котопёс - - - Котопёс - - - Котопёс - - - Котопёс - - - Эй, Арнольд! - - - Друзья, 1-я часть - - - Друзья, 2-я часть - - - Теория большого взрыва - - - Теория большого взрыва - - - Теория большого взрыва - - - Друзья - - - Друзья - - - Детство Шелдона - - - Детство Шелдона - - - Голдберги - - - Голдберги - - - Клиника - - - Друзья, 1-я часть - - - Друзья, 2-я часть - - - Теория большого взрыва - - - Теория большого взрыва - - - Теория большого взрыва - - - Клиника - - - Американская семейка - - - Американская семейка - - - Клиника, 2-я часть - - - Клиника - - - Клиника - - - Детство Шелдона - - - Детство Шелдона - - - Друзья - - - Друзья - - - Голдберги - - - Голдберги - - - Теория большого взрыва - - - Теория большого взрыва - - - Теория большого взрыва - - - Друзья - - - Друзья - - - Клиника, 1-я часть - - - Клиника, 2-я часть - - - Клиника - - - Голдберги - - - Голдберги - - - Южный парк - - - Южный парк - - - Друзья - - - Друзья - - - Стендап от Paramount Comedy - - - Стендап от Paramount Comedy - - - Американская семейка - - - Американская семейка - - - Южный парк - - - Детство Шелдона - - \ No newline at end of file diff --git a/guides/ru/WebGrab++.config.xml b/guides/ru/WebGrab++.config.xml new file mode 100755 index 00000000..49062302 --- /dev/null +++ b/guides/ru/WebGrab++.config.xml @@ -0,0 +1,16 @@ + + + + guide.xml + + rex + Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.130 Safari/537.36 Edg/79.0.309.71 + off + 4 + 0 + f + + 2x2 + Paramount Comedy + + diff --git a/rex/rex.config.xml b/guides/ru/rex/rex.config.xml similarity index 100% rename from rex/rex.config.xml rename to guides/ru/rex/rex.config.xml diff --git a/guides/ru/siteini.pack/tv.yandex.ru.ini b/guides/ru/siteini.pack/tv.yandex.ru.ini new file mode 100755 index 00000000..53566d00 --- /dev/null +++ b/guides/ru/siteini.pack/tv.yandex.ru.ini @@ -0,0 +1,152 @@ +**------------------------------------------------------------------------------------------------ +* @header_start +* WebGrab+Plus ini for grabbing EPG data from TvGuide websites +* @Site: tv.yandex.ru +* @MinSWversion: V1.57 +* @Revision 7 - [18/02/2019] EgiszZ +* - ini fixes based on new web site design (title) +* @Revision 6 - [14/10/2018] FlyGoneCrazy +* - ini fixes based on new web site design +* @Revision 5 - [08/11/2017] Blackbear199 +* - added UA and TR to channels.xml creation +* @Revision 4 - [30/10/2017] Blackbear199 +* - site changes +* @Revision 3 - [05/04/2017] Blackbear199 +* - site changes +* @Revision 2 - [28/07/2016] Blackbear199 +* - title match fix +* @Revision 1 - [25/07/2016] Blackbear199 +* - added subtitle +* - added country +* - added urlchannellogo +* - added showicon +* - rewrote season/episode to version 56.25+ format. +* - set desired output,onscreen(S5 E9/10) or xmltv_ns(4.8/9.) on site{...} line.default onscreen. +* @Revision 0 - [02/03/2016] Blackbear199 +* - creation +* @Remarks: your_remarks +* @header_end +**------------------------------------------------------------------------------------------------ + +*site {loadcookie=cookie_file.txt} +site {url=tv.yandex.ru|timezone=Europe/Moscow|maxdays=6|cultureinfo=ru-RU|charset=UTF-8|titlematchfactor=90} +site {ratingsystem=RU|episodesystem=onscreen} +* +url_index{url|https://tv.yandex.ru/##region##/channels/##channel##?date=|urldate|&period=all-day} +url_index.headers {customheader=Accept-Encoding=gzip,deflate} +urldate.format {datestring|yyyy-MM-dd} +* +scope.range{(urlindex)|end} +global_temp_1.modify {substring(type=regex)|'config_site_id' "^(\d+)##"} +global_temp_2.modify {substring(type=regex)|'config_site_id' "##(\d+)$"} +url_index.modify {replace|##region##|'global_temp_1'} +url_index.modify {replace|##channel##|'global_temp_2'} +end_scope +* +index_urlchannellogo {url(scope=datelogo)|https:||/>} +* +index_showsplit.scrub {multi|"events":[{||}]}|}]}} +index_showsplit.modify {replace|\},\{|\|} +* +index_urlshow {url|https://tv.yandex.ru|"url":"||",|",} +index_urlshow.headers {customheader=Accept-Encoding=gzip,deflate} +* +index_temp_1.scrub {regex||"start":"\d{4}-\d{2}-\d{2}T\d{1,2}:\d{2}:\d{2}([-+]\d{2}:\d{2})"||} +index_start.scrub {regex||"start":"(\d{4}-\d{2}-\d{2}T\d{1,2}:\d{2}:\d{2})[-+]\d{2}:\d{2}"||} +index_stop.scrub {regex||"finish":"(\d{4}-\d{2}-\d{2}T\d{1,2}:\d{2}:\d{2})[-+]\d{2}:\d{2}"||} +*index_title.scrub {(debug)single||||} +index_title.scrub {regex||"finish":"[^"]*"(?:,"liveId":\d*,"yacFamilyId":\d*)?,"title":"(.*?)","||} +index_title.scrub {regex||"finish":"[^"]*"(?:,"yacFamilyId":\d*)?,"title":"(.*?)","||} +*index_title.scrub {single|,"title":"||"|"} +*index_title.scrub {(debug)single|

||

|} +index_subtitle.scrub {single|"episodeTitle":"||","|","} +* +scope.range{(indexshowdetails)|end} +index_start.modify {calculate(format=date,unix)} +index_stop.modify {calculate(format=date,unix)} +index_temp_2.modify {substring(type=char)|'index_temp_1' 0 1} +index_temp_1.modify {remove(type=char)|0 1} +index_temp_1.modify {calculate(format=F0)|3600 *} +index_start.modify {calculate('index_temp_2' "-" format=F0)|'index_start' 'index_temp_1' +} +index_start.modify {calculate('index_temp_2' "+" format=F0)|'index_start' 'index_temp_1' -} +index_stop.modify {calculate('index_temp_2' "-" format=F0)|'index_stop' 'index_temp_1' +} +index_stop.modify {calculate('index_temp_2' "+" format=F0)|'index_stop' 'index_temp_1' -} +index_title.modify {cleanup(style=jsondecode)} +index_title.modify {replace(type=regex)|(.*)(","title":")|} +index_subtitle.modify {clear('index_title')} +index_subtitle.modify {substring(type=regex)|"\s-\s\"(.*?)\""} +* +index_episode.modify {substring(type=regex pattern="Сезон 'S1'. 'E1'/'Et1'""Сезон 'S1'. 'E1'""'E1'/'Et1'""'E1'")|'index_title' "\s((?:Сезон\s\d+\.\s)?(?:\d+-я\s[и-]\s)?\d+-я\sсери[ия])"} +*index_episode.modify {replace|-я и |/} +*index_episode.modify {replace|-я - |/} +*index_episode.modify {remove(type=regex)|-я сери[ия]} +index_title.modify {remove(type=regex)|\.*\s(?:Сезон \d+\.\s)?(?:\d+-я\s[и-]\s)?\d+-я\sсери[ия](?:\s-*\s*\".*?\")?} +* +*index_subtitle.modify {substring(type=regex)|"\s-\s\"(.*?)\""} +index_category.scrub {single|"type":{|"name":"|"|}} +end_scope +* +title.modify {addstart|'index_title'} *index_title and details title often different +title.modify {replace(type=regex)|(.*)(","title":")|} +*description.scrub {(debug)||||} +description.scrub {single||" />} +*description.scrub {(debug)regex||"description":"(.+?)","countries"||} +*description.modify {replace(type=regex)|(","(.*))|} +description.modify {cleanup} +*director.scrub {multi|Режиссёр|||} +director.scrub {multi|Режиссёр|||} +*director.scrub {(debug)regex||Режиссёр(.+?)||} +*actor.scrub {(debug)multi||||} +*actor.scrub {multi|В ролях|||} +actor.scrub {regex||\{"id":\d+,"name":"(.+?)","role":"actor","||} +actor.modify {replace(type=regex)|(.*)(,"name":")|} +*actor.scrub {(debug)multi|"name":"||","role":"actor","|","role":"actor","} +*actor.modify {(debug)regex||"name":"(.+?)","role":"actor","||} +*presenter.scrub {multi|Ведущие|||} +presenter.scrub {multi|Ведущий|itemProp="presenter">||} +rating.scrub {single||||} +rating.modify {cleanup(tags="<"">")} +*rating.scrub {single|class="program-statistics__value">|||} +*starrating.scrub {single|Рейтинг КиноПоиска|">||} +starrating.scrub {single|class="program-statistics__value">|||} +productiondate.scrub {single|Страна и год|class="program-details__text">||} +productiondate.modify {replace(type=regex)|(.*)(, )|} +country.scrub {single|Страна и год|class="program-details__text">||} +country.modify {replace(type=regex)|(, \d{4})|} +showicon.scrub {single|
|')">} +showicon.modify {addstart(not "")|https:} +* +** _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ +** ##### CHANNEL FILE CREATION (only to create the xxx-channel.xml file) +** +** @auto_xml_channel_start +*url_index{url|https://tv.yandex.ru/ajax?params=%5B%7B%22name%22%3A%22i-tv-region%22%2C%22method%22%3A%22get%22%2C%22args%22%3A%7B%22params%22%3A%22%7B%5C%22type%5C%22%3A%5C%22regional%5C%22%2C%5C%22packageIds%5C%22%3A%5B%5D%2C%5C%22limit%5C%22%3A500%2C%5C%22fields%5C%22%3A%5C%22schedules%2Cchannels%2Cfinish%2Cchannel%2Cid%2Ctitle%2Cfavourite%5C%22%2C%5C%22lang%5C%22%3A%5C%22ru%5C%22%7D%22%2C%22cacheKey%22%3A%22channels%3Fparams%3D%7B%5C%22type%5C%22%3A%5C%22regional%5C%22%2C%5C%22packageIds%5C%22%3A%5B%5D%2C%5C%22limit%5C%22%3A500%2C%5C%22fields%5C%22%3A%5B%5C%22schedules%5C%22%2C%5C%22channels%5C%22%2C%5C%22finish%5C%22%2C%5C%22channel%5C%22%2C%5C%22id%5C%22%2C%5C%22title%5C%22%2C%5C%22favourite%5C%22%5D%7D%22%2C%22userRegion%22%3A%22|subpage|%22%2C%22resource%22%3A%22channels%22%2C%22ncrd%22%3A1469479392374%7D%7D%2C%7B%22name%22%3A%22i-tv-region%22%2C%22method%22%3A%22get%22%2C%22args%22%3A%7B%22params%22%3A%22%7B%5C%22type%5C%22%3A%5C%22local%5C%22%2C%5C%22packageIds%5C%22%3A%5B%5D%2C%5C%22limit%5C%22%3A500%2C%5C%22fields%5C%22%3A%5C%22schedules%2Cchannels%2Cfinish%2Cchannel%2Cid%2Ctitle%2Cfavourite%5C%22%2C%5C%22lang%5C%22%3A%5C%22ru%5C%22%7D%22%2C%22cacheKey%22%3A%22channels%3Fparams%3D%7B%5C%22type%5C%22%3A%5C%22local%5C%22%2C%5C%22packageIds%5C%22%3A%5B%5D%2C%5C%22limit%5C%22%3A500%2C%5C%22fields%5C%22%3A%5B%5C%22schedules%5C%22%2C%5C%22channels%5C%22%2C%5C%22finish%5C%22%2C%5C%22channel%5C%22%2C%5C%22id%5C%22%2C%5C%22title%5C%22%2C%5C%22favourite%5C%22%5D%7D%22%2C%22userRegion%22%3A%22|subpage|%22%2C%22resource%22%3A%22channels%22%2C%22ncrd%22%3A1469479392374%7D%7D%2C%7B%22name%22%3A%22i-tv-region%22%2C%22method%22%3A%22get%22%2C%22args%22%3A%7B%22params%22%3A%22%7B%5C%22type%5C%22%3A%5C%22satelite%5C%22%2C%5C%22packageIds%5C%22%3A%5B%5D%2C%5C%22limit%5C%22%3A500%2C%5C%22fields%5C%22%3A%5C%22schedules%2Cchannels%2Cfinish%2Cchannel%2Cid%2Ctitle%2Cfavourite%5C%22%2C%5C%22lang%5C%22%3A%5C%22ru%5C%22%7D%22%2C%22cacheKey%22%3A%22channels%3Fparams%3D%7B%5C%22type%5C%22%3A%5C%22satelite%5C%22%2C%5C%22packageIds%5C%22%3A%5B%5D%2C%5C%22limit%5C%22%3A500%2C%5C%22fields%5C%22%3A%5B%5C%22schedules%5C%22%2C%5C%22channels%5C%22%2C%5C%22finish%5C%22%2C%5C%22channel%5C%22%2C%5C%22id%5C%22%2C%5C%22title%5C%22%2C%5C%22favourite%5C%22%5D%7D%22%2C%22userRegion%22%3A%22|subpage|%22%2C%22resource%22%3A%22channels%22%2C%22ncrd%22%3A1469479392374%7D%7D%5D&sk=42a26daf72c9b3c34a81c144d6a754f0&userRegion=|subpage|&resource=null&ncrd=} +*subpage.format {list|187|213|983} +*index_site_id.scrub {|} +*index_temp_9.scrub {regex||^.*$||} +*index_temp_9.modify {replace|]\}"\}]|\|} +*index_temp_9.modify {remove(type=element)|-1 1} +*scope.range{(channellist)|end} +*index_temp_4.modify {set|187\|213\|983} +*index_temp_3.modify {set|0} +*loop{(each "index_temp_8" in 'index_temp_9')|end} +*index_temp_7.modify {substring(type=element)|'index_temp_4' 'index_temp_3' 1} +*index_temp_6.modify {substring(type=regex)|'index_temp_8' ":(\d+)\}} +*index_temp_5.modify {substring(type=regex)|'index_temp_8' "\\\"title\\\":\\\"(.+?)\\\","} +*index_temp_6.modify {addstart|'index_temp_7'##} +*index_temp_5.modify {addstart('index_temp_7' "187")|UA-} +*index_temp_5.modify {addstart('index_temp_7' "213")|RU-} +*index_temp_5.modify {addstart('index_temp_7' "983")|TR-} +*index_temp_6.modify {replace|\||#_#} +*index_temp_5.modify {replace|\||#_#} +*index_site_id.modify {addend|'index_temp_6'#_#} +*index_site_channel.modify {addend|'index_temp_5'#_#} +*index_temp_3.modify {calculate(format=F0)|1 +} +*end_loop +*index_site_id.modify {replace|#_#|\|} +*index_site_channel.modify {replace|#_#|\|} +*index_site_id.modify {remove(type=element)|-1 1} +*index_site_channel.modify {remove(type=element)|-1 1} +*index_site_id.modify {cleanup(removeduplicates=equal,100 link="index_site_channel")} +*end_scope +** @auto_xml_channel_end diff --git a/hot_cookies.txt b/hot_cookies.txt deleted file mode 100644 index 93020d01..00000000 --- a/hot_cookies.txt +++ /dev/null @@ -1,5 +0,0 @@ -# Hot_Cookies, saved for the purpose of an actual WebGrab run -# Saved by WG++ 09/03/2021 22:37 -# Response cookie from url :https://tv.yandex.ru/channel/paramount-comedy-733?date=2021-03-11&period=all-day - -.yandex.ru FALSE / FALSE 1930858663 yandexuid 870117971615318663 diff --git a/install.sh b/install.sh deleted file mode 100755 index 55fcadc5..00000000 --- a/install.sh +++ /dev/null @@ -1,68 +0,0 @@ -#!/bin/bash - -#/** -# * @file install.sh -# * @brief install/update WebGrab+Plus -# * @author Francis De Paemeleere -# * @date 04/01/2018 -# */ -#---------------------------------------------- -# * V0.02 @ 04/01/2018 -# * - fix relative paths -# * V0.01 @ 05/11/2016 -# * - initial version -#---------------------------------------------- - -#backup the current working dir -WG_BCKP_DIR="$(pwd)" - -quit() { - #restore previous working dir - cd "$WG_BCKP_DIR" - exit $1; -} - -# go the the folder of the script -DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" && pwd )" -cd "$DIR" - - -#check if the siteini.pack.update can be seen -if [ -d "siteini.pack.update" ] -then - if [ -d "siteini.pack" ] - then - echo " ==> update siteini.pack" - rm -rf siteini.pack - mv siteini.pack.update siteini.pack - else - echo " ==> installing siteini.pack" - mv siteini.pack.update siteini.pack - fi -fi - -#check if the WebGrab++.config.example.xml needs to be installed -if [ ! -f "WebGrab++.config.xml" ] -then - echo " ==> installing WebGrab++.config.xml" - cp WebGrab++.config.example.xml WebGrab++.config.xml -fi - -#check if the mdb.config.example.xml needs to be installed -if [ ! -f "mdb/mdb.config.xml" ] -then - echo " ==> installing mdb/mdb.config.xml" - cp mdb/mdb.config.example.xml mdb/mdb.config.xml -fi - -#check if the rex.config.example.xml needs to be installed -if [ ! -f "rex/rex.config.xml" ] -then - echo " ==> installing rex/rex.config.xml" - cp rex/rex.config.example.xml rex/rex.config.xml -fi - -echo " ==> DONE" - - -quit 0; \ No newline at end of file diff --git a/mdb/mdb.config.example.xml b/mdb/mdb.config.example.xml deleted file mode 100755 index 9cefc5f3..00000000 --- a/mdb/mdb.config.example.xml +++ /dev/null @@ -1,206 +0,0 @@ - - - - - - - - - - - - - guide.xml - - - mdb.xml - - - - defaults - defaults - - - defaults - defaults - - - - - content - - the content of the xmltv-target elements can be specified by means of a mixture of text and element-values. - - content can be left empty to remove the xmltv element (except the element ) - - the element-values must be entered by their (wg++) element-name enclosed by ' ' - - optionally, element values can be processed by means of certain operations, - E.g. 'description[cleanup(style=upper), max_sentences=2]' - - optionally, element xmltv attribute values can be added to the content by adding /a (only attribute value) or /a+ (value + attributename) to the 'elementname' - - multiple value elements (like actor) will be converted to single value elements if the xmltv-target element is a single value element, like <desc>. - The individual values will be listed with a (standard WG++ internal element separator character) | as separator unless another separator is specified as follows: -'element-name(separator-string)' e.g. 'actor(, )' or with attribute 'actor/a(, )' - - text and element-names can be linked together by enclosing them by {}. This will ensure that, when the element in it is empty, everything between the {} is - ignored. E.g. {\nProduced in : ('productiondate')} - - the text in the xmltv-target elements may contain the following simple formatting : - - \n or \r to force a newline - - \t to add a tab - -2. The allowed xmltv-target elements (the ones in the target file specified above) are : -- IMPORTANT! : any of the next listed xmltv-target elements that is specified in this allocation specification, replaces the existing xmltv element and -its content! -2.1 'Full' function , these can be added, changed and removed - <title> <sub-title> <desc> <star-rating> <director> <actor> <category> <episode> <icon> - <review> (=optional new xmltv element) -2.2 'Remove/Keep' only, cannot be added, changed, only removed or kept as 'is' - <date> <producer> <writer> <presenter> <composer> <commentator> <rating> <aspect> <quality> <url> <country> - -3. Supported element-names (from the existing xmltv listing, name definitions as in Appendix E of the documentation) to be used as content to expand: - 'title' 'description' 'starrating' 'subtitle' 'productiondate' 'category' 'director' 'actor' 'presenter' 'writer' 'composer' 'producer' 'commentator' 'rating' - 'episode' 'showicon' 'review' 'subtitles' 'premiere' 'previously-shown' 'aspect' 'quality' 'country' 'url' - -4. Attributes - - for each of the xmltv-elements the following attribute can be specified - (if not specified, the existing one, if present in the xmltv, will be used) : - - lang for <title> and <desc> , default : no attribute - - system for <star-rating> , default : no attribute - - type for <review> , default: type="text" - - Existing xmltv attribute values can be added to expanded content. (see above) ]]> - - <!--mdb-starrating correction: -allows to convert the mdb-starrating into a value that suits a media-center starrating display. E.g. , the majority of the IMDb starrating values are between 4 (bad) and 8 (good) in a scale of 10. In a 5 star display system , like the one in MCE, there is too little difference between these values. -The following settings, first subtracts 4 from the grabbed mdb-starrating and multiplies the result by 1.2 with a maximum of 5 . That will convert the values above, in 0 (was 4) and 5 (was 8) - Default values: subtract="0" multiply="1" and max="10"--> - <mdb-starrating subtract="4" multiply="1.2" max="5" /> - - <!--example -The next two lines add mdb-title (if different) as an extra <title> element before the existing one: --> - <title lang="xx">'mdb-title' - 'title' - - {'mdb-title'...}{[plot: 'mdb-plot']\n}'description'{\n[imdb description: 'mdb-description[max_sentences=2]']} - - 'starrating' - 'mdb-starrating' - - - {Viewers comments : 'mdb-commentsummary'} - {IMDb review: 'mdb-review'} - - - Disney Channel - RTL 4 - \ No newline at end of file diff --git a/mdb/mdb.config.xml b/mdb/mdb.config.xml deleted file mode 100755 index 9cefc5f3..00000000 --- a/mdb/mdb.config.xml +++ /dev/null @@ -1,206 +0,0 @@ - - - - - - - - - - - - - guide.xml - - - mdb.xml - - - - defaults - defaults - - - defaults - defaults - - - - - content - - the content of the xmltv-target elements can be specified by means of a mixture of text and element-values. - - content can be left empty to remove the xmltv element (except the element ) - - the element-values must be entered by their (wg++) element-name enclosed by ' ' - - optionally, element values can be processed by means of certain operations, - E.g. 'description[cleanup(style=upper), max_sentences=2]' - - optionally, element xmltv attribute values can be added to the content by adding /a (only attribute value) or /a+ (value + attributename) to the 'elementname' - - multiple value elements (like actor) will be converted to single value elements if the xmltv-target element is a single value element, like <desc>. - The individual values will be listed with a (standard WG++ internal element separator character) | as separator unless another separator is specified as follows: -'element-name(separator-string)' e.g. 'actor(, )' or with attribute 'actor/a(, )' - - text and element-names can be linked together by enclosing them by {}. This will ensure that, when the element in it is empty, everything between the {} is - ignored. E.g. {\nProduced in : ('productiondate')} - - the text in the xmltv-target elements may contain the following simple formatting : - - \n or \r to force a newline - - \t to add a tab - -2. The allowed xmltv-target elements (the ones in the target file specified above) are : -- IMPORTANT! : any of the next listed xmltv-target elements that is specified in this allocation specification, replaces the existing xmltv element and -its content! -2.1 'Full' function , these can be added, changed and removed - <title> <sub-title> <desc> <star-rating> <director> <actor> <category> <episode> <icon> - <review> (=optional new xmltv element) -2.2 'Remove/Keep' only, cannot be added, changed, only removed or kept as 'is' - <date> <producer> <writer> <presenter> <composer> <commentator> <rating> <aspect> <quality> <url> <country> - -3. Supported element-names (from the existing xmltv listing, name definitions as in Appendix E of the documentation) to be used as content to expand: - 'title' 'description' 'starrating' 'subtitle' 'productiondate' 'category' 'director' 'actor' 'presenter' 'writer' 'composer' 'producer' 'commentator' 'rating' - 'episode' 'showicon' 'review' 'subtitles' 'premiere' 'previously-shown' 'aspect' 'quality' 'country' 'url' - -4. Attributes - - for each of the xmltv-elements the following attribute can be specified - (if not specified, the existing one, if present in the xmltv, will be used) : - - lang for <title> and <desc> , default : no attribute - - system for <star-rating> , default : no attribute - - type for <review> , default: type="text" - - Existing xmltv attribute values can be added to expanded content. (see above) ]]> - - <!--mdb-starrating correction: -allows to convert the mdb-starrating into a value that suits a media-center starrating display. E.g. , the majority of the IMDb starrating values are between 4 (bad) and 8 (good) in a scale of 10. In a 5 star display system , like the one in MCE, there is too little difference between these values. -The following settings, first subtracts 4 from the grabbed mdb-starrating and multiplies the result by 1.2 with a maximum of 5 . That will convert the values above, in 0 (was 4) and 5 (was 8) - Default values: subtract="0" multiply="1" and max="10"--> - <mdb-starrating subtract="4" multiply="1.2" max="5" /> - - <!--example -The next two lines add mdb-title (if different) as an extra <title> element before the existing one: --> - <title lang="xx">'mdb-title' - 'title' - - {'mdb-title'...}{[plot: 'mdb-plot']\n}'description'{\n[imdb description: 'mdb-description[max_sentences=2]']} - - 'starrating' - 'mdb-starrating' - - - {Viewers comments : 'mdb-commentsummary'} - {IMDb review: 'mdb-review'} - - - Disney Channel - RTL 4 - \ No newline at end of file diff --git a/rex/rex.config.example.xml b/rex/rex.config.example.xml deleted file mode 100755 index d8bbf072..00000000 --- a/rex/rex.config.example.xml +++ /dev/null @@ -1,171 +0,0 @@ - - - - - - - - - - guide.xml - - - 'description'\n'actor' - The result is the existing 'description', followed by, on a newline, the actor(s) separated by the standard WG++ element separator |. - The result: - This is the original description. - Michael Douglas|Kim Basinger - - You probably don't like the | as separator between the actors, so you specify another separator like this: - 'description'\n'actor(, )' - The result: - This is the original description. - Michael Douglas, Kim Basinger - - You can make this prettier by adding some text to the actors addition: - 'description'\nActors: 'actor(, )'. - The result: - This is the original description. - Actors: Michael Douglas, Kim Basinger. - - A small problem: Suppose the source xmltv show doesn't have any actors, then the result would be not so pretty: - This is the original description. - Actors: . - - To avoid that, the added text can be linked to the element it must be added to, like this: - 'description'{\nActors: 'actor(, )'.} - Result with actors: - This is the original description. - Actors: Michael Douglas, Kim Basinger. - And without actors: - This is the original description. - - An example with some more elements: - 'description'{\n\tYear of production: 'productiondate'.}{\n\tProducer: 'producer(, )'.}{\n\tActors: 'actor(, )'.} - Result: - This is the original description. - Year of production: 2002. - Producer: Steven Spielberg. - Actors: Michael Douglas, Kim Basinger. - - And another one: - {Episode: 'episode'\t}'subtitle' - Result: - Episode: 3.2/12.1 The original subtitle - - You can also remove elements (but not the title!) from the xmltv listing by specifying an empty element, like this: - or simply - This will remove all elements - And this: - - Will remove the element, including all its child elements like , etc. - -Additional options : - -** Operations : optionally to do certain operations on the element value to expand e.g: - These operations must be specified within the ' ' characters that specify the elementname, enclosed by [] and separated by a , e.g. - {Summary: 'description[cleanup(style=upper), max_chars=500]'}{\nActors: 'actor(, )'} - supported operations : - - cleanup with style and tags arguments, - - max_chars, max_words and max_sentences to limit the content data of the expanded element. - -** Xmltv Attributes in content to expand: If the source xmltv element has an attribute, like lang="en" or role="rolename" (in actor) or system="US", - it is possible to add it to the expanded content by add /a (for attribute value only) or /a+ (for attributename and value) to the element name. - This /a or /a+ addition must be added directly after the element name, like 'actor/a' or combined with a custom separator, 'actor/a(, )' - or combined with an operation 'country/a(/)[cleanup(style=lower)]' - Example (assuming the actors role values are provided in the source xmltv file): - 'description'{\n\tYear of production: 'productiondate',}{ Rating: 'rating/a+'.}{\n\tProducer: 'producer(, )'.}{\n\tActors: 'actor/a+(, )'.} - - Result: - This is the original description. - Year of production: 2002, Rating TV-14(system=US). - Producer: Steven Spielberg. - Actors: Michael Douglas(role=The carpenter), Kim Basinger(role=Mary). - -Summary of Content/Values: -1. Syntax -content - - the content of the xmltv-target elements can be specified by means of a mixture of text and element-values. - - content can be left empty to remove the xmltv element (except the element ) - - the element-values must be entered by their (wg++) element-name enclosed by ' ' - - optionally, element values can be processed by means of certain operations, - E.g. 'description[cleanup(style=upper), max_sentences=2]' - - optionally, element xmltv attribute values can be added to the content by adding /a (only attribute value) or /a+ (value + attributename) to the 'elementname' - - multiple value elements (like actor) will be converted to single value elements if the xmltv-target element is a single value element, like <desc>. - The individual values will be listed with a (standard WG++ internal element separator character) | as separator unless another separator is specified as follows: -'element-name(separator-string)' e.g. 'actor(, )' or with attribute 'actor/a(, )' - - text and element-names can be linked together by enclosing them by {}. This will ensure that, when the element in it is empty, everything between the {} is - ignored. E.g. {\nProduced in : ('productiondate')} - - the text in the xmltv-target elements may contain the following simple formatting : - - \n or \r to force a newline - - \t to add a tab - -2. The allowed xmltv-target elements (the ones in the target file specified above) are : -- IMPORTANT! : any of the next listed xmltv-target elements that is specified in this allocation specification, replaces the existing xmltv element and -its content! -2.1 'Full' function , these can be added, changed and removed - <title> <sub-title> <desc> <star-rating> <director> <actor> <category> <episode> <icon> - <review> (=optional new xmltv element) -2.2 'Remove/Keep' only, cannot be added, changed, only removed or kept as 'is' - <date> <producer> <writer> <presenter> <composer> <commentator> <rating> <aspect> <quality> <url> <country> - -3. Supported element-names (from the existing xmltv listing, name definitions as in Appendix E of the documentation) to be used as content to expand: - 'title' 'description' 'starrating' 'subtitle' 'productiondate' 'category' 'director' 'actor' 'presenter' 'writer' 'composer' 'producer' 'commentator' 'rating' - 'episode' 'showicon' 'review' 'subtitles' 'premiere' 'previously-shown' 'aspect' 'quality' 'country' 'url' - -4. Attributes - - for each of the xmltv-elements the following attribute can be specified - (if not specified, the existing one, if present in the xmltv, will be used) : - - lang for <title> and <desc> , default : no attribute - - system for <star-rating> , default : no attribute - - type for <review> , default: type="text" - - Existing xmltv attribute values can be added to expanded content. (see above) - ]]> - <!-- examples--> - <sub-title>{Episode: 'episode' }'subtitle'</sub-title> - <desc>'description[max_words=100]'{\n\t¤ Produced in: 'productiondate'. }{¤ Category: 'category(, )'. }{\n\t¤ Actors: 'actor/a+(, )'}{\n\t¤ Director: 'director(, )'}{\n\t¤ Presenter: 'presenter(, )'}</desc> - <credits></credits> - <episode-num></episode-num> - <date></date> - <category></category> - <review>{Ratings: 'rating(, )'.}</review> - <rating></rating> -</settings> \ No newline at end of file diff --git a/robots/epg.i-cable.com.robots b/robots/epg.i-cable.com.robots deleted file mode 100644 index f5f416f8..00000000 --- a/robots/epg.i-cable.com.robots +++ /dev/null @@ -1,5 +0,0 @@ -# No data! -# Dummy robots-data created by WebGrab+Plus: - -User-agent: * -Disallow: diff --git a/robots/tv.yandex.ru.robots b/robots/tv.yandex.ru.robots deleted file mode 100644 index 3e2c3676..00000000 --- a/robots/tv.yandex.ru.robots +++ /dev/null @@ -1,12 +0,0 @@ -User-agent: * -Disallow: /*/search$ -Disallow: /search$ -Disallow: /*/search?*text -Disallow: /search?*text -Disallow: /*/my/favorites -Disallow: /my/favorites -Clean-param: eventId /program/* -Clean-param: eventId /*/program/* -Sitemap: https://tv.yandex.ru/sitemap.xml -Host: https://tv.yandex.ru -