Benjamin_Loison commented on issue Benjamin_Loison/YouTube_captions_search_engine#11 2023-01-22 16:12:04 +01:00
Current algorithm doesn't check all channel tabs

Treated @LeParisien livestreams:

  • in 1 hour and 15 minutes
  • to discover 29,650 channels
  • to treat about 261,000 comments (with 134,338…
4e162e34c3 Add comment in README.md about the usage of --no-keys or generating a YouTube Data API v3 key
10e8811817 Introduce {,MAIN_}EXIT_WITH_ERROR macros for exitting with an error
0f15bb0235 #11: Add the discovering of channels having commented on ended livestreams
Compare 2 commits »
bdb4e6443a #11: Add current livestreams support to discover channels
d2391e5d54 Instead of looping on items where we expect only one to be, we just use items[0]
993d0b9771 Make PRINT not requiring to precise threadId
0fcb5a0426 #11: Treat COMMUNITY post comments to discover channels
Benjamin_Loison commented on issue Benjamin_Loison/YouTube_captions_search_engine#29 2023-01-21 22:25:51 +01:00
Could add executable arguments to restrict the discovery on different methods

I don't know how to easily make the end-user able to configure which features are used, as there are quite a few.

57200da482 Add in README.md the fact that as documented in #30, this algorithm is only known to be working fin on Linux
Benjamin_Loison opened issue Benjamin_Loison/YouTube_captions_search_engine#30 2023-01-21 22:19:28 +01:00
Make the compression mechanism inter-OS compatible
Benjamin_Loison opened issue Benjamin_Loison/YouTube_captions_search_engine#29 2023-01-21 22:11:29 +01:00
Could add executable arguments to restrict the discovery on different methods
a0880c79bb #11: Update channel CHANNELS tab treatment following YouTube-operational-API/issues/121 closure
40e0b35940 Update channel CHANNELS tab treatment following YouTube-operational-API/issues/121 closure
Benjamin_Loison commented on issue Benjamin_Loison/YouTube_captions_search_engine#7 2023-01-16 15:46:04 +01:00
Add multi-threading

Previous commit removes the bug of having following output when doing:

unzip -l UCWeg2Pkate69NFdBeuRFTAw.zip
   147928  2023-01-14 10:15   99997.json
   ...
---------     …
Benjamin_Loison commented on issue Benjamin_Loison/YouTube_captions_search_engine#11 2023-01-15 15:27:17 +01:00
Current algorithm doesn't check all channel tabs

Note that we could also give a try to YouTube Data API v3 endpoints Search: list with relatedToVideoId filter and Videos: list with part=suggestions using OAuth (note that it is maybe to some…

Benjamin_Loison opened issue Benjamin_Loison/YouTube_captions_search_engine#28 2023-01-15 15:01:23 +01:00
Make this algorithm able to completely treat the YouTube graph
10c5c1d605 #11: Add the treatment of channels' tab, but only postpone unlisted videos treatment
Benjamin_Loison commented on issue Benjamin_Loison/YouTube_captions_search_engine#11 2023-01-15 14:37:09 +01:00
Current algorithm doesn't check all channel tabs

Note that we could find even more channels/videos by analyzing user messages etc however as we don't have any guarantee that a message contains a channel or a video, we don't treat them. So we…

51a70f6e54 #7: Make commentsCount and requestsPerChannel compatible with multithreading
2ff8234009 #7: Make commentsCount and requestsPerChannel compatible with multithreading