Benjamin_Loison/YouTube_captions_search_engine
Benjamin_Loison/YouTube_captions_search_engine
1
0
Fork 0
Code Issues 16 Pull Requests Packages Projects Releases 2 Wiki Activity

Use YouTube Data API v3 to detect which captions need to be downloaded to reduce the workload of yt-dlp #5

New Issue
Closed
opened 2022-12-30 16:08:41 +01:00 by Benjamin_Loison · 1 comment
Benjamin_Loison commented 2022-12-30 16:08:41 +01:00
Owner
Copy Link

For instance o8NPllzkFhE has English auto-generated and not auto-generated captions but also not auto-generated captions for many other languages.

Thanks to YouTube Data API v3 Captions: list endpoint which doesn't require OAuth,

https://yt.lemnoslife.com/noKey/captions?part=snippet&videoId=o8NPllzkFhE

returns:

{
  "kind": "youtube#captionListResponse",
  "etag": "eZ4pML3jCdSxjPCRhyWvH7nMa0s",
  "items": [
    {
      "kind": "youtube#caption",
      "etag": "7raZhEYvFCS9MwLKOjW5pPF7BXw",
      "id": "AUieDaZ8x9nwAN2cK8895ywCcmz49iZctbG81Ovocmgg",
      "snippet": {
        "videoId": "o8NPllzkFhE",
        "lastUpdated": "2017-10-26T05:13:24.943773Z",
        "trackKind": "standard",
        "language": "ar",
        "name": "",
        "audioTrackType": "unknown",
        "isCC": false,
        "isLarge": false,
        "isEasyReader": false,
        "isDraft": false,
        "isAutoSynced": false,
        "status": "serving"
      }
    },
    {
      "kind": "youtube#caption",
      "etag": "a9DNn3s5o6I3tZil9nKEB3_5s3I",
      "id": "AUieDabxfZrqqConqQVjbMhVHuONncnqo1SgXpm4OTqYcsQkTws",
      "snippet": {
        "videoId": "o8NPllzkFhE",
        "lastUpdated": "2021-04-30T16:37:45.813712Z",
        "trackKind": "asr",
        "language": "en",
        "name": "",
        "audioTrackType": "unknown",
        "isCC": false,
        "isLarge": false,
        "isEasyReader": false,
        "isDraft": false,
        "isAutoSynced": false,
        "status": "serving"
      }
    },
    {
      "kind": "youtube#caption",
      "etag": "THUyFxy089bEVfTO6JmdVWFJeAA",
      "id": "AUieDaZMBT1mc642LsRsrYydeiGxuwKAwVSpfMdpC4gt",
      "snippet": {
        "videoId": "o8NPllzkFhE",
        "lastUpdated": "2019-02-14T09:02:01.320387Z",
        "trackKind": "standard",
        "language": "az",
        "name": "",
        "audioTrackType": "unknown",
        "isCC": false,
        "isLarge": false,
        "isEasyReader": false,
        "isDraft": false,
        "isAutoSynced": false,
        "status": "serving"
      }
    },
    ...
    {
      "kind": "youtube#caption",
      "etag": "6u0rriJpLf0dsEnjugXsIs9ufBM",
      "id": "AUieDaY2-og3KCf7oqT1nncb16x940K6tzRwPrRtcMS0",
      "snippet": {
        "videoId": "o8NPllzkFhE",
        "lastUpdated": "2017-10-26T05:13:18.669212Z",
        "trackKind": "standard",
        "language": "el",
        "name": "",
        "audioTrackType": "unknown",
        "isCC": false,
        "isLarge": false,
        "isEasyReader": false,
        "isDraft": false,
        "isAutoSynced": false,
        "status": "serving"
      }
    },
    {
      "kind": "youtube#caption",
      "etag": "yLecM9KX8sogzUO9VzEWdjmhmiM",
      "id": "AUieDaZmxwhOXO_ARX5Fp8wdMdywZ1O1sJ0hNMaio4rP",
      "snippet": {
        "videoId": "o8NPllzkFhE",
        "lastUpdated": "2017-10-26T05:13:19.881248Z",
        "trackKind": "standard",
        "language": "en",
        "name": "",
        "audioTrackType": "unknown",
        "isCC": false,
        "isLarge": false,
        "isEasyReader": false,
        "isDraft": false,
        "isAutoSynced": false,
        "status": "serving"
      }
    },
    {
      "kind": "youtube#caption",
      "etag": "Uci5L1ZlTCig74h4nbYhK5OsSZc",
      "id": "AUieDaYLhf7na1htIkpqWVtX2kr--Thh189LgRbND4A6",
      "snippet": {
        "videoId": "o8NPllzkFhE",
        "lastUpdated": "2017-10-26T05:13:28.525599Z",
        "trackKind": "standard",
        "language": "es",
        "name": "",
        "audioTrackType": "unknown",
        "isCC": false,
        "isLarge": false,
        "isEasyReader": false,
        "isDraft": false,
        "isAutoSynced": false,
        "status": "serving"
      }
    },
    ...
  ]
}
For instance [`o8NPllzkFhE`](https://www.youtube.com/watch?v=o8NPllzkFhE) has English auto-generated and not auto-generated captions but also not auto-generated captions for many other languages. Thanks to YouTube Data API v3 [Captions: list](https://developers.google.com/youtube/v3/docs/captions/list) endpoint which doesn't require OAuth, https://yt.lemnoslife.com/noKey/captions?part=snippet&videoId=o8NPllzkFhE returns: ```json { "kind": "youtube#captionListResponse", "etag": "eZ4pML3jCdSxjPCRhyWvH7nMa0s", "items": [ { "kind": "youtube#caption", "etag": "7raZhEYvFCS9MwLKOjW5pPF7BXw", "id": "AUieDaZ8x9nwAN2cK8895ywCcmz49iZctbG81Ovocmgg", "snippet": { "videoId": "o8NPllzkFhE", "lastUpdated": "2017-10-26T05:13:24.943773Z", "trackKind": "standard", "language": "ar", "name": "", "audioTrackType": "unknown", "isCC": false, "isLarge": false, "isEasyReader": false, "isDraft": false, "isAutoSynced": false, "status": "serving" } }, { "kind": "youtube#caption", "etag": "a9DNn3s5o6I3tZil9nKEB3_5s3I", "id": "AUieDabxfZrqqConqQVjbMhVHuONncnqo1SgXpm4OTqYcsQkTws", "snippet": { "videoId": "o8NPllzkFhE", "lastUpdated": "2021-04-30T16:37:45.813712Z", "trackKind": "asr", "language": "en", "name": "", "audioTrackType": "unknown", "isCC": false, "isLarge": false, "isEasyReader": false, "isDraft": false, "isAutoSynced": false, "status": "serving" } }, { "kind": "youtube#caption", "etag": "THUyFxy089bEVfTO6JmdVWFJeAA", "id": "AUieDaZMBT1mc642LsRsrYydeiGxuwKAwVSpfMdpC4gt", "snippet": { "videoId": "o8NPllzkFhE", "lastUpdated": "2019-02-14T09:02:01.320387Z", "trackKind": "standard", "language": "az", "name": "", "audioTrackType": "unknown", "isCC": false, "isLarge": false, "isEasyReader": false, "isDraft": false, "isAutoSynced": false, "status": "serving" } }, ... { "kind": "youtube#caption", "etag": "6u0rriJpLf0dsEnjugXsIs9ufBM", "id": "AUieDaY2-og3KCf7oqT1nncb16x940K6tzRwPrRtcMS0", "snippet": { "videoId": "o8NPllzkFhE", "lastUpdated": "2017-10-26T05:13:18.669212Z", "trackKind": "standard", "language": "el", "name": "", "audioTrackType": "unknown", "isCC": false, "isLarge": false, "isEasyReader": false, "isDraft": false, "isAutoSynced": false, "status": "serving" } }, { "kind": "youtube#caption", "etag": "yLecM9KX8sogzUO9VzEWdjmhmiM", "id": "AUieDaZmxwhOXO_ARX5Fp8wdMdywZ1O1sJ0hNMaio4rP", "snippet": { "videoId": "o8NPllzkFhE", "lastUpdated": "2017-10-26T05:13:19.881248Z", "trackKind": "standard", "language": "en", "name": "", "audioTrackType": "unknown", "isCC": false, "isLarge": false, "isEasyReader": false, "isDraft": false, "isAutoSynced": false, "status": "serving" } }, { "kind": "youtube#caption", "etag": "Uci5L1ZlTCig74h4nbYhK5OsSZc", "id": "AUieDaYLhf7na1htIkpqWVtX2kr--Thh189LgRbND4A6", "snippet": { "videoId": "o8NPllzkFhE", "lastUpdated": "2017-10-26T05:13:28.525599Z", "trackKind": "standard", "language": "es", "name": "", "audioTrackType": "unknown", "isCC": false, "isLarge": false, "isEasyReader": false, "isDraft": false, "isAutoSynced": false, "status": "serving" } }, ... ] } ```
Benjamin_Loison added the
medium
 label 2023-01-06 18:50:46 +01:00
Benjamin_Loison added the
enhancement
 label 2023-01-06 18:52:52 +01:00
Benjamin_Loison added the
high priority
 label 2023-01-06 19:33:33 +01:00
Benjamin_Loison added the
captions
 label 2023-01-14 15:29:26 +01:00
Benjamin_Loison commented 2023-02-10 17:09:28 +01:00
Author
Owner
Copy Link

As we completely rely on yt-dlp, we don't have to bother with this optimization aspect, at least for the moment.

As [we completely rely on `yt-dlp`](https://gitea.lemnoslife.com/Benjamin_Loison/YouTube_captions_search_engine/wiki/Project-proposal#technical-details), we don't have to bother with this optimization aspect, at least for the moment.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
bug
Something isn't working.
captions
Related to retrieving captions.
discussion
The task has to be more precisely scoped or the task is waiting details.
enhancement
New feature or request.
epic
A task that is going to take more than a day to complete.
high priority
Issue disabling the user to use correctly the tool.
low priority
Nice to have feature.
medium
A task that should take less than a day to complete.
medium priority
A high-priority issue noticeable by the user but he can still workaround it.
quick
A task that should take less than two hours to complete.
security
Related to security properties that we want.
waiting presentation
Need to be reconsidered before presenting this project. No more relevant, as the presentation took place on February 17, 2023.
website
Related to the end-user website.
youtube-operational-api
Related with YouTube operational API.
No Label
captions
enhancement
high priority
medium
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Benjamin_Loison/YouTube_captions_search_engine#5
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?