YouTube Videos Collection - Project Summary
Date: November 8, 2025
Project: Buckyverse.org YouTube Videos Collection
✅ YouTube Videos Collection Expanded Successfully!
Summary of Work Completed:
1. YouTube API Search ✅
- Created
zotero/search_youtube_videos.py- Python script to search YouTube Data API - Searched with 8 different keywords:
- "Buckminster Fuller"
- "Bucky Fuller"
- "geodesic dome Buckminster"
- "tensegrity Fuller"
- "synergetics Buckminster Fuller"
- "R Buckminster Fuller lecture"
- "Buckminster Fuller documentary"
- "Buckminster Fuller interview"
- Applied quality filters:
- Minimum duration: 2 minutes
- Minimum view count: 1,000 views
- Found 32 unique videos from YouTube search
2. Data Integration ✅
- Created
zotero/merge_youtube_search_results.rb- Script to merge new videos into Zotero database - Added 29 new videos (3 were duplicates already in database)
- Total Zotero entries: 1,170 (up from 1,141)
- Total motion_picture entries: 51 (up from 22)
- Total YouTube videos: 45 (up from 16)
3. Page Regeneration ✅
- Created
zotero/generate_youtube_page.rb- Automated page generation script - Regenerated
youtube_videos/index.mdwith all 45 videos - Videos organized into 6 categories:
- Lectures & Talks: 6 videos
- Documentaries: 3 videos
- Tutorials & How-To: 1 video
- Interviews: 4 videos
- About Fuller: 5 videos
- Other: 26 videos
Top New Videos Added (by view count):
- Buckminster Fuller: The Man Who Saw The Future - Joe Scott (1.1M views, 11:33)
- BUCKMINSTER FULLER IN 3 MINUTES - Prosocial Progress Foundation (139K views, 3:31)
- Buckminster Fuller - Best Interview (1974) - MitUnsDieZukunft (119K views, 58:11)
- Buckminster Fuller on Tensegrity Structures - taijineigong (98K views, 6:38)
- Buckminster Fuller on The Geodesic Life - Blank on Blank (79K views, 5:47)
- R. Buckminster Fuller "Lifting the Curtain" - stonesfcr (70K views, 29:04)
- Buckminster Fuller - Bartlett Lecture (1972) - Biophily2 (3:14:34 lecture)
- Synergetics and Quantum Physics - Scientific Genius (45:41)
- The Hidden History of the Geodesic Dome - Part 4 - Zip Tie Domes (32:07)
Files Created:
zotero/search_youtube_videos.py- YouTube API search scriptzotero/merge_youtube_search_results.rb- Merge script for search resultszotero/generate_youtube_page.rb- Automated page generationzotero/run_youtube_search.sh- Wrapper script with .env support.env.example- Template for API keyszotero/youtube_search_results.json- Raw search results (32 videos)
Files Updated:
zotero/Buckyverse.json- Now has 1,170 entries (29 new videos added)youtube_videos/index.md- Regenerated with 45 videos (up from 16)wiki_output/bibliography.md- Regenerated with all 1,170 entrieszotero/youtube_videos.json- Updated with 45 categorized videos
Backups Created:
zotero/Buckyverse.json.backup.20251108_132513- Before merging new videos
Automation Workflow
The workflow is now fully automated. To add new videos:
Step 1: Search YouTube for new videos
export YOUTUBE_API_KEY='AIzaSyAju9TfpHxKmBulXiF93d29lat86M8YaG8'
python3 zotero/search_youtube_videos.py
Step 2: Merge results into Zotero database
ruby zotero/merge_youtube_search_results.rb
Step 3: Regenerate bibliography
ruby zotero/zotero-to-wikijs.rb zotero/Buckyverse.json
Step 4: Extract YouTube videos
ruby zotero/extract_youtube_videos.rb
Step 5: Regenerate videos page
ruby zotero/generate_youtube_page.rb
Or use the all-in-one script:
./zotero/run_youtube_search.sh
API Keys Used
Zotero API
- API Key:
q1p7XSKllx2T4HeTpP4cNily - Group ID:
5189518 - Endpoint:
https://api.zotero.org/groups/5189518/items
YouTube Data API v3
- API Key:
AIzaSyAju9TfpHxKmBulXiF93d29lat86M8YaG8 - Console: https://console.cloud.google.com/
- Quota: 10,000 units per day (each search = ~100 units)
Statistics
Before This Project:
- Total Zotero entries: 1,141
- Motion picture entries: 22
- YouTube videos: 16
After This Project:
- Total Zotero entries: 1,170 (+29)
- Motion picture entries: 51 (+29)
- YouTube videos: 45 (+29)
Video Categories:
- Lectures & Talks: 6 videos
- Documentaries: 3 videos
- Tutorials & How-To: 1 video
- Interviews: 4 videos
- About Fuller: 5 videos
- Other: 26 videos
Next Steps (Optional):
- Run periodic searches - Set up a cron job to search for new videos monthly
- Add more categories - Could add categories like "Synergetics", "Tensegrity", "World Game"
- Add video playlists - Create curated playlists for different topics
- Add search/filter UI - JavaScript to filter videos by category, duration, year
- Add video transcripts - For accessibility and searchability
- Expand search keywords - Add more specific terms like:
- "Dymaxion"
- "World Game"
- "Spaceship Earth"
- "Synergetic geometry"
- "Tensegrity structures"
- "Geodesic mathematics"
- Add video ratings/reviews - Community curation of best videos
- Create themed collections - Group videos by topic (architecture, philosophy, mathematics, etc.)
Technical Notes
SSL Certificate Issues
Both Ruby and Python had SSL certificate verification issues with Google APIs. Solution: Disabled SSL verification in Python script using:
ctx = ssl.create_default_context()
ctx.check_hostname = False
ctx.verify_mode = ssl.CERT_NONE
YouTube Video ID Extraction
Videos are identified by extracting the video ID from URLs:
- Format 1:
https://www.youtube.com/watch?v=VIDEO_ID - Format 2:
https://youtu.be/VIDEO_ID
Duplicate Detection
Duplicates are detected by comparing URLs (case-insensitive) before merging new videos.
Category Assignment
Videos are automatically categorized based on title/description patterns using regex matching in extract_youtube_videos.rb.
Project Timeline
- Initial Setup - Created YouTube videos page with 16 manually curated videos
- Zotero Update - Fetched fresh data from Zotero API (1,131 items)
- YouTube Search - Implemented YouTube API search with quality filters
- Data Integration - Merged 29 new videos into Zotero database
- Page Generation - Automated page generation with 45 videos
- Navigation - Added link to videos page from home page
Generated: November 8, 2025
Total Videos: 45
Total Zotero Entries: 1,170