🚨🚨 Omarchy Automation Investigation (Building Custom Harness) 🚨🚨

The PrimeTime
02:35:06 Summary & quotes Report Issue
Loading transcript... Click for full transcript
About this episode The host builds 'Oligarchy,' an automated testing harness for the Omarchy Linux distribution, using AI agents … AI summary

The host builds 'Oligarchy,' an automated testing harness for the Omarchy Linux distribution, using AI agents to drive virtual machines and verify system stability. The project integrates KVM, PlanetScale for logging, and Linear for task management, highlighting the high token costs and debugging challenges of 'vibe coding' complex systems.

Key takeaways 5
  • The host developed a custom testing framework named 'Oligarchy' (a play on Omarchy and oligarchy) to automate the testing of the Omarchy Linux ISO using AI agents.
  • The architecture uses a proxy server to manage multiple KVM instances, storing all logs, desktop images, and test results in a PlanetScale (PostgreSQL) database for remote monitoring.
  • Vibe coding with LLMs incurs significant token costs; the host noted spending 2.8 billion tokens on a previous project and observed high usage during this session, leading to a preference for Grok over Claude for speed.
  • The host prefers immediate mode GUIs and CLI/Vim-based workflows over traditional desktop websites, aiming to control the testing harness via mobile or terminal.
  • Linear is used as the central controller for test tickets, allowing AI agents to pick up tasks, update statuses (backlog, in progress, done), and report results.
Notable quotes 4 AI-generated: wording and quote attribution may be wrong. Use the play link to verify.
  • “I don't think anybody has any care how it's done... I don't think we have to live this life? Like, damn you live this way? Is this who you are?”
    ▶ 1:12:26 Frustration with an AI agent creating unnecessary 'token' fields instead of using existing UUIDs in the database schema.
  • “If you're only a proxy for the LLM, you literally offer nothing more to the employer than anybody else. Why hire you when you can hire anybody else?”
    ▶ 1:21:55 Argument that developers must understand the underlying software architecture to effectively use AI coding tools.
  • “I prefer to use the model that's committed the most felonies. I think that's a good way to measure it.”
    ▶ 1:45:15 Humorous justification for preferring Grok over other models due to its speed and history of controversies.
  • “The custom harness is that I can kind of really set up all the things... it's not the agent itself. It's all the things you wrap around it to make it do a task.”
    ▶ 2:14:26 Defining the concept of a 'custom harness' in the context of AI agent orchestration.

Chapters & Sections (64)

0:00 Omarchy Automation and Screenplay Development chapter 4
1:54 Omarchy Testing and Cloudflare Discussion
3:50 Terminal UI Animation and Vector Actions
5:22 Video Style and Terminal Aesthetics
6:50 Early 2000s Video Game Bugs
8:18 Software Evolution and AI Development Setup chapter 2
10:17 Industry Frustrations and Creator Ethics
11:53 AI Skill Setup and Collaboration
16:04 Omarchy Automation Investigation and Project Naming chapter 5
18:51 Jippity Cursor Ban Reaction and Project Naming
20:21 Oligarchy Naming and Funding Controversy
21:57 Kick vs Twitch and Linux Excitement
23:42 Mobile and Vim Workflow Preferences
26:06 AI Coding Tools and Phone Discussion
27:25 Omarchy Automation Proxy Architecture and Planet Scale Integration chapter 1
30:32 Planet Scale Commercial and Sponsorship Discussion
32:54 Omarchy Automation Harness Setup chapter 3
34:58 Grok Schema Usage and Sentry Error Reporting
37:00 ISO Caching and Local Database Setup
38:41 Test Definitions and Linear Integration
42:42 Automated UI Testing with AI Agents chapter
50:34 Setting Up API Tokens and Teams chapter 2
52:32 Creating Team and Configuring API Tokens
55:17 Critiquing Crypto Scam Victim Blame
57:08 Automating Linear Ticket Creation with AI chapter 1
1:00:22 Cursor Token Misuse and Security Concerns
1:02:42 Omarchy Security Investigation and Linux Community Reaction chapter 1
1:05:05 Debugging Test Run ID and Token Confusion
1:08:37 Debugging Test Run Token and UUID Design chapter 3
1:11:17 Critique of Token vs UUID Design
1:13:04 UUID Auto-Generation and Drizzle Migrations
1:15:30 Chat Moderation and Ban Avoidance
1:18:49 Token Costs and Vibe Coding Joy chapter 2
1:21:40 Value of Technical Understanding in Automation
1:23:32 Custom Component Interfaces and Scene Editing
1:25:36 AI Arg Parser and Linear Ticket Automation chapter 2
1:28:42 Generalized Arg Parser and Linear Ticket Logic
1:30:40 Effect CLI and Linear Ticket Logic
1:32:21 Guessing the YouTuber Who Rides in Rolls-Royce chapter 2
1:34:24 Guessing the Mystery YouTuber
1:36:07 Identifying YouTubers and Personal Connections
1:37:33 Guessing Game and Database Debugging chapter 1
1:39:26 Database Query Debugging and Error Analysis
1:43:08 Comparing LLM Models for Code Generation chapter 2
1:45:06 LLM Code Generation Workflow and Model Selection
1:47:09 Fable Token Cost and Performance Issues
1:49:15 Omarchy Automation and Linear vs Jira chapter 2
1:51:51 Linear Speed and Automation Potential
1:53:48 Jira Pain and AI Design Strategies
1:57:03 Coding Language Preferences and MCP Debate chapter 1
2:00:56 Local Execution and MCP Utility
2:04:09 CLI Ticket Labeling and MCP Discussion chapter 2
2:05:45 MCP Evaluation and Agent Workflows
2:07:18 Local Testing Setup and Stream Planning
2:08:46 Automating Linear Tickets with Custom Harness chapter 1
2:11:30 Debugging Oligarchy Term.sh and ISO Downloads
2:14:40 Agent Automation Testing and Handwriting Banter chapter 2
2:17:27 High School Banter and System Testing
2:19:40 Agent Token Usage and Client Communication
2:21:17 Building Custom AI Harnesses chapter 1
2:24:47 Custom AI Harness Lessons
2:27:40 Anthropic Fable Model Versions and Cost Analysis chapter 2
2:30:38 Anthropic Bribery Joke and Model Versions
2:32:39 Ethics of Paying Silence on AI Companies

Transcript

Loading transcript...