Live: Kicking it with RTX 6000 Blackwell. 600 watts, 96gb ram

Level1Techs
04:10:26 Report Issue
Loading transcript... Click for full transcript

Chapters & Sections (220)

0:01 Introduction and Card Overview chapter
4:13 Introduction and Overview of the Blackwell RTX 6000 chapter
5:14 Discussion on Quadro Sync, DisplayPort, and PCIe Gen 5 chapter
6:17 Comparison of Systems and Performance Benchmarks chapter
8:56 Discussion on Windows Subsystem for Linux and GPU Performance chapter
9:29 GPU Comparison and Performance Analysis chapter
10:01 Geekbench Submission and GPU Discussion chapter
11:04 GPU Comparison and Performance Analysis (Continued) chapter
13:21 Windows Update and GPU Discussion chapter
15:32 Power Supply Discussion chapter 3
15:32 Initial Power Supply Considerations
16:46 GPU Installation and Troubleshooting
18:25 Power Supply Design and Features
20:29 GPU and Performance Testing chapter 1
21:01 GPU Performance Testing with Blender
22:04 GPU Benchmarking and Power Supply Discussion chapter 5
22:04 Benchmarks and Comparison with Previous Results
23:14 Power Supply Options and SMB Bus Connection
24:15 Discussion on Electrical Standards and Variations
25:17 LM Studio and Linux Compatibility
27:11 Microsoft's Hash Verification Process and Latency Issues
28:17 Discussion on DeepSec R1 and Benchmarking chapter 4
28:17 Incorrect benchmarking of DeepSec R1 in BF-16
28:48 Native Q8 and GPU Performance
29:18 Distilled Model and Large File Size
31:01 Discussion on Harbor Info 64 and Temperature Issues
31:30 Troubleshooting and Open CL Benchmark chapter 1
32:08 Troubleshooting Windows Issues and Open CL Benchmark
34:54 GPU Performance and Cyberpunk Benchmark chapter 6
34:54 Prediction on GPU Performance and Secondhand Prices
35:25 Discussion on ADA Secondhand Prices and Cyberpunk Benchmark
36:38 Troubleshooting Steam Issues and Running Cyberpunk
37:09 Temperature Monitoring and Red Launcher Issues
38:16 Error 43 Solution for Video Card and Audio Driver
39:18 Rateracing Ultra Preset and GPU Performance for LLM
40:57 PCIe 5.0 x4 and GPU Performance chapter
41:27 Workstation CPU and VRAM Comparison chapter
42:00 Technical Issues and Troubleshooting chapter
44:11 Power Consumption and GPU Temperature chapter
45:12 GPD Live Stream and Blender Test chapter
47:30 Discussion about AI, Models, and Hardware chapter 5
47:30 AI Model Download Issues and Performance Concerns
48:41 Blender Scores, Competex, and Personal Plans
49:45 AMD GPU and Water Block Discussion
50:16 AI Knowledge Gaps, Research, and Learning
51:19 Future of AI Models and Hardware
51:51 Introduction and Initial Discussion chapter 3
51:51 Excitement and Potential Concerns
52:23 Coupon Codes and HBM Customization
53:26 Mounting Bracket and Adapter Discussion
54:31 Technical Details and Benchmarks chapter 1
55:02 Benchmarks and Comparison to H100
56:04 Nvidia RTX 6000 Performance and Features chapter 3
56:04 Comparison to ADA Generation and Abuntu Switching Issues
57:07 Nvidia Inferencing Microservices (NIMS) and Cloud Compute
59:14 Gen 5 PCIe Switches and DJX Station Review
01:00:15 RDMA and Switch Recommendations chapter 3
01:00:15 RDMA and Switch Options
01:01:18 Comparison of RDMA Chipsets
01:02:19 GPU Options for AI Workloads
1:03:51 Model Loading and Troubleshooting chapter 1
1:03:51 Initial Model Loading Issues
1:05:26 GPU Memory and Performance Issues chapter 2
1:05:26 VRAM and GPU Memory Concerns
1:06:32 Windows Issues and Workarounds
1:09:05 Model Regeneration and Optimization chapter 2
1:09:05 Model Regeneration and Optimization
1:12:08 AI-Generated Code and Math PhD Insights
1:13:53 Python Loop and Student Feedback chapter
1:15:31 GPU Performance and Task Manager chapter
1:16:36 Storage and PCIe Gen 4 chapter
1:18:30 GPU Swap and Booting Up chapter
1:20:18 Geekbench and Model Download chapter
1:22:06 Discussion on Drive Storage and Geekbench chapter 4
1:22:06 Question on Drive Storage and Geekbench Installation
1:23:28 Geekbench Score Analysis
1:24:55 Model Directory and Geekbench Run
1:25:35 Cyberpunk Benchmarking and Comparison
1:26:56 Cyberpunk Benchmarking and Path Tracing chapter 2
1:28:39 Path Tracing and Ray Tracing Discussion
1:30:18 Comparison of Path Tracing Results
1:31:51 Discussion on DLSS Performance chapter 5
1:31:51 Auto Resolution Scaling and Frame Generation
1:32:25 Frame Tearing and Capture Issues
1:32:56 Deep Learning and Context Window Optimization
1:33:31 Cinematic Performance and Frame Tearing
1:34:14 AI Experiments and Rerunning the Blender Benchmark
1:34:45 Blender Benchmark and AI Experiments chapter 2
1:34:45 Blender Optimization and Linux Compatibility
1:35:15 Perfect Numbers and AI Reasoning
1:36:48 Discussion on Perfect Numbers and Model Sophistication chapter 5
1:36:48 Model Training and Optimization for Perfect Numbers
1:37:19 Benchmarking Model Sophistication and Information Organization
1:37:51 GPU Discussion and VGPU on Linux
1:38:21 Blender Optimization and GPU Subdivision
1:39:23 GPU Comparison and Linux Testing
1:41:34 Home Automation with Home Assistant chapter 4
1:41:34 Parameter Model and Intent Filtering
1:42:07 Model-Based Automation with Home Assistant
1:43:12 Comparison to Cloud-Based Services and Ellen Studio
1:44:15 Node Red and Alternative LLMs for Automation
1:45:15 NVIDIA Container Toolkit and Traditional Programming chapter 1
1:45:15 NVIDIA Container Toolkit and Traditional Programming
1:46:21 CUDA, Containers, and Scalability chapter 3
1:46:21 CUDA, Containers, and Scalability
1:46:48 NVIDIA's Plans for a Marketplace
1:47:51 GPU and System Information
01:49:26 Discussion of LM Studio and Home Assistant chapter 7
01:49:26 LM Studio and Analytics Concerns
01:49:57 Model Connection to Home Assistant Evolution
01:50:28 Home Assistant and Node Red Development
01:51:03 eGPU Nerdery and PCIe Gen 5 Testing
01:51:41 Whisper AI Input and Text-to-Speech
01:52:13 Loading Model and Nvidia Power Connector
01:52:44 Falcon Northwest System and HGP Question
1:53:44 GPU and Model Discussion chapter 4
1:53:44 GPU and Model Configuration
1:54:18 Model Load Failure and Error Handling
1:54:52 Performance Optimization and Layer Addition
1:55:50 Testing and Windows Environment
1:57:18 Model Performance and RAM Usage chapter 3
1:58:12 Model Comparison and RAM Usage Discussion
1:59:20 Modded GPU Testing and Alternative Options
1:59:51 AI and GIMPs Project Discussion
02:01:23 Kubernetes and AI Model Discussion chapter 3
02:01:23 Kubernetes and Model Performance Comparison
02:03:09 RTS 6000 and Consumer Options for AI Models
02:04:35 Model Configuration and Performance Optimization
02:07:22 Discussion on RAM and System Configuration chapter 2
02:07:22 RAM Configuration and Model Selection
02:08:30 GPU and KV Cache Discussion
02:09:34 Switching to Linux and Troubleshooting Issues chapter 2
02:12:55 Troubleshooting Driver Issues and Reboots
02:14:52 Power Connector and PSU Discussion
02:16:26 Troubleshooting GPU Issues chapter 4
02:16:26 Initial Troubleshooting Steps
02:16:58 Proposed Solution for GPU Issues
02:19:04 Discussion of Nvidia Driver Version and Compatibility
02:20:16 Activation Failure and Kernel Building
02:24:46 Linux and Nvidia Driver Installation chapter 2
02:24:46 Camera and Mic Setup Discussion
02:27:49 Nvidia Driver Installation and Configuration
02:30:20 Manual Process and Packaging Software chapter 1
02:30:20 Nuking DRO and Software Packaging
02:31:35 Case Discussion and Customization chapter 7
02:31:35 Fixing Power Cable Issues
02:32:07 Silverstone Case and Linux Distro
02:32:40 NVIDIA Windows Driver for ARM
02:33:11 Falcon Northwest Frag Box and SSD Issues
02:33:42 LLM on Modded GPU and VRAM Limitations
02:34:12 GPU Borrowing and PCIe Cable Issues
02:35:19 Uninstalling Software and Chat Break
2:36:59 Linux and GPU Discussion chapter 6
2:36:59 Linux and GPU Configuration Options
2:38:29 RTX Pro 6000 Acquisition and Usage
2:39:47 GPU Issues and Solutions
2:41:19 Phase Change Memory and Optane Discussion
2:43:29 Windows OS Drive Options
2:45:30 Firmware and GPU Configuration
02:47:40 Nvidia Drivers and GPU Discussion chapter 5
02:47:40 Hot Plugging Thunderbolt GPU with Ryzen Linux Desktop
02:48:11 Oculink and NVL Link Discussion
02:48:42 HDMI DP Handshake Process and Linus Torvalds
02:49:20 Nvidia Driver Booting and Oculink Issues
02:49:51 Thread Ripper Motherboard Recommendations and AMD CPUs
02:52:35 Discussion on Redstone MCrafter and Engineering chapter 3
02:52:35 Potential for Engineers to Learn Engineering in Minecraft
02:53:06 Learning RTL or Verilog for Engineering
02:53:38 Crossover Point between Survival Sims and Reality
02:57:44 Live Stream and Gaming Discussion chapter
03:00:26 System Sleep and Wi-Fi Connection chapter
03:02:01 Laptop Hardware and Software Discussion chapter
03:03:09 Nix OS, AI Image Generation, and ZFS chapter
3:13:04 CUDA Problem and Troubleshooting chapter 5
3:13:04 Initial CUDA Problem Discussion
3:15:24 Nvidia Installation and Driver Issues
3:17:16 Multiple Version Installation and Virtual Environment
3:18:52 GPU Performance and Headroom Discussion
3:21:06 PLC Automation and Smart Home Systems
3:23:12 Introduction and Setup chapter 2
3:23:12 Initial Setup and Testing
3:24:48 Water Break and Chat Interaction
3:26:27 LLM Testing and Discussion chapter 2
3:26:27 LLM Model Loading and Testing
3:30:36 GPU Usage and VRAM Discussion
3:31:07 GPU and Memory Configuration for Deepseek chapter
03:36:59 Disabling USB and Ethernet Connections chapter
03:37:30 RTX 6000 Blackwell and Deep Seek Coder V2 chapter
03:38:02 Deep Coder V2 Performance and Comparison chapter
03:39:37 Power Limiting and Thermal Imaging chapter
03:41:40 VRAM and Multi-Tenant Scenario chapter
03:42:13 GPU Utilization and Power Limit chapter
03:47:26 Discussion on Nvidia Inferencing Microser and Power Usage chapter 2
03:47:26 Nvidia Inferencing Microser and Software Enablement
03:47:56 Power Usage Curve and Efficiency Comparison
03:49:01 Comparison of Performance and Power Consumption chapter 2
03:51:07 LLM Testing and Memory Limitations
03:52:38 Power Reduction and Performance Loss
03:54:20 Power Testing and Benchmarking Results chapter 1
03:55:53 Temperature Check and Benchmarking Results
3:58:08 Discussion on DeepSeek and LLMs chapter 4
3:58:08 Raw Teraflops and LLM Performance
3:58:47 Windows Machine Turning Off
3:59:29 RTX 6000 and DeepSeek Issues
4:00:01 Switching to DeepSeek R1 and LLM Model
4:00:45 Comparison of DeepSeek on Linux and LM Studio chapter 3
4:01:21 Comparison of DeepSeek Performance on Linux and LM Studio
4:02:23 Discussion on Quantization Approaches and Unsloth's Work
4:03:24 Conclusion on DeepSeek Performance and Efficiency
4:04:26 Nvidia Blackwell RTX 6000 and NIMS Discussion chapter 4
4:04:26 Performance Comparison and Cloud Access
4:04:58 AI Spirit Journey and Token Processing
4:05:30 Teraflop Computation and VRAM Usage
4:06:01 YouTube Algorithm and Stream Limitations
04:08:10 Discussion on Cyberpunk and Server Room Makeover chapter 3
04:08:10 Cyberpunk Run and Server Room Plans
04:08:40 Loan to Steve and AI Workloads
04:09:11 Llama.cpp Updates and Optimizations
04:09:42 Llama.cpp Optimizations and Performance Improvements chapter 1
04:10:13 Closing Remarks and OBS Stop

Transcript

Loading transcript...