profile

TheByte.io

Wait, What?!?! Run LLM Models Locally 👀

Published 8 days ago • 1 min read

Run LLM Models Locally with Docker

Good morning! This week has been a year long. I'm pretty confident if I still had hair I would've lost it again.

All the best things come from down turns. Let's focus on the positives and get to work.

Quick hitters, let's go

Docker Model Runner

Docker has been really busy lately.

Meet Docker Model Runner:

  1. Run AI models with the tools you’re using today
  2. GPU acceleration on Apple Silicon
  3. Pull models as OCI Artifacts
  4. No extra setup, just dev

​

A2A Beach front Avenue

Oh wait, wrong decade. You've maybe heard of the MCP Server craze recently trying to standardize how LLM's interface to applications. Well Google, just slipped in another standard called A2A to try to create a standards battle.
​
Put the coffee on as this will be an interesting battle.

Google's new AI Overview is killing search

Killing them softly comes to mind but for some it is more drastic. The new Google AI Overview answers your google search question and pushes all the other results down. Good for Google, bad for anyone trying to rank on Google.

This week has been all about making ChatGPT Image action figures. So if you want to do it yourself check out the steps below:

That's it for this week. I'm off next week where I plan on deploying vacation mode for a few days!

Brian

​

PS Do me a favor and send me feedback on what sucked, what was good, and I will post the best comments in next weeks Mailbag.

Burgmatt 11, Baar, Zug 6340
​Unsubscribe · Preferences​

TheByte.io

Byte Sized Updates about AI & Tech

The Byte provides "Byte" sized weekly newsletters about all things AI & Tech in under 2 minutes.

Read more from TheByte.io
Who trades better: AI or Human?

11 April 2025 Who's Trading Better: AI or Human? Happy long weekend eve! Sipping my Gin & Tonic, trying to enjoy the last days of my holidays. Good time to clean out your inbox and ensure you don't publish any breaking changes before the weekend. Quick Bytes Google Labs Google is secretly releasing some amazing projects. However, they are not getting much press. I highly recommend having a look at the Google Labs projects that are currently available. Here are just a couple of examples: Data...

1 day ago • 1 min read
Convert Kajabi Course to Replit

Byte Sized Updates about AI & Tech The Byte is back! After a bit of a hiatus I decided the relaunch The Byte. My goal is to keep the newsletter fresh, engaging, and byte sized. I'm open to feedback and ideas to help restart The Byte community. Happy Friday and let's Vibe Code into the weekend. Brian 💸 How I Saved $1,900 by Building My Own Learning Platform Tired of overpriced and overcomplicated course platforms, I decided to roll up my sleeves and build my own using Replit. The result? A...

15 days ago • 1 min read
Moon setting on the alps and 2020

Byte Sized Updates about Containers, Cloud & Tech I took the above picture this morning (New Years Eve) of the moon setting behind the Swiss Alps and on 2020 (It pays to get up early). Watching the moon set really brings closure on 2020 on the ups and downs. As we close out 2020, we could focus on all the negatives but instead lets focus on the positives and start planning 2021! Happy New Years to you! Forget New Year's Resolutions and instead conduct a year in Review I have to dig this...

over 4 years ago • 1 min read