alt.hn

3/17/2026 at 3:26:32 PM

Unsloth Studio

 https://unsloth.ai/docs/new/studio

by brainless

3/18/2026 at 5:51:41 PM

I still have trouble to get unsloth studio setup working on my MacBook because of Python tooling issues.

However, since I already have pi working with llama.cpp server from a docker container, I did a quick experiment to compare three code bases:

https://gist.github.com/ontouchstart/7483c12efa3c3d3a49e38c2...

https://gist.github.com/ontouchstart/217fe2b8103a5c0bfaee1e9...

Very interesting.

Will do it again next week if I can get unsloth studio working.

by ontouchstart

3/18/2026 at 5:54:58 PM

If you can try again we just updated the process sorry! We did a new pypi release:

curl -LsSf https://astral.sh/uv/install.sh | sh

uv venv unsloth_studio --python 3.13

source unsloth_studio/bin/activate

uv pip install unsloth==2026.3.7 --torch-backend=auto

unsloth studio setup

unsloth studio -H 0.0.0.0 -p 8888

by danielhanchen

3/18/2026 at 6:24:15 PM

Thank you Daniel.

Here is the error message on my machine:

https://gist.github.com/ontouchstart/86ca3cbd8b6b61fa0aeec75...

It seems we might need more instructions on how to set up python (via uv) in vanilla MacOS.

by ontouchstart

3/18/2026 at 7:40:30 PM

I have been updating the gist above and will stop this

``` ../scipy/meson.build:274:9: ERROR: Dependency lookup for OpenBLAS with method 'pkgconfig' failed: Pkg-config for machine host machine not found. Giving up. ```

Too much work.

by ontouchstart

3/17/2026 at 10:05:16 PM

What is unsloths business/income? They seem to be publishing lot of stuff for free, with no clear product to back them?

by zokier

3/18/2026 at 1:55:44 AM

Hey! Our primary objective for now is to provide the open source community with cool and useful tooling - we found closed source to be much more popular because of better tooling!

We have much much in the pipeline!!

by danielhanchen

3/18/2026 at 2:07:43 AM

Thanks! How do you earn or keep yourself afloat? I really like what you guys are doing. And similar orgs. I am personally doing the same, full-time. But I am worried when I will run out of personal savings.

by brainless

3/19/2026 at 3:55:15 PM

I've been wondering this since they started it, mostly as a concern they stay afloat. Since Daniel does the work of ten, it seems like their value:cost ratio is world-class at the very least.

With the studio release, it seems to like they could be on the path to just bootstrapping a unicorn or a 10x corn or whatever that's called, which is super interesting. Anyway, his refusal to go into details reassures me, sounds like things are fine, and they're shipping. Vai com dios

by vessenes

3/18/2026 at 10:59:30 AM

Daniel is a very impressive guy. Well within the realm of “fund the people not the idea” that YC seems to do. Got a few bucks from them and probably earning from collaborations etc. Odds of them not figuring out a business model seem slim.

https://www.ycombinator.com/companies/unsloth-ai

by richardw

3/18/2026 at 3:08:14 PM

From comments elsewhere in this thread, it sounds like Unsloth could also be getting some decent consulting revenue from larger companies.

by sowbug

3/18/2026 at 3:51:01 PM

The opportunity here is HUUUUGGGEEEE!!!

Companies have no idea what they are doing, they know they need it, they know they want it, engineers want it, they don’t have it in their ecosystem so this is a perfect opportunity to come in with a professional services play. We got you on inference training/running, your models, all that, just focus on your business. Pair that with huggingface’s storage and it’s a win/win.

by reactordev

3/18/2026 at 5:05:10 PM

Investments are not income

by zokier

3/18/2026 at 3:08:01 AM

You didn't answer the parent question.

by csomar

3/18/2026 at 11:58:54 AM

They don't owe anyone an answer.

by segmondy

3/18/2026 at 5:04:00 PM

But if they want to attract users, like they seem to do, then answering would go long way.

by zokier

3/18/2026 at 5:53:41 AM

that doesnt sound reassuring?

by kartaka83838

3/18/2026 at 1:56:22 PM

With a team size of eight (!) I think they are not exactly bleeding money

by throwa356262

3/18/2026 at 2:13:43 AM

Unsloth is the real thing. Highly recommended for those running their own AI engines and that want to get the most out of them.

by jacquesm

3/17/2026 at 11:51:10 PM

Apache license. Can’t wait to try it out at work! LMStudio’s proprietary license makes getting permission hard.

by illusive4080

3/18/2026 at 2:34:52 AM

Some of it is Apache

by halJordan

3/18/2026 at 3:29:17 AM

Some of unsloth studio’s code is Apache? Or some of lmstudio is?

by smcnally

3/18/2026 at 8:02:08 AM

From the README at https://github.com/unslothai/unsloth: "Unsloth uses a dual-licensing model of Apache 2.0 and AGPL-3.0. The core Unsloth package remains licensed under Apache 2.0, while certain optional components, such as the Unsloth Studio UI are licensed under AGPL-3.0."

by mkl

3/18/2026 at 11:37:52 AM

Good to know. AGPL is fine at my workplace too, whereas the custom LMStudio license has been in review since mid January with no ETA in sight.

by illusive4080

3/18/2026 at 1:58:18 PM

What do you mean by custom LMStudio license? Your employer requires reviews of proprietary EULAs or do you try to get a custom licensing deal from LMStudio?

by solomatov

3/19/2026 at 1:26:12 AM

Employer must review all EULA terms, yes. The license is a hand crafted proprietary license not a standard OS license.

by illusive4080

3/18/2026 at 11:35:03 AM

I noticed the training part, that was interesting for my use case. Unfortunately it's said 'on NVIDIA'.

Is there an alternative, tutorial, or project you'd recommend that would help me do supervised fine tuning (SFT) with the metal stack / macOS?

by keyle

3/18/2026 at 4:26:56 PM

They state further down that they're working on non-Nvidia support. Looking forward to it, since I'm pretty heavily invested in suffering on AMD (ROCm sucks, but everything else about AMD is worth it to me.).

by MrDrMcCoy

3/18/2026 at 1:53:27 PM

Use that mac to rent Nvidia gpus

by TiredOfLife

3/18/2026 at 2:46:10 PM

> Mac: Like CPU - Chat only works for now. MLX training coming very soon

by syntaxing

3/18/2026 at 1:58:24 PM

lol.

by kahrl

3/17/2026 at 10:26:02 PM

Tried to build from source on MacOS, but got this error:

  (base)   unsloth git:(main) unsloth studio setup
  ╔══════════════════════════════════════╗
  ║     Unsloth Studio Setup Script      ║
  ╚══════════════════════════════════════╝ 
   Node v25.8.1 and npm 11.11.0 already meet requirements. Skipping nvm install.
   Node v25.8.1 | npm 11.11.0
   npm run build failed (exit code 2):

  > unsloth-theme@0.0.0 build
  > tsc -b && vite build

  src/features/chat/shared-composer.tsx(366,17): error TS6133: 'status' is declared but its value is never read.

by car

3/17/2026 at 10:42:34 PM

Hey will check ASAP and fix - sorry about that

by danielhanchen

3/18/2026 at 5:56:30 PM

Apologies on the delay - we fixed it! Please re-try with:

curl -LsSf https://astral.sh/uv/install.sh | sh

uv venv unsloth_studio --python 3.13

source unsloth_studio/bin/activate

uv pip install unsloth --torch-backend=auto

unsloth studio setup

unsloth studio -H 0.0.0.0 -p 8888

by danielhanchen

3/19/2026 at 1:29:04 AM

Thank you for the follow up! Big fan of your models here, thanks for everything you are doing!

Works fine on MacOS now (chat only).

On Ubuntu 24.04 with two GPU's (3090+3070), it appears that Llama.cpp sometimes uses the CPU and not GPU. This is judging from the tk/s and CPU load for identical models run with US-studio vs. just Llama.cpp (bleeding edge).

by car

3/17/2026 at 9:17:09 PM

Installing with pip on macOS is just not an acceptable option. It'll mess up your system just like npm or gem.

This needs to go on homebrew or be a zip file with an app for manual download.

by trvz

3/17/2026 at 9:32:41 PM

Agree with you, a slightly more maintainable way to use it now is with "uv" or mise. i've used `uv tool install unsloth` for this one.

by DIVx0

3/17/2026 at 10:12:05 PM

Yep - uv is a better fit - and you get parallel downloads as well

by danielhanchen

3/18/2026 at 10:20:58 AM

It's not just uv, it also will drop an nvm install in your home directory :(

by saagarjha

3/17/2026 at 10:10:22 PM

Hey we're still working on making installation much better - appreciate the feedback!

We come from Python land mainly so packaging and distribution is all very new to us - homebrew will definitely be next!

by danielhanchen

3/18/2026 at 2:31:54 AM

Uv helps you up though. Use a pyproject.toml and uv sync. Everything will be put into the venv only, nothing spread across the whole system.

The pyproject.toml can even handles build env for you, so you no longer need a setup.sh that installs 10 tool in specific order with specific flag to produce working environment. A single uv sync, and the job is done.

Plus the result is reproducible, so if this time uv sync work, then it also work next time.

Highly recommend if you are still on pip.

Note: Take a example that I used to install unsloth with rocm setup that based on unreleased git version dependencies and graphic card specific build flag, all of them can be handled with one command 'uv sync'. This will require a big pile of shell script if doing another way. https://github.com/unslothai/unsloth/issues/4280#issuecommen...

by mmis1000

3/17/2026 at 10:02:22 PM

I recommend installing uv first, then you can install any Python code you want inside a virtual environment to keep it isolated from the rest of the system.

by bityard

3/17/2026 at 10:11:33 PM

Yep uv pip install unsloth works as well - we probably should have just made that the default - in fact Unsloth makes its own venv using UV if you have it dynamically

by danielhanchen

3/18/2026 at 2:56:44 AM

I think the website should probably mention those installation preset in unsloth pyproject.toml though. The website instruct you to install dependencies separately. But it turns out there are dedicated preset that install specific rocm/cuda/xpu version in the project.

by mmis1000

3/18/2026 at 9:15:15 AM

or `uv tool install unsloth` for a safe 'global' installation

by anentropic

3/17/2026 at 9:55:20 PM

On my linux systems I use venv to not affect system packages, is that not an option for this situation?

by Computer0

3/17/2026 at 10:05:59 PM

I know the whole package system across most languages is a dumpster fire but for Python, uv solves a lot of problems.

uv init

uv add unsloth

uv run main.py % or whatever

by gessha

3/17/2026 at 10:21:01 PM

Yep UV is fantastic - should have just that default!

by danielhanchen

3/18/2026 at 6:43:55 AM

Ah yes, came to say something similar, Python dependencies are an absolute nightmare, even with uv it feels like there's always a battle to make other peoples Python apps install.

Update: It looks like it doesn't work with the current Python version, you might have to downgrade to Python 3.13 (however even then I still get `error: unexpected argument '--torch-backend' found`)

by smcleod

3/17/2026 at 10:00:40 PM

Agreed, feels like a vibe-coded frontend based on already given backend features.

Also, never saw any Unsloth related software in production to this day. Feels strongly like a non-essential tool for hobby LLM wizards.

by beernet

3/17/2026 at 10:15:36 PM

You would be surprised - we're the 4th largest independent distributor of LLMs in the world - and nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - we for example collab directly with large labs to release models with bug fixes.

by danielhanchen

3/17/2026 at 10:43:07 PM

Unsloth is providing the best and most reliable libraries for finetuning LLMs. We've used it for production use-cases where I work, definitely solid.

by airspresso

3/18/2026 at 1:57:06 AM

Glad it was helpful!

by danielhanchen

3/18/2026 at 1:00:27 AM

Even a brief reading of their site would have spared you this embarrassment.

by ta9000

3/19/2026 at 6:03:09 AM

LM Studio user here. Unsloth looks great, wanted to check it out, but there is no app file to download and install? Sorry I'm not familiar with the command line.

by pentagrama

3/18/2026 at 9:22:37 AM

I hope you will support AMD. This looks Nice but I went the complicated route with AMD GPUs.

by kuon

3/18/2026 at 4:29:16 PM

They state that they're working on it. I'm waiting, too.

by MrDrMcCoy

3/18/2026 at 4:46:29 AM

Will check back when there's AMD support.

by claaams

3/17/2026 at 8:47:38 PM

The GUI for the fine tuning looks interesting. Hopefully this leads to a lot of new custom models

by meowokIknewit

3/17/2026 at 10:16:16 PM

Thank you! We're still iterating on it so any suggestions are welcome!

by danielhanchen

3/18/2026 at 12:23:17 AM

FYI, if any devs are around, the privacy policy still links to the gitbook.

by yomansat

3/18/2026 at 1:55:57 AM

Oh will check and fix - thanks

by danielhanchen

3/17/2026 at 9:12:42 PM

Who's the intended user for this?

Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models?

Is it a competitor to LMStudio?

by saberience

3/17/2026 at 10:32:09 PM

You would be surprised! Nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - the UI was primarily a culmination of pain points folks had when doing either training or inference!

We're complimentary to LM Studio - they have a great tool as well!

by danielhanchen

3/17/2026 at 11:54:23 PM

I don’t know why this is being downvoted. Danielhanchen is legit, and unsloth was early to the fine-tuning on a budget party.

by TheTaytay

3/18/2026 at 1:57:21 AM

Haha no worries at all :)

by danielhanchen

3/17/2026 at 9:42:54 PM

From the homepage looks like it: “Training: Works on NVIDIA GPUs: RTX 30, 40, 50, Blackwell, DGX Spark/Station etc.”

by lastdong

3/17/2026 at 9:40:22 PM

I am unaware lm studio is being used for fine tuning. I believe it only does inference.

Happy to see unsloth making it even easier for people like me to get going with fine tuning. Not that I am unable to I'm just lazy.

Fine tuning with a UI is definitely targeted towards hobbyists. Sadly I'll have to wait for AMD ROCm support.

by mlnj

3/17/2026 at 10:44:13 PM

Thanks! We do have normal AMD support for Unsloth but yes the UI doesn't support it just yet! Will keep you posted!

by danielhanchen

3/18/2026 at 4:38:33 PM

What does "normal AMD support" mean here? I was completely unable to get it working on my Ryzen AI 9700 XT. I had to munge the versions in the requirements to get libraries compatible with recent enough ROCm, and it didn't go well at all. My last attempt was a couple weeks before studio was announced.

by MrDrMcCoy

3/17/2026 at 10:20:49 PM

you just answered your own question, "AI hobbyists who has 4090 at home". And they are pretty much targeted user of Unsloth since the start.

by huydotnet

3/17/2026 at 10:33:51 PM

Actually the opposite haha- more than 50% of our audience comes from large organizations eg Meta, NASA, the UN, Walmart, Spotify, AWS, Google, and the list goes on!

by danielhanchen

3/18/2026 at 10:45:12 AM

Does it use gpu support on mac? At least when running setup, it said cpu only.

by fl0id

3/17/2026 at 7:20:46 PM

Excited to use this been using unsloth models for the past couple years

by jawerty

3/17/2026 at 10:16:51 PM

Thank you for your continued support - we have much more planned for it!

by danielhanchen

3/18/2026 at 2:21:41 PM

Congrats to team. Busy build a dataset for training so will def test it out

by Havoc

3/18/2026 at 3:48:00 AM

This looks really cool. Any chance you'll support pretraining runs as well?

by peddling-brink

3/18/2026 at 3:42:03 AM

Nice! Is there something planned to run the finetuning via hf jobs or runpod?

by ma2kx

3/17/2026 at 10:23:26 PM

Can Unsloth Studio use already downloaded models?

by car

3/18/2026 at 12:47:48 AM

IDK how it did but it detected my LM studio downloaded models I have on a spinning drive (they're not in the default location).

by nodja

3/18/2026 at 3:06:43 AM

wish there were an option to disable the annoying startup messages with emojis when using the library.

by yacin

3/18/2026 at 4:03:48 PM

[dead]

by maxothex

3/18/2026 at 3:30:54 AM

[dead]

by smissingham

3/18/2026 at 5:48:53 AM

[dead]

by cboyardee