lawrence.video/truenas VM Bridge Forum Post www.truenas.com/community/threads/accessing-nas-from-vm-still-broken-without-bridge.106033/post-729793 ⏱ Time Stamps ⏱ 00:00 ▶ TrueNAS Scale Hypervisor (add timestamp for demo) 01:04 ▶ Working Features 03:00 ▶ VM Bridge Issue 04:51 ▶ Missing Features 07:24 ▶ How To Build A VM 10:48 ▶ VM Management 11:52 ▶ Cloning Vitrual Machines 12:32 ▶ VM Zvol Management 13:13 ▶ Device Management 13:48 ▶ VM Snapshots
Please make it easier for new VMs to be able to talk/see to TrueNAS. As Tom said, TrueNAS is NAS first, so we usually want to be able to read/write some data that is on TrueNAS dataset(s) from inside VM, currently setting this is really cumbersome, because by default the newly created VM can't see/ping TrueNAS. Thanks 🙏
Well, thanks for convincing me this is exactly what I want for my setup! Its not too "fluffy" with features I do not need at my scale but gets the job done.
Just FYI the limitations in features are not part of KVM it can do both clustering and backing up of VMs. I am guessing who ever is working out the logic for the GUI hasn't figured out how to present that yet. But it is only a matter of time. As to VMs not accessing the host by default, that is definitely a feature, not a bug. As you alluded usually it is a separate VM and NAS and would always have some sort of credentials certificates between them. To access and NAS share though the VM you should just add the local share the VMs pool instead. It would be redundant to rely on networking protocols when you access the raw dataset locally anyway. Good video though and I am happy to see Scale coming on with leaps and bounds. Cheers
Thanks for producing the best vids about truenas scale that I've seen. If I have one wish it would be to drill down more for us enthusiastic newbs who need a more step by step guide and explanations of all the features that you (and many RU-vidrs) skim over assuming prior knowledge. Of course you may not want to bore the already familiar but tutorial videos for beginners would be great. For example setup VM, Different use cases for clone, snapshot and replication. Off-site backups? A friend and I are trying to make 2 server to run VM game servers, one at each site. We'd like to build in some data resilience. We also hit the snag of the host/VM visibility so a guide for the work around would be great. Sorry for the big wish list but we hope you'll be our teacher on this. :)
To have your virtual machine talk to the host is to configure a bridge on your network adapter. 20Gb/s on the virtual interface should be plenty of speed for your VM to communicate to the host.
They're using qemu under the hood, and qemu requires a tun/tap interface to interact with the host, and because of that, it's required to bridge that interface to any networks that might be natively on the host. TrueNAS probably needs to build some infrastructure around their qemu support to enable this to work smoothly.
Don't forget that TrusNAS scale is (announced) an hyperconverged virtualization platform (like HP Simplivity, Nutanix, etc) but also offer the other stuff like file sharing (NAS) and application hosting all in one box with no licensing. What I want to see is how to put those TrusNAS scale in cluster. Now let's watch the video.. ;-P
Every TrueNAS SCALE tutorial I find on VM hosting glosses over networking. I have no issues creating the VMs but getting them on the network is an entirely different proposition. I create linux VMs and am unable to update repositories or host services because the procedure you provided (and many other RU-vid hosts) do not go over network setup. A VM that is completely offline has limited value. Do you have a video on getting TrueNAS VMs on your local network?
I contacted TrueNAS scale support. While TrueNAS scale VMs are able to interact with the NAS storage itself, they have not validated a usecase where VMs hosted on the NAS are accessible by other systems on the LAN. You cannot for example host a simple webserver for clients on your LAN.. How is that valuable as a VM host?
hey tom, thanks for that video :) another note on truenas scale that might be of interest for anyone: it seems like power saving options do not work very well if you transfer your installation to a different system (mainboard / cpu upgrade). i did have to reinstall the system and restore config to get all cpu c-states to work etc. just a heads up :)
I've tried to think of usecases where it makes sense to run a VM on the NAS, and my best use casse really is A) Very small 1-25 employee businesses that only need a basic DC + File share, or B) Read-only DC/DNS for a remote site (and it's offsite storage), or C) A jump client to be able to perform management on some of the other infrastructure. Of course there are other strategies, but I know clients for some of the sites I help manage that would sufficiently run, or run better with, the VM running directly on the box that hosts a more robust storage box vs Storage + Vm host + networking to make that work well.
@@WarrenGarabrandt Oh that's a pretty good idea for Cloud based backup solutions that don't natively integrate with the NAS like Barracuda MSP or something. Nice idea!
TN is my all in one solution. Since custom apps only support a single image, I use a VM to run apps that require multiple images, also known as docker stacks.
Was just (finally) getting around to testing the virtualisation functionality in TrueNAS and I didn't realise that the TrueNAS host itself CANNOT run in headless mode, and that it NEEDS a GPU. That's such a bummer.
Which option is better to use now: - TrueNAS Scale? - Proxmox+TrueNAS Core? - Or does Proxmox+TrueNAS Scale make sense? Because now the difference between TrueNAS Scale and Proxmox is getting smaller and smaller.
I still continue with Proxmox. Flexibility, easy to maintain the cluster, ZFS mounting disks across the cluster and VM replication/forward to another PRX server ❤️
It depends on your needs.I recently downscaled from 3 proxmox servers and 8 vm’s to one TNS server with no vm’s. It’s much simpler to maintain and also saves $$$ on electricity!
I'm still doubting in what I should do with my server. I'm using it now as a windows server file sharing server. I'm doubting between Proxmox (with a windows vm filesharing and several other Vm's) or Truenas with builtin filesharing and several VM's.
the networking issues stems from a similar sriov pcie device problem with net ROM options and what is known as nic promiscuous mode. Not all nic(Netwrok Cards) support this mode, with short in short can support vlan bridge traffic to host. simalr with dockers and mac_vlan network setps where host traffic and docker traffic for "security" are designed as such. But i agree there should be a checkbox to software or have host traffic accessible without the need of passing a nic card to the VM.
VM access to Internet over bridge (IP with TCP Port Aliases ) or NAT is essential for me. Its better to develop websites on isolated environment before deploying it to the Server. I'm currently developing Multiple Websites with various versions and brands of Database and Host.
When creating a VM und want to upload the ISO-image via the WebUI it always gives me a 403 Forbidden error. Tried several permission settings for the dataset to upload but with no success. Tom did not show his upload in the video thus I can’t learn from him how to do. Who can help me out?
I'm working on a configuration/deployment where I'm aiming to use TrueNAS Scale and have it host a Windows Server VM that will have WDS enabled and working to PXE boot into a WinPE environment.
Are there any guides on optimal CPU settings for VM’s? I have an Intel i7-12700k CPU with 12 cores and 20 threads. How does that translate into VM CPUs, cores, and threads?
I have my Truenas in a system with 4 physical CPU's but when I try to make a Virtual machine with 4 Virtual cpu's or even 1 virtual cpu with multiple cores it tells me Only one virtual CPU is allowed on this system...... Why?
Tom, Can you do an updated video on how APPs (and TrueCharts) Use SSL Certs? It looks like the choose certificate option is deprecated and there is no info in the Docs on the new options or why APPs don't pick up renewed wildcard certs.
Any idea if we can restore vm's backed up with XCP-NG on a local dataset via NFS? I'm looking to match features for Datto backup. Also looking for a more intuitive Web interface which can organize snapshots vs Full backups
Hi! My VM crashed and I'm looking for a way to recover some config files from it. Looks like impossible. Do you know how to do it? Maybe you post a video.
Hi and thanks for the video, I have a question. How can I add true nas storage to virtual machine? Also it's a good Idea tu use this kind of virtual machine to install docker and there install all the containers like plex, navidrome, etc..?????
@@LAWRENCESYSTEMS Thanks for the response. I'm still looking for more info about that. It seems given the way TNS runs their virtual machines, doing lightweight VMs with containers may be a better option, but I don't yet really get how to manage them in their interface.
Good Q! I’m using custom apps and bridged networking to run apps and given them their own IP’s so that I don’t need to use port forwarding to make them accessible. However , if you have a multi-container app , like one with a web front end and db backend, running native docker in a VM is probably your best bet.
I find the CPU settings confusing. I run Scale on a Poweredge R420 which is a dual CPU system. If I want to give a VM access two 2 cores on each of the 2 CPUs what do I set those settings to? 4, 2 and 2? The little help bubbles aren't very helpful in my opinion. In proxmox I just set the number of sockets and cores then enable NUMA. Also how are you supposed to backup these VMs?
Mr. T, I have a rather weird question, but trust me it makes sense given my deployment scenario. -- can you virtualize a Hyper-V hypervisor (nested virtualization) on TrueNAS Scale? Looking forward to your response, or anyone who might chime in to clarify.
I'm speaking from experiences with proxmox and see if you can find the equivalent since it's just KVM under the hood. I understand that as you'd want WSL2 in a Windows guest - Intel needs CPU model set to Skylake-Client-noTSX-IBRS, with args '+vmx,-hypervisor' - AMD needs host with args '+svm,-hypervisor' Enabling hyper v makes everything in guest windows 12% slower because the whole windows became a guest OS
For XCP-ng, as long as they remain on a CentOS kernel (because Citrix Xen is on RHEL), I will not use that as an hypervisor. Too risky with Ryzen processors. Promox is still my go-to home setup as it is based on Debian and it just works on everything.
XCP-ng has a super ancient kernel so I'm not surprised that it doesn't support 12th gen. Try Proxmox, it ships with a 5.15 (IIRC) kernel but 5.19 is available.
friend can't install vm on supermicro x9dbl-if 2x e5-2470v2 not add 20 cores,40 threads vm, The product of vCPUs, cores and threads must not exceed 255 on this system. truenas scale, do you have an idea? thanks!
Hello! Could somebody please point me to a tutorial or video on how to give a VM (Ubuntu) an IP address outside of my DHCP range? I have two NICs in my Truenas System. One gets its IP adress via DHCP from my router (192.168...) and the other is configured with a static IP (10.10.0...). I'd like to have my VM an address from the 10.10... range, but even if I attach the second NIC in "Devices" to it, it will always get an IP of 192.168....X. I can't find a comprehensive walkthrough on this so any help is much appreciated!
So if I understand what you said Tom regarding TNS networking in VMs, virtualizing something like Opnsense or pfSense wouldn't work well if at all? I just setup TNS out of curiosity and as a replacement for Core for my uses, and I love it... If I could take my QTOM or w/e miniPC's SSD out and plop it into my TNS server with PCI passthrough that'd be awesome. Please let me know what's possible.
@@Mr.Leeroy I'm currently learning Scale by using it in my homelab and I actually prefer it now after getting used to it. I run Core virtualized the same way but that's mostly to stay up to date on what's new.
Just out of curiosity, how do you choose and set up the physical VM-storage, is it as simple as putting two NVMe drives in a mirror or is there more to it with TrueNAS and ZFS?
@@aemonblackfyre4159 Just something to run a couple of VM's (HASS, Windows) and docker containers for databases and some other things. So no need for SLOG or something like that?
hi im getting soon a old pc for my nas (first nas ill have) i wish i had bigger one but wanted one fast and i need to save to get a better system for it so i get this one this week (2nd hand pc ) not very good pc at fist i planed to put proxmox and true nas as vm on it but cause i ll have only a i5 6th gen so 4 core 8 thread , wiht only 16 gig ram (this part will be upgraded in a few weeks or month) when i do cause i wont use proxmox on this one ill use that vm to use linux ill be experiencing on this one then when i get my bigger server ill have a better machine and better knowledge of what to do :-) i decided to go wiht 3 ssd for hard drive ( plus 1 for isntalation and one for the cache) . so untill i get it (cause im waiting the guy to come to bring it ( up untill this weekend) until i installed it on my laptop(the pc i have here)as a vm to start to experiement on how example to implement aps(like my next cloud ectÈ=_ so ill scheckseveral of video too about it
@@LAWRENCESYSTEMS i really appreciate your time and work. This "bug" is the only thing holding me back from moving over. Cant wait to see an update on Truenas Scale performance.
So you created a 4 cpu 4 core vm, cloned it, and they were each 2 cpu 2 core, then deleted the clone, and the original vm reverted to 4 cpu 4 core. Interesting.
Great video as always. What would be the best way to access files etc. in a zfs dataset ( which is NFS/SMB shared) with an Ubuntu VM inside the TrueNAS given host networking communication is missing?
The moment I see jgreco username and that stupid grinch avatar in a thread i stop reading that link and look elsewhere for answers. If he shows up you know there will be no answers, only smug self congratulatory garbage and belittling the user for wanting to do anything at all.
