[Nix-dev] libvirt/nixops

[Joachim Schiele]

dear developers,

i'm using nixos 16.03.1271.546618c (Emu) with nixops 1.4 and i wanted to
deploy to libvirtd. according to
https://nixos.org/nixops/manual/#idm140737319108016 this should be working.

my problem is, i can't manage to get a IPv4 via dhcpcd from a
kvm/libvirtd-client.

i see this:
====================================================
nixops deploy ...
...
mailserver> waiting for IP address to appear in DHCP
leases.........................................................................
.....................................
====================================================

this dottet line never finishes. i've also used virt-manager to deploy a
nixos based guest and using static ip-addresses i can access the
internet from the guest. using dhcpcd from that guest never terminates
successfully either. i see the requests using tcpdump -i virbr0 (on the
host).

this is my host configuration:

  ...
  virtualisation.libvirtd.enable = true;
  networking = {
    firewall = {
      allowedTCPPorts = [ 22 80 443 ];
      allowPing = true;
      checkReversePath = false;
    };
  };

i'm quite lost now, what could i try to fix this?

best wishes,
joachim

# host networking

ip a

3: virbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
state UP group default qlen 1000
    link/ether 52:54:00:50:21:e8 brd ff:ff:ff:ff:ff:ff
    inet 192.168.122.1/24 scope global virbr0
       valid_lft forever preferred_lft forever
    inet6 fe80::5054:ff:fe50:21e8/64 scope link
       valid_lft forever preferred_lft forever
4: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc pfifo_fast master
virbr0 state DOWN group default qlen 1000
    link/ether 52:54:00:50:21:e8 brd ff:ff:ff:ff:ff:ff
21: vnet0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast
master virbr0 state UNKNOWN group default qlen 1000
    link/ether fe:54:00:15:84:41 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::fc54:ff:fe15:8441/64 scope link
       valid_lft forever preferred_lft forever


# my deployment

[root at nixcloud0001:~/nixops]# nixops deploy -d mailserver
mailserver> these derivations will be built:
mailserver>
/nix/store/8c2mkqamyxccjsz7fpid15wifc5b7rm3-libvirtd-ssh-image.drv
mailserver> building path(s)
‘/nix/store/rzrx0yj7j6s78407r6jj8b18jgn8ap2n-libvirtd-ssh-image’
mailserver> Formatting
'/nix/store/rzrx0yj7j6s78407r6jj8b18jgn8ap2n-libvirtd-ssh-image/image',
fmt=qcow2 size=10737418240 backing_fi
le=/nix/store/r3kls90m6zg6zvgzvwm0mdz78f1lqn9b-libvirtd-image/disk.qcow2
encryption=off cluster_size=65536 lazy_refcounts=off refcou
nt_bits=16
mailserver> loading kernel modules...
mailserver> mounting Nix store...
mailserver> mounting host's temporary directory...
mailserver> starting stage 2
(/nix/store/849ih13ch5vylrzii4j7yx8xdkinf28l-vm-run-stage2)
mailserver> [    1.407943] reboot: Power down
mailserver> Formatting
'/var/lib/libvirt/images/nixops-b489ee3d-727b-11e6-9f02-08606e445f1d-mailserver.img',
fmt=qcow2 size=10737418
240
backing_file=/nix/store/rzrx0yj7j6s78407r6jj8b18jgn8ap2n-libvirtd-ssh-image/disk.qcow2
encryption=off cluster_size=65536 lazy_re
fcounts=off refcount_bits=16
mailserver> starting...
mailserver> Domain
nixops-b489ee3d-727b-11e6-9f02-08606e445f1d-mailserver created from
/tmp/nixops-tmpnx7Gix/mailserver-domain.xml
mailserver>
mailserver> waiting for IP address to appear in DHCP
leases.........................................................................
....................................................................................................................................
....................................................................................................................................
.........................................................................^Cerror:
interrupted

# ps aux | grep dnsmasq

nobody    1096  0.0  0.0  25220  2156 ?        S    Aug16   0:00
/nix/store/nic8g0523qxlixk7lvwmfk5qzkj4dbyd-dnsmasq-2.76/bin/dnsmasq
--conf-file=/var/lib/libvirt/dnsmasq/default.conf --leasefile-ro
--dhcp-script=/nix/store/qnb5j957gba9sfa5lg8rshfb5yqnxd05-libvirt-1.3.5/libexec/libvirt_leaseshelper
root      1097  0.0  0.0  25088   232 ?        S    Aug16   0:00
/nix/store/nic8g0523qxlixk7lvwmfk5qzkj4dbyd-dnsmasq-2.76/bin/dnsmasq
--conf-file=/var/lib/libvirt/dnsmasq/default.conf --leasefile-ro
--dhcp-script=/nix/store/qnb5j957gba9sfa5lg8rshfb5yqnxd05-libvirt-1.3.5/libexec/libvirt_leaseshelper
...
nobody   29079  0.0  0.0  25220  2232 ?        S    Sep02   0:00
/nix/store/2bgcngjm8jny1n5wm0w4s8i8xyw7r615-dnsmasq-2.76/bin/dnsmasq
--conf-file=/var/lib/libvirt/dnsmasq/default.conf --leasefile-ro
--dhcp-script=/nix/store/nda7mns66zflv1mk1zavad3dmbx3amcd-libvirt-1.3.5/libexec/libvirt_leaseshelper
root     29080  0.0  0.0  25088   236 ?        S    Sep02   0:00
/nix/store/2bgcngjm8jny1n5wm0w4s8i8xyw7r615-dnsmasq-2.76/bin/dnsmasq
--conf-file=/var/lib/libvirt/dnsmasq/default.conf --leasefile-ro
--dhcp-script=/nix/store/nda7mns66zflv1mk1zavad3dmbx3amcd-libvirt-1.3.5/libexec/libvirt_leaseshelper