WALinuxAgent 2.0 under Freebsd about walinuxagent

[szarkos]

Hi crea7or,

Sorry for the delay. From the log you posted above it looks like we are able to obtain an IP address and communicate with the Azure fabric, but then the agent is unable to locate the DVD ISO that is usually attached during provisioning. This DVD includes the information we need to provision the system (i.e. hostname, username, password/ssh key, etc.).

I haven't seen this error before on FreeBSD so we will need to investigate to see if we can reproduce this. Can you confirm if this is essentially a default install of FreeBSD 10?

Thanks,
Steve

[crea7or]

This is system is from freebsd vm images: ftp://ftp.freebsd.org/pub/FreeBSD/snapshots/VM-IMAGES/10.0-RELEASE/amd64/20140116/
As I know they are default installs. Additionally I have installed openssl, sudo and python then Waagent. If you need any other information - let me know.

[crea7or]

There is no CD in the system (on azure):

cd /dev
/dev # ls

acpi            da0             kbdmux0         stdin           ttyv8
apm             da0p1           klog            stdout          ttyv9
apmctl          da0p2           kmem            sysmouse        ttyva
atkbd0          da0p3           log             ttyu0           ttyvb
audit           da1             mdctl           ttyu0.init      ttyvc
bpf             da1s1           mem             ttyu0.lock      ttyvd
bpf0            devctl          midistat        ttyu1           ttyve
bpsm0           devstat         nfslock         ttyu1.init      ttyvf
console         fd              null            ttyu1.lock      ufssuspend
consolectl      fd0             pass0           ttyv0           urandom
ctty            fido            pass1           ttyv1           usbctl
cuau0           geom.ctl        pci             ttyv2           xpt0
cuau0.init      gpt             psm0            ttyv3           zero
cuau0.lock      gptid           pts             ttyv4           zfs
cuau1           io              random          ttyv5
cuau1.init      kbd0            sndstat         ttyv6
cuau1.lock      kbd1            stderr          ttyv7

[szarkos]

Hi,

If you still have access to the VM would you mind posting the output of 'dmesg'?

Thanks,
Steve

[ericgable]

$ dmesg
Copyright (c) 1992-2013 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.0-RC2 #0 r259404: Sun Dec 15 08:18:20 UTC 2013
[email protected]:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610
CPU: AMD Opteron(tm) Processor 4171 HE (1059.03-MHz K8-class CPU)
Origin = "AuthenticAMD" Id = 0x100f81 Family = 0x10 Model = 0x8 Stepping = 1
Features=0x783fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2>
Features2=0x80802001<SSE3,CX16,POPCNT,HV>
AMD Features=0xe2500800<SYSCALL,NX,MMX+,FFXSR,LM,3DNow!+,3DNow!>
AMD Features2=0x3f3<LAHF,CMP,CR8,ABM,SSE4A,MAS,Prefetch,OSVW>
real memory = 1879048192 (1792 MB)
avail memory = 1696780288 (1618 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table:
ioapic0: Changing APIC ID to 0
ioapic0 <Version 1.1> irqs 0-23 on motherboard
kbd1 at kbdmux0
random: <Software, Yarrow> initialized
vmbus0: on motherboard
acpi0: on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, 1ff00000 (3) failed
cpu0: on acpi0
attimer0: port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: port 0xcf8-0xcff on acpi0
pci0: on pcib0
isab0: at device 7.0 on pci0
isa0: on isab0
atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 7.1 on pci0
ata0: at channel 0 on atapci0
ata1: at channel 1 on atapci0
pci0: at device 7.3 (no driver attached)
vgapci0: mem 0xf8000000-0xfbffffff irq 11 at device 8.0 on pci0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model IntelliMouse Explorer, device ID 4
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
fdc0: <floppy drive controller (FDE)> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
orm0: at iomem 0xc0000-0xcbfff on isa0
sc0: at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ppc0: cannot reserve I/O port range
Timecounter "Hyper-V" frequency 10000000 Hz quality 10000000
Timecounters tick every 10.000 msec
storvsc0 on vmbus0
storvsc1 on vmbus0
hyperv-utils0 on vmbus0
hyperv-utils0: Hyper-V Service attaching: Hyper-V Heartbeat Service

hyperv-utils1 on vmbus0
hyperv-utils1: Hyper-V Service attaching: Hyper-V Shutdown Service

hyperv-utils2 on vmbus0
hyperv-utils2: Hyper-V Service attaching: Hyper-V Time Synch Service

storvsc2 on vmbus0
da0 at blkvsc0 bus 0 scbus1 target 0 lun 0
da0: <Msft Virtual Disk 1.0> Fixed Direct Access SCSI-4 device
da0: 300.000MB/s transfers
da0: Command Queueing enabled
da0: 30720MB (62914560 512 byte sectors: 255H 63S/T 3916C)
da1 at blkvsc1 bus 0 scbus2 target 1 lun 0
da1: <Msft Virtual Disk 1.0> Fixed Direct Access SCSI-4 device
da1: 300.000MB/s transfers
da1: Command Queueing enabled
da1: 71680MB (146800640 512 byte sectors: 255H 63S/T 9137C)
storvsc3 on vmbus0
Netvsc probe... DONE
hn0: on vmbus0
Netvsc initializing... hn0: Ethernet address: 00:15:5d:43:e3:a6
random: unblocking device.
Netvsc initializing... Already initialized!
Timecounter "TSC" frequency 1059026255 Hz quality 800
Trying to mount root from ufs:/dev/da0p2 [rw]...
calcru: runtime went backwards from 859 usec to 434 usec for pid 1027 (md0)
calcru: runtime went backwards from 19003 usec to 10497 usec for pid 1024 (sh)
calcru: runtime went backwards from 3800 usec to 2794 usec for pid 1024 (sh)
calcru: runtime went backwards from 7392 usec to 5436 usec for pid 1023 (sshd)
calcru: runtime went backwards from 47124 usec to 23824 usec for pid 1021 (sshd)
calcru: runtime went backwards from 12995 usec to 6570 usec for pid 1021 (sshd)
calcru: runtime went backwards from 341 usec to 172 usec for pid 966 (dhclient)
calcru: runtime went backwards from 1235 usec to 624 usec for pid 930 (dhclient)
calcru: runtime went backwards from 53373 usec to 26983 usec for pid 930 (dhclient)
calcru: runtime went backwards from 2591 usec to 1310 usec for pid 912 (getty)
calcru: runtime went backwards from 2625 usec to 1327 usec for pid 911 (getty)
calcru: runtime went backwards from 2580 usec to 1304 usec for pid 910 (getty)
calcru: runtime went backwards from 2628 usec to 1328 usec for pid 909 (getty)
calcru: runtime went backwards from 2633 usec to 1331 usec for pid 908 (getty)
calcru: runtime went backwards from 2678 usec to 1354 usec for pid 907 (getty)
calcru: runtime went backwards from 2662 usec to 1346 usec for pid 906 (getty)
calcru: runtime went backwards from 4834 usec to 2443 usec for pid 905 (getty)
calcru: runtime went backwards from 1013 usec to 512 usec for pid 904 (sleep)
calcru: runtime went backwards from 1489 usec to 753 usec for pid 902 (logger)
calcru: runtime went backwards from 404 usec to 204 usec for pid 901 (sh)
calcru: runtime went backwards from 3906 usec to 1975 usec for pid 866 (cron)
calcru: runtime went backwards from 5556 usec to 2809 usec for pid 862 (sendmail)
calcru: runtime went backwards from 1529 usec to 773 usec for pid 862 (sendmail)
calcru: runtime went backwards from 8277 usec to 4281 usec for pid 859 (sendmail)
calcru: runtime went backwards from 2522 usec to 1275 usec for pid 859 (sendmail)
calcru: runtime went backwards from 541062 usec to 276540 usec for pid 851 (python2.7)
calcru: runtime went backwards from 6275162 usec to 3173103 usec for pid 851 (python2.7)
calcru: runtime went backwards from 2778 usec to 1404 usec for pid 849 (sshd)
calcru: runtime went backwards from 14538 usec to 7398 usec for pid 724 (syslogd)
calcru: runtime went backwards from 3408 usec to 1723 usec for pid 621 (devd)
calcru: runtime went backwards from 685 usec to 588 usec for pid 16 (softdepflush)
calcru: runtime went backwards from 195 usec to 118 usec for pid 9 (vnlru)
calcru: runtime went backwards from 159 usec to 95 usec for pid 8 (bufdaemon)
calcru: runtime went backwards from 1088 usec to 630 usec for pid 5 (pagedaemon)
calcru: runtime went backwards from 139 usec to 70 usec for pid 4 (xpt_thrd)
calcru: runtime went backwards from 12 usec to 6 usec for pid 3 (sctp_iterator)
calcru: runtime went backwards from 30385 usec to 15384 usec for pid 2 (fdc0)
calcru: runtime went backwards from 34160 usec to 18048 usec for pid 14 (rand_harvestq)
calcru: runtime went backwards from 257568 usec to 131340 usec for pid 13 (geom)
calcru: runtime went backwards from 293188 usec to 154727 usec for pid 12 (intr)
calcru: runtime went backwards from 44971467 usec to 27735263 usec for pid 11 (idle)
calcru: runtime went backwards from 9959 usec to 5035 usec for pid 1 (init)
calcru: runtime went backwards from 3841427 usec to 1942106 usec for pid 1 (init)
calcru: runtime went backwards from 25082 usec to 12709 usec for pid 0 (kernel)

---

From: Stephen A. Zarkos [email protected]
Sent: Wednesday, April 30, 2014 12:48 PM
To: Azure/WALinuxAgent
Subject: Re: [WALinuxAgent] WALinuxAgent 2.0 under Freebsd (#29)

Hi,

If you still have access to the VM would you mind posting the output of 'dmesg'?

Thanks,
Steve

Reply to this email directly or view it on GitHubhttps://github.com//issues/29#issuecomment-41841609.

[crea7or]

dmesg
Copyright (c) 1992-2014 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.0-RELEASE #0 r260789: Thu Jan 16 22:34:59 UTC 2014
    [email protected]:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610
CPU: AMD Opteron(tm) Processor 4171 HE (1059.12-MHz K8-class CPU)
  Origin = "AuthenticAMD"  Id = 0x100f81  Family = 0x10  Model = 0x8  Stepping = 1
  Features=0x783fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2>
  Features2=0x80802001<SSE3,CX16,POPCNT,HV>
  AMD Features=0xe2500800<SYSCALL,NX,MMX+,FFXSR,LM,3DNow!+,3DNow!>
  AMD Features2=0x3f3<LAHF,CMP,CR8,ABM,SSE4A,MAS,Prefetch,OSVW>
real memory  = 1879048192 (1792 MB)
avail memory = 1696780288 (1618 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <VRTUAL MICROSFT>
ioapic0: Changing APIC ID to 0
ioapic0 <Version 1.1> irqs 0-23 on motherboard
kbd1 at kbdmux0
random: <Software, Yarrow> initialized
vmbus0: <Vmbus Devices> on motherboard
acpi0: <VRTUAL MICROSFT> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, 1ff00000 (3) failed
cpu0: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
isab0: <PCI-ISA bridge> at device 7.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel PIIX4 UDMA33 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 7.1 on pci0
ata0: <Hyper-V ATA storage disengage driver> at channel 0 on atapci0
ata1: <ATA channel> at channel 1 on atapci0
pci0: <bridge> at device 7.3 (no driver attached)
vgapci0: <VGA-compatible display> mem 0xf8000000-0xfbffffff irq 11 at device 8.0 on pci0
vgapci0: Boot video device
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model IntelliMouse Explorer, device ID 4
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
fdc0: <floppy drive controller (FDE)> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
orm0: <ISA Option ROM> at iomem 0xc0000-0xcbfff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ppc0: cannot reserve I/O port range
Timecounter "Hyper-V" frequency 10000000 Hz quality 10000000
Timecounters tick every 10.000 msec
storvsc0 on vmbus0
storvsc1 on vmbus0
hyperv-utils0 on vmbus0
hyperv-utils0: Hyper-V Service attaching: Hyper-V Heartbeat Service

hyperv-utils1 on vmbus0
hyperv-utils1: Hyper-V Service attaching: Hyper-V Shutdown Service

hyperv-utils2 on vmbus0
hyperv-utils2: Hyper-V Service attaching: Hyper-V Time Synch Service

storvsc2 on vmbus0
da0 at blkvsc0 bus 0 scbus1 target 0 lun 0
da0: <Msft Virtual Disk 1.0> Fixed Direct Access SCSI-4 device 
da0: 300.000MB/s transfers
da0: Command Queueing enabled
da0: 20482MB (41947136 512 byte sectors: 255H 63S/T 2611C)
da1 at blkvsc1 bus 0 scbus2 target 1 lun 0
da1: <Msft Virtual Disk 1.0> Fixed Direct Access SCSI-4 device 
da1: 300.000MB/s transfers
da1: Command Queueing enabled
da1: 71680MB (146800640 512 byte sectors: 255H 63S/T 9137C)
storvsc3 on vmbus0
GEOM: da0: the secondary GPT header is not in the last LBA.
Netvsc probe... DONE 
hn0: <Synthetic Network Interface> on vmbus0
Netvsc initializing... hn0: Ethernet address: 00:15:5d:e2:a6:9e
random: unblocking device.
Netvsc initializing... Already initialized!
Timecounter "TSC" frequency 1059123784 Hz quality 800
Trying to mount root from ufs:/dev/gpt/rootfs [rw]...
ipfw2 (+ipv6) initialized, divert loadable, nat loadable, default to deny, logging disabled
calcru: runtime went backwards from 3171 usec to 1721 usec for pid 1232 (cron)
calcru: runtime went backwards from 1584 usec to 801 usec for pid 1228 (sendmail)
calcru: runtime went backwards from 1563 usec to 790 usec for pid 1228 (sendmail)
calcru: runtime went backwards from 5328 usec to 3991 usec for pid 1225 (sendmail)
calcru: runtime went backwards from 1628 usec to 823 usec for pid 1225 (sendmail)
calcru: runtime went backwards from 3925 usec to 2311 usec for pid 1218 (cronolog)
calcru: runtime went backwards from 42865 usec to 29502 usec for pid 1214 (httpd)
calcru: runtime went backwards from 50104 usec to 25333 usec for pid 1207 (mysqld)
calcru: runtime went backwards from 69323 usec to 35050 usec for pid 866 (sh)
calcru: runtime went backwards from 383035 usec to 193668 usec for pid 866 (sh)
calcru: runtime went backwards from 2285 usec to 1155 usec for pid 859 (nginx)
calcru: runtime went backwards from 1459 usec to 737 usec for pid 857 (nginx)
calcru: runtime went backwards from 1626 usec to 822 usec for pid 855 (sshd)
calcru: runtime went backwards from 23711 usec to 14980 usec for pid 834 (perl)
calcru: runtime went backwards from 12903 usec to 6750 usec for pid 655 (syslogd)
calcru: runtime went backwards from 2609 usec to 1339 usec for pid 516 (devd)
calcru: runtime went backwards from 604 usec to 305 usec for pid 447 (dhclient)
calcru: runtime went backwards from 4256 usec to 2151 usec for pid 397 (dhclient)
calcru: runtime went backwards from 127836 usec to 64635 usec for pid 397 (dhclient)
calcru: runtime went backwards from 181 usec to 91 usec for pid 4 (xpt_thrd)
calcru: runtime went backwards from 12 usec to 6 usec for pid 3 (sctp_iterator)
calcru: runtime went backwards from 9788 usec to 5320 usec for pid 2 (fdc0)
calcru: runtime went backwards from 142422 usec to 77526 usec for pid 13 (geom)
calcru: runtime went backwards from 6275 usec to 5415 usec for pid 1 (init)
calcru: runtime went backwards from 8029055 usec to 4116515 usec for pid 1 (init)
calcru: runtime went backwards from 28967 usec to 15078 usec for pid 0 (kernel)
ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present;
            to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)

[szarkos]

The CD/DVD device goes away after provisioning, so if you have rebooted since the last provision (or last failed provision) then it is not unusual that we do not see cd0 anymore. The issue above seems like it did not find /dev/cd0 during the first provision, is that correct? Is this issue reproducible?

Next I will take upload the image from ftp://ftp.freebsd.org/pub/FreeBSD/snapshots/VM-IMAGES/10.0-RELEASE/amd64/20140116/ and see if there might be something missing.

[crea7or]

Yes, it looks like and yes, reproducible with the new vm image (created from the same source).

[szarkos]

I've created the following patch to fix up some of these issues:
szarkos@7c9efe4

You get the agent with this patch here:
https://raw.githubusercontent.com/szarkos/WALinuxAgent/7c9efe4308c80a874857ad15edddb62b3ae79dc3/waagent

Would you be able to test this and let me know if it works? If if works I will create a pull request.

I tested this on the FreeBSD image you posted above. All I added was python27, py27-asn1, sudo, openssh-portable and of course waagent.

Thanks,
Steve

[crea7or]

I should replace waagent file in /usr/sbin and restart the machine?

[szarkos]

No, if you restart it will not provision. You can either

1. Replace /usr/sbin/waagent after creating the VM but before provisioning has timed out (and before rebooting). This assumes you created a default user on the image already and you're able to log into the VM.

2. Replace /usr/sbin/waagent on the base VHD, reupload the VHD and re-register is as an image to attempt provisioning again.

Option 2 may take longer, but you'll want to do this anyway if the fix works for you.

[crea7or]

openssh-portable is necessary? Freebsd already include openssh and I tried without it. I see at azure website that provisioning is sucessful, but the log is almost the same:

2014/05/02 13:29:36 Windows Azure Linux Agent Version: WALinuxAgent-2.0.5-PRE
2014/05/02 13:29:36 Module /lib/modules/10.0-RELEASE/kernel/drivers/ata/ata_piix.ko driver for ATAPI CD-ROM does not exist.
2014/05/02 13:29:36 VMM Init script not found.  Provisioning for Azure
2014/05/02 13:29:36 lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
2014/05/02 13:29:36     options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
2014/05/02 13:29:36     inet6 ::1 prefixlen 128 
2014/05/02 13:29:36     inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1 
2014/05/02 13:29:36     inet 127.0.0.1 netmask 0xff000000 
2014/05/02 13:29:36     nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
2014/05/02 13:29:36 hn0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
2014/05/02 13:29:36     options=18<VLAN_MTU,VLAN_HWTAGGING>
2014/05/02 13:29:36     ether 00:15:5d:d2:47:fd
2014/05/02 13:29:36     nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
2014/05/02 13:29:36 
2014/05/02 13:29:36 GetFreeBSDEthernetInfo - Error: retry ethernet detection 9
2014/05/02 13:29:36 uid=0(root) gid=0(wheel) groups=0(wheel)
2014/05/02 13:29:36 
2014/05/02 13:29:48 IPv4 address: 100.82.222.101
2014/05/02 13:29:48 lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
2014/05/02 13:29:48     options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
2014/05/02 13:29:48     inet6 ::1 prefixlen 128 
2014/05/02 13:29:48     inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1 
2014/05/02 13:29:48     inet 127.0.0.1 netmask 0xff000000 
2014/05/02 13:29:48     nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
2014/05/02 13:29:48 hn0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
2014/05/02 13:29:48     options=18<VLAN_MTU,VLAN_HWTAGGING>
2014/05/02 13:29:48     ether 00:15:5d:d2:47:fd
2014/05/02 13:29:48     inet 100.82.222.101 netmask 0xfffffe00 broadcast 100.82.223.255 
2014/05/02 13:29:48     nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
2014/05/02 13:29:48 
2014/05/02 13:29:48 MAC  address: 00:15:5D:D2:47:FD
2014/05/02 13:29:49 ERROR:Reading from file /sys/firmware/acpi/tables/OEM0 Exception is [Errno 2] No such file or directory: '/sys/firmware/acpi/tables/OEM0'
2014/05/02 13:29:49 Probing for Windows Azure environment.
2014/05/02 13:29:49 lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
2014/05/02 13:29:49     options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
2014/05/02 13:29:49     inet6 ::1 prefixlen 128 
2014/05/02 13:29:49     inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1 
2014/05/02 13:29:49     inet 127.0.0.1 netmask 0xff000000 
2014/05/02 13:29:49     nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
2014/05/02 13:29:49 hn0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
2014/05/02 13:29:49     options=18<VLAN_MTU,VLAN_HWTAGGING>
2014/05/02 13:29:49     ether 00:15:5d:d2:47:fd
2014/05/02 13:29:49     inet 100.82.222.101 netmask 0xfffffe00 broadcast 100.82.223.255 
2014/05/02 13:29:49     nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
2014/05/02 13:29:49 
2014/05/02 13:29:49 DoDhcpWork: Setting socket.timeout=10, entering recv
2014/05/02 13:29:49 Discovered Windows Azure endpoint: 100.82.222.200
2014/05/02 13:29:49 Fabric preferred wire protocol version: 2012-11-30
2014/05/02 13:29:49 Negotiated wire protocol version: 2012-11-30
2014/05/02 13:29:49 Retrieved GoalState from Windows Azure Fabric.
2014/05/02 13:29:49 ExpectedState: Started
2014/05/02 13:29:49 ContainerId: b81c472d-0f1d-403e-a992-93c261fe87db
2014/05/02 13:29:49 RoleInstanceId: 8cbe87b7bee245f9baca593ff9161638.freebsd10
2014/05/02 13:29:49 Spawning bsd_activate_resource_disk.py
2014/05/02 13:29:49 Provisioning image started.
2014/05/02 13:29:50 ERROR:Traceback (most recent call last):
2014/05/02 13:29:50 ERROR:  File "/usr/sbin/waagent", line 4741, in main
2014/05/02 13:29:50 ERROR:    WaAgent.Run()
2014/05/02 13:29:50 ERROR:  File "/usr/sbin/waagent", line 4333, in Run
2014/05/02 13:29:50 ERROR:    provisionError = self.Provision()
2014/05/02 13:29:50 ERROR:  File "/usr/sbin/waagent", line 4188, in Provision
2014/05/02 13:29:50 ERROR:    if MyDistro.mediaHasFilesystem(dvd) is False :
2014/05/02 13:29:50 ERROR:  File "/usr/sbin/waagent", line 1526, in mediaHasFilesystem
2014/05/02 13:29:50 ERROR:    if Run('LC_ALL=C fdisk -p ' + dsk + ' | grep "invalid fdisk partition table found" ',False):
2014/05/02 13:29:50 ERROR:TypeError: cannot concatenate 'str' and 'NoneType' objects
2014/05/02 13:29:50 ERROR:
2014/05/02 13:29:50 ERROR:Exception: cannot concatenate 'str' and 'NoneType' objects
2014/05/02 13:29:52 Resource disk (/dev/da1s1) is mounted at /mnt/resource with fstype ufs2

[crea7or]

Tried openssh-portable - same result. Maybe I doing something wrong?

Download and login to image
Allow sshd and enable network then restart
install python, sudo...
Upload waagent via ssh
Launch waagent -install
shutdown -p now

upload to azure, create new disk and then new vm. wait until it will be launched. login and look into /var/log/waagent.log

[szarkos]

Ah, I think I might know what's happening. Just to clarify, when you create this FreeBSD VM are you creating it from an "Image" or a "Disk"? To create an image you need to go into "Virtual Machines"->"Images" in the Azure management portal and create the image from the uploaded VHD.

The difference is that provisioning from a Disk will never attach a DVD to provide provisioning data (which is what's happening here) and the VM will immediately be set to "Ready" by the fabric. In fact you don't even need the agent. You are then responsible for pre-creating users and all the configuration.

If you want to provision from disk you can just set "Provisioning.Enabled=n" in /etc/waagent.conf. But I suspect most likely you will want to provision via an image so you can create and customize multiple VMs, correct?

I modified the fix a bit to suppress the error you are seeing when provisioning as a "Disk". You can get the new agent here: https://raw.githubusercontent.com/szarkos/WALinuxAgent/d7df229d2d39222fe66159d6aa9b0b391145adb0/waagent

Lastly, no openssh-portable isn't necessary, that's just what I used :)

Thanks,
Steve

[crea7or]

Yes, you are right! I did it via disk. Thank you! Will try it right now.

[crea7or]

Sorry, but different problem ;) Something encoding related, py27-asn1 is installed.

2014/05/03 00:04:48 Spawning bsd_activate_resource_disk.py
2014/05/03 00:04:48 Provisioning image started.
2014/05/03 00:04:49 ERROR:Traceback (most recent call last):
2014/05/03 00:04:49 ERROR:  File "/usr/sbin/waagent", line 4745, in main
2014/05/03 00:04:49 ERROR:    WaAgent.Run()
2014/05/03 00:04:49 ERROR:  File "/usr/sbin/waagent", line 4337, in Run
2014/05/03 00:04:49 ERROR:    provisionError = self.Provision()
2014/05/03 00:04:49 ERROR:  File "/usr/sbin/waagent", line 4206, in Provision
2014/05/03 00:04:49 ERROR:    retcode,output=MyDistro.mountDVD(dvd,location)
2014/05/03 00:04:49 ERROR:  File "/usr/sbin/waagent", line 1542, in mountDVD
2014/05/03 00:04:49 ERROR:    SetFileContents(location+"/ovf-env.xml", ovfxml)
2014/05/03 00:04:49 ERROR:  File "/usr/sbin/waagent", line 1611, in SetFileContents
2014/05/03 00:04:49 ERROR:    contents=contents.encode('latin-1')
2014/05/03 00:04:49 ERROR:UnicodeDecodeError: 'ascii' codec can't decode byte 0xed in position 2049: ordinal not in range(128)
2014/05/03 00:04:49 ERROR:
2014/05/03 00:04:49 ERROR:Exception: 'ascii' codec can't decode byte 0xed in position 2049: ordinal not in range(128)
2014/05/03 00:04:50 Resource disk (/dev/da1s1) is mounted at /mnt/resource with fstype ufs2

[szarkos]

That's odd. I'll need to research why the previous fix didn't mitigate that issue... but in the meantime we can just force the encoding. Can you try the following agent:

https://raw.githubusercontent.com/szarkos/WALinuxAgent/789bbc8855a2dd3e400e8c593dd47a292c0331a6/waagent

Thanks for sticking with us on this :)

Steve

[crea7or]

Almost done! ;) But now there network error while getting some properties. However provisioning is done!

2014/05/03 09:52:07 lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
2014/05/03 09:52:07     options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
2014/05/03 09:52:07     inet6 ::1 prefixlen 128 
2014/05/03 09:52:07     inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1 
2014/05/03 09:52:07     inet 127.0.0.1 netmask 0xff000000 
2014/05/03 09:52:07     nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
2014/05/03 09:52:07 hn0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
2014/05/03 09:52:07     options=18<VLAN_MTU,VLAN_HWTAGGING>
2014/05/03 09:52:07     ether 00:15:5d:e3:59:f2
2014/05/03 09:52:07     inet 100.74.136.33 netmask 0xfffffe00 broadcast 100.74.137.255 
2014/05/03 09:52:07     nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
2014/05/03 09:52:07 
2014/05/03 09:52:08 Resource disk (/dev/da1s1) is mounted at /mnt/resource with fstype ufs2
2014/05/03 09:52:09 ERROR:CalledProcessError.  Error Code is 1
2014/05/03 09:52:09 ERROR:CalledProcessError.  Command string was pgrep -n dhclient
2014/05/03 09:52:09 ERROR:CalledProcessError.  Command result was 
2014/05/03 09:52:10 ERROR:socket IOError  args: (51, 'Network is unreachable')
2014/05/03 09:52:10 ERROR:HttpPost(/machine?comp=roleProperties),retry=0,status=None
2014/05/03 09:52:10 ERROR:sleep 10 seconds HttpPost(/machine?comp=roleProperties),retry=0,status=None
2014/05/03 09:52:20 ERROR:retry HttpPost(/machine?comp=roleProperties),retry=1
2014/05/03 09:52:20 ERROR:socket IOError  args: (51, 'Network is unreachable')
2014/05/03 09:52:20 ERROR:response HttpPost(/machine?comp=roleProperties),retry=1,status=None
2014/05/03 09:52:20 ERROR:HttpPost(/machine?comp=roleProperties),retry=1,status=None
2014/05/03 09:52:20 ERROR:sleep 10 seconds HttpPost(/machine?comp=roleProperties),retry=1,status=None
2014/05/03 09:52:30 ERROR:retry HttpPost(/machine?comp=roleProperties),retry=2
2014/05/03 09:52:30 ERROR:socket IOError  args: (51, 'Network is unreachable')
2014/05/03 09:52:30 ERROR:response HttpPost(/machine?comp=roleProperties),retry=2,status=None
2014/05/03 09:52:30 ERROR:HttpPost(/machine?comp=roleProperties),retry=2,status=None
2014/05/03 09:52:30 ERROR:return HttpPost(/machine?comp=roleProperties),retry=2,status=None
2014/05/03 09:52:30 Posted Role Properties. CertificateThumbprint=42f6b574ff02118c0628a75ff042204f
2014/05/03 09:52:30 Root password deleted.
2014/05/03 09:52:30 Provisioning image completed.
2014/05/03 09:52:30 lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
2014/05/03 09:52:30     options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
2014/05/03 09:52:30     inet6 ::1 prefixlen 128 
2014/05/03 09:52:30     inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1 
2014/05/03 09:52:30     inet 127.0.0.1 netmask 0xff000000 
2014/05/03 09:52:30     nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
2014/05/03 09:52:30 hn0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
2014/05/03 09:52:30     options=18<VLAN_MTU,VLAN_HWTAGGING>
2014/05/03 09:52:30     ether 00:15:5d:e3:59:f2
2014/05/03 09:52:30     nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
2014/05/03 09:52:30 
2014/05/03 09:52:30 GetFreeBSDEthernetInfo - Error: retry ethernet detection 9
2014/05/03 09:52:30 uid=0(root) gid=0(wheel) groups=0(wheel)
2014/05/03 09:52:30 
2014/05/03 09:52:41 Posted Role Properties. CertificateThumbprint=42f6b574ff02118c0628a75ff042204f

[szarkos]

It looks like networking is having issues for some reason. Does this VM have network access after provisioning?

Also, how did you set up networking on your FreeBSD image? Typically I set the following in /etc/rc.conf:

ifconfig_hn0="SYNCDHCP"

After setting this verify that "service netif restart" properly restarts networking (it should).

[crea7or]

I thought that waagent will set it before use, so, after adding ifconfig_hn0 it works without problems!
Thank you!

[szarkos]

That's great news :) I guess we can consider this issue "closed" then? I'll get these fixes we worked on into the next version of waagent, so when 2.0.5 is released it should work without concerns.

[abgupta]

Hi,

If you don’t mind very much then would it be possible for you to post your FreeBSD 10 VHD for Azure on vmdepot :

http://vmdepot.msopentech.com/List/Index

This will help others run FreeBSD 10 VMs as well. Please let me know your thoughts.
Thanks,
Abhishek

From: Stephen A. Zarkos [mailto:[email protected]]
Sent: Tuesday, May 6, 2014 10:05 AM
To: Azure/WALinuxAgent
Subject: Re: [WALinuxAgent] WALinuxAgent 2.0 under Freebsd (#29)

That's great news :) I guess we can consider this issue "closed" then? I'll get these fixes we worked on into the next version of waagent, so when 2.0.5 is released it should work without concerns.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/29#issuecomment-42329904.

[crea7or]

Did it few minutes ago ;)
http://vmdepot.msopentech.com/Vhd/Show?vhdId=36254

[abgupta]

Thank you Pavel! Much appreciated ☺. I will advertise your VM to other customers as well.

May I also ask what is the motivation behind your project? You can little r me on [email protected]:[email protected]

Thanks,
Abhishek

From: crea7or [mailto:[email protected]]
Sent: Tuesday, May 6, 2014 10:53 AM
To: Azure/WALinuxAgent
Cc: Abhishek Gupta (LIS)
Subject: Re: [WALinuxAgent] WALinuxAgent 2.0 under Freebsd (#29)

Did it few minutes ago ;)
http://vmdepot.msopentech.com/Vhd/Show?vhdId=36254&version=37334

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/29#issuecomment-42335948.

[crea7or]

Freebsd is very stable, low-resources and high-performance network server. I use it for a 7 years in my projects and I'm very satisfied.

[abgupta]

Thanks Pavel. My question was more along the lines on how you will be using it for Azure? Will you be implementing a network appliance for Azure or is this more of a hobby project for you? Please let me know.

Thanks,
Abhishek
From: crea7or [mailto:[email protected]]
Sent: Tuesday, May 6, 2014 12:14 PM
To: Azure/WALinuxAgent
Cc: Abhishek Gupta (LIS)
Subject: Re: [WALinuxAgent] WALinuxAgent 2.0 under Freebsd (#29)

Freebsd is very stable, low-resources and high-performance network server. I use it for a 7 years in my projects and I'm very satisfied.

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/29#issuecomment-42345903.

[crea7or]

Currently I use it as web server. But in the next project it will work as frontend to the database with advanced functionality.

[abgupta]

Awesome! Will this next project be for some customer or is it for your private use as well? Please let me know.
Thanks,
Abhishek

[crea7or]

It will be a product for small business. So, will be widely used ( I hope :).

[abgupta]

Thank you and good luck to you!

[wangjj1989]

@szarkos
Hi, I also have this issue on Linux. My Linux is based on Redhat but I make many customizations .
I find following info from log:
INFO Run provision handler. 2016/11/02 22:30:31.414999 INFO Copy ovf-env.xml. 2016/11/02 22:30:31.419522 ERROR Event: name=WALA, op=Provision, message=Failed to copy ovf-env.xml: (000008)(000007) Failed to get dvd device
I also can't find dvd device under /dev.
I have some question about dvd device:

1. This dvd device is attached by Azure (underlying hypervisor?)
2. When this dvd device will be attached? (boot and provision?)

Looking forward for your help!

[wangjj1989]

Another question: usually, I create the VHD from HyperV and I don't attach a dvd for it. Does it relate to this?

[wangjj1989]

Is /dev/sr0 created by waagent for Linux on Azure?
I create a centos 7 linux on hyperv and I also can't find /dev/{cdrom, hdc, sr0}.

[szarkos]

On Azure, at first boot a configuration file is passed to the guest VM via the DVD device. Usually the DVD device is picked up by the ata_piix driver. The agent doesn't create /dev/sr0.

Since the original issue is from 2014 please file a new issue for this if you think it's a bug in the Azure agent. However, this is almost certainly a bug in your custom kernel or distro.

[wangjj1989]

Yes, I find ata_piix driver doesn't exist in my VM. And I also find this Microsoft post:
https://support.microsoft.com/en-sg/kb/2600152
so I should load ata_piix driver after hv_utils/storvsc drivers have been loaded, right?( I need change my os rc boot script, I afraid hv driver will unload it again)

[wangjj1989]

Hi szarkos,
I still have one question: if the first boot provision failed, for example, the agent is still not installed, is there are the other ways to trigger the provision(get the configration file via the DVD device)?
I find "Provisioning.Enabled=y" in waagent.conf, does this option will make the provision happen every times(include passing the configuration file to guest VM)?

[brendandixon]

@wangjj1989 Provisioning is (meant to be) a one-time action. The Provisioning.Enabled flag allows / disallows that one-time action. It does not request provisioning on every boot.