Hi, I was trying to run the L4 demo *vm-basic-pci* for *arm64* using the command $ make qemu E=vm-basic-pci but It didn't work because of the missing 2 files : * virt-arm_virt-64_pci.dtb : which is requested by the *modules.list* file in the line :
module[arch=arm64,fname=virt-pci.dtb] dtb/virt-arm_virt-64_pci.dtb
* virt-pci.dtbo : which is requested by the *vm-basic-pci.cfg* by the configuration
if (L4.Info.arch() == "arm64") then dt = "-drom/.fdt" overlay = "*-drom/virt-pci.dtbo*" else dt = "-drom/virt-pci.dtb" overlay = "" end
I searched for both files in the whole *l4re-snapshot-23.10.1* directory but I couldn't find them Where can I find those necessary files to run *vm-basic-pc*i demo?
Thanks in advance, Regards
Hi Mohamed,
On [15-10-2024 16:59], Mohamed Dawod wrote:
Hi, I was trying to run the L4 demo *vm-basic-pci* for *arm64* using the command $ make qemu E=vm-basic-pci but It didn't work because of the missing 2 files :
- virt-arm_virt-64_pci.dtb : which is requested by the *modules.list* file
in the line :
module[arch=arm64,fname=virt-pci.dtb] dtb/virt-arm_virt-64_pci.dtb
- virt-pci.dtbo : which is requested by the *vm-basic-pci.cfg* by the
configuration
if (L4.Info.arch() == "arm64") then dt = "-drom/.fdt" overlay = "*-drom/virt-pci.dtbo*"
This is actually a typo. Please change this line to
overlay = "-drom/virt-pci.dtb"
Best, Matthias.
else dt = "-drom/virt-pci.dtb" overlay = "" end
I searched for both files in the whole *l4re-snapshot-23.10.1* directory but I couldn't find them Where can I find those necessary files to run *vm-basic-pc*i demo?
Thanks in advance, Regards
-- Mohamed Dawod *Software Engineer,* Cairo Egypt
--
*Driving Innovation! Visit our website www.avelabs.com http://www.avelabs.com/*, to read Avelabs Confidentiality Notice, follow this link: http://www.avelabs.com/email/disclaimer.html http://www.avelabs.com/email/disclaimer.html
l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de
Thanks Matthias I'm going to fix the typo of *virt-pci.dtbo*. What about the missing file *dtb/virt-arm_virt-64_pci.dtb *?
On Tue, Oct 15, 2024 at 11:58 PM Matthias Lange < matthias.lange@kernkonzept.com> wrote:
Hi Mohamed,
On [15-10-2024 16:59], Mohamed Dawod wrote:
Hi, I was trying to run the L4 demo *vm-basic-pci* for *arm64* using the
command
$ make qemu E=vm-basic-pci but It didn't work because of the missing 2 files :
- virt-arm_virt-64_pci.dtb : which is requested by the *modules.list*
file
in the line :
module[arch=arm64,fname=virt-pci.dtb] dtb/virt-arm_virt-64_pci.dtb
- virt-pci.dtbo : which is requested by the *vm-basic-pci.cfg* by the
configuration
if (L4.Info.arch() == "arm64") then dt = "-drom/.fdt" overlay = "*-drom/virt-pci.dtbo*"
This is actually a typo. Please change this line to
overlay = "-drom/virt-pci.dtb"
Best, Matthias.
else dt = "-drom/virt-pci.dtb" overlay = "" end
I searched for both files in the whole *l4re-snapshot-23.10.1* directory but I couldn't find them Where can I find those necessary files to run *vm-basic-pc*i demo?
Thanks in advance, Regards
-- Mohamed Dawod *Software Engineer,* Cairo Egypt
--
*Driving Innovation! Visit our website www.avelabs.com http://www.avelabs.com/*, to read Avelabs Confidentiality Notice,
follow
this link: http://www.avelabs.com/email/disclaimer.html http://www.avelabs.com/email/disclaimer.html
l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de
-- Get started with L4Re in 3 days - register now for our workshop in October!
Visit https://www.kernkonzept.com/workshop-getting-started-with-l4re to learn more.
-- Matthias Lange phone: +49 (0) 351-41 888 614 Customer Engineer Specialist web: https://www.kernkonzept.com
Kernkonzept GmbH Buchenstraße 16b 01097 Dresden
Geschäftsführer: Dr.-Ing. Michael Hohmuth Registergericht: Amtsgericht Dresden Handelsregister: HRB 31129
You might not be working when I am and that's ok! Please make sure to only reply when it suits you. Mails can wait.
Hi Mohamed,
can you please check your arm64 build tree and look into the folder 'assets/dtb/'? There should be links to all the .dtb files of uvmm. The link of the file in question on my machine is:
[...]/.build-arm64/pkg/uvmm/configs/dts/OBJ-arm64_armv8a-std-l4f/virt-arm_virt-64_pci.dtb
If the file is missing in the linked folder, please check the corresponding source directory:
<src>/pkg/uvmm/configs/dts/
If virt-arm_virt-64_pci.dts isn't in there, you can download it from our development version of L4Re on github and recompile the uvmm package.
https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64...
If the file is there, please check that '<arm64-build>/assets' directory is in your MODULE_SEARCH_PATH.
Let me know, if this solves the missing file problem.
Cheers, Philipp
Am 20.10.24 um 09:20 schrieb Mohamed Dawod:
Thanks Matthias I'm going to fix the typo of *virt-pci.dtbo*. What about the missing file *dtb/virt-arm_virt-64_pci.dtb *?
On Tue, Oct 15, 2024 at 11:58 PM Matthias Lange <matthias.lange@kernkonzept.com mailto:matthias.lange@kernkonzept.com> wrote:
Hi Mohamed, On [15-10-2024 16:59], Mohamed Dawod wrote: > Hi, > I was trying to run the L4 demo *vm-basic-pci* for *arm64* using the command > $ make qemu E=vm-basic-pci > but It didn't work because of the missing 2 files : > * virt-arm_virt-64_pci.dtb : which is requested by the *modules.list* file > in the line : > > > module[arch=arm64,fname=virt-pci.dtb] dtb/virt-arm_virt-64_pci.dtb > > * virt-pci.dtbo : which is requested by the *vm-basic-pci.cfg* by the > configuration > > > if (L4.Info.arch() == "arm64") then > > dt = "-drom/.fdt" > > overlay = "*-drom/virt-pci.dtbo*" This is actually a typo. Please change this line to overlay = "-drom/virt-pci.dtb" Best, Matthias. > > else > > dt = "-drom/virt-pci.dtb" > > overlay = "" > > end > > > I searched for both files in the whole *l4re-snapshot-23.10.1* directory > but I couldn't find them > Where can I find those necessary files to run *vm-basic-pc*i demo? > > Thanks in advance, > Regards > > -- > Mohamed Dawod > *Software Engineer,* Cairo Egypt > > -- > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com/ <http://www.avelabs.com/>>*, to read Avelabs Confidentiality Notice, follow > this link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > _______________________________________________ > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> -- Get started with L4Re in 3 days - register now for our workshop in October! Visit https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> to learn more. -- Matthias Lange phone: +49 (0) 351-41 888 614 Customer Engineer Specialist web: https://www.kernkonzept.com <https://www.kernkonzept.com> Kernkonzept GmbH Buchenstraße 16b 01097 Dresden Geschäftsführer: Dr.-Ing. Michael Hohmuth Registergericht: Amtsgericht Dresden Handelsregister: HRB 31129 You might not be working when I am and that's ok! Please make sure to only reply when it suits you. Mails can wait.*Driving Innovation! Visit our website www.avelabs.com http://www.avelabs.com/*, to read Avelabs Confidentiality Notice, follow this link: http://www.avelabs.com/email/disclaimer.html http://www.avelabs.com/email/disclaimer.html
l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de
I upgraded L4 version to 24.08 instead of 23.10 because 24.08 contains the missing virt-arm_virt-64_pci.dts file. I'm building for arm64 and when I run the demo VM-basic-pci, I got the following error ! I didn't change anything in the dts/dtb or ned scripts excepting the typo of
overlay = "-drom/virt-pci.dtbo"
What is the problem here ?
[image: image.png]
On Mon, Oct 21, 2024 at 11:35 AM Philipp Eppelt < philipp.eppelt@kernkonzept.com> wrote:
Hi Mohamed,
can you please check your arm64 build tree and look into the folder 'assets/dtb/'? There should be links to all the .dtb files of uvmm. The link of the file in question on my machine is:
[...]/.build-arm64/pkg/uvmm/configs/dts/OBJ-arm64_armv8a-std-l4f/virt-arm_virt-64_pci.dtb
If the file is missing in the linked folder, please check the corresponding source directory:
<src>/pkg/uvmm/configs/dts/
If virt-arm_virt-64_pci.dts isn't in there, you can download it from our development version of L4Re on github and recompile the uvmm package.
https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64...
If the file is there, please check that '<arm64-build>/assets' directory is in your MODULE_SEARCH_PATH.
Let me know, if this solves the missing file problem.
Cheers, Philipp
Am 20.10.24 um 09:20 schrieb Mohamed Dawod:
Thanks Matthias I'm going to fix the typo of *virt-pci.dtbo*. What about the missing file *dtb/virt-arm_virt-64_pci.dtb *?
On Tue, Oct 15, 2024 at 11:58 PM Matthias Lange <
matthias.lange@kernkonzept.com
mailto:matthias.lange@kernkonzept.com> wrote:
Hi Mohamed, On [15-10-2024 16:59], Mohamed Dawod wrote: > Hi, > I was trying to run the L4 demo *vm-basic-pci* for *arm64* usingthe command
> $ make qemu E=vm-basic-pci > but It didn't work because of the missing 2 files : > * virt-arm_virt-64_pci.dtb : which is requested by the*modules.list* file
> in the line : > > > module[arch=arm64,fname=virt-pci.dtb]dtb/virt-arm_virt-64_pci.dtb
> > * virt-pci.dtbo : which is requested by the *vm-basic-pci.cfg* bythe
> configuration > > > if (L4.Info.arch() == "arm64") then > > dt = "-drom/.fdt" > > overlay = "*-drom/virt-pci.dtbo*" This is actually a typo. Please change this line to overlay = "-drom/virt-pci.dtb" Best, Matthias. > > else > > dt = "-drom/virt-pci.dtb" > > overlay = "" > > end > > > I searched for both files in the whole *l4re-snapshot-23.10.1*directory
> but I couldn't find them > Where can I find those necessary files to run *vm-basic-pc*i demo? > > Thanks in advance, > Regards > > -- > Mohamed Dawod > *Software Engineer,* Cairo Egypt > > -- > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com/ <http://www.avelabs.com/>>*, to readAvelabs
Confidentiality Notice, follow > this link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > _______________________________________________ > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > To unsubscribe send an email tol4-hackers-leave@os.inf.tu-dresden.de
<mailto:l4-hackers-leave@os.inf.tu-dresden.de> -- Get started with L4Re in 3 days - register now for our workshop inOctober!
Visit https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> tolearn
more. -- Matthias Lange phone: +49 (0) 351-41 888 614 Customer Engineer Specialist web: https://www.kernkonzept.com <https://www.kernkonzept.com> Kernkonzept GmbH Buchenstraße 16b 01097 Dresden Geschäftsführer: Dr.-Ing. Michael Hohmuth Registergericht: Amtsgericht Dresden Handelsregister: HRB 31129 You might not be working when I am and that's ok! Please make sureto only
reply when it suits you. Mails can wait.*Driving Innovation! Visit our website www.avelabs.com http://www.avelabs.com/*, to read Avelabs Confidentiality Notice,
follow this
link: http://www.avelabs.com/email/disclaimer.html http://www.avelabs.com/email/disclaimer.html
l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de
-- philipp.eppelt@kernkonzept.com - Tel. 0351-41 883 221 http://www.kernkonzept.com
Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. Geschäftsführer: Dr.-Ing. Michael Hohmuth _______________________________________________ l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de
Hi Mohamed,
I'm happy to see you resolved the issue. If possible, please prefer a text log from the serial console over a picture, because the text log is longer and thus provides more information about the booted system.
uvmm show this error, when memory regions overlap. In this case RAM and the intc device overlap. The intc device is specified in the device tree you passed to uvmm. Here, the device tree does not contain explicit RAM regions, so uvmm sets up the default RAM region, which spans the area starting at zero up to the size of the RAM you configured in the ned script. In this case, RAM covers the area [ 0: fff'ffff] (256MB). The itc device wants to allocate the area [0x0800'0000 : 0x0800'ffff] which is contained within the already existing RAM allocation. Thus the error message.
You have two options, either specify the areas where the RAM should be placed in the memory node of the device tree or move the intc device such that it doesn't overlap. For this setup this means above 0x1000'0000.
Cheers Philipp
Am 22.10.24 um 09:36 schrieb Mohamed Dawod:
I upgraded L4 version to 24.08 instead of 23.10 because 24.08 contains the missing virt-arm_virt-64_pci.dts file. I'm building for arm64 and when I run the demo VM-basic-pci, I got the following error ! I didn't change anything in the dts/dtb or ned scripts excepting the typo of
overlay = "-drom/virt-pci.dtbo"What is the problem here ?
image.png
On Mon, Oct 21, 2024 at 11:35 AM Philipp Eppelt <philipp.eppelt@kernkonzept.com mailto:philipp.eppelt@kernkonzept.com> wrote:
Hi Mohamed, can you please check your arm64 build tree and look into the folder 'assets/dtb/'? There should be links to all the .dtb files of uvmm. The link of the file in question on my machine is: [...]/.build-arm64/pkg/uvmm/configs/dts/OBJ-arm64_armv8a-std-l4f/virt-arm_virt-64_pci.dtb If the file is missing in the linked folder, please check the corresponding source directory: <src>/pkg/uvmm/configs/dts/ If virt-arm_virt-64_pci.dts isn't in there, you can download it from our development version of L4Re on github and recompile the uvmm package. https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts <https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts> If the file is there, please check that '<arm64-build>/assets' directory is in your MODULE_SEARCH_PATH. Let me know, if this solves the missing file problem. Cheers, Philipp Am 20.10.24 um 09:20 schrieb Mohamed Dawod: > Thanks Matthias > I'm going to fix the typo of *virt-pci.dtbo*. > What about the missing file *dtb/virt-arm_virt-64_pci.dtb *? > > > On Tue, Oct 15, 2024 at 11:58 PM Matthias Lange <matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>>> wrote: > > Hi Mohamed, > > On [15-10-2024 16:59], Mohamed Dawod wrote: > > Hi, > > I was trying to run the L4 demo *vm-basic-pci* for *arm64* using the command > > $ make qemu E=vm-basic-pci > > but It didn't work because of the missing 2 files : > > * virt-arm_virt-64_pci.dtb : which is requested by the *modules.list* file > > in the line : > > > > > module[arch=arm64,fname=virt-pci.dtb] dtb/virt-arm_virt-64_pci.dtb > > > > * virt-pci.dtbo : which is requested by the *vm-basic-pci.cfg* by the > > configuration > > > > > if (L4.Info.arch() == "arm64") then > > > dt = "-drom/.fdt" > > > overlay = "*-drom/virt-pci.dtbo*" > > This is actually a typo. Please change this line to > > overlay = "-drom/virt-pci.dtb" > > Best, > Matthias. > > > > else > > > dt = "-drom/virt-pci.dtb" > > > overlay = "" > > > end > > > > > > I searched for both files in the whole *l4re-snapshot-23.10.1* directory > > but I couldn't find them > > Where can I find those necessary files to run *vm-basic-pc*i demo? > > > > Thanks in advance, > > Regards > > > > -- > > Mohamed Dawod > > *Software Engineer,* Cairo Egypt > > > > -- > > > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>*, to read Avelabs > Confidentiality Notice, follow > > this link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > > > _______________________________________________ > > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > > -- > Get started with L4Re in 3 days - register now for our workshop in October! > > Visit https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re>> to learn > more. > > -- > Matthias Lange phone: +49 (0) 351-41 888 614 > Customer Engineer Specialist web: https://www.kernkonzept.com <https://www.kernkonzept.com> > <https://www.kernkonzept.com <https://www.kernkonzept.com>> > > Kernkonzept GmbH > Buchenstraße 16b > 01097 Dresden > > Geschäftsführer: Dr.-Ing. Michael Hohmuth > Registergericht: Amtsgericht Dresden > Handelsregister: HRB 31129 > > You might not be working when I am and that's ok! Please make sure to only > reply when it suits you. Mails can wait. > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com/ <http://www.avelabs.com/>>*, to read Avelabs Confidentiality Notice, follow this > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > _______________________________________________ > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> -- philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> - Tel. 0351-41 883 221 http://www.kernkonzept.com <http://www.kernkonzept.com> Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. Geschäftsführer: Dr.-Ing. Michael Hohmuth _______________________________________________ l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>*Driving Innovation! Visit our website www.avelabs.com http://www.avelabs.com/*, to read Avelabs Confidentiality Notice, follow this link: http://www.avelabs.com/email/disclaimer.html http://www.avelabs.com/email/disclaimer.html
Hi,
Thanks Philipp for your patience and valuable support.
I changed the areas where the RAM should be placed in the memory node of the device tree and it worked. Now, I want to test the pci bus by connecting a virtio-blk-pci device via qemu to be mounted on /dev/vda to do that, I run qemu using the following options :
*$ qemu-system-aarch64 -kernel
/home/dawod/workspace/l4re-snapshot-24.08.0/build_aarch64/l4/images/l4re_VM-basic-pci.elf -serial stdio -M virt,virtualization=true,iommu=smmuv3 -cpu cortex-a57 -m 4096 --display none -drive if=none,file=/home/dawod/storage/disk.rootfs.ext4,format=raw,id=disk0 -device virtio-blk-pci,drive=disk0*
but the VM hangs in the booting stage while trying to create the /dev/vda block device which will be responsible for handling the added disk. *please* *find attached a text log from the serial console * : vm-blk-pci.log https://mail.google.com/mail/u/0?ui=2&ik=b05e32a9ef&attid=0.1&permmsgid=msg-a:r-4942377897740831663&view=att&disp=safe&realattid=f_m2lp0t191
[image: image.png]
Many Thanks, Regards
On Tue, Oct 22, 2024 at 6:54 PM Philipp Eppelt < philipp.eppelt@kernkonzept.com> wrote:
Hi Mohamed,
I'm happy to see you resolved the issue. If possible, please prefer a text log from the serial console over a picture, because the text log is longer and thus provides more information about the booted system.
uvmm show this error, when memory regions overlap. In this case RAM and the intc device overlap. The intc device is specified in the device tree you passed to uvmm. Here, the device tree does not contain explicit RAM regions, so uvmm sets up the default RAM region, which spans the area starting at zero up to the size of the RAM you configured in the ned script. In this case, RAM covers the area [ 0: fff'ffff] (256MB). The itc device wants to allocate the area [0x0800'0000 : 0x0800'ffff] which is contained within the already existing RAM allocation. Thus the error message.
You have two options, either specify the areas where the RAM should be placed in the memory node of the device tree or move the intc device such that it doesn't overlap. For this setup this means above 0x1000'0000.
Cheers Philipp
Am 22.10.24 um 09:36 schrieb Mohamed Dawod:
I upgraded L4 version to 24.08 instead of 23.10 because 24.08 contains
the
missing virt-arm_virt-64_pci.dts file. I'm building for arm64 and when I run the demo VM-basic-pci, I got the
following
error ! I didn't change anything in the dts/dtb or ned scripts excepting the
typo of
overlay = "-drom/virt-pci.dtbo"What is the problem here ?
image.png
On Mon, Oct 21, 2024 at 11:35 AM Philipp Eppelt <
philipp.eppelt@kernkonzept.com
mailto:philipp.eppelt@kernkonzept.com> wrote:
Hi Mohamed, can you please check your arm64 build tree and look into the folder 'assets/dtb/'? There should be links to all the .dtb files of uvmm.The link of
the file in question on my machine is:[...]/.build-arm64/pkg/uvmm/configs/dts/OBJ-arm64_armv8a-std-l4f/virt-arm_virt-64_pci.dtb
If the file is missing in the linked folder, please check thecorresponding
source directory: <src>/pkg/uvmm/configs/dts/ If virt-arm_virt-64_pci.dts isn't in there, you can download it fromour
development version of L4Re on github and recompile the uvmm package.https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64...
If the file is there, please check that '<arm64-build>/assets'directory is in
your MODULE_SEARCH_PATH. Let me know, if this solves the missing file problem. Cheers, Philipp Am 20.10.24 um 09:20 schrieb Mohamed Dawod: > Thanks Matthias > I'm going to fix the typo of *virt-pci.dtbo*. > What about the missing file *dtb/virt-arm_virt-64_pci.dtb *? > > > On Tue, Oct 15, 2024 at 11:58 PM Matthias Lange <matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>
> <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>>> wrote: > > Hi Mohamed, > > On [15-10-2024 16:59], Mohamed Dawod wrote: > > Hi, > > I was trying to run the L4 demo *vm-basic-pci* for *arm64*using
the command > > $ make qemu E=vm-basic-pci > > but It didn't work because of the missing 2 files : > > * virt-arm_virt-64_pci.dtb : which is requested by the *modules.list* file > > in the line : > > > > > module[arch=arm64,fname=virt-pci.dtb] dtb/virt-arm_virt-64_pci.dtb > > > > * virt-pci.dtbo : which is requested by the*vm-basic-pci.cfg* by the
> > configuration > > > > > if (L4.Info.arch() == "arm64") then > > > dt = "-drom/.fdt" > > > overlay = "*-drom/virt-pci.dtbo*" > > This is actually a typo. Please change this line to > > overlay = "-drom/virt-pci.dtb" > > Best, > Matthias. > > > > else > > > dt = "-drom/virt-pci.dtb" > > > overlay = "" > > > end > > > > > > I searched for both files in the whole*l4re-snapshot-23.10.1*
directory > > but I couldn't find them > > Where can I find those necessary files to run*vm-basic-pc*i demo?
> > > > Thanks in advance, > > Regards > > > > -- > > Mohamed Dawod > > *Software Engineer,* Cairo Egypt > > > > -- > > > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>*, to readAvelabs
> Confidentiality Notice, follow > > this link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > > > _______________________________________________ > > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > > -- > Get started with L4Re in 3 days - register now for ourworkshop in
October! > > Visithttps://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re>>to learn
> more. > > -- > Matthias Lange phone: +49 (0) 351-41 888614
> Customer Engineer Specialist web:<https://www.kernkonzept.com> > <https://www.kernkonzept.com <https://www.kernkonzept.com>> > > Kernkonzept GmbH > Buchenstraße 16b > 01097 Dresden > > Geschäftsführer: Dr.-Ing. Michael Hohmuth > Registergericht: Amtsgericht Dresden > Handelsregister: HRB 31129 > > You might not be working when I am and that's ok! Please makesure to
only > reply when it suits you. Mails can wait. > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com/ <http://www.avelabs.com/>>*, to readAvelabs
Confidentiality Notice, follow this > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > _______________________________________________ > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > To unsubscribe send an email tol4-hackers-leave@os.inf.tu-dresden.de
<mailto:l4-hackers-leave@os.inf.tu-dresden.de> -- philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> -
Tel. 0351-41 883 221 http://www.kernkonzept.com <http://www.kernkonzept.com> Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. Geschäftsführer: Dr.-Ing. Michael Hohmuth _______________________________________________ l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> To unsubscribe send an email tol4-hackers-leave@os.inf.tu-dresden.de
<mailto:l4-hackers-leave@os.inf.tu-dresden.de>*Driving Innovation! Visit our website www.avelabs.com http://www.avelabs.com/*, to read Avelabs Confidentiality Notice,
follow this
link: http://www.avelabs.com/email/disclaimer.html http://www.avelabs.com/email/disclaimer.html
-- philipp.eppelt@kernkonzept.com - Tel. 0351-41 883 221 http://www.kernkonzept.com
Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. Geschäftsführer: Dr.-Ing. Michael Hohmuth
Hi Mohamed,
I'm not quite certain where this issue comes from. My hunch is, it's an interrupt issue. Please try to cherry-pick this commit [1] to uvmm and see if this helps. The commit is new and probably not part of the snapshot.
Another thing is that you configured qemu to use legacy virtio devices. Please add `disable-legacy=on,disable-modern=off` to -device virtio-blk-pci,...
Also note, that hardware pass-through of PCIe devices on arm64 is not yet supporting MSI-X. Meaning, the device tree node of the PCIe host bridge device for uvmm should not mention the msi-map property. Legacy IRQ should work, though.
Hint: add `earlyprinkt=serial,ttyS0` to the guest linux' command line to see more information from the guest linux boot.
Let's see what these things change.
Cheers, Philipp
[1] https://github.com/kernkonzept/uvmm/commit/b8bcbf4d34460cc7d66dcdcb7763fc1e8...
Am 23.10.24 um 11:52 schrieb Mohamed Dawod:
Hi,
Thanks Philipp for your patience and valuable support.
I changed the areas where the RAM should be placed in the memory node of the device tree and it worked. Now, I want to test the pci bus by connecting a virtio-blk-pci device via qemu to be mounted on /dev/vda to do that, I run qemu using the following options :
/$ qemu-system-aarch64 -kernel /home/dawod/workspace/l4re-snapshot-24.08.0/build_aarch64/l4/images/l4re_VM-basic-pci.elf -serial stdio -M virt,virtualization=true,iommu=smmuv3 -cpu cortex-a57 -m 4096 --display none *-drive if=none,file=/home/dawod/storage/disk.rootfs.ext4,format=raw,id=disk0 -device virtio-blk-pci,drive=disk0*/but the VM hangs in the booting stage while trying to create the /dev/vda block device which will be responsible for handling the added disk. *please* *find attached a text log from the serial console * : vm-blk-pci.log
image.png
Many Thanks, Regards
On Tue, Oct 22, 2024 at 6:54 PM Philipp Eppelt <philipp.eppelt@kernkonzept.com mailto:philipp.eppelt@kernkonzept.com> wrote:
Hi Mohamed, I'm happy to see you resolved the issue. If possible, please prefer a text log from the serial console over a picture, because the text log is longer and thus provides more information about the booted system. uvmm show this error, when memory regions overlap. In this case RAM and the intc device overlap. The intc device is specified in the device tree you passed to uvmm. Here, the device tree does not contain explicit RAM regions, so uvmm sets up the default RAM region, which spans the area starting at zero up to the size of the RAM you configured in the ned script. In this case, RAM covers the area [ 0: fff'ffff] (256MB). The itc device wants to allocate the area [0x0800'0000 : 0x0800'ffff] which is contained within the already existing RAM allocation. Thus the error message. You have two options, either specify the areas where the RAM should be placed in the memory node of the device tree or move the intc device such that it doesn't overlap. For this setup this means above 0x1000'0000. Cheers Philipp Am 22.10.24 um 09:36 schrieb Mohamed Dawod: > I upgraded L4 version to 24.08 instead of 23.10 because 24.08 contains the > missing virt-arm_virt-64_pci.dts file. > I'm building for arm64 and when I run the demo VM-basic-pci, I got the following > error ! > I didn't change anything in the dts/dtb or ned scripts excepting the typo of > > overlay = "-drom/virt-pci.dtbo" > > > What is the problem here ? > > image.png > > On Mon, Oct 21, 2024 at 11:35 AM Philipp Eppelt <philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> > <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>> wrote: > > Hi Mohamed, > > can you please check your arm64 build tree and look into the folder > 'assets/dtb/'? There should be links to all the .dtb files of uvmm. The link of > the file in question on my machine is: > > [...]/.build-arm64/pkg/uvmm/configs/dts/OBJ-arm64_armv8a-std-l4f/virt-arm_virt-64_pci.dtb > > If the file is missing in the linked folder, please check the corresponding > source directory: > > <src>/pkg/uvmm/configs/dts/ > > If virt-arm_virt-64_pci.dts isn't in there, you can download it from our > development version of L4Re on github and recompile the uvmm package. > > https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts <https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts> <https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts <https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts>> > > If the file is there, please check that '<arm64-build>/assets' directory is in > your MODULE_SEARCH_PATH. > > Let me know, if this solves the missing file problem. > > Cheers, > Philipp > > > > Am 20.10.24 um 09:20 schrieb Mohamed Dawod: > > Thanks Matthias > > I'm going to fix the typo of *virt-pci.dtbo*. > > What about the missing file *dtb/virt-arm_virt-64_pci.dtb *? > > > > > > On Tue, Oct 15, 2024 at 11:58 PM Matthias Lange > <matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>> > > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>>>> wrote: > > > > Hi Mohamed, > > > > On [15-10-2024 16:59], Mohamed Dawod wrote: > > > Hi, > > > I was trying to run the L4 demo *vm-basic-pci* for *arm64* using > the command > > > $ make qemu E=vm-basic-pci > > > but It didn't work because of the missing 2 files : > > > * virt-arm_virt-64_pci.dtb : which is requested by the > *modules.list* file > > > in the line : > > > > > > > module[arch=arm64,fname=virt-pci.dtb] > dtb/virt-arm_virt-64_pci.dtb > > > > > > * virt-pci.dtbo : which is requested by the *vm-basic-pci.cfg* by the > > > configuration > > > > > > > if (L4.Info.arch() == "arm64") then > > > > dt = "-drom/.fdt" > > > > overlay = "*-drom/virt-pci.dtbo*" > > > > This is actually a typo. Please change this line to > > > > overlay = "-drom/virt-pci.dtb" > > > > Best, > > Matthias. > > > > > > else > > > > dt = "-drom/virt-pci.dtb" > > > > overlay = "" > > > > end > > > > > > > > > I searched for both files in the whole *l4re-snapshot-23.10.1* > directory > > > but I couldn't find them > > > Where can I find those necessary files to run *vm-basic-pc*i demo? > > > > > > Thanks in advance, > > > Regards > > > > > > -- > > > Mohamed Dawod > > > *Software Engineer,* Cairo Egypt > > > > > > -- > > > > > > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com <http://www.avelabs.com> <http://www.avelabs.com <http://www.avelabs.com>>> > > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>> > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>>*, to read Avelabs > > Confidentiality Notice, follow > > > this link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>>> > > > > > > > > _______________________________________________ > > > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>> > > > To unsubscribe send an email to > l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>> > > > > > > -- > > Get started with L4Re in 3 days - register now for our workshop in > October! > > > > Visit https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re>> > > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re>>> to learn > > more. > > > > -- > > Matthias Lange phone: +49 (0) 351-41 888 614 > > Customer Engineer Specialist web: https://www.kernkonzept.com <https://www.kernkonzept.com> > <https://www.kernkonzept.com <https://www.kernkonzept.com>> > > <https://www.kernkonzept.com <https://www.kernkonzept.com> <https://www.kernkonzept.com <https://www.kernkonzept.com>>> > > > > Kernkonzept GmbH > > Buchenstraße 16b > > 01097 Dresden > > > > Geschäftsführer: Dr.-Ing. Michael Hohmuth > > Registergericht: Amtsgericht Dresden > > Handelsregister: HRB 31129 > > > > You might not be working when I am and that's ok! Please make sure to > only > > reply when it suits you. Mails can wait. > > > > > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>*, to read Avelabs > Confidentiality Notice, follow this > > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > > _______________________________________________ > > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > -- > philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>> - > Tel. 0351-41 883 221 > http://www.kernkonzept.com <http://www.kernkonzept.com> <http://www.kernkonzept.com <http://www.kernkonzept.com>> > > Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. > Geschäftsführer: Dr.-Ing. Michael Hohmuth > _______________________________________________ > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com/ <http://www.avelabs.com/>>*, to read Avelabs Confidentiality Notice, follow this > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> -- philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> - Tel. 0351-41 883 221 http://www.kernkonzept.com <http://www.kernkonzept.com> Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. Geschäftsführer: Dr.-Ing. Michael Hohmuth*Driving Innovation! Visit our website www.avelabs.com http://www.avelabs.com/*, to read Avelabs Confidentiality Notice, follow this link: http://www.avelabs.com/email/disclaimer.html http://www.avelabs.com/email/disclaimer.html
Hi Philipp,
The mentioned commit didn't help. Also the added qemu configuration didn't change anything. I added `earlyprinkt=serial,ttyS0` in order to show more logs from the VM kernel but nothing new.
I also think that it's an interrupt issue! I'm not an expert in device tree nodes, How can I use Legacy IRQ instead of MSI-X ?
Thanks, Regards
On Wed, Oct 23, 2024 at 5:34 PM Philipp Eppelt < philipp.eppelt@kernkonzept.com> wrote:
Hi Mohamed,
I'm not quite certain where this issue comes from. My hunch is, it's an interrupt issue. Please try to cherry-pick this commit [1] to uvmm and see if this helps. The commit is new and probably not part of the snapshot.
Another thing is that you configured qemu to use legacy virtio devices. Please add `disable-legacy=on,disable-modern=off` to -device virtio-blk-pci,...
Also note, that hardware pass-through of PCIe devices on arm64 is not yet supporting MSI-X. Meaning, the device tree node of the PCIe host bridge device for uvmm should not mention the msi-map property. Legacy IRQ should work, though.
Hint: add `earlyprinkt=serial,ttyS0` to the guest linux' command line to see more information from the guest linux boot.
Let's see what these things change.
Cheers, Philipp
[1]
https://github.com/kernkonzept/uvmm/commit/b8bcbf4d34460cc7d66dcdcb7763fc1e8...
Am 23.10.24 um 11:52 schrieb Mohamed Dawod:
Hi,
Thanks Philipp for your patience and valuable support.
I changed the areas where the RAM should be placed in the memory node of
the
device tree and it worked. Now, I want to test the pci bus by connecting a virtio-blk-pci device
via qemu
to be mounted on /dev/vda to do that, I run qemu using the following options :
/$ qemu-system-aarch64 -kernel/home/dawod/workspace/l4re-snapshot-24.08.0/build_aarch64/l4/images/l4re_VM-basic-pci.elf -serial stdio -M virt,virtualization=true,iommu=smmuv3 -cpu cortex-a57 -m 4096 --display none *-drive if=none,file=/home/dawod/storage/disk.rootfs.ext4,format=raw,id=disk0 -device virtio-blk-pci,drive=disk0*/
but the VM hangs in the booting stage while trying to create the
/dev/vda block
device which will be responsible for handling the added disk. *please* *find attached a text log from the serial console * : vm-blk-pci.log
<
https://mail.google.com/mail/u/0?ui=2&ik=b05e32a9ef&attid=0.1&pe...
image.png
Many Thanks, Regards
On Tue, Oct 22, 2024 at 6:54 PM Philipp Eppelt <
philipp.eppelt@kernkonzept.com
mailto:philipp.eppelt@kernkonzept.com> wrote:
Hi Mohamed, I'm happy to see you resolved the issue. If possible, please prefer a text log from the serial console over apicture,
because the text log is longer and thus provides more informationabout the
booted system. uvmm show this error, when memory regions overlap. In this case RAMand the
intc device overlap. The intc device is specified in the device tree youpassed
to uvmm. Here, the device tree does not contain explicit RAM regions, so uvmmsets up
the default RAM region, which spans the area starting at zero up to thesize of the
RAM you configured in the ned script. In this case, RAM covers the area [ 0: fff'ffff] (256MB). The itc device wants to allocate the area [0x0800'0000 :0x0800'ffff] which is
contained within the already existing RAM allocation. Thus the errormessage.
You have two options, either specify the areas where the RAM shouldbe
placed in the memory node of the device tree or move the intc device such thatit doesn't
overlap. For this setup this means above 0x1000'0000. Cheers Philipp Am 22.10.24 um 09:36 schrieb Mohamed Dawod: > I upgraded L4 version to 24.08 instead of 23.10 because 24.08contains the
> missing virt-arm_virt-64_pci.dts file. > I'm building for arm64 and when I run the demo VM-basic-pci, Igot the
following > error ! > I didn't change anything in the dts/dtb or ned scripts exceptingthe typo of
> > overlay = "-drom/virt-pci.dtbo" > > > What is the problem here ? > > image.png > > On Mon, Oct 21, 2024 at 11:35 AM Philipp Eppelt <philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>
> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>> wrote: > > Hi Mohamed, > > can you please check your arm64 build tree and look into thefolder
> 'assets/dtb/'? There should be links to all the .dtb files ofuvmm.
The link of > the file in question on my machine is: > >[...]/.build-arm64/pkg/uvmm/configs/dts/OBJ-arm64_armv8a-std-l4f/virt-arm_virt-64_pci.dtb
> > If the file is missing in the linked folder, please check the corresponding > source directory: > > <src>/pkg/uvmm/configs/dts/ > > If virt-arm_virt-64_pci.dts isn't in there, you can downloadit from our
> development version of L4Re on github and recompile the uvmmpackage.
> >https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64...
> > If the file is there, please check that '<arm64-build>/assets' directory is in > your MODULE_SEARCH_PATH. > > Let me know, if this solves the missing file problem. > > Cheers, > Philipp > > > > Am 20.10.24 um 09:20 schrieb Mohamed Dawod: > > Thanks Matthias > > I'm going to fix the typo of *virt-pci.dtbo*. > > What about the missing file *dtb/virt-arm_virt-64_pci.dtb*?
> > > > > > On Tue, Oct 15, 2024 at 11:58 PM Matthias Lange > <matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>>
> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>>>> wrote: > > > > Hi Mohamed, > > > > On [15-10-2024 16:59], Mohamed Dawod wrote: > > > Hi, > > > I was trying to run the L4 demo *vm-basic-pci* for*arm64*
using > the command > > > $ make qemu E=vm-basic-pci > > > but It didn't work because of the missing 2 files : > > > * virt-arm_virt-64_pci.dtb : which is requested bythe
> *modules.list* file > > > in the line : > > > > > > > module[arch=arm64,fname=virt-pci.dtb] > dtb/virt-arm_virt-64_pci.dtb > > > > > > * virt-pci.dtbo : which is requested by the *vm-basic-pci.cfg* by the > > > configuration > > > > > > > if (L4.Info.arch() == "arm64") then > > > > dt = "-drom/.fdt" > > > > overlay = "*-drom/virt-pci.dtbo*" > > > > This is actually a typo. Please change this line to > > > > overlay = "-drom/virt-pci.dtb" > > > > Best, > > Matthias. > > > > > > else > > > > dt = "-drom/virt-pci.dtb" > > > > overlay = "" > > > > end > > > > > > > > > I searched for both files in the whole*l4re-snapshot-23.10.1*
> directory > > > but I couldn't find them > > > Where can I find those necessary files to run *vm-basic-pc*i demo? > > > > > > Thanks in advance, > > > Regards > > > > > > -- > > > Mohamed Dawod > > > *Software Engineer,* Cairo Egypt > > > > > > -- > > > > > > > > > *Driving Innovation! Visit our websitewww.avelabs.com
<http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com <http://www.avelabs.com> <http://www.avelabs.com <http://www.avelabs.com>>> > > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>> > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>>*, to readAvelabs
> > Confidentiality Notice, follow > > > this link:http://www.avelabs.com/email/disclaimer.html
<http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>>> > > > > > > > > _______________________________________________ > > > l4-hackers mailing list --l4-hackers@os.inf.tu-dresden.de
<mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>> > > > To unsubscribe send an email to > l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>> > > > > > > -- > > Get started with L4Re in 3 days - register now for ourworkshop in
> October! > > > > Visit https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re>> > > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re>>>to learn
> > more. > > > > -- > > Matthias Lange phone: +49 (0)351-41 888 614
> > Customer Engineer Specialist web: https://www.kernkonzept.com <https://www.kernkonzept.com> > <https://www.kernkonzept.com <https://www.kernkonzept.com>> > > <https://www.kernkonzept.com <https://www.kernkonzept.com%3E
<https://www.kernkonzept.com <https://www.kernkonzept.com>>> > > > > Kernkonzept GmbH > > Buchenstraße 16b > > 01097 Dresden > > > > Geschäftsführer: Dr.-Ing. Michael Hohmuth > > Registergericht: Amtsgericht Dresden > > Handelsregister: HRB 31129 > > > > You might not be working when I am and that's ok!Please make
sure to > only > > reply when it suits you. Mails can wait. > > > > > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>*, to readAvelabs
> Confidentiality Notice, follow this > > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > > _______________________________________________ > > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > -- > philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>
<mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>> - > Tel. 0351-41 883 221 > http://www.kernkonzept.com <http://www.kernkonzept.com> <http://www.kernkonzept.com <http://www.kernkonzept.com>> > > Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB
> Geschäftsführer: Dr.-Ing. Michael Hohmuth > _______________________________________________ > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > To unsubscribe send an email tol4-hackers-leave@os.inf.tu-dresden.de
<mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com/ <http://www.avelabs.com/>>*, to readAvelabs
Confidentiality Notice, follow this > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> -- philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> -
Tel. 0351-41 883 221 http://www.kernkonzept.com <http://www.kernkonzept.com> Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. Geschäftsführer: Dr.-Ing. Michael Hohmuth*Driving Innovation! Visit our website www.avelabs.com http://www.avelabs.com/*, to read Avelabs Confidentiality Notice,
follow this
link: http://www.avelabs.com/email/disclaimer.html http://www.avelabs.com/email/disclaimer.html
-- philipp.eppelt@kernkonzept.com - Tel. 0351-41 883 221 http://www.kernkonzept.com
Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. Geschäftsführer: Dr.-Ing. Michael Hohmuth
Hi Mohamed,
just a quick reply. Long one comes later.
Am 24.10.24 um 12:47 schrieb Mohamed Dawod:
Hi Philipp,
The mentioned commit didn't help. Also the added qemu configuration didn't change anything. I added `earlyprinkt=serial,ttyS0` in order to show more logs from the VM kernel
Sorry, I mistyped: the linux cmdline argument is `earlyprintk=serial,ttyS0`. (not earlyprinkt).
Cheers, Philipp
but nothing new.
I also think that it's an interrupt issue! I'm not an expert in device tree nodes, How can I use Legacy IRQ instead of MSI-X ?
Thanks, Regards
On Wed, Oct 23, 2024 at 5:34 PM Philipp Eppelt <philipp.eppelt@kernkonzept.com mailto:philipp.eppelt@kernkonzept.com> wrote:
Hi Mohamed, I'm not quite certain where this issue comes from. My hunch is, it's an interrupt issue. Please try to cherry-pick this commit [1] to uvmm and see if this helps. The commit is new and probably not part of the snapshot. Another thing is that you configured qemu to use legacy virtio devices. Please add `disable-legacy=on,disable-modern=off` to -device virtio-blk-pci,... Also note, that hardware pass-through of PCIe devices on arm64 is not yet supporting MSI-X. Meaning, the device tree node of the PCIe host bridge device for uvmm should not mention the msi-map property. Legacy IRQ should work, though. Hint: add `earlyprinkt=serial,ttyS0` to the guest linux' command line to see more information from the guest linux boot. Let's see what these things change. Cheers, Philipp [1] https://github.com/kernkonzept/uvmm/commit/b8bcbf4d34460cc7d66dcdcb7763fc1e84dbae82 <https://github.com/kernkonzept/uvmm/commit/b8bcbf4d34460cc7d66dcdcb7763fc1e84dbae82> Am 23.10.24 um 11:52 schrieb Mohamed Dawod: > Hi, > > Thanks Philipp for your patience and valuable support. > > I changed the areas where the RAM should be placed in the memory node of the > device tree and it worked. > Now, I want to test the pci bus by connecting a virtio-blk-pci device via qemu > to be mounted on /dev/vda > to do that, I run qemu using the following options : > > /$ qemu-system-aarch64 -kernel > /home/dawod/workspace/l4re-snapshot-24.08.0/build_aarch64/l4/images/l4re_VM-basic-pci.elf -serial stdio -M virt,virtualization=true,iommu=smmuv3 -cpu cortex-a57 -m 4096 --display none *-drive if=none,file=/home/dawod/storage/disk.rootfs.ext4,format=raw,id=disk0 -device virtio-blk-pci,drive=disk0*/ > > > but the VM hangs in the booting stage while trying to create the /dev/vda block > device which will be responsible for handling the added disk. > *please* *find attached a text log from the serial console * : > vm-blk-pci.log > > <https://mail.google.com/mail/u/0?ui=2&ik=b05e32a9ef&attid=0.1&permmsgid=msg-a:r-4942377897740831663&view=att&disp=safe&realattid=f_m2lp0t191 <https://mail.google.com/mail/u/0?ui=2&ik=b05e32a9ef&attid=0.1&permmsgid=msg-a:r-4942377897740831663&view=att&disp=safe&realattid=f_m2lp0t191>> > > image.png > > > Many Thanks, > Regards > > > > On Tue, Oct 22, 2024 at 6:54 PM Philipp Eppelt <philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> > <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>> wrote: > > Hi Mohamed, > > I'm happy to see you resolved the issue. > If possible, please prefer a text log from the serial console over a picture, > because the text log is longer and thus provides more information about the > booted system. > > uvmm show this error, when memory regions overlap. In this case RAM and the > intc > device overlap. The intc device is specified in the device tree you passed > to uvmm. > Here, the device tree does not contain explicit RAM regions, so uvmm sets up > the > default RAM region, which spans the area starting at zero up to the size of the > RAM you configured in the ned script. > In this case, RAM covers the area [ 0: fff'ffff] (256MB). > The itc device wants to allocate the area [0x0800'0000 : 0x0800'ffff] which is > contained within the already existing RAM allocation. Thus the error message. > > You have two options, either specify the areas where the RAM should be > placed in > the memory node of the device tree or move the intc device such that it doesn't > overlap. For this setup this means above 0x1000'0000. > > > Cheers > Philipp > > > Am 22.10.24 um 09:36 schrieb Mohamed Dawod: > > I upgraded L4 version to 24.08 instead of 23.10 because 24.08 contains the > > missing virt-arm_virt-64_pci.dts file. > > I'm building for arm64 and when I run the demo VM-basic-pci, I got the > following > > error ! > > I didn't change anything in the dts/dtb or ned scripts excepting the typo of > > > > overlay = "-drom/virt-pci.dtbo" > > > > > > What is the problem here ? > > > > image.png > > > > On Mon, Oct 21, 2024 at 11:35 AM Philipp Eppelt > <philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>> > > <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> > <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>>> wrote: > > > > Hi Mohamed, > > > > can you please check your arm64 build tree and look into the folder > > 'assets/dtb/'? There should be links to all the .dtb files of uvmm. > The link of > > the file in question on my machine is: > > > > > [...]/.build-arm64/pkg/uvmm/configs/dts/OBJ-arm64_armv8a-std-l4f/virt-arm_virt-64_pci.dtb > > > > If the file is missing in the linked folder, please check the > corresponding > > source directory: > > > > <src>/pkg/uvmm/configs/dts/ > > > > If virt-arm_virt-64_pci.dts isn't in there, you can download it from our > > development version of L4Re on github and recompile the uvmm package. > > > > > https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts <https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts> <https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts <https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts>> <https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts <https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts> <https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts <https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64_pci.dts>>> > > > > If the file is there, please check that '<arm64-build>/assets' > directory is in > > your MODULE_SEARCH_PATH. > > > > Let me know, if this solves the missing file problem. > > > > Cheers, > > Philipp > > > > > > > > Am 20.10.24 um 09:20 schrieb Mohamed Dawod: > > > Thanks Matthias > > > I'm going to fix the typo of *virt-pci.dtbo*. > > > What about the missing file *dtb/virt-arm_virt-64_pci.dtb *? > > > > > > > > > On Tue, Oct 15, 2024 at 11:58 PM Matthias Lange > > <matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>>> > > > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>> > > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>>>>> wrote: > > > > > > Hi Mohamed, > > > > > > On [15-10-2024 16:59], Mohamed Dawod wrote: > > > > Hi, > > > > I was trying to run the L4 demo *vm-basic-pci* for *arm64* > using > > the command > > > > $ make qemu E=vm-basic-pci > > > > but It didn't work because of the missing 2 files : > > > > * virt-arm_virt-64_pci.dtb : which is requested by the > > *modules.list* file > > > > in the line : > > > > > > > > > module[arch=arm64,fname=virt-pci.dtb] > > dtb/virt-arm_virt-64_pci.dtb > > > > > > > > * virt-pci.dtbo : which is requested by the > *vm-basic-pci.cfg* by the > > > > configuration > > > > > > > > > if (L4.Info.arch() == "arm64") then > > > > > dt = "-drom/.fdt" > > > > > overlay = "*-drom/virt-pci.dtbo*" > > > > > > This is actually a typo. Please change this line to > > > > > > overlay = "-drom/virt-pci.dtb" > > > > > > Best, > > > Matthias. > > > > > > > > else > > > > > dt = "-drom/virt-pci.dtb" > > > > > overlay = "" > > > > > end > > > > > > > > > > > > I searched for both files in the whole *l4re-snapshot-23.10.1* > > directory > > > > but I couldn't find them > > > > Where can I find those necessary files to run > *vm-basic-pc*i demo? > > > > > > > > Thanks in advance, > > > > Regards > > > > > > > > -- > > > > Mohamed Dawod > > > > *Software Engineer,* Cairo Egypt > > > > > > > > -- > > > > > > > > > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com <http://www.avelabs.com> <http://www.avelabs.com <http://www.avelabs.com>>> > > > <http://www.avelabs.com <http://www.avelabs.com> <http://www.avelabs.com <http://www.avelabs.com>> > <http://www.avelabs.com <http://www.avelabs.com> <http://www.avelabs.com <http://www.avelabs.com>>>> > > > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>> > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>> > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>> > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>>>*, to read Avelabs > > > Confidentiality Notice, follow > > > > this link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>>> > > > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>>>> > > > > > > > > > > > _______________________________________________ > > > > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>> > > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>>> > > > > To unsubscribe send an email to > > l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>> > > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>>> > > > > > > > > > -- > > > Get started with L4Re in 3 days - register now for our workshop in > > October! > > > > > > Visit > https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re>> > > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re>>> > > > > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re>> > > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re>>>> to learn > > > more. > > > > > > -- > > > Matthias Lange phone: +49 (0) 351-41 888 614 > > > Customer Engineer Specialist web: > https://www.kernkonzept.com <https://www.kernkonzept.com> <https://www.kernkonzept.com <https://www.kernkonzept.com>> > > <https://www.kernkonzept.com <https://www.kernkonzept.com> <https://www.kernkonzept.com <https://www.kernkonzept.com>>> > > > <https://www.kernkonzept.com <https://www.kernkonzept.com> <https://www.kernkonzept.com <https://www.kernkonzept.com>> > <https://www.kernkonzept.com <https://www.kernkonzept.com> <https://www.kernkonzept.com <https://www.kernkonzept.com>>>> > > > > > > Kernkonzept GmbH > > > Buchenstraße 16b > > > 01097 Dresden > > > > > > Geschäftsführer: Dr.-Ing. Michael Hohmuth > > > Registergericht: Amtsgericht Dresden > > > Handelsregister: HRB 31129 > > > > > > You might not be working when I am and that's ok! Please make > sure to > > only > > > reply when it suits you. Mails can wait. > > > > > > > > > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com <http://www.avelabs.com> <http://www.avelabs.com <http://www.avelabs.com>>> > > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>> > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>>*, to read Avelabs > > Confidentiality Notice, follow this > > > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>>> > > > > > > _______________________________________________ > > > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>> > > > To unsubscribe send an email to > l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>> > > > > -- > > philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>> > <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> > <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>> - > > Tel. 0351-41 883 221 > > http://www.kernkonzept.com <http://www.kernkonzept.com> <http://www.kernkonzept.com <http://www.kernkonzept.com>> > <http://www.kernkonzept.com <http://www.kernkonzept.com> <http://www.kernkonzept.com <http://www.kernkonzept.com>>> > > > > Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. > > Geschäftsführer: Dr.-Ing. Michael Hohmuth > > _______________________________________________ > > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>> > > To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>> > > > > > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>*, to read Avelabs > Confidentiality Notice, follow this > > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > -- > philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>> - > Tel. 0351-41 883 221 > http://www.kernkonzept.com <http://www.kernkonzept.com> <http://www.kernkonzept.com <http://www.kernkonzept.com>> > > Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. > Geschäftsführer: Dr.-Ing. Michael Hohmuth > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com/ <http://www.avelabs.com/>>*, to read Avelabs Confidentiality Notice, follow this > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> -- philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> - Tel. 0351-41 883 221 http://www.kernkonzept.com <http://www.kernkonzept.com> Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. Geschäftsführer: Dr.-Ing. Michael Hohmuth*Driving Innovation! Visit our website www.avelabs.com http://www.avelabs.com/*, to read Avelabs Confidentiality Notice, follow this link: http://www.avelabs.com/email/disclaimer.html http://www.avelabs.com/email/disclaimer.html
Hi Philipp, I wrote it correctly, "earlyprintk" instead of "earlyprinkt". but nothing changed.
On Thu, Oct 24, 2024 at 3:20 PM Philipp Eppelt < philipp.eppelt@kernkonzept.com> wrote:
Hi Mohamed,
just a quick reply. Long one comes later.
Am 24.10.24 um 12:47 schrieb Mohamed Dawod:
Hi Philipp,
The mentioned commit didn't help. Also the added qemu configuration didn't change anything. I added `earlyprinkt=serial,ttyS0` in order to show more logs from the
VM kernel Sorry, I mistyped: the linux cmdline argument is `earlyprintk=serial,ttyS0`. (not earlyprinkt).
Cheers, Philipp
but nothing new.
I also think that it's an interrupt issue! I'm not an expert in device tree nodes, How can I use Legacy IRQ instead
of MSI-X ?
Thanks, Regards
On Wed, Oct 23, 2024 at 5:34 PM Philipp Eppelt <
philipp.eppelt@kernkonzept.com
mailto:philipp.eppelt@kernkonzept.com> wrote:
Hi Mohamed, I'm not quite certain where this issue comes from. My hunch is, it'san
interrupt issue. Please try to cherry-pick this commit [1] to uvmmand see if
this helps. The commit is new and probably not part of the snapshot. Another thing is that you configured qemu to use legacy virtiodevices. Please
add `disable-legacy=on,disable-modern=off` to -devicevirtio-blk-pci,...
Also note, that hardware pass-through of PCIe devices on arm64 isnot yet
supporting MSI-X. Meaning, the device tree node of the PCIe hostbridge device
for uvmm should not mention the msi-map property. Legacy IRQ shouldwork,
though. Hint: add `earlyprinkt=serial,ttyS0` to the guest linux' commandline to see
more information from the guest linux boot. Let's see what these things change. Cheers, Philipp [1]https://github.com/kernkonzept/uvmm/commit/b8bcbf4d34460cc7d66dcdcb7763fc1e8... < https://github.com/kernkonzept/uvmm/commit/b8bcbf4d34460cc7d66dcdcb7763fc1e8...
Am 23.10.24 um 11:52 schrieb Mohamed Dawod: > Hi, > > Thanks Philipp for your patience and valuable support. > > I changed the areas where the RAM should be placed in the memorynode of the
> device tree and it worked. > Now, I want to test the pci bus by connecting a virtio-blk-pcidevice via
qemu > to be mounted on /dev/vda > to do that, I run qemu using the following options : > > /$ qemu-system-aarch64 -kernel >/home/dawod/workspace/l4re-snapshot-24.08.0/build_aarch64/l4/images/l4re_VM-basic-pci.elf -serial stdio -M virt,virtualization=true,iommu=smmuv3 -cpu cortex-a57 -m 4096 --display none *-drive if=none,file=/home/dawod/storage/disk.rootfs.ext4,format=raw,id=disk0 -device virtio-blk-pci,drive=disk0*/
> > > but the VM hangs in the booting stage while trying to create the/dev/vda
block > device which will be responsible for handling the added disk. > *please* *find attached a text log from the serial console * : > vm-blk-pci.log > > <https://mail.google.com/mail/u/0?ui=2&ik=b05e32a9ef&attid=0.1&pe... < https://mail.google.com/mail/u/0?ui=2&ik=b05e32a9ef&attid=0.1&pe...
> > image.png > > > Many Thanks, > Regards > > > > On Tue, Oct 22, 2024 at 6:54 PM Philipp Eppelt <philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>
> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>> wrote: > > Hi Mohamed, > > I'm happy to see you resolved the issue. > If possible, please prefer a text log from the serial consoleover a
picture, > because the text log is longer and thus provides moreinformation
about the > booted system. > > uvmm show this error, when memory regions overlap. In thiscase RAM
and the > intc > device overlap. The intc device is specified in the devicetree you
passed > to uvmm. > Here, the device tree does not contain explicit RAM regions,so uvmm
sets up > the > default RAM region, which spans the area starting at zero upto the
size of the > RAM you configured in the ned script. > In this case, RAM covers the area [ 0: fff'ffff] (256MB). > The itc device wants to allocate the area [0x0800'0000 :0x0800'ffff]
which is > contained within the already existing RAM allocation. Thusthe error
message. > > You have two options, either specify the areas where the RAMshould be
> placed in > the memory node of the device tree or move the intc devicesuch that
it doesn't > overlap. For this setup this means above 0x1000'0000. > > > Cheers > Philipp > > > Am 22.10.24 um 09:36 schrieb Mohamed Dawod: > > I upgraded L4 version to 24.08 instead of 23.10 because24.08
contains the > > missing virt-arm_virt-64_pci.dts file. > > I'm building for arm64 and when I run the demoVM-basic-pci, I got the
> following > > error ! > > I didn't change anything in the dts/dtb or ned scriptsexcepting
the typo of > > > > overlay = "-drom/virt-pci.dtbo" > > > > > > What is the problem here ? > > > > image.png > > > > On Mon, Oct 21, 2024 at 11:35 AM Philipp Eppelt > <philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>
> > <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> > <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>>> wrote: > > > > Hi Mohamed, > > > > can you please check your arm64 build tree and lookinto the
folder > > 'assets/dtb/'? There should be links to all the .dtbfiles of
uvmm. > The link of > > the file in question on my machine is: > > > > >[...]/.build-arm64/pkg/uvmm/configs/dts/OBJ-arm64_armv8a-std-l4f/virt-arm_virt-64_pci.dtb
> > > > If the file is missing in the linked folder, pleasecheck the
> corresponding > > source directory: > > > > <src>/pkg/uvmm/configs/dts/ > > > > If virt-arm_virt-64_pci.dts isn't in there, you candownload
it from our > > development version of L4Re on github and recompilethe uvmm
package. > > > > >https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64...
> > > > If the file is there, please check that'<arm64-build>/assets'
> directory is in > > your MODULE_SEARCH_PATH. > > > > Let me know, if this solves the missing file problem. > > > > Cheers, > > Philipp > > > > > > > > Am 20.10.24 um 09:20 schrieb Mohamed Dawod: > > > Thanks Matthias > > > I'm going to fix the typo of *virt-pci.dtbo*. > > > What about the missing file*dtb/virt-arm_virt-64_pci.dtb *?
> > > > > > > > > On Tue, Oct 15, 2024 at 11:58 PM Matthias Lange > > <matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>>>
> > > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>> > > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>>>>> wrote: > > > > > > Hi Mohamed, > > > > > > On [15-10-2024 16:59], Mohamed Dawod wrote: > > > > Hi, > > > > I was trying to run the L4 demo*vm-basic-pci* for
*arm64* > using > > the command > > > > $ make qemu E=vm-basic-pci > > > > but It didn't work because of the missing 2files :
> > > > * virt-arm_virt-64_pci.dtb : which isrequested by the
> > *modules.list* file > > > > in the line : > > > > > > > > > module[arch=arm64,fname=virt-pci.dtb] > > dtb/virt-arm_virt-64_pci.dtb > > > > > > > > * virt-pci.dtbo : which is requested by the > *vm-basic-pci.cfg* by the > > > > configuration > > > > > > > > > if (L4.Info.arch() == "arm64") then > > > > > dt = "-drom/.fdt" > > > > > overlay = "*-drom/virt-pci.dtbo*" > > > > > > This is actually a typo. Please change thisline to
> > > > > > overlay = "-drom/virt-pci.dtb" > > > > > > Best, > > > Matthias. > > > > > > > > else > > > > > dt = "-drom/virt-pci.dtb" > > > > > overlay = "" > > > > > end > > > > > > > > > > > > I searched for both files in the whole *l4re-snapshot-23.10.1* > > directory > > > > but I couldn't find them > > > > Where can I find those necessary files to run > *vm-basic-pc*i demo? > > > > > > > > Thanks in advance, > > > > Regards > > > > > > > > -- > > > > Mohamed Dawod > > > > *Software Engineer,* Cairo Egypt > > > > > > > > -- > > > > > > > > > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com <http://www.avelabs.com> <http://www.avelabs.com <http://www.avelabs.com>>> > > > <http://www.avelabs.com <http://www.avelabs.com <http://www.avelabs.com <http://www.avelabs.com>> > <http://www.avelabs.com <http://www.avelabs.com> <http://www.avelabs.com <http://www.avelabs.com>>>> > > > > <http://www.avelabs.com/ <<http://www.avelabs.com/ <http://www.avelabs.com/>> > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>> > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>> > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>>>*, to readAvelabs
> > > Confidentiality Notice, follow > > > > this link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>>> > > > > <http://www.avelabs.com/email/disclaimer.html
<http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>>>> > > > > > > > > > > >
> > > > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>
> <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>> > > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>>> > > > > To unsubscribe send an email to > > l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>> > > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>>> > > > > > > > > > -- > > > Get started with L4Re in 3 days - register nowfor our
workshop in > > October! > > > > > > Visit > https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re>> > > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re>>> > > > > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re>> > > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re>>>>to learn
> > > more. > > > > > > -- > > > Matthias Lange phone: +49(0)
351-41 888 614 > > > Customer Engineer Specialist web: > https://www.kernkonzept.com <https://www.kernkonzept.com> <https://www.kernkonzept.com <https://www.kernkonzept.com>> > > <https://www.kernkonzept.com <https://www.kernkonzept.com%3E
<https://www.kernkonzept.com <https://www.kernkonzept.com>>> > > > <https://www.kernkonzept.com <https://www.kernkonzept.com> <https://www.kernkonzept.com <https://www.kernkonzept.com>> > <https://www.kernkonzept.com <https://www.kernkonzept.com> <https://www.kernkonzept.com <https://www.kernkonzept.com>>>> > > > > > > Kernkonzept GmbH > > > Buchenstraße 16b > > > 01097 Dresden > > > > > > Geschäftsführer: Dr.-Ing. Michael Hohmuth > > > Registergericht: Amtsgericht Dresden > > > Handelsregister: HRB 31129 > > > > > > You might not be working when I am and that'sok!
Please make > sure to > > only > > > reply when it suits you. Mails can wait. > > > > > > > > > > > > *Driving Innovation! Visit our websitewww.avelabs.com
<http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com <http://www.avelabs.com> <http://www.avelabs.com <http://www.avelabs.com>>> > > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>> > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>>*, to readAvelabs
> > Confidentiality Notice, follow this > > > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>>> > > > > > > _______________________________________________ > > > l4-hackers mailing list --l4-hackers@os.inf.tu-dresden.de
<mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>> > > > To unsubscribe send an email to > l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>> > > > > -- > > philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>
> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> > <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>> - > > Tel. 0351-41 883 221 > > http://www.kernkonzept.com <http://www.kernkonzept.com> <http://www.kernkonzept.com <http://www.kernkonzept.com>> > <http://www.kernkonzept.com <http://www.kernkonzept.com> <http://www.kernkonzept.com <http://www.kernkonzept.com>>> > > > > Kernkonzept GmbH. Sitz: Dresden. AmtsgerichtDresden, HRB 31129.
> > Geschäftsführer: Dr.-Ing. Michael Hohmuth > > _______________________________________________ > > l4-hackers mailing list --l4-hackers@os.inf.tu-dresden.de
<mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>> > > To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>> > > > > > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>*, to readAvelabs
> Confidentiality Notice, follow this > > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > -- > philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>
<mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>> - > Tel. 0351-41 883 221 > http://www.kernkonzept.com <http://www.kernkonzept.com> <http://www.kernkonzept.com <http://www.kernkonzept.com>> > > Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB
> Geschäftsführer: Dr.-Ing. Michael Hohmuth > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com/ <http://www.avelabs.com/>>*, to readAvelabs
Confidentiality Notice, follow this > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> -- philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> -
Tel. 0351-41 883 221 http://www.kernkonzept.com <http://www.kernkonzept.com> Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. Geschäftsführer: Dr.-Ing. Michael Hohmuth*Driving Innovation! Visit our website www.avelabs.com http://www.avelabs.com/*, to read Avelabs Confidentiality Notice,
follow this
link: http://www.avelabs.com/email/disclaimer.html http://www.avelabs.com/email/disclaimer.html
-- philipp.eppelt@kernkonzept.com - Tel. 0351-41 883 221 http://www.kernkonzept.com
Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. Geschäftsführer: Dr.-Ing. Michael Hohmuth
Hi Philipp, Regarding the PCI bus issue (hardware pass-through of PCIe devices on arm64 is not yet supporting MSI-X) Is there a method to make the device tree node of the PCIe host bridge device for uvmm uses the Legacy IRQ instead of MSI-X ? I tried to just remove the msi-map property from the device tree node of the PCIe host bridge device but nothing changed! Is there more configuration/changes should be added ?
Thanks in advance, Regards
On Sun, Oct 27, 2024 at 11:34 AM Mohamed Dawod mohamed.dawod@avelabs.com wrote:
Hi Philipp, I wrote it correctly, "earlyprintk" instead of "earlyprinkt". but nothing changed.
On Thu, Oct 24, 2024 at 3:20 PM Philipp Eppelt < philipp.eppelt@kernkonzept.com> wrote:
Hi Mohamed,
just a quick reply. Long one comes later.
Am 24.10.24 um 12:47 schrieb Mohamed Dawod:
Hi Philipp,
The mentioned commit didn't help. Also the added qemu configuration didn't change anything. I added `earlyprinkt=serial,ttyS0` in order to show more logs from the
VM kernel Sorry, I mistyped: the linux cmdline argument is `earlyprintk=serial,ttyS0`. (not earlyprinkt).
Cheers, Philipp
but nothing new.
I also think that it's an interrupt issue! I'm not an expert in device tree nodes, How can I use Legacy IRQ
instead of MSI-X ?
Thanks, Regards
On Wed, Oct 23, 2024 at 5:34 PM Philipp Eppelt <
philipp.eppelt@kernkonzept.com
mailto:philipp.eppelt@kernkonzept.com> wrote:
Hi Mohamed, I'm not quite certain where this issue comes from. My hunch is,it's an
interrupt issue. Please try to cherry-pick this commit [1] to uvmmand see if
this helps. The commit is new and probably not part of the snapshot. Another thing is that you configured qemu to use legacy virtiodevices. Please
add `disable-legacy=on,disable-modern=off` to -devicevirtio-blk-pci,...
Also note, that hardware pass-through of PCIe devices on arm64 isnot yet
supporting MSI-X. Meaning, the device tree node of the PCIe hostbridge device
for uvmm should not mention the msi-map property. Legacy IRQ shouldwork,
though. Hint: add `earlyprinkt=serial,ttyS0` to the guest linux' commandline to see
more information from the guest linux boot. Let's see what these things change. Cheers, Philipp [1]https://github.com/kernkonzept/uvmm/commit/b8bcbf4d34460cc7d66dcdcb7763fc1e8... < https://github.com/kernkonzept/uvmm/commit/b8bcbf4d34460cc7d66dcdcb7763fc1e8...
Am 23.10.24 um 11:52 schrieb Mohamed Dawod: > Hi, > > Thanks Philipp for your patience and valuable support. > > I changed the areas where the RAM should be placed in the memorynode of the
> device tree and it worked. > Now, I want to test the pci bus by connecting a virtio-blk-pcidevice via
qemu > to be mounted on /dev/vda > to do that, I run qemu using the following options : > > /$ qemu-system-aarch64 -kernel >/home/dawod/workspace/l4re-snapshot-24.08.0/build_aarch64/l4/images/l4re_VM-basic-pci.elf -serial stdio -M virt,virtualization=true,iommu=smmuv3 -cpu cortex-a57 -m 4096 --display none *-drive if=none,file=/home/dawod/storage/disk.rootfs.ext4,format=raw,id=disk0 -device virtio-blk-pci,drive=disk0*/
> > > but the VM hangs in the booting stage while trying to create the/dev/vda
block > device which will be responsible for handling the added disk. > *please* *find attached a text log from the serial console * : > vm-blk-pci.log > > <https://mail.google.com/mail/u/0?ui=2&ik=b05e32a9ef&attid=0.1&pe... < https://mail.google.com/mail/u/0?ui=2&ik=b05e32a9ef&attid=0.1&pe...
> > image.png > > > Many Thanks, > Regards > > > > On Tue, Oct 22, 2024 at 6:54 PM Philipp Eppelt <philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>
> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>> wrote: > > Hi Mohamed, > > I'm happy to see you resolved the issue. > If possible, please prefer a text log from the serialconsole over a
picture, > because the text log is longer and thus provides moreinformation
about the > booted system. > > uvmm show this error, when memory regions overlap. In thiscase RAM
and the > intc > device overlap. The intc device is specified in the devicetree you
passed > to uvmm. > Here, the device tree does not contain explicit RAM regions,so uvmm
sets up > the > default RAM region, which spans the area starting at zero upto the
size of the > RAM you configured in the ned script. > In this case, RAM covers the area [ 0: fff'ffff](256MB).
> The itc device wants to allocate the area [0x0800'0000 :0x0800'ffff]
which is > contained within the already existing RAM allocation. Thusthe error
message. > > You have two options, either specify the areas where the RAMshould be
> placed in > the memory node of the device tree or move the intc devicesuch that
it doesn't > overlap. For this setup this means above 0x1000'0000. > > > Cheers > Philipp > > > Am 22.10.24 um 09:36 schrieb Mohamed Dawod: > > I upgraded L4 version to 24.08 instead of 23.10 because24.08
contains the > > missing virt-arm_virt-64_pci.dts file. > > I'm building for arm64 and when I run the demoVM-basic-pci, I got the
> following > > error ! > > I didn't change anything in the dts/dtb or ned scriptsexcepting
the typo of > > > > overlay = "-drom/virt-pci.dtbo" > > > > > > What is the problem here ? > > > > image.png > > > > On Mon, Oct 21, 2024 at 11:35 AM Philipp Eppelt > <philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>
> > <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> > <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>>> wrote: > > > > Hi Mohamed, > > > > can you please check your arm64 build tree and lookinto the
folder > > 'assets/dtb/'? There should be links to all the .dtbfiles of
uvmm. > The link of > > the file in question on my machine is: > > > > >[...]/.build-arm64/pkg/uvmm/configs/dts/OBJ-arm64_armv8a-std-l4f/virt-arm_virt-64_pci.dtb
> > > > If the file is missing in the linked folder, pleasecheck the
> corresponding > > source directory: > > > > <src>/pkg/uvmm/configs/dts/ > > > > If virt-arm_virt-64_pci.dts isn't in there, you candownload
it from our > > development version of L4Re on github and recompilethe uvmm
package. > > > > >https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64... < https://github.com/kernkonzept/uvmm/blob/master/configs/dts/virt-arm_virt-64...
> > > > If the file is there, please check that'<arm64-build>/assets'
> directory is in > > your MODULE_SEARCH_PATH. > > > > Let me know, if this solves the missing file problem. > > > > Cheers, > > Philipp > > > > > > > > Am 20.10.24 um 09:20 schrieb Mohamed Dawod: > > > Thanks Matthias > > > I'm going to fix the typo of *virt-pci.dtbo*. > > > What about the missing file*dtb/virt-arm_virt-64_pci.dtb *?
> > > > > > > > > On Tue, Oct 15, 2024 at 11:58 PM Matthias Lange > > <matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>>>
> > > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>> > > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com> > <mailto:matthias.lange@kernkonzept.com <mailto:matthias.lange@kernkonzept.com>>>>> wrote: > > > > > > Hi Mohamed, > > > > > > On [15-10-2024 16:59], Mohamed Dawod wrote: > > > > Hi, > > > > I was trying to run the L4 demo*vm-basic-pci* for
*arm64* > using > > the command > > > > $ make qemu E=vm-basic-pci > > > > but It didn't work because of the missing 2files :
> > > > * virt-arm_virt-64_pci.dtb : which isrequested by the
> > *modules.list* file > > > > in the line : > > > > > > > > > module[arch=arm64,fname=virt-pci.dtb] > > dtb/virt-arm_virt-64_pci.dtb > > > > > > > > * virt-pci.dtbo : which is requested by the > *vm-basic-pci.cfg* by the > > > > configuration > > > > > > > > > if (L4.Info.arch() == "arm64") then > > > > > dt = "-drom/.fdt" > > > > > overlay = "*-drom/virt-pci.dtbo*" > > > > > > This is actually a typo. Please change thisline to
> > > > > > overlay = "-drom/virt-pci.dtb" > > > > > > Best, > > > Matthias. > > > > > > > > else > > > > > dt = "-drom/virt-pci.dtb" > > > > > overlay = "" > > > > > end > > > > > > > > > > > > I searched for both files in the whole *l4re-snapshot-23.10.1* > > directory > > > > but I couldn't find them > > > > Where can I find those necessary files torun
> *vm-basic-pc*i demo? > > > > > > > > Thanks in advance, > > > > Regards > > > > > > > > -- > > > > Mohamed Dawod > > > > *Software Engineer,* Cairo Egypt > > > > > > > > -- > > > > > > > > > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com <http://www.avelabs.com> <http://www.avelabs.com <http://www.avelabs.com>>> > > > <http://www.avelabs.com <<http://www.avelabs.com <http://www.avelabs.com>> > <http://www.avelabs.com <http://www.avelabs.com> <http://www.avelabs.com <http://www.avelabs.com>>>> > > > > <http://www.avelabs.com/ <<http://www.avelabs.com/ <http://www.avelabs.com/>> > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>> > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>> > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>>>*, to readAvelabs
> > > Confidentiality Notice, follow > > > > this link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>>> > > > > <http://www.avelabs.com/email/disclaimer.html
<http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>>>> > > > > > > > > > > >
> > > > l4-hackers mailing list -- l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>
> <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>> > > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>>> > > > > To unsubscribe send an email to > > l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>> > > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>>> > > > > > > > > > -- > > > Get started with L4Re in 3 days - register nowfor our
workshop in > > October! > > > > > > Visit > https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re>> > > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re>>> > > > > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re>> > > <https://www.kernkonzept.com/workshop-getting-started-with-l4re <https://www.kernkonzept.com/workshop-getting-started-with-l4re> > <https://www.kernkonzept.com/workshop-getting-started-with-l4re
<https://www.kernkonzept.com/workshop-getting-started-with-l4re>>>>to learn
> > > more. > > > > > > -- > > > Matthias Lange phone: +49(0)
351-41 888 614 > > > Customer Engineer Specialist web: > https://www.kernkonzept.com <https://www.kernkonzept.com> <https://www.kernkonzept.com <https://www.kernkonzept.com>> > > <https://www.kernkonzept.com <https://www.kernkonzept.com%3E
<https://www.kernkonzept.com <https://www.kernkonzept.com>>> > > > <https://www.kernkonzept.com <https://www.kernkonzept.com> <https://www.kernkonzept.com <https://www.kernkonzept.com>> > <https://www.kernkonzept.com <https://www.kernkonzept.com> <https://www.kernkonzept.com <https://www.kernkonzept.com>>>> > > > > > > Kernkonzept GmbH > > > Buchenstraße 16b > > > 01097 Dresden > > > > > > Geschäftsführer: Dr.-Ing. Michael Hohmuth > > > Registergericht: Amtsgericht Dresden > > > Handelsregister: HRB 31129 > > > > > > You might not be working when I am and that'sok!
Please make > sure to > > only > > > reply when it suits you. Mails can wait. > > > > > > > > > > > > *Driving Innovation! Visit our websitewww.avelabs.com
<http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com <http://www.avelabs.com> <http://www.avelabs.com <http://www.avelabs.com>>> > > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>> > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>>*, to readAvelabs
> > Confidentiality Notice, follow this > > > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>>> > > > > > > _______________________________________________ > > > l4-hackers mailing list --l4-hackers@os.inf.tu-dresden.de
<mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>> > > > To unsubscribe send an email to > l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>> > > > > -- > > philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>
> <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> > <mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>>> - > > Tel. 0351-41 883 221 > > http://www.kernkonzept.com <http://www.kernkonzept.com> <http://www.kernkonzept.com <http://www.kernkonzept.com>> > <http://www.kernkonzept.com <http://www.kernkonzept.com> <http://www.kernkonzept.com <http://www.kernkonzept.com>>> > > > > Kernkonzept GmbH. Sitz: Dresden. AmtsgerichtDresden, HRB 31129.
> > Geschäftsführer: Dr.-Ing. Michael Hohmuth > > _______________________________________________ > > l4-hackers mailing list --l4-hackers@os.inf.tu-dresden.de
<mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>> > > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de> > <mailto:l4-hackers@os.inf.tu-dresden.de <mailto:l4-hackers@os.inf.tu-dresden.de>>> > > To unsubscribe send an email to l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>> > > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de> > <mailto:l4-hackers-leave@os.inf.tu-dresden.de <mailto:l4-hackers-leave@os.inf.tu-dresden.de>>> > > > > > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com <http://www.avelabs.com>> > > <http://www.avelabs.com/ <http://www.avelabs.com/> <http://www.avelabs.com/ <http://www.avelabs.com/>>>*, to readAvelabs
> Confidentiality Notice, follow this > > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> > > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>>> > > -- > philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>
<mailto:philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com>> - > Tel. 0351-41 883 221 > http://www.kernkonzept.com <http://www.kernkonzept.com> <http://www.kernkonzept.com <http://www.kernkonzept.com>> > > Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB
> Geschäftsführer: Dr.-Ing. Michael Hohmuth > > > > *Driving Innovation! Visit our website www.avelabs.com <http://www.avelabs.com> > <http://www.avelabs.com/ <http://www.avelabs.com/>>*, to readAvelabs
Confidentiality Notice, follow this > link: http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html> > <http://www.avelabs.com/email/disclaimer.html <http://www.avelabs.com/email/disclaimer.html>> -- philipp.eppelt@kernkonzept.com <mailto:philipp.eppelt@kernkonzept.com> -
Tel. 0351-41 883 221 http://www.kernkonzept.com <http://www.kernkonzept.com> Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. Geschäftsführer: Dr.-Ing. Michael Hohmuth*Driving Innovation! Visit our website www.avelabs.com http://www.avelabs.com/*, to read Avelabs Confidentiality Notice,
follow this
link: http://www.avelabs.com/email/disclaimer.html http://www.avelabs.com/email/disclaimer.html
-- philipp.eppelt@kernkonzept.com - Tel. 0351-41 883 221 http://www.kernkonzept.com
Kernkonzept GmbH. Sitz: Dresden. Amtsgericht Dresden, HRB 31129. Geschäftsführer: Dr.-Ing. Michael Hohmuth
l4-hackers@os.inf.tu-dresden.de
-
Matthias Lange -
Mohamed Dawod -
Philipp Eppelt