- l4-hackers - example.com Site

ANNOUNCE: Pre-virtualization project
by Joshua LeVasseur 20 May '05

20 May '05

The L4Ka team is pleased to announce the release of a new approach to building virtual machines, which we call pre-virtualization. Pre- virtualization is a technique to automate para-virtualization, and is thus a more trustworthy alternative to L4Linux, and yet with the same performance that L4Linux has always achieved on the L4Ka microkernels. Since the virtualization is automated, the final binary (whether Linux 2.6, Linux 2.4, FreeBSD, etc.) can execute on raw hardware, and on a variety of hypervisors. At load time, the binary's virtualization-sensitive instructions are rewritten, and the OS is dynamically linked against an architectural emulation layer. The project has been co-developed with UNSW/NICTA. The project web page is located at: http://l4ka.org/projects/virtualization/afterburn/ The current release supports the L4Ka::Pistachio microkernel and the Xen hypervisor, on x86 hardware. We currently release support only for Linux 2.6 as a guest OS. Other operating systems are under test. This project obsoletes our prior L4Ka L4Linux work. We thus stop support for our L4Linux-2.4 project, and will not publicly release our L4Linux 2.6 project. Enjoy, The L4Ka Development Team

1 0

Reading and writing to files in DROPS
by Rene Wittmann 19 May '05

19 May '05

Hi, I'm still trying to write to a file in DROPS. What is the best way to do so? When trying to use the OSKIT support (at least I think that I use it...) it doesn't work, maybe I'm thinking too straightforward, but my code looks simply this way: --------------------------------------------------------------------- #include <stdio.h> char LOG_tag[9]="tso_test"; int main(int argc, const char**argv){ FILE *handle; int i; handle = fopen("/tmp/check","w+"); printf("before fileprinting\n"); fprintf(handle,"Just a writing to file test."); printf("after fileprinting\n"); fclose(handle); printf("after closing\n"); return 0; } -------------------------------------------------------------------- My Makefile (compiling without error or warning): -------------------------------------------------------------------- PKGDIR ?= ../.. L4DIR ?= $(PKGDIR)/../.. TARGET = tso_test DEFAULT_RELOC = 0x02000000 MODE = l4env SRC_C = tso_test.c LOGTAG = $(addprefix ",$(addsuffix ",$(TARGET))) include $(L4DIR)/mk/prog.mk -------------------------------------------------------------------- Finally my config: -------------------------------------------------------------------- title vmware tso_test root (hd0,1) kernel /drops/drops/bin/x86_586/l4v2/rmgr -sigma0 module /drops/l4/kernel/fiasco/build/main -nokdb -nowait -serial -serial_esc module /drops/drops/bin/x86_586/l4v2/sigma0 modaddr 0x02000000 module /drops/drops/bin/x86_586/l4v2/names module /drops/drops/bin/x86_586/l4v2/log module /drops/drops/bin/x86_586/l4v2/dm_phys module /drops/drops/bin/x86_586/l4v2/simple_ts module /drops/drops/bin/x86_586/l4v2/tso_test -------------------------------------------------------------------- But the error message: -------------------------------------------------------------------- names | Fiasco detected, registering thread names at kernel tso_test| OSKit support: using 4096KB at 0x00180000 as heap tso_test| fs_init: WARNING: No Filesystem tso_test| before fileprinting tso_test| Just a writing to file test.after fileprinting tso_test| L4RM: [PF] read at 0x000000c, eip 0200e54b, src 9.02 tso_test| [9.0] l4rm/lib/src/pagefault.c:78:__unknown_pf(): tso_test| unhandled page fault --PANIC--------------------------------------------------EIP:02004403 (9.00) jdb: -------------------------------------------------------------------- Of course, I can see that fs_init says about "No Filesystem". Is it because I'm using reiserfs? Would it work with ext2? Or is there a better way writing to a file in DROPS? Maybe some L4-specific functions? Regards, Rene

2 1

Building binaries for L4Linux with IPC
by Tiago Jorge 18 May '05

18 May '05

hello... I am trying now to do IPC to my server from L4Linux. I'm not doing a Lib. I'm picking up the client code generated from dice, build encapsulation code and i'm trying to use it in a simple program. I've made the makefile that looks like this: ########################################### PKGDIR ?= ../.. L4DIR ?= $(PKGDIR)/../.. TARGET = WOO_test SRC_CC = WOO_test.cc encap.cc WOO-client.cc MODE = l4linux include $(L4DIR)/mk/prog.mk ########################################### but the files are in c++. They compile right but when the link the give the following error: ################################################### ==> Linking WOO_test LD_PRELOAD=/home/tiago/l4/tool/gendep/libgendep.so GENDEP_TARGET=WOO_test GENDEP_BINARY=ld gcc -o WOO_test WOO_test.o encap.o WOO-client.o -L../../../../../lib/x86_586/l4v2 -L/home/tiago/drops/lib/x86_586/l4v2 -L../../../../../lib/x86_586 -L/home/tiago/drops/lib/x86_586 -L../../../../../lib -L/home/tiago/drops/lib -L/home/tiago/drops/lib -ldm_generic -ldm_mem -lnames -ll4util -lrmgr -lloaderif -ll4env -ll4env_err -lslab -ll4sys WOO_test.o(.text+0x17e): In function `std::vector<long long, std::allocator<long long> >::_M_insert_aux(__gnu_cxx::__normal_iterator<long long*, std::vector<long long, std::allocator<long long> > >, long long const&)': /usr/include/c++/3.3/bits/stl_alloc.h:232: undefined reference to `std::__default_alloc_template<(bool)1, (int)0>::allocate(unsigned)' WOO_test.o(.text+0x21a):/usr/include/c++/3.3/bits/stl_alloc.h:232: undefined reference to `std::__default_alloc_template<(bool)1, (int)0>::deallocate(void*, unsigned)' WOO_test.o(.text+0x24e):/usr/include/c++/3.3/bits/stl_alloc.h:232: undefined reference to `std::basic_string<char, std::char_traits<char>, std::allocator<char> >::basic_string[in-charge](char const*, std::allocator<char> const&)' WOO_test.o(.text+0x2f8):/usr/include/c++/3.3/bits/stl_alloc.h:232: undefined reference to `std::__default_alloc_template<(bool)1, (int)0>::deallocate(void*, unsigned)' WOO_test.o(.text+0x306):/usr/include/c++/3.3/bits/stl_alloc.h:232: undefined reference to `std::basic_string<char, std::char_traits<char>, std::allocator<char> >::_Rep::_M_destroy(std::allocator<char> const&)' WOO_test.o(.text+0x388):/usr/include/c++/3.3/bits/stl_alloc.h:232: undefined reference to `std::__default_alloc_template<(bool)1, (int)0>::deallocate(void*, unsigned)' WOO_test.o(.text+0x3ae):/usr/include/c++/3.3/bits/stl_alloc.h:232: undefined reference to `std::__default_alloc_template<(bool)1, (int)0>::deallocate(void*, unsigned)' WOO_test.o(.text+0x3d9):/usr/include/c++/3.3/bits/stl_alloc.h:232: undefined reference to `std::basic_string<char, std::char_traits<char>, std::allocator<char> >::_Rep::_M_destroy(std::allocator<char> const&)' WOO_test.o(.gnu.linkonce.t._ZNSt6vectorIxSaIxEE13_M_insert_auxEN9__gnu_cxx17__normal_iteratorIPxS1_EERKx+0xf3): In function `std::vector<long long, std::allocator<long long> >::_M_insert_aux(__gnu_cxx::__normal_iterator<long long*, std::vector<long long, std::allocator<long long> > >, long long const&)': /usr/include/c++/3.3/bits/stl_iterator.h:642: undefined reference to `std::__default_alloc_template<(bool)1, (int)0>::deallocate(void*, unsigned)' WOO_test.o(.gnu.linkonce.t._ZNSt6vectorIxSaIxEE13_M_insert_auxEN9__gnu_cxx17__normal_iteratorIPxS1_EERKx+0x107): In function `std::vector<long long, std::allocator<long long> >::_M_insert_aux(__gnu_cxx::__normal_iterator<long long*, std::vector<long long, std::allocator<long long> > >, long long const&)': /usr/include/c++/3.3/bits/stl_alloc.h:232: undefined reference to `std::__default_alloc_template<(bool)1, (int)0>::allocate(unsigned)' WOO_test.o(.eh_frame+0x12): In function `std::vector<long long, std::allocator<long long> >::_M_insert_aux(__gnu_cxx::__normal_iterator<long long*, std::vector<long long, std::allocator<long long> > >, long long const&)': /usr/include/c++/3.3/bits/vector.tcc:224: undefined reference to `__gxx_personality_v0' encap.o(.text+0x430): In function `WOO_decide(std::basic_string<char, std::char_traits<char>, std::allocator<char> >)': /usr/include/c++/3.3/bits/char_traits.h:127: undefined reference to `std::basic_string<char, std::char_traits<char>, std::allocator<char> >::_Rep::_S_terminal' encap.o(.eh_frame+0x11): In function `check_server()': /home/tiago/l4/pkg/WOO/examples/client/encap.cc:20: undefined reference to `__gxx_personality_v0' ################################################### what do i need to link to use c++ in l4linux? i can not link stdlibc++ because it's not intended to use in L4linux... the lack of __gxx_personality_v0 is not due to linking with gcc because i link my server with gcc... and i use c++. How can i make this link with the correct c++ stdlib? Thanks Tiago

2 2

L4 Linux and compatibility with other L4 servers
by Tiago Jorge 17 May '05

17 May '05

Hello... I'm now trying to boot my own server with the L4Linux 2.4. i'm using this servers: title Tests root (hd0,0) kernel /home/tiago/fiasco_builddir/rmgr -sigma0 modaddr 0x02000000 module /home/tiago/fiasco_builddir/main -nokdb -nowait -serial_esc -comspeed 115200 -comport 1 module /home/tiago/fiasco_builddir/sigma0 module /home/tiago/fiasco_builddir/names module /home/tiago/fiasco_builddir/dm_phys module /home/tiago/fiasco_builddir/l4io module /home/tiago/fiasco_builddir/rtc module /home/tiago/fiasco_builddir/name_server module /home/tiago/fiasco_builddir/flips-lxdrv module /home/tiago/fiasco_builddir/mini_ifconfig eth0 10.10.5.197 255.255.0.0 10.10.255.255 module /home/tiago/fiasco_builddir/WOO 10.10.5.197 eth0 module /home/tiago/fiasco_builddir/vmlinuz.V2 no-scroll no-hlt l4irqack=linux root=/dev/hda1 but as i expected there are many pagefaults and resources allocated. How can i configure this servers (not my own of course :) ) so that they don't interfere with the l4linux work but still do their work(mainly networking with FLIPS)? for example, when put only this servers... kernel /home/tiago/fiasco_builddir/rmgr -sigma0 modaddr 0x02000000 module /home/tiago/fiasco_builddir/main -nokdb -nowait -serial_esc -comspeed 115200 -comport 1 module /home/tiago/fiasco_builddir/sigma0 module /home/tiago/fiasco_builddir/names module /home/tiago/fiasco_builddir/dm_phys the module dm_phys and l4linux start to page fault. thanks for the help Tiago

4 12

Killing L4Linux
by gjoel123＠fastmail.fm 17 May '05

17 May '05

Hi How does one kill L4linux from the DROPS console using the loader program? This is what I am currently doing: 1:I type 'n' at the DROPS console to get task ID's and names. This is what I get: . . F.02 LOADER 12.03 Linux server . . 2. I type 'k' and then '12', and I get: 'Error -11 (not owner) killing task #12'. Any ideas? The aim is ultimately to correctly halt/reboot l4linux from l4linux's own shutdown code. Regards Gordon -- gjoel123(a)fastmail.fm

2 3

tftp issue when starting 3 VMs
by Derick Swanepoel 11 May '05

11 May '05

Hi, I'm trying to start three VMs from grub (one master and two slaves), but the tftp provider fails to load the third kernel. This file is the same as the second VM's kernel, which loads successfully. Here's the error output: ===================================================================== tftp | File not found: "(nd)/fiasco/ds/vmlinuz-slave.l4env" exec | vmlinuz-slave.l4env: Error -8 (item not found) from file provider, exec : path was "(nd)/fiasco/ds". DMphys | [7.0] dm_phys/server/src/close.c:130:if_l4dm_generic_close_component( DMphys : ): DMphys | DMphys: client B.02 does not own dataspace 113 (owner is F.02) exec | [B.2] dm_generic/lib/clientlib/src/close.c:58:l4dm_close(): exec | libdm_generic: close dataspace 113 at 7.00 failed (ret -17, exc 0)! loader | vmlinuz-slave.l4env: Error -8 (item not found) while loading loader | ==> App successfully purged ===================================================================== Here is my grub.conf entry: ===================================================================== title Fiasco + Con + L4Linux [3 VMs] kernel (nd)/fiasco/ds/rmgr -sigma0 task modname "L4Linux task" modaddr 0x02000000 module (nd)/fiasco/ds/fiasco -nowait -nokdb -nofancy -serial -comspeed 115200 -comport 1 module (nd)/fiasco/ds/sigma0 module (nd)/fiasco/ds/names module (nd)/fiasco/ds/log module (nd)/fiasco/ds/dm_phys module (nd)/fiasco/ds/l4io --noirq module (nd)/fiasco/ds/tftp -i -s 192.168.1.253 module (nd)/fiasco/ds/simple_ts module (nd)/fiasco/ds/l4exec module (nd)/fiasco/ds/name_server module (nd)/fiasco/ds/con --l4io module (nd)/fiasco/ds/loader (nd)/fiasco/ds/con.cfg (nd)/fiasco/ds/l4linux-nsrd.cfg (nd)/fiasco/ds/l4linux-slave.cfg (nd)/fiasco/ds/l4linux-slave.cfg vbeset 0x117 ===================================================================== l4linux-slave.cfg looks like this: ===================================================================== verbose 2 modpath "(nd)/fiasco/ds" task "vmlinuz-slave.l4env" "l4irqack=linux mem=64M load_ramdisk=1 ramdisk_size=32768 root=/dev/ram0 ro l4env_rd=(nd)/fiasco/ds/nsrd.gz" priority 0xA0 ===================================================================== Thanks, Derick

3 8

L4Linux Scheduling error with Kernel Module
by Leon Brits 10 May '05

10 May '05

Hi all, My Kernel Module seem to be working fine for most of the time. But I get an intermittent error where the Kernel crashes with the following error: <snip> Scheduling in interrupt KERNEL: 12.9 (tcb=c0484800) killed: Unhandled trap <snip> The Kernel module does not control any interrupts and at this point-in-time is pure virtual. Any ideas why or how to debugging this error is appreciated? Thanks Leon

2 1

Flips tracking of IPC
by Tiago Jorge 10 May '05

10 May '05

hello... I'm having a problem with the FLIPS server. I'm doing some transmission in TCP and i seems that the call from the client to the FLIPS server doesn't arrive. I've putten some printfs along the way in l4vfs_net_io_send_call and he does the call the IPC function... but i've putten also some debug message in l4vfs_net_io_send_component and it doesn't print out... so something is dying around here and i don't know where...:( My questions are... in the FLIPS/L4vfs net_io server side where should i put the debug to see if the call has arrived? (i've tried in net_io-server.c and nothing is shown) i've sent something earlier trought that socket... i mean... it only dies when i try to send something the second time... am i missing something (the socket its the same it stays connected)? is there any problem with FLIPS that prevents me from sending something from a socket that is blocked in a recv in another thread (should't be because TCP is bi-directional)? thanks in advance Tiago

3 9

Pagefaulting in lock instruction
by Tiago Jorge 06 May '05

06 May '05

hello... I'm having a strange page fault in my program. My server has an object called Consensus. This object its responsable in the system to do consensus about something... an has an inner thread that receives some parameters from outside. its header file its the following ################################################## #ifndef CONSENSUS_H #define CONSENSUS_H #include <fcntl.h> #include <stdlib.h> #include <netdb.h> #include <sys/types.h> #include <sys/socket.h> #include <netinet/in.h> #include <arpa/inet.h> #include <l4/thread/thread.h> #include <l4/log/l4log.h> #include <l4/lock/lock.h> #include "WOO_vector.h" #include "WOO_map.h" #include "WOO_string.h" #include "FailureDetector.h" #include "Consensus_Packet.h" #include "WOO_TMO.h" #include "WOO_Groups.h" #include "WOO_common.h" #include "WOO_member.h" #define CONSENSUS_PORTNUMBER 30987 struct estimate{ int eid; vector<string> myEstimate; }; class Consensus{ private: int sock; int trueFlag; socklen_t addrLength; struct sockaddr_in destinationAddr; struct sockaddr_in myAddr; struct sockaddr_in responseAddr; estimate est; phases current_phase; bool mustRunConsensus; //l4lock_t consensus_lock; l4thread_t consTh; int consensus_id; //params int myEid; vector<WOO_member> *eids; l4lock_t *group_lock; map<string, CWOO_TMO> *addr_TMO_running; l4lock_t *lock_TMO_running; map<string, CWOO_TMO> *addr_TMO_decided; l4lock_t *lock_TMO_decided; vector<CWOO_Groups> *addr_WOO_groups_table; l4lock_t *lock_WOO_groups_table; public: l4lock_t consensus_lock; private: void initialize_comm(); bool amICoordinator(vector<WOO_member> v); int coordinator(vector<WOO_member> v); void copyGroup(vector<WOO_member> *toFill); bool deadCoordinator(vector<WOO_member> v, FailureDetector *fd); void cleanFailures(vector<WOO_member> *toClean, FailureDetector *fd); void consensus_broadcast(vector<WOO_member> *toBroadcast, phases phase, packet_type packet, int consensus_round); vector<string> buildEstimate(); bool moreConsensus(); void decide(); public: Consensus(); void start(int eid, vector<WOO_member> *new_eids, l4lock_t *new_group_lock, map<string, CWOO_TMO> *p_addr_TMO_running, l4lock_t *p_lock_TMO_running, map<string, CWOO_TMO> *p_addr_TMO_decided, l4lock_t *p_lock_TMO_decided, vector<CWOO_Groups> *p_addr_WOO_groups_table, l4lock_t *p_lock_WOO_groups_table); void consensus_impl(); void startConsensus(); void stopConsensus(); bool get_mustRunConsensus(); }; void helper_consensus(void *args); #endif // CONSENSUS_H ################################################## when someone wants to start the program we invoke start() that has this code... ################################################## //passar aqui as TMOdecided e as TMOrunning e respectivos locks void Consensus::start (int new_eid, vector < WOO_member > *new_eids, l4lock_t * new_group_lock, map < string, CWOO_TMO > *p_addr_TMO_running, l4lock_t * p_lock_TMO_running, map < string, CWOO_TMO > *p_addr_TMO_decided, l4lock_t * p_lock_TMO_decided, vector < CWOO_Groups > *p_addr_WOO_groups_table, l4lock_t * p_lock_WOO_groups_table) { myEid = new_eid; eids = new_eids; group_lock = new_group_lock; consensus_id = 0; trueFlag = 0x1; consensus_lock = L4LOCK_UNLOCKED; addr_TMO_running = p_addr_TMO_running; lock_TMO_running = p_lock_TMO_running; addr_TMO_decided = p_addr_TMO_decided; lock_TMO_decided = p_lock_TMO_decided; addr_WOO_groups_table = p_addr_WOO_groups_table; lock_WOO_groups_table = p_lock_WOO_groups_table; /*consTh = l4thread_create (helper_consensus, this, L4THREAD_CREATE_ASYNC);*/ this->startConsensus(); this->consensus_impl(); LOG ("estou dps do thread create\n"); } ################################################## for testing porpuses the l4thread_create method its commented because its page faulting also :(. Because it page-faulted when i've called the object's method that its inside helper_consensus... ################################################## void helper_consensus (void *args) { Consensus *cobj = static_cast<Consensus *>(args); cobj->consensus_impl(); } ################################################## i thought it was pagefaulting because of this method... but no... he page-faults event when called normally... but the focus of the problem it's not here yet. when i call the startConsensus() method it page-faults in the l4lock_lock(...) instruction... the method looks like this ################################################## void Consensus::startConsensus () { l4lock_lock(&consensus_lock); <---- it page faults here... LOG("inside\n"); mustRunConsensus = true; est.myEstimate = this->buildEstimate (); LOG("out\n"); l4lock_unlock(&consensus_lock); } ################################################## here it is the dissassembled output... ################################################## <Consensus::startConsensus()>: /home/tiago/l4/pkg/WOO/server/src/Consensus_udp.cc:178 01db6a50 push %ebp 01db6a51 mov %esp,%ebp 01db6a53 push %edi 01db6a54 push %esi 01db6a55 push %ebx 01db6a56 sub $0xc37c,%esp 01db6a5c mov 8(%ebp),%ebx /home/tiago/l4/include/l4/lock/lock.h:97 01db6a5f lea 0xc3c8(%ebx),%eax 01db6a65 mov %eax,0xffff3c84(%ebp) <<--- PAGE FAULT HERE!!!!!!!!!!!! /home/tiago/l4/include/l4/lock/lock.h:98 01db6a6b call 0x1dc0e80 <l4thread_myself> /home/tiago/l4/include/l4/lock/lock.h:101 01db6a70 mov 0xffff3c84(%ebp),%ecx /home/tiago/l4/include/l4/lock/lock.h:98 01db6a76 mov %eax,0xffff3c80(%ebp) /home/tiago/l4/include/l4/lock/lock.h:101 01db6a7c test %ecx,%ecx 01db6a7e je 0x1db6aa6 ################################################## as of my inexperience with Fiasco debug issues... what might be causing this? thanks for your all your help...(and yes... i'm just about to finish my project) Tiago Jorge

2 3

L4Linux priority
by Leon Brits 02 May '05

02 May '05

Hi all, One is able to set the priority of L4Linux in the loader config file with the "priority" parameter. Q1: How can I change this priority dynamically after the Linux server has been loaded? Q2: Which tasks has the rights to do this - only RMGR? Thanks Leon

2 1