Archive

Posts Tagged ‘linux’

Keeping track of time with ntp in Linux

October 4th, 2009 No comments

So today we had to move our clocks forward 1 hour (at 2am). Just realised that our Ubuntu box (zeus) was not displaying the right time to begin with (prior to the change). So to keep your computer clock in time with the world, use ntp.

$ sudo ntpdate [timeserver]

I use the Melbourne AAPT time-server but you can find another here or if your an aussie, use these:

ACT ntp.can.connect.com.au stratum three
NSW ntp.syd.connect.com.au stratum two
Queensland ntp.bri.connect.com.au stratum three
South Australia ntp.ade.connect.com.au stratum three
Victoria ntp.mel.connect.com.au stratum two
Western Australia ntp.per.connect.com.au stratum three

Configure your /etc/ntpd.conf with

driftfile /var/lib/ntp/ntp.drift
server ntp.mel.connect.com.au

So how far off was zeus?

4 Oct 21:39:46 ntpdate[24844]: step time server 192.189.54.17 offset -1225.284656 sec

eeek!

{lang: 'en-GB'}
Share

xkcd: Surgery

October 3rd, 2009 No comments

\

Source: http://xkcd.com/644/

{lang: 'en-GB'}
Share

Redhat 5.4 released, CentOS 5.4 is coming soon!

September 3rd, 2009 No comments

If you haven’t heard already, Redhat has released the eagerly anticipated 5.4 release of Redhat Enterprise Linux at their Redhat Summit in Chicago. As expected, Redhat looks to have moved from using Xen as their favoured virtualisation hypervisor to using KVM (which is an integral part of the Linux Kernel). All this will eventually go into RHEV.

All the changes in this release are documented in the  Release Notes, unfortunately Ext4 is still not considered usable in this release (they’re targetting for RHEL6 possibly).

So what of the RHEL clone CentOS? Possibly a 2-4 week delay it seems. WOO! In the meantime, upgrading from 5.3 is easy peasy.

{lang: 'en-GB'}
Share

Mounting and activating LVM Volumes from BootCD to recover data in linux

September 2nd, 2009 No comments

I’ve been working heavily with Red Hat Enterprise Linux (and subsequently CentOS) the past few months (shh! dont tell my MSFT homey!) and one of the great things about CentOS and RHEL is that they both install using LVM – which is a helluvah lot easier when time passes and you realise your running out of space on a drive.

But today I had to recover some data from an LVM partition and copy over some bits to another partition without actually booting the CentOS install (it was bj0rked by yours truely!). What to do? Throw in a Ubuntu LiveCD (or another) and just mount the partitions :-)

First thing we need to do is install LVM – remember we need to be sudo for these to work.

$ aptitude install lvm2

Then scan for any available physical volumes on any of the drives.

$ pvscan

Scan for any Volume Groups that may be present.

$ vgscan

Now activate any of the Volume Groups that it finds, running this makes the logical volumes known to the kernel.

$ vgchange –available y

Then let it scan for any Logical Volumes on any drives

$ lvscan

After running the logical volume scan it will show the path to the LVM mount path, for my boxen it gives something like this

ACTIVE            ‘/dev/LVM/Data‘ [5.26 TB] inherit

You simply mount the path specified and browse like normally :-)

$ mount /dev/LVM/Data /mnt

Enjoy.

{lang: 'en-GB'}
Share

Boffins get 1,000,000 Linux Kernels running as virtual machines!

August 4th, 2009 No comments

Thats right, that wasn’t a typo. Some crazy boffins at Sandia National Laboratories in Livermore, have run more than a million Linux kernels as virtual machines out of which 20,000 can be run simultaneously! Why on earth would they attempt such feats?

Prehaps this XKCD may jog your memory

XKCD: Networking

Yep, just about:

The technique will allow them to effectively observe behaviour found in malicious botnets, or networks of infected machines that can operate on the scale of a million nodes.

Insane!

{lang: 'en-GB'}
Share

Linux Btrfs: A short history of btrfs

August 2nd, 2009 No comments

Valerie Aurora (such a cool name!) takes a look into the history of Btrfs, well written and easy to follow.

{lang: 'en-GB'}
Share

VirtualBox 3.0.2 released with SMP and Network IO fixes

July 13th, 2009 No comments

Quick note about VirtualBox 3.0.2 being released, this fixes up two critcal problems – one is the poor SMP performance everyone is coming to realise, and the network IO issue (reproduced in Fedora for

  • VMM: fixed network regressions (guest hangs during network IO) (bug #4343)
  • VMM: guest SMP performance improvements
  • VMM: fixed hangs and poor performance with Kaspersky Internet Security (VT-x/AMD-V only; bug #1778)
  • VMM: fixed crashes when executing certain Linux guests (software virtualization only; bugs #2696 & #3868)
  • ACPI: fixed Windows 2000 kernel hangs with IO-APIC enabled (bug #4348)
  • APIC: fixed high idle load for certain Linux guests (3.0 regression)
  • BIOS: properly handle Ctrl-Alt-Del in real mode
  • iSCSI: fixed configuration parsing (bug #4236)
  • OVF: fix potential confusion when exporting networks
  • OVF: compatibility fix (bug #4452)
  • NAT: fixed crashes under certain circumstances (bug #4330)
  • 3D support: fixed dynamic linking on Solaris/OpenSolaris guests (bug #4399)
  • 3D support: fixed incorrect context/window tracking for multithreaded apps
  • Shared Folders: fixed loading from saved state (bug #1595)
  • Shared Folders: host file permissions set to 0400 with Windows guest (bug #4381)
  • X11 host and guest clipboard: fixed a number of issues, including bug #4380 and #4344
  • X11 Additions: fixed some issues with seamless windows in X11 guests (bug #3727)
  • Windows Additions: added VBoxServiceNT for NT4 guests (for time synchronization and guest properties)
  • Windows Additions: fixed version lookup
  • Linux hosts: workaround for buggy graphics drivers showing a black VM window on recent distributions (bug #4335)
  • Linux hosts: fixed typo in kernel module startup script (bug #4388)
  • Installer: support Pardus Linux
  • Solaris hosts: several installer fixes
  • Solaris host: fixed a preemption issue causing VMs to never start on Solaris 10 (bug #4328).
  • Solaris guest: fixed mouse integration for OpenSolaris 2009.06 (bug #4365)
  • Windows hosts: fixed high CPU usage after resuming the host (bug #2978)
  • OVF: accept ovf:/disk/ specifiers with a single slash in addition to ovf://disk/ (bug #4452)
  • Fixed a settings file conversion bug which sometimes caused hardware acceleration to be enabled for virtual machines that had no explicit configuration in the XML.

Download links:

  • VirtualBox 3.0.2 for Windows hosts x86/amd64
  • VirtualBox 3.0.2 for Solaris and OpenSolaris hosts x86/amd64
  • VirtualBox 3.0.2 Software Developer Kit (SDK) All platforms (registration required)

I’ve been running it all day at work today without issues.

{lang: 'en-GB'}
Share

Time flies: VirtualBox 3.0 final is out!

July 1st, 2009 No comments

It only feels like last week that I mentioned the beta release of VirtualBox 3.0, Sun has released the final version of the much anticipated v3.0!

As mentioned earlier, this release is super exciting for the simple fact that it has SMP support – a maximum of 32 virtual CPUs (but relax, you shouldn’t assign more than what you can afford – or the number of cores you have!). VMWare still only supports a maximum of 2 virtual-cpus (this _may_ change in VMWare 7.0!), another feat is the hardware 3D (Direct3D/OpenGL)  support for guests.

This version is a major update. The following major new features were added:

  • Guest SMP with up to 32 virtual CPUs (VT-x and AMD-V only; see chapter 3.7.2.2 of the user manual)
  • Windows guests: ability to use Direct3D 8/9 applications / games (experimental; see chapter 4.8 of the user manual)
  • Support for OpenGL 2.0 for Windows, Linux and Solaris guests

In addition, the following items were ?xed and/or added:

  • Solaris hosts: allow suspend/resume on the host when a VM is running (bug #3826)
  • Solaris hosts: loosen the restriction for contiguous physical memory under certain conditions
  • Mac OS X hosts: ?xed guest PAE
  • Linux hosts: kernel module compile ?xes for 2.6.31 (bug #4264)
  • VMM: ?xed occasional guru meditation when loading a saved state (VT-x only)
  • VMM: eliminated IO-APIC overhead with 32 bits guests (VT-x only, some Intel CPUs don’t support this feature (most do); bug #638)
  • VMM: ?xed 64 bits CentOS guest hangs during early boot (AMD-V only; bug #3927)
  • VMM: performance improvements for certain PAE guests (e.g. Linux 2.6.29+ kernels)
  • VMM: some Windows guests detected a completely wrong CPU frequency (bug #2227)
  • VMM: ?xed hanging and unkillable VM processes (bug #4040)
  • VMM: ?xed random infrequent guest crashes due to XMM state corruption (Win64 hosts only)
  • VMM: performance improvements for network I/O (VT-x/AMD-V only)
  • GUI: added mini toolbar for fullscreen and seamless mode (Thanks to Huihong Luo)
  • GUI: redesigned settings dialogs
  • GUI: allow to create/remove more than one host-only network adapters (non Windows hosts)
  • GUI: display estimated time for long running operations (e.g. OVF import/export)
  • GUI: ?xed rare hangs when open the OVF import/export wizards (bug #4157)
  • 3D support: ?xed VM crashes for client applications using incorrect OpenGL states
  • 3D support: ?xed memory corruption when querying for supported texture compression formats
  • 3D support: ?xed incorrect rendering of glDrawRangeElements
  • 3D support: ?xed memory leak when using VBOs
  • 3D support: ?xed glew library detection
  • 3D support: ?xed random textures corruption
  • VRDP: support Windows 7 RDP client
  • Networking: ?xed another problem with TX checksum of?oading with Linux kernels up to version 2.6.18
  • NAT: ?xed “open ports on virtual router 10.0.2.2 – 513, 514” (forum)
  • NAT: allow to con?gure socket and internal parameters
  • NAT: allow to bind sockets to speci?c interface
  • PXE boot: signi?cant performance increase (VT-x/AMD-V only)
  • VHD: properly write empty sectors when cloning of VHD images (bug #4080)
  • VHD: ?xed crash when discarding snapshots of a VHD image
  • VHD: ?xed access beyond the block bitmap which could lead to arbitrary crashes
  • VBoxManage: ?xed incorrect partition table processing when creating VMDK ?les giving raw partition access (bug #3510)
  • VBoxManage: support cloning to existing image ?le
  • OVF: several OVF 1.0 compatibility ?xes
  • OVF: ?xed exporting of disk images when multiple virtual machines are exported at once
  • Virtual mouse device: eliminated micro-movements of the virtual mouse which were confusing some applications (bug #3782)
  • Shared Folders: sometimes a ?le was created using the wrong permissions (2.2.0 regression; bug #3785)
  • Shared Folders: allow to change ?le attributes from Linux guests and use the correct ?le mode when creating ?les
  • Shared Folders: some content was incorrectly written under certain conditions (bug #1187)
  • Shared Folders: ?xed incorrect ?le timestamps, when using Windows guest on a Linux host (bug #3404)
  • X11 clipboard: ?x duplicate end of lines (bug #4270)
  • X11 guests: a number of shared clipboard ?xes
  • Linux guests: Guest Additions support for SUSE Linux Enterprise Desktop 11
  • Linux guests: new daemon vboxadd-service to handle time synchronization and guest property lookup
  • Linux guests: implemented guest properties (OS info, logged in users, basic network information)
  • Windows host installer: VirtualBox Python API can now be installed automatically (requires Python and Win32 Extensions installed)
  • USB: Support for high-speed isochronous endpoints has been added. In addition, read-ahead buffering is performed for input endpoints (currently Linux hosts only). This should allow additional devices to work, notably webcams (bug #242).
  • USB: ?xed error handling for some USB dongles
  • Web service: ?xed inability to handle NULL pointers for object arguments, which are valid values for a lot of APIs, in both the raw and the object-oriented web service.
  • Web service: object-oriented bindings for JAX-WS did not exhibit interface inheritance correctly, ?xed
  • Web service: added support for IDisplay and IGuest interfaces, which were previously unavailable
  • Registration dialog uses Sun Online accounts now

Why keep reading, upgrade dammit!

  • VirtualBox 3.0.0 for Windows hosts x86/amd64
  • VirtualBox 3.0.0 for Solaris and OpenSolaris hosts x86/amd64
  • VirtualBox 3.0.0 Software Developer Kit (SDK) All platforms (registration required)

Enjoy, see the manual online too!

{lang: 'en-GB'}
Share

Linus releases Linux 2.6.30

June 11th, 2009 No comments

Linus has released 2.6.30 of the kernel, list of changes are available in the Linux Kernel Newbies guide.

This version adds the log-structured NILFS2 filesystem, a filesystem for object-based storage devices, a caching layer for local caching of NFS data, the RDS protocol which delivers high-performance reliable connections between the servers of a cluster, a distributed networking filesystem (POHMELFS), automatic flushing of files on renames/truncates in ext3, ext4 and btrfs, preliminary support for the 802.11w drafts, support for the Microblaze architecture, the Tomoyo security module, DRM support for the Radeon R6xx/R7xx graphic cards, asynchronous scanning of devices and partitions for faster bootup, MD support for switching between raid5/6 modes, the preadv/pwritev syscalls, several new drivers and many other small improvements.

One interesting change (amongst the many) is that we have this new feature called Fastboot. Essentially, when we boot right now, there is significant cycles wasted waiting for the device probing to complete. From Johnathan Corbet’s article on LWN:

There are many aspects to the job of making a system boot quickly. Some of the lowest-hanging fruit can be found in the area of device probing. Figuring out what hardware exists on the system tends to be a slow task at best; if it involves physical actions (such as spinning up a disk) it gets even worse. Kernel developers have long understood that they could gain a lot of time if this device probing could, at least, be done in a parallel manner: while the kernel is waiting for one device to respond, it can be talking to another. Attempts at parallelizing this work over the years have foundered, though. Problems with device ordering, concurrent access, and more have adversely affected system stability, with the inevitable result that the parallel code is taken back out. So early system initialization remains almost entirely sequential.

This new release attempts to address this problem.

Arjan hopes to succeed where others have failed by (1) taking a carefully-controlled approach to parallelization which doesn’t try to parallelize everything at once, and (2) an API which attempts to hide the effects of parallelization (other than improved speed) from the rest of the system. For (1), Arjan has limited himself to making parts of the SCSI and libata subsystems asynchronous, without addressing much of the rest of the system. The API work ensures that device registration happens in the same order is it would in a strictly sequential system. That eliminates the irritating problems which result when one’s hardware changes names from one boot to the next.

How well it does it, I guess we’ll have to wait and see. But here’s a bit of a tidbit in the kernel for the new Microblaze implementation.

void __init setup_cpuinfo(void)
{
struct device_node *cpu = NULL;

cpu = (struct device_node *) of_find_node_by_type(NULL, "cpu");
if (!cpu)
printk(KERN_ERR "You don't have cpu!!!\n");

printk(KERN_INFO "%s: initialising\n", __func__);

DUDE, You dont’ have cpu!!!

{lang: 'en-GB'}
Share

THIS IS FEDORA: Fedora 11 Released

June 9th, 2009 No comments

This is FEDORA.

Fedora 11 aka Leonidas has been released. Whilst the front page is yet to be updated the mirrors are being updated as I write and ISO’s are being propogated.

Download ISO:

In Australia? Try the local mirrors:

Bit of a torrenter? See the Torrent Tracker page.

Approximate sizes (from internode):

Fedora-11-i686-Live.iso             688M
Fedora-11-i686-Live-KDE.iso         686M
Fedora-11-x86_64-Live.iso           691M
Fedora-11-x86_64-Live-KDE.iso       693M

See the Fedora 11 Release Notes for more information about changes in this release, the Fedora 11 feature list or the Unoffficial Fedora 11 Guide.

I’ve been awaiting this release primarily for the Linux Kernel v2.6.29 (in comparison to Jaunty‘s Kernel 2.6.28) which brings a slew of updates to the table – in particular KMS (Kernel mode setting – flicker free graphics), the inclusion of Btrfs in the kernel for preliminary testing and better memory mangement. Ofcourse Fedora 11 ships with X.org 1.6 as well. With the inclusion of GCC 4.4 all packages are now compiled with gcc4.4 too.

I’ve only dabbled in Fedora 10, but I think its a worthy move from my primarily Ubuntu lifestyle.

Whats really interesting though, is that Ubuntu 9.10 seems to have a decent performance bump, so whilst the wait for Fedora 11 is over, its time to get excited about the snappier the Karmic Koala.

{lang: 'en-GB'}
Share