Categories: General IT stuff

Self made home NAS power measurements

by SUNWfrk Published on: March 27, 2011
Comments: No Comments
Tags: , , ,
Categories:General IT stuff

I promised to publish some power measurements of my self made home NAS, so… here they are!

The CPU cores only seems to support the C1 state (loved to use C3 or C6..) for the rest I’m using powerd to throttle the frequency and ‘atacontrol spindown’ for the disks.

When the system is idle and the data disk are spun down:

Nas IdleWhen all 4 threads (it’s a dual core ATOM with HT) on the system are in use:

NAS CPU loadWhen all 4 threads are in use and a benchmarks is running on the data disks:

NAS CPU and DISKS

If you are wondering which components I used then take a look at my first NAS post

Disk performance benchmarks can be found here

Self made home NAS I/O benchmarks

by SUNWfrk Published on: February 28, 2011
Comments: 3 Comments
Tags: , , ,
Categories:General IT stuff

As requested by some, these are some graphs of the benchmarks I’ve run on my home NAS. Bear in mind that I didn’t made this NAS for screaming performance. It just had to stream movies, pictures but also keep them save and this with ‘green’ in the back of my mind.

for the setup of the machine, check my previous blog post.

 

Bonnie benchmark on a ZFS mirror with compression disabled

 

Bonnie benchmark on a ZFS mirror with compression enabled (LZJB)

 

Conclusion: I think this is a fair performance for home use, even if you think that the drives I use are optimized for reduced power (‘green’) usage and are running at 5200rpm. Also compression seems to improve disk I/O as it needs less data to be send/read to the disks but will use more CPU and thus.. also more power..

Next UP: power measurements.

Self made home NAS with ZFS

by SUNWfrk Published on: February 22, 2011
Comments: No Comments
Tags: , , , , , , ,
Categories:General IT stuff

Yes, this is yet another self-made NAS post.. But when I was searching for information I had the feeling it was either with OpenSolaris/Solaris Express and ZFS or with Linux and some LVM. Some even dare to use btrfs which in my opinion is still in heavy development and not near stable. I’m not such a big fan of Solaris Express or btrfs for home use. I do like Linux or FreeBSD and ZFS. So it was clear for me, it would be FreeBSD with ZFS because of the native support for this FS.

Before I had this NAS I had 2 USB disk with ZFS in mirror attached to an OpenSolaris laptop but believe me, this is not an ideal setup, it worked but after one year of non stop operation scrubs constantly found data inconsistencies. Even after opening the USB cases and attaching the drives directly with a SATA cable ZFS was reporting errors. So, buy some new drives! (they’re really not so expensive)

So I ordered the following things.

1x SuperMicro X7SPA-H Atom D510 Mainboard, Retail
1x Lian Li PC-Q08 Black, No power supply
2x Kingston KTH-ZD8000B/2G 2 GB, PC5300, 667 MHz
1x Seasonic M12II-520 Modular, Bronze 520 Watt, 20+24 Pins
1x Lite-On LiteOn IHAS324 Serial ATA, Retail, Black
2x Western Digital Caviar 1,5TB WD15EARS-22Z5B1

Home NAS

Since it’s a home NAS I didn’t needed Enterprise grade performance but a low powered multifunctional device where I had the freedom to install what I want on it (that rules out Qnap, Synology..)

Some downsides of my configuration:

no graphic support in FreeBSD because of lacking GEM support (seems they’re working on it.)
no ECC memory, ECC memory is not supported on current ATOM boards. (this is also not offered by qnap or other home NAS builders)

Oracle starts with video blog

by SUNWfrk Published on: November 20, 2010
Comments: No Comments
Tags:
Categories:General IT stuff

Oracle started with a video blog, showing a lot of new features of the new Solaris 11 express OS

check it out here: http://blogs.sun.com/video/

Thanks to Henkis blog “It’s a UNIX system

yum update problems on a vps

by SUNWfrk Published on: November 12, 2010
Comments: No Comments
Tags: , , ,
Categories:General IT stuff

I had a slight problem when upgrading my RPM’s on my VPS (which I got from belGOnet and I can fully recommend!!) Most of the time ‘yum update’ failed to work and exits with this error

[root@rogue ~]# yum update
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
Traceback (most recent call last):
File “/usr/bin/yum”, line 29, in ?
yummain.user_main(sys.argv[1:], exit_code=True)
File “/usr/share/yum-cli/yummain.py”, line 309, in user_main
errcode = main(args)
File “/usr/share/yum-cli/yummain.py”, line 178, in main
result, resultmsgs = base.doCommands()
File “/usr/share/yum-cli/cli.py”, line 345, in doCommands
self._getTs(needTsRemove)
File “/usr/lib/python2.4/site-packages/yum/depsolve.py”, line 101, in _getTs
self._getTsInfo(remove_only)
File “/usr/lib/python2.4/site-packages/yum/depsolve.py”, line 112, in _getTsInfo
pkgSack = self.pkgSack
File “/usr/lib/python2.4/site-packages/yum/__init__.py”, line 661, in
pkgSack = property(fget=lambda self: self._getSacks(),
File “/usr/lib/python2.4/site-packages/yum/__init__.py”, line 501, in _getSacks
self.repos.populateSack(which=repos)
File “/usr/lib/python2.4/site-packages/yum/repos.py”, line 232, in populateSack
self.doSetup()
File “/usr/lib/python2.4/site-packages/yum/repos.py”, line 79, in doSetup
self.ayum.plugins.run(‘postreposetup’)
File “/usr/lib/python2.4/site-packages/yum/plugins.py”, line 179, in run
func(conduitcls(self, self.base, conf, **kwargs))
File “/usr/lib/yum-plugins/fastestmirror.py”, line 181, in postreposetup_hook
all_urls = FastestMirror(all_urls).get_mirrorlist()
File “/usr/lib/yum-plugins/fastestmirror.py”, line 333, in get_mirrorlist
self._poll_mirrors()
File “/usr/lib/yum-plugins/fastestmirror.py”, line 376, in _poll_mirrors
pollThread.start()
File “/usr/lib/python2.4/threading.py”, line 416, in start
_start_new_thread(self.__bootstrap, ())
thread.error: can’t start new thread

The answer is (again) more simple then you might expect. Thus, before you start reinstalling python or start rebuilding your yum database try this and modify this file as following: /etc/yum/pluginconf.d/fastestmirror.conf

[main]
enabled=1
verbose=0
socket_timeout=3
hostfilepath=/var/cache/yum/timedhosts.txt
maxhostfileage=10
#this was set to 15 and causes problems on a VPS which is mostly limited in the number of concurrent threads
maxthreads=5
#exclude=.gov, facebook

After this ‘yum update’ should be working again. if you are still running out of threads you can put the enabled flag to zero and this will disable the fastestmirror plugin.

Adding custom rpm’s to your autoyast installation

by SUNWfrk Published on: November 11, 2010
Comments: 1 Comment
Tags: , , ,
Categories:General IT stuff

This is a follow up of my previous blogpost where I created a custom initrd for an autoyast installation. The module I added to the initrd was made out of a source rpm, this source rpm also generated rpm files with this module in so you can use it in your installation. I found a lot of info from this site. What we will do is adding an ‘updates’ directory which can be used for rpm’s who will update existing rpm’s or we can add new or custom rpm’s.

some background info: my installation is located in /install/sles10sp2/CD1, my install server ip is 10.8.0.1 and I installed inst-source-utils.rpm

/usr/bin/create_update_source.sh /install/sles10sp2/CD1

this will create an ‘updates’ directory in /install/sles10sp2/CD1. Now you can add your custom rpm’s into that directory. I’m using an x86_64 installation so for me it will be:

cp /usr/src/packages/RPMS/x86_64/hp-igb-kmp-smp-2.3.4_2.6.16.60_0.21-1.x86_64.rpm /install/sles10sp2/CD1/updates/suse/x86_64/
cd  /install/sles10sp2/CD1/updates/suse
create_package_descr -x setup/descr/EXTRA_PROV
cd setup/descr
ls > directory.yast

We’re almost there; now we only have to edit your autoyast profile and add the following:

<add-on>
<add_on_products config:type=”list”>
<listentry>
<media_url>nfs://10.8.0.1/install/sles10sp2/updates</media_url>
<product>SuSE-Linux-Updates</product>
<product_dir>/</product_dir>
</listentry>
</add_on_products>
</add-on>

That’s it!

Adding an exotic network driver to a suse autoyast installation

by SUNWfrk Published on: November 11, 2010
Comments: 1 Comment
Tags: , , , ,
Categories:General IT stuff

I’m writing this because I lost some significant time on this whole problem.. I wanted to install 17 nodes over the network (because they didn’t had a dvd-rom) but when they started booting over pxe and tftp they couldn’t find any networking cards. ‘That’s strange!’ because they have two Intel 1000 network cards and the igb.ko module is loaded. What is happening here? After some searching I found out that HP has their own driver for this and it is not included in many distro’s and also not in Suse Enterprise Linux 10 SP2. I found a nice article on this site (strangely enough their site has some nice articles!) here is what I needed to do.

I downloaded the source rpm from the HP site and installed it.

installsrv:~ # rpm -i hp-igb-2.3.4-1.src.rpm

This will extract the source into /usr/src/packages and we now have to build the kernel modules and create the needed rpm packages for our 17 nodes.
(make sure you have installed gcc, automake and autoconf)

installsrv:~ # cd /usr/src/packages
installsrv:/usr/src/packages # rpmbuild -bb SPECS/hp-igb.spec
*** a lot of output ***

okay! we now have a kernel module for our network installation and rpm’s we can install onto our new machines.

Let’s rebuild our initrd we are using for our network installation (more info here)

installsrv:/usr/src/packages # cd /tftpboot/
installsrv:/tftpboot # cp sles10.ird sles10.ird.orig
installsrv:/tftpboot # cp sles10.ird initrd_unzipped.gz && gunzip initrd_unzipped.gz
installsrv:/tftpboot # mkdir initrd_staging
installsrv:/tftpboot # cd initrd_staging
installsrv:/tftpboot/initrd_staging # cpio -id < ../initrd_unzipped
installsrv:/tftpboot/initrd_staging # cp /usr/src/packages/BUILD/hp-igb-2.3.4/obj/default/igb.ko /tftpboot/initrd_staging/lib/modules/2.6.16.60-override-default/initrd/
installsrv:/tftpboot/initrd_staging # find . | cpio -o –format=newc > ../new_initrd_unzipped
installsrv:/tftpboot/initrd_staging # cd ..
installsrv:/tftpboot # gzip -9 < ./new_initrd_unzipped > sles10.ird

I’ll discuss how to use the rpm’s we created from the source rpm in the network install in another plogpost

page 1 of 2»
Disclaimer
The opinions expressed on this site are my own personal opinions and do not represent my employer's view in anyway.
SUNWfrk

Welcome , today is Thursday, February 23, 2012