New IT forum
27 June 2022, 11:53:58 am *
Welcome, %1$s. Please login or register.

: MiraBox now in stock.
 
Pages: [1]

Author Topic: kernel error on dev mtdblock0  (Read 15290 times)

patrick295767

  • Newbie
  • *
  • Posts: 17
kernel error on dev mtdblock0
« on: 01 January 2013, 09:21:33 am »

Hello,

I would like to report a serious kernel error of my logs.

Please would you  mind informing whether it can be solved, what to do ?

Quote
# cat /var/log/syslog | tail
Jan  1 10:18:00 debian kernel: uncorrectable error :
Jan  1 10:18:00 debian kernel: end_request: I/O error, dev mtdblock0, sector 24
Jan  1 10:18:00 debian kernel: Buffer I/O error on device mtdblock0, logical block 3
Jan  1 10:18:00 debian kernel: uncorrectable error :
Jan  1 10:18:00 debian kernel: uncorrectable error :
Jan  1 10:18:00 debian kernel: end_request: I/O error, dev mtdblock0, sector 0
Jan  1 10:18:00 debian kernel: Buffer I/O error on device mtdblock0, logical block 0



my disks are like:
Quote
Disk identifier: 0x00000000

Disk /dev/mtdblock2 doesn't contain a valid partition table

Disk /dev/mmcblk0: 8018 MB, 8018460672 bytes
4 heads, 16 sectors/track, 244704 cylinders
Units = cylinders of 64 * 512 = 32768 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk identifier: 0x2a97ca24

        Device Boot      Start         End      Blocks   Id  System
/dev/mmcblk0p1               1         385       12312   83  Linux
/dev/mmcblk0p2             386      244704     7818208   83  Linux


thanks
Logged

SLUGex

  • Newbie
  • *
  • Posts: 7
Re: kernel error on dev mtdblock0
« Reply #1 on: 28 June 2013, 05:59:25 pm »

I would like to report a serious kernel error of my logs.

Please would you  mind informing whether it can be solved, what to do ?

Quote
# cat /var/log/syslog | tail
Jan  1 10:18:00 debian kernel: uncorrectable error :
Jan  1 10:18:00 debian kernel: end_request: I/O error, dev mtdblock0, sector 24
Jan  1 10:18:00 debian kernel: Buffer I/O error on device mtdblock0, logical block 3
Jan  1 10:18:00 debian kernel: uncorrectable error :

thanks

Same problem here. Each time after a power on, I get this. I do not use the mtdblock (builtin NAND flash), booting Debian 6 from SD Card. But I have to type ^D on the USB-serial console to skip over this. THIS IS ODD and makes me mad!

Any solution?

Hey NewIT linux expert, please read the below cited text and tell us, if this is a solution - and kindly translate it into a better understandable solution:

cite (found at www.spinics.net/lists/hotplug/msg01834.html):
"Where /dev/mtdblock0 is something of a special NAND partition, used by the mask ROM on the ARM to get a second stage loader, which is then loaded from /dev/mtdblock1 etc.  The messages about "uncorrectable error" are from the kernel, since that first partition uses a different ECC scheme than the rest of the flash.
What's happening is that it's trying to read partition data from the MTD devices ... which is inappropriate, they don't use internal partition data.  And the mtdblock0 read fails, because of the ECC differences, producing messages ... ones that should never have appeared, since it shouldn't have been trying to read partition data.

The boot is easily cleaned up by a patch to a udev rules file:  /etc/udev/rules.d/60-persistent-storage.rules is already skipping a bunch of devices, it just needs to add the "mtd*" devices to what should be skipped:
  KERNEL=="ram*|loop*|fd*|mtd*|nbd*|gnbd*|dm-*|md*", GOTO="persistent_storage_end"
It'd be good to see this bug fixed before lenny goes final..."

I am not the kind of ARM linux crack, so please investigate it and give advice...

« Last Edit: 28 June 2013, 06:22:00 pm by SLUGex »
Logged

Confusticated

  • New IT customer
  • Hero Member
  • *
  • Posts: 663
Re: kernel error on dev mtdblock0
« Reply #2 on: 28 June 2013, 08:44:38 pm »

Quote
Hey NewIT linux expert
I am not a NewIT employee, neither am I a Linux expert, my comments are worth exactly what you paid for them....

Quote
Where /dev/mtdblock0 is something of a special NAND partition, used by the mask ROM on the ARM
This is not the case for the plugs, and does not apply.

Quote
/etc/udev/rules.d/60-persistent-storage.rules
Should be /lib/udev/rules.d/60-persistent-storage.rules
And should already include a rule line containing 'mtdblock', something like
Code: [Select]
# and we can safely ignore these kinds of devices
KERNEL=="fd[0-9]*|mtd[0-9]*|mtdblock[0-9]*|nbd[0-9]*|gnbd[0-9]*|dm-[0-9]*|md[0-9]*|btibm[0-9]*", \
                                        GOTO="persistent_storage_end"

Error reports like
Quote
end_request: I/O error, dev mtdblock0, sector
can have many causes, not just the one specific case referred to in your post.
Try to determine what action is causing the error, i.e. does it coincide with mounting the external eSATA drive ?
A post of your log output is far more valuable than a quote of someone else's.
Logged
Advocatus Diaboli - My agenda is not to give you the answer, but to guide your thoughts so you derive it for yourself!

SLUGex

  • Newbie
  • *
  • Posts: 7
Re: kernel error on dev mtdblock0
« Reply #3 on: 27 July 2013, 08:49:57 am »

Hi Confusticated and all other readers,

thank you for taking the time to shed a light into this very annoying problem.
The problem still exists, even after reading all your hints, so I'll fulfill your requested investigations here.


Quote
/etc/udev/rules.d/60-persistent-storage.rules
Should be /lib/udev/rules.d/60-persistent-storage.rules
And should already include a rule line containing 'mtdblock', something like
Code: [Select]
# and we can safely ignore these kinds of devices
KERNEL=="fd[0-9]*|mtd[0-9]*|mtdblock[0-9]*|nbd[0-9]*|gnbd[0-9]*|dm-[0-9]*|md[0-9]*|btibm[0-9]*", \
                                        GOTO="persistent_storage_end"
Yes, it is there. exactly this way. Are you sure this file has influence here? As far as I can guess, my failing checks are reported before  /etc/ or /lib/ is even mounted. Or am I wrong?

Try to determine what action is causing the error, i.e. does it coincide with mounting the external eSATA drive ?
A post of your log output is far more valuable than a quote of someone else's.

You're right. Now watch out for the > 300 places of repeated
Code: [Select]
end_request: I/O error, dev mtdblock0, sector xx
Okay, here we go without SATA and without USB-Swap-Stick, as you asked me to do:
Code: [Select]

        |  \/  | __ _ _ ____   _____| | |
        | |\/| |/ _` | '__\ \ / / _ \ | |
        | |  | | (_| | |   \ V /  __/ | |
        |_|  |_|\__,_|_|    \_/ \___|_|_|
 _   _     ____              _
| | | |   | __ )  ___   ___ | |_
| | | |___|  _ \ / _ \ / _ \| __|
| |_| |___| |_) | (_) | (_) | |_
 \___/    |____/ \___/ \___/ \__|
 ** MARVELL BOARD: SHEEVA PLUG LE

U-Boot 1.1.4 (Jul 14 2009 - 06:46:57) Marvell version: 3.4.16

U-Boot code: 00600000 -> 0067FFF0  BSS: -> 006CF120

Soc: MV88F6281 Rev 3 (DDR2)
CPU running @ 1200Mhz L2 running @ 400Mhz
SysClock = 400Mhz , TClock = 200Mhz

DRAM CAS Latency = 5 tRP = 5 tRAS = 18 tRCD=6
DRAM CS[0] base 0x00000000   size 256MB
DRAM CS[1] base 0x10000000   size 256MB
DRAM Total size 512MB  16bit width
Flash:  0 kB
Addresses 8M - 0M are saved for the U-Boot usage.
Mem malloc Initialization (8M - 7M): Done
NAND:512 MB

CPU : Marvell Feroceon (Rev 1)

Streaming disabled
Write allocate disabled


USB 0: host mode
PEX 0: interface detected no Link.
Net:   egiga0 [PRIME], egiga1
Hit any key to stop autoboot:  0
SDHC found. Card desciption is:
Manufacturer:       0x1b, OEM "SM"
Product name:       "00000", revision 1.0
Serial number:      1951175429
Manufacturing date: 4/2010
CRC:                0x00, b0 = 0

2799824 bytes read
## Booting image at 00800000 ...
   Image Name:   Linux-2.6.38.8
   Created:      2011-06-26   0:14:27 UTC
   Image Type:   ARM Linux Kernel Image (uncompressed)
   Data Size:    2799760 Bytes =  2.7 MB
   Load Address: 00008000
   Entry Point:  00008000
   Verifying Checksum ... OK
OK

Starting kernel ...

Uncompressing Linux... done, booting the kernel.
Initializing cgroup subsys cpu
Linux version 2.6.38.8 ([email protected]) (gcc version 4.5.3 (PlugComputer G++ 20110530) ) #8 PREEMPT Sat Jun 25 18:14:23 MDT 2011
CPU: Feroceon 88FR131 [56251311] revision 1 (ARMv5TE), cr=00053177
CPU: VIVT data cache, VIVT instruction cache
Machine: Marvell eSATA SheevaPlug Reference Board
Memory policy: ECC disabled, Data cache writeback
Built 1 zonelists in Zone order, mobility grouping on.  Total pages: 130048
Kernel command line: console=ttyS0,115200 root=/dev/mmcblk0p2 rootdelay=5
PID hash table entries: 2048 (order: 1, 8192 bytes)
Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
Memory: 512MB = 512MB total
Memory: 513288k/513288k available, 11000k reserved, 0K highmem
Virtual kernel memory layout:
    vector  : 0xffff0000 - 0xffff1000   (   4 kB)
    fixmap  : 0xfff00000 - 0xfffe0000   ( 896 kB)
    DMA     : 0xffc00000 - 0xffe00000   (   2 MB)
    vmalloc : 0xe0800000 - 0xfe800000   ( 480 MB)
    lowmem  : 0xc0000000 - 0xe0000000   ( 512 MB)
    modules : 0xbf000000 - 0xc0000000   (  16 MB)
      .init : 0xc0008000 - 0xc002f000   ( 156 kB)
      .text : 0xc002f000 - 0xc054e2d8   (5245 kB)
      .data : 0xc0550000 - 0xc05838d8   ( 207 kB)
SLUB: Genslabs=13, HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
Preemptable hierarchical RCU implementation.
        RCU-based detection of stalled CPUs is disabled.
        Verbose stalled-CPUs detection is disabled.
NR_IRQS:114
sched_clock: 32 bits at 200MHz, resolution 5ns, wraps every 21474ms
Console: colour dummy device 80x30
Calibrating delay loop... 1192.75 BogoMIPS (lpj=5963776)
pid_max: default: 32768 minimum: 301
Mount-cache hash table entries: 512
CPU: Testing write buffer coherency: ok
devtmpfs: initialized
NET: Registered protocol family 16
Kirkwood: MV88F6281-A1, TCLK=200000000.
Feroceon L2: Enabling L2
Feroceon L2: Cache support initialised.
bio: create slab <bio-0> at 0
vgaarb: loaded
SCSI subsystem initialized
usbcore: registered new interface driver usbfs
usbcore: registered new interface driver hub
usbcore: registered new device driver usb
Switching to clocksource orion_clocksource
FS-Cache: Loaded
Switched to NOHz mode on CPU #0
NET: Registered protocol family 2
IP route cache hash table entries: 4096 (order: 2, 16384 bytes)
TCP established hash table entries: 16384 (order: 5, 131072 bytes)
TCP bind hash table entries: 16384 (order: 4, 65536 bytes)
TCP: Hash tables configured (established 16384 bind 16384)
TCP reno registered
UDP hash table entries: 256 (order: 0, 4096 bytes)
UDP-Lite hash table entries: 256 (order: 0, 4096 bytes)
NET: Registered protocol family 1
RPC: Registered udp transport module.
RPC: Registered tcp transport module.
RPC: Registered tcp NFSv4.1 backchannel transport module.
FS-Cache: Netfs 'nfs' registered for caching
JFFS2 version 2.2. (NAND) © 2001-2006 Red Hat, Inc.
JFS: nTxBlock = 4010, nTxLock = 32080
msgmni has been set to 1002
io scheduler noop registered
io scheduler deadline registered
io scheduler cfq registered (default)
Serial: 8250/16550 driver, 2 ports, IRQ sharing disabled
serial8250.0: ttyS0 at MMIO 0xf1012000 (irq = 33) is a 16550A
console [ttyS0] enabled
brd: module loaded
loop: module loaded
ONFI flash detected
NAND device: Manufacturer ID: 0xad, Chip ID: 0xdc (Hynix NAND 512MiB 3,3V 8-bit)
Scanning device for bad blocks
Bad eraseblock 1212 at 0x000009780000
Bad eraseblock 1214 at 0x0000097c0000
Bad eraseblock 1215 at 0x0000097e0000
Bad eraseblock 1216 at 0x000009800000
Bad eraseblock 1217 at 0x000009820000
Bad eraseblock 1218 at 0x000009840000
Bad eraseblock 1219 at 0x000009860000
Bad eraseblock 2176 at 0x000011000000
Creating 3 MTD partitions on "orion_nand":
0x000000000000-0x000000100000 : "u-boot"
0x000000100000-0x000000500000 : "uImage"
0x000000500000-0x000020000000 : "root"
MV-643xx 10/100/1000 ethernet driver version 1.4
mv643xx_eth smi: probed
net eth0: port 0 with MAC address f0:ad:4e:00:6a:31
ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
orion-ehci orion-ehci.0: Marvell Orion EHCI
orion-ehci orion-ehci.0: new USB bus registered, assigned bus number 1
orion-ehci orion-ehci.0: irq 19, io mem 0xf1050000
orion-ehci orion-ehci.0: USB 2.0 started, EHCI 1.00
hub 1-0:1.0: USB hub found
hub 1-0:1.0: 1 port detected
Initializing USB Mass Storage driver...
usbcore: registered new interface driver usb-storage
USB Mass Storage support registered.
usbcore: registered new interface driver ums-datafab
usbcore: registered new interface driver ums-freecom
usbcore: registered new interface driver ums-jumpshot
usbcore: registered new interface driver ums-sddr09
usbcore: registered new interface driver ums-sddr55
mousedev: PS/2 mouse device common for all mice
rtc-mv rtc-mv: rtc core: registered rtc-mv as rtc0
i2c /dev entries driver
cpuidle: using governor ladder
cpuidle: using governor menu
mv_xor_shared mv_xor_shared.0: Marvell shared XOR driver
mv_xor_shared mv_xor_shared.1: Marvell shared XOR driver
mv_xor mv_xor.0: Marvell XOR: ( xor cpy )
mv_xor mv_xor.1: Marvell XOR: ( xor fill cpy )
mv_xor mv_xor.2: Marvell XOR: ( xor cpy )
mv_xor mv_xor.3: Marvell XOR: ( xor fill cpy )
sdhci: Secure Digital Host Controller Interface driver
sdhci: Copyright(c) Pierre Ossman
mmc0: mvsdio driver initialized, using GPIO 47 for card detection
usbcore: registered new interface driver usbhid
usbhid: USB HID core driver
oprofile: hardware counters not available
oprofile: using timer interrupt.
TCP cubic registered
NET: Registered protocol family 17
lib80211: common routines for IEEE802.11 drivers
Registering the dns_resolver key type
registered taskstats version 1
rtc-mv rtc-mv: setting system clock to 2013-07-27 10:30:48 UTC (1374921048)
Waiting 5sec before mounting root device...
mmc0: new high speed SDHC card at address 0001
mmcblk0: mmc0:0001 00000 7.41 GiB
 mmcblk0: p1 p2
EXT3-fs: barriers not enabled
kjournald starting.  Commit interval 5 seconds
EXT3-fs (mmcblk0p2): using internal journal
EXT3-fs (mmcblk0p2): recovery complete
EXT3-fs (mmcblk0p2): mounted filesystem with writeback data mode
VFS: Mounted root (ext3 filesystem) on device 179:2.
Freeing init memory: 156K
INIT: version 2.88 booting
Using makefile-style concurrent boot in runlevel S.
Starting the hotplug events dispatcher: udevdudevd[621]: can not read '/etc/udev/rules.d/75-persistent-net-generator.rules'

.
Synthesizing the initial hotplug events...udevd[622]: can not read '/etc/udev/rules.d/75-persistent-net-generator.rules'

done.
Waiting for /dev to be fully populated...sata_mv sata_mv.0: version 1.28
sata_mv sata_mv.0: slots 32 ports 2
scsi0 : sata_mv
scsi1 : sata_mv
ata1: SATA max UDMA/133 irq 21
ata2: SATA max UDMA/133 irq 21
ata1: SATA link down (SStatus 0 SControl F300)
ata2: SATA link down (SStatus 0 SControl F300)
done.
Setting parameters of disc: (none).
Checking root file system...fsck from util-linux-ng 2.17.2

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 0
Buffer I/O error on device mtdblock0, logical block 0

[ edit: previous 4 lines repeated 10 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 0

[ edit: previous 3 lines repeated 68 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 8

[ edit: previous 3 lines repeated 2 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 16

[ edit: previous 3 lines repeated 2 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 64

[ edit: previous 3 lines repeated 17 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 128

[ edit: previous 3 lines repeated 2 times ]

shvplug-rootfs: clean, 45539/242880 files, 284820/970744 blocks
done.
EXT3-fs (mmcblk0p2): using internal journal
device-mapper: ioctl: 4.19.1-ioctl (2011-01-07) initialised: [email protected]
Starting early crypto disks...done.
Starting remaining crypto disks...done.
Cleaning up ifupdown....
Setting up networking....
Loading kernel modules...done.
Activating lvm and md swap...done.
Checking file systems...fsck from util-linux-ng 2.17.2

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 0

[ edit: previous 3 lines repeated 222 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 8

[ edit: previous 3 lines repeated 6 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 16

[ edit: previous 3 lines repeated 6 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 64

[ edit: previous 3 lines repeated 53 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 128

[ edit: previous 3 lines repeated 6 times ]

fsck.ext3: Unable to resolve 'UUID=815340d0-d56a-4c4b-93a0-012e9fb75eee'
[ edit: this is okay, I unplugged the SATA device]

fsck.ext3: Unable to resolve 'UUID=dc7bd095-1422-4d57-ba0d-91ac52e97d63'
fsck died with exit status 8
failed (code 8).

File system check failed. A log is being saved in /var/log/fsck/checkfs if that location is writable. Please repair the file system manually. ... failed!
A maintenance shell will now be started. CONTROL-D will terminate this shell and resume system boot. ... (warning).
Give root password for maintenance
(or type Control-D to continue):

--------------------------------------------------------------------------------------------------------------------------
after pressing ^D
--------------------------------------------------------------------------------------------------------------------------

Mounting local filesystems...
quiet_error: 406 callbacks suppressed

Buffer I/O error on device mtdblock0, logical block 0

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 0

[ edit: previous 3 lines repeated 80 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 8

[ edit: previous 4 lines repeated 2 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 16

[ edit: previous 4 lines repeated 2 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 64

[ edit: previous 3 lines repeated 18 times ]

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 128

[ edit: previous 3 lines repeated 2 times ]


[ edit: following failures regarding UUID=xxxxx5eee, /var are expected, since I unplugged SATA ]

mount: mount point /sys/fs/fuse/connections does not exist
mount: special device UUID=815340d0-d56a-4c4b-93a0-012e9fb75eee does not exist
mount: special device UUID=dc7bd095-1422-4d57-ba0d-91ac52e97d63 does not exist
failed.
Activating swapfile swap...done.
Cleaning up temporary files....
Configuring network interfaces...Internet Systems Consortium DHCP Client 4.1.1-P1
Copyright 2004-2010 Internet Systems Consortium.
All rights reserved.
For info, please visit https://www.isc.org/software/dhcp/
...

ANY further ideas?
Is your debian-from-SDCard boot up sequence of the black sheeva plug different?
Do you NOT have this Control-D blocker?
Is my Plug broken?

???
Logged

Confusticated

  • New IT customer
  • Hero Member
  • *
  • Posts: 663
Re: kernel error on dev mtdblock0
« Reply #4 on: 02 August 2013, 07:25:18 pm »

Quote
SDHC found. Card desciption is:
Manufacturer:       0x1b, OEM "SM"
Product name:       "00000", revision 1.0
Serial number:      1951175429
Manufacturing date: 4/2010
CRC:                0x00, b0 = 0
The SDHC is three years old....

Quote
kjournald starting.  Commit interval 5 seconds
EXT3-fs (mmcblk0p2): using internal journal
EXT3-fs (mmcblk0p2): recovery complete
You have journaling enabled (a bad idea on flash, it wears it out faster) and the file system has erred (according to the journal).

Quote
Checking root file system...fsck from util-linux-ng 2.17.2

uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 0
Buffer I/O error on device mtdblock0, logical block 0
uncorrectable error, my first course of action would be to replace the SDHC.

Logged
Advocatus Diaboli - My agenda is not to give you the answer, but to guide your thoughts so you derive it for yourself!

SLUGex

  • Newbie
  • *
  • Posts: 7
Re: kernel error on dev mtdblock0
« Reply #5 on: 21 February 2015, 12:15:33 pm »

The SDHC is three years old....
right, but now it is 5 years old and still okay. I have nearly no writes to it.
My problem is still present, and nothing helped - even a temporarily replace of the debian SD Card with another official NewIT-Debian-SDCard from my 2nd Plug didn't change anything.

Quote
kjournald starting.  Commit interval 5 seconds
EXT3-fs (mmcblk0p2): using internal journal
EXT3-fs (mmcblk0p2): recovery complete
You have journaling enabled (a bad idea on flash, it wears it out faster) and the file system has erred (according to the journal).
Yes, might be a bad idea. It was shipped by NewIT with this settings and I could only guess how to configure it to not using journaling (tune2fs?)

Quote
Checking root file system...fsck from util-linux-ng 2.17.2
uncorrectable error :
uncorrectable error :
end_request: I/O error, dev mtdblock0, sector 0
Buffer I/O error on device mtdblock0, logical block 0
uncorrectable error, my first course of action would be to replace the SDHC.

I am in Doubt about that. As far as I learned in the past 3 years about the plug, 'mtdblock0' is the internel NAND flash (ubuntu installed as a fallback), while 'mmcblk0' is the SDC.
'mmcblk0' has no errors, so changing the SDCard did not changed the problem.

Have you any better hints for me, in between?

Even if my original post is quite old, it is quite active, since I have this problem and moving to a better supported platform (raspberry) would not help, because this lacks the SATA. I also get a cubie last year, but this has different problems, so the cubie is laying around, collecting dust and dirt, and my essential data is still attached to the Sheevas.
Logged
Pages: [1]
 
 

Powered by MySQL Powered by PHP SMF 2.0.10 | SMF © 2015, Simple Machines Valid XHTML 1.0! Valid CSS!