Computing.Net > Forums > Windows Server 2003 > Missing a lot of drive space

Computer Problems? Computing.Net has over 1,000,000 posts about all things technology related! Over 90% answered within 24 hours! Click here to start participating now! Also, be sure to check out the New User Guide.

Missing a lot of drive space

Reply to Message Icon

Name: calorie712
Date: December 15, 2008 at 12:01:46 Pacific
OS: Standard SP1
CPU/Ram: Xeon 3.4 / 2 GB
Product: Hewlett-packard / DL 380 G5
Comment:

Main Problem:
Cannot account for 160GB of space on C:\ drive.
There are 1,276,524 files we cannot locate using windows explorer.

TROUBLESHOOTING STEPS SO FAR::
1. WinDirStat  Disk Space Used 500GB / Files Accounted For 342 GB (158 GB Missing)
2. Right-Click Properties on C:\ came up with the same results as WinDirStat.
3. Checked Event Logs (Disk busy errors from HP Management software)
4. Checked HP Management Tools  No Hardware Systems Degraded
5. Contacted HP  They verified there were no hardware problems with the server via HP logs
a.HP has suggested upgrading the firmware and support tools to resolve the event log problems.
6. Internet research did not turn up much usable information regarding this problem, except...
a.The only thing I found was that the hard disk cluster size could have been configured incorrectly and it could be wasting disk space on a per file basis. (over 1,000,000 files and that could add up to a lot of wasted disk space)
b. Viruses - this server is not on the internet and we have scanned it thouroughly
c. System restore - there is none
d. Disk quota - disabled
7. I am showing OS files and Hidden files
8. I have logged in as local admin, and domain administrator and get the same results

HDD Defrag Analysis  Total Files 2,583,394 (501 GB used)
Right-Click -> Properties the contents of C:\  Total Files 1,306,789 (343 GB used)

System Specs:

HP Proliant DL380 G4
4 - 300 GB SCSI drives (Raid 5 with one online spare 599GB usable drive space)
Windows Server 2003 Standard SP1
Only has C:\ partition



Sponsored Link
Ads by Google

Response Number 1
Name: wanderer
Date: December 15, 2008 at 12:10:05 Pacific
Reply:

do a chkdsk and post the results

When was the last time you run disk cleanup and defragged?

Example of Oxymoron:
Person who is pro life and anti sex education.
Education is key to prevention. Prevent conception you prevent abortion. Abstinence training clearly isn't working.


0

Response Number 2
Name: calorie712
Date: December 15, 2008 at 12:53:07 Pacific
Reply:

I must wait for scheduled downtime to do chkdsk. I ran disk cleanup last week. The only thing it came back with is that it could compress old files and free up 100 GB. I don't want to do that right now. I want to know where the 160GB is. Defrag about a month ago, it definitely needs it.


0

Response Number 3
Name: wanderer
Date: December 15, 2008 at 13:09:41 Pacific
Reply:

I wasn't asking you to do a chkdsk /f or /r which would require a reboot. Just do a chkdsk [which is informational and does not require a reboot] with no switches and copy the results to a post here.

Example of Oxymoron:
Person who is pro life and anti sex education.
Education is key to prevention. Prevent conception you prevent abortion. Abstinence training clearly isn't working.


0

Response Number 4
Name: calorie712
Date: December 16, 2008 at 05:49:19 Pacific
Reply:

index $SDH of file 9.
Deleting an index entry with Id 5527 from index $SDH of file 9.
Deleting an index entry with Id 5431 from index $SDH of file 9.
Fixing mirror copy of the security descriptors data stream.
Security descriptor verification completed.
Windows found problems with the file system.
Run CHKDSK with the /F (fix) option to correct these.

585914631 KB total disk space.
523672074 KB in 2591241 files.
978512 KB in 63142 indexes.
0 KB in bad sectors.
2935352 KB in use by the system.
23056 KB occupied by the log file.
58328692 KB available on disk.

512 bytes in each allocation unit.
1171829262 total allocation units on disk.
116657384 allocation units available on disk.

I had to leave it go over night so I don't know what happened before this, I know there were alot of "Deleting an index..."


0

Response Number 5
Name: mrwhite89
Date: December 16, 2008 at 06:37:42 Pacific
Reply:

Did you check hidden files and folders. They tend to take up a lot of room.


0

Related Posts

See More



Response Number 6
Name: calorie712
Date: December 16, 2008 at 06:55:36 Pacific
Reply:

If you post here, make sure you read my original post. We will save time and space. Thanks.

"7. I am showing OS files and Hidden files"


0

Response Number 7
Name: wanderer
Date: December 16, 2008 at 10:37:17 Pacific
Reply:

OK. Clearly you have some disk corruption and will need to run chkdsk /r [I do /r so it also checks the media]

"512 bytes in each allocation unit."

Should be 4096 bytes per allocation unit.

This is really BAD. How did you set this drive up? Who recommended making the allocation size the same for sector size on a disk that large???

For a disk that large you should have gone 16-32k per allocation unit though you lose some benefits like compression [which I never use].

What is your average file size?

http://www.ntfs.com/ntfs_optimizati...

It does not appear you are missing 160gig. Appears from chkdsk you are missing no space at all. With allocation units this small you have to have a massive Master File Table to track them all. Then you have issues like if the drive is caching disk writes to speed up access which in turn can corrupt the master file table.

For example any drive that contains a database is always to have write caching disabled because of this corruption issue.

Example of Oxymoron:
Person who is pro life and anti sex education.
Education is key to prevention. Prevent conception you prevent abortion. Abstinence training clearly isn't working.


0

Response Number 8
Name: calorie712
Date: December 16, 2008 at 11:39:47 Pacific
Reply:

This server was setup in 4/2006 I started in 1/2007, I have no clue who set it up.

Check out these images to see what I am talking about when I say I am missing drive space...

http://filedb.experts-exchange.com/...

http://filedb.experts-exchange.com/...

Here is a defrag report that may help:

Volume (C:) Volume size = 559 GB
Cluster size = 512 bytes
Used space = 503 GB
Free space = 55.39 GB
Percent free space = 9 %

Volume Fragmentation
Total fragmentation = 15 %
File fragmentation = 30 %
Free space fragmentation = 0 %

File fragmentation
Total files = 2,592,908
Average file size = 210 KB
Total fragmented files = 656,567
Total excess fragments = 2,392,923
Average fragments per file = 1.92

Pagefile fragmentation
Pagefile size = 4.00 GB
Total fragments = 1

Folder fragmentation
Total folders = 63,145
Fragmented folders = 2,730
Excess folder fragments = 104,219

Master File Table (MFT) fragmentation
Total MFT size = 2.63 GB
MFT record count = 2,661,950 Percent
MFT in use = 96 %
Total MFT fragments = 5


0

Response Number 9
Name: wanderer
Date: December 16, 2008 at 13:26:28 Pacific
Reply:

"Master File Table (MFT) fragmentation
Total MFT size = 2.63 GB
MFT record count = 2,661,950 Percent
MFT in use = 96 %
Total MFT fragments = 5"

Oh my goodness! Accessing this drive setup must be really slow!

My Computer and chkdsk say the same thing. Even though in the first picture you have everything selected the properties are only of documents and settings. You are not missing disk space. I wish for your sake that was all you had to deal with.

I would highly recommend backing everything up, wipe the disk with a new install, and restore from backup. Also consider partitioning for a number of good reasons.

You can't win with this setup. You will continue with severe fragmentation and your master file table will be corrupted.

The person who set this up didn't know about how hard drives/file systems work. This person thought "oh no disk waste if I user 512k allocation units."

The correct way of thinking about this is to balance between being too small [512k] or being too large. Too small means a HUGE MFT, which in your case is 2.6gig and fragmented into 5 pieces [bad] vs too large when you waste disk space.

MS loves 4k allocation units and for the OS drive that is recommended.

An example of disk space wastage [called slack] is where you have a 32k cluster [allocation unit in Microsoft speak] but your average file size is 8K. You waste 24k of cluster space for each 8k file stored.

You need to understand how bad this is. Your MFT is 96% used. Soon you won't be able to store files even if you have disk space!!!!

The other problem with small allocation units is fragmentation of files. If you have 100 32K units vs 800 4K units, which do you think will get fragmented more? The 800 pieces will. In your case you have 3200 pieces at 512kb

Wish I had good news for you.

Example of Oxymoron:
Person who is pro life and anti sex education.
Education is key to prevention. Prevent conception you prevent abortion. Abstinence training clearly isn't working.


0

Response Number 10
Name: calorie712
Date: December 16, 2008 at 13:46:39 Pacific
Reply:

Point taken about the server, I will bring this up to my manager.

As for the drive space. "you have everything selected the properties are only of documents and settings". Ok then, what is taking up the other 160GB?

Thanks for your help!


0

Response Number 11
Name: calorie712
Date: December 16, 2008 at 14:55:30 Pacific
Reply:

How would someone setup the cluster size wrong? When your installing Win2K3 you don't have an option to choose cluster size. All you can choose is format or not. Correct? Keep in mind there is only one partition.


0

Response Number 12
Name: wanderer
Date: December 16, 2008 at 16:25:59 Pacific
Reply:

You can use server based software to change cluster size. If you review the link I gave you, you will see the larger the drive the larger the cluster size. Never smaller.

'tis the season to be of good cheer. Wishing one and all happy times with family and friends.


0

Response Number 13
Name: calorie712
Date: December 16, 2008 at 17:56:21 Pacific
Reply:

I checked the size of the full backup we take
with backup exec. We don't select all
folders, but most. The size of the backup is
470GB and over 2,000,000 files.

So Backup exec sees the files and recognizes
the used space. So why can't I find the 160GB
worth of files?

They could have used an HP smart-start CD to
change the default cluster size?


0

Response Number 14
Name: wanderer
Date: December 17, 2008 at 08:38:55 Pacific
Reply:

Again you are not missing 160gig of files.

Your one picture, that you base this on, clearly shows you have 300+gig in documents and settings. You did not select the entire drive. You misread this screen. Yet chkdsk and my computer both show the file usage correctly as does the defrag report [there is always a little fluxuation since the server is being used and all the reports were not done at the exact same time].

Again you are not missing any files or disk space.

according to chkdsk you have 2,591,241 files

If you are only backing up 2,000,000 you will want to ask yourself what isn't being backed up.

'tis the season to be of good cheer. Wishing one and all happy times with family and friends.


0

Response Number 15
Name: calorie712
Date: December 17, 2008 at 11:19:47 Pacific
Reply:

"You did not select the entire drive."

The statement above my friend is where we are having a communication disconnect. If I do a ctrl-a then right-click properties on the contents of the C:\ drive, I do not see 2.5 million files and 500GB worth of used space.

Why?

PS. I am currently restoring the backup to another server with permissions stripped in hopes to find ALL the files.


0

Response Number 16
Name: wanderer
Date: December 18, 2008 at 10:03:03 Pacific
Reply:

585914631 KB total disk space.
523672074 KB in 2,591,241 files.
from your 4th post

Volume (C:) Volume size = 559 GB
Used space = 503 GB
Free space = 55.39 GB
Total files = 2,592,908
from your 8th post

Not sure why you are having such a hard time seeing this. Look at your 8th post and your first link. See where is says Documents and Settings? See where it says 345gig? YOU ARE ONLY SEEING 345GIG IN DOCUMENTS AND SETTINGS.

Now look at post 4 and 8 which list:
2,591,241 files and
2,592,908 files
Two different views but the same information.

Now look at post 8 and your second link
558gig total with 56.1gig free
From post 4
58,328,692 KB available on disk
and post 8
Free space = 55.39 GB

Your free space ranges from 55gig to 58gig which is totally expected if a server experiencing constant writes and deletes.

You are on a wild goose chase because you misinterpreted a single screen as you ignore all the others.

Your server is a fast car on a short pier. You need to be focusing on its rebuild not trying to address a nonexistant problem.

Followup:
"If I do a ctrl-a then right-click properties on the contents of the C:\ drive, I do not see 2.5 million files and 500GB worth of used space.

Why?

Control-a only highlights all folders and files. It does not tally the contents of those folders. Again review the picture in your first link and note the "properties" are ONLY of documents and settings.

'tis the season to be of good cheer. Wishing one and all happy times with family and friends.


0

Response Number 17
Name: rmatrem
Date: March 14, 2009 at 00:09:14 Pacific
Reply:

Wanderer, you are wrong. If you look at the picture it says, Documents and Settings ... Properties. The ... means ALL the folders selected, and yes it does tally ALL the files in the folder. It may not get the number of files correct, but it should get the memory size or pretty darn close. I bet if this guy ran a 3rd party program (like treesize) to count the size of the memory use, he'll be missing 160 gigs too.
I have seen this problem before, and I have no clue what causes it. From my research, it seems nobody knows what causes it.


0

Response Number 18
Name: calorie712
Date: March 14, 2009 at 06:03:58 Pacific
Reply:

This has been resolved. It seems my manager stores a
160GB email archive and broke inheritance and permissions
on it. That is why I see the space gone but any tool couldn't
tell me what it was because I didn't have permissions.

How I found out... I did a restore of the data to a different
location from a backup tape and stripped permissions using
backup exec. Then I used windirstat to find out and compare
my results to the one on the server. Thanks for all your help
people.


0

Sponsored Link
Ads by Google
Reply to Message Icon






Post Locked

This post is quite old and has been locked from receiving new replies. Please create a new posting instead.


Go to Windows Server 2003 Forum Home


Sponsored links

Ads by Google


Results for: Missing a lot of drive space

Roaming profiles to Mandatory ones? www.computing.net/answers/windows-2003/roaming-profiles-to-mandatory-ones/5576.html

A couple of questions.... www.computing.net/answers/windows-2003/a-couple-of-questions/4924.html

Remote Hard Drive Space www.computing.net/answers/windows-2003/remote-hard-drive-space/7840.html