Personal computing discussed

Moderator: Dposcorp

 
Madman
Minister of Gerbil Affairs
Topic Author
Posts: 2317
Joined: Tue Apr 01, 2003 4:55 am
Location: Latvia

Tips on how to find duplicate files, clean system, etc.?

Sun May 15, 2011 7:23 pm

I have a ton of needed files on my PC that are all over the place, and I would like to clean them up somehow. Does anyone know a good tool I can use to find duplicates or something like that?

I wrote one that compares MD5 and filesizes of files, but it's a console application and not very easy to use, and there must be something better available. At the same time googling and downloading random crap I see on the netz is not what I do anymore, so I was hoping someone here can advise a good, verified tool.

So far files are all over the place, and I have to keep them somewhat synchronized between 2 computers, so I have a lot of laptop_date1\desktop\desktop\desktop, laptop_date2\desktop\desktop\desktop stuff there that's a complete nightmare to browse. Any tips?
Core 2 Duo E6300, MSI P45 NEO-F, Club 3D GTX 260, 4Gb DDR2-800Mhz, Audigy X-Fi Fatal1ty Champ1on ed., 0.5Tb+1Tb Seagate Barracuda 7200.12, 630W AXP, Samsung SyncMaster BX2450, ViewSonic VP171b
 
ordskiweicz
Gerbil Team Leader
Posts: 275
Joined: Fri Feb 27, 2009 5:44 pm
Location: lowest level of ...

Re: Tips on how to find duplicate files, clean system, etc.?

Sun May 15, 2011 7:34 pm

Duplicate files finders at http://doubles.sourceforge.net/
 
Dirge
Gerbil Jedi
Posts: 1620
Joined: Thu Feb 19, 2004 3:08 am

Re: Tips on how to find duplicate files, clean system, etc.?

Sun May 15, 2011 11:51 pm

It probably goes without saying but be careful not to trash any system files. Some of these programs can be set to auto pilot.

I have tried CloneSpyon Windows which seemed to work ok.
FDISK /MBR
 
trackerben
Minister of Gerbil Affairs
Posts: 2037
Joined: Mon Jun 15, 2009 12:28 am
Location: 'Tween oceans...

Re: Tips on how to find duplicate files, clean system, etc.?

Mon May 16, 2011 2:06 am

Madman wrote:
I have a ton of needed files on my PC that are all over the place, and I would like to clean them up somehow. Does anyone know a good tool I can use to find duplicates or something like that?


Try Total Commander 7.x from ghisler, which I've been using everyday for the past decade. Its file indexing is not the fastest but it's a stable and fast-enough 2-pane file explorer/manager, it can find duplicates as well as single files, search filters galore, synchronize by content as well as date, network and ftp, batch rename using masks and file attributes, other stuff too numerous to mention.
 
Dirge
Gerbil Jedi
Posts: 1620
Joined: Thu Feb 19, 2004 3:08 am

Re: Tips on how to find duplicate files, clean system, etc.?

Mon May 16, 2011 7:32 am

@trackerben Cool I didn't realise Total Commander was so versatile. Would be great if it was cross platform too.
FDISK /MBR
 
Usacomp2k3
Gerbil God
Posts: 21686
Joined: Thu Apr 01, 2004 4:53 pm
Location: Orlando, FL
Contact:

Re: Tips on how to find duplicate files, clean system, etc.?

Mon May 16, 2011 8:26 am

Burn the data to a DVD and then delete it. Copy the data back to the PC if you need it.
 
Meadows
Grand Gerbil Poohbah
Posts: 3373
Joined: Mon Oct 08, 2007 1:10 pm
Location: Location: Location

Re: Tips on how to find duplicate files, clean system, etc.?

Mon May 16, 2011 8:49 am

Usacomp2k3 wrote:
Burn the data to a DVD and then delete it. Copy the data back to the PC if you need it.

That's one way to approach it, but you need a lot of DVDs nowadays, considering capacity constraints. You could, of course, store backups on BD-R/RW, but that method - and the appropriate burner drives - are still much more expensive than DVD counterparts, and a questionable value unless you have income to burn.

Over longer spans of time though, it might not actually pay off - and it will take a load of shelf space as an added perk. Consider a 1+ TB portable backup drive and weigh the costs and convenience.
 
bthylafh
Grand Gerbil Poohbah
Posts: 3907
Joined: Mon Dec 29, 2003 11:55 pm
Location: Southwest Missouri, USA

Re: Tips on how to find duplicate files, clean system, etc.?

Mon May 16, 2011 9:01 am

Once you've gotten the dupes removed, sounds like it's time to get religion about organizing your files.
Hakkaa päälle!
i7-8700K|Asus Z-370 Pro|32GB DDR4|Asus Radeon RX-580|Samsung 960 EVO 1TB|1988 Model M||Logitech MX 518 & F310|Samsung C24FG70|Dell 2209WA|ATH-M50x|Asus Xonar DX
 
Usacomp2k3
Gerbil God
Posts: 21686
Joined: Thu Apr 01, 2004 4:53 pm
Location: Orlando, FL
Contact:

Re: Tips on how to find duplicate files, clean system, etc.?

Mon May 16, 2011 9:03 am

Meadows wrote:
Usacomp2k3 wrote:
Burn the data to a DVD and then delete it. Copy the data back to the PC if you need it.

That's one way to approach it, but you need a lot of DVDs nowadays, considering capacity constraints.

How much real data is one likely to have though? Once you take out ripped media and system files, I'd say most computer backups can fit onto a couple 4.7GB DVD without too much trouble. Especially if you are using compression.
 
bthylafh
Grand Gerbil Poohbah
Posts: 3907
Joined: Mon Dec 29, 2003 11:55 pm
Location: Southwest Missouri, USA

Re: Tips on how to find duplicate files, clean system, etc.?

Mon May 16, 2011 9:09 am

You're making a ton of unwarranted assumptions about what he's got.

I wouldn't use compression on any backups I'd like a fighting chance at recovering if the disc goes a bit bad, either.
Hakkaa päälle!
i7-8700K|Asus Z-370 Pro|32GB DDR4|Asus Radeon RX-580|Samsung 960 EVO 1TB|1988 Model M||Logitech MX 518 & F310|Samsung C24FG70|Dell 2209WA|ATH-M50x|Asus Xonar DX
 
bdwilcox
Graphmaster Gerbil
Posts: 1261
Joined: Mon Apr 21, 2003 12:21 pm

Re: Tips on how to find duplicate files, clean system, etc.?

Mon May 16, 2011 9:45 am

The free utility, EasyCleaner, can find duplicate files.
 
Madman
Minister of Gerbil Affairs
Topic Author
Posts: 2317
Joined: Tue Apr 01, 2003 4:55 am
Location: Latvia

Re: Tips on how to find duplicate files, clean system, etc.?

Mon May 16, 2011 2:10 pm

Usacomp2k3 wrote:
Burn the data to a DVD and then delete it. Copy the data back to the PC if you need it.

That makes even more mess :lol: Then you have copies of data on PC, copies on Laptop, and copies on DVD (I use an extra HDD instead of DVD, I upgraded the system disk, so I got one spare disk for backups now, cheaper per GB and faster).

So all that times Laptop\desktop\desktop\old_desktop\desktop\*.*, and there is a problem :lol:

bthylafh wrote:
Once you've gotten the dupes removed, sounds like it's time to get religion about organizing your files.

Any tips on that? I tried to invent my own system, but it always ends up in even more mess :roll:

Usacomp2k3 wrote:
How much real data is one likely to have though? Once you take out ripped media and system files, I'd say most computer backups can fit onto a couple 4.7GB DVD without too much trouble. Especially if you are using compression.

With RAW photos it's about 200Gigs I guess, but these I backup in one folder, so they are somewhat ordered. The worse part is school papers, presentations with prerendered videos from my programming projects, compiled executables, database backups for test projects, pdb files (~100MB per project). They are not large, but all over the place, with different revisions. All in all it adds up.

I wonder if you can use some sort of SVN with dupe detection for documents, presentations, videos etc.? :roll:

I will study the tools linked here, thanks a lot!
Core 2 Duo E6300, MSI P45 NEO-F, Club 3D GTX 260, 4Gb DDR2-800Mhz, Audigy X-Fi Fatal1ty Champ1on ed., 0.5Tb+1Tb Seagate Barracuda 7200.12, 630W AXP, Samsung SyncMaster BX2450, ViewSonic VP171b
 
bthylafh
Grand Gerbil Poohbah
Posts: 3907
Joined: Mon Dec 29, 2003 11:55 pm
Location: Southwest Missouri, USA

Re: Tips on how to find duplicate files, clean system, etc.?

Mon May 16, 2011 5:56 pm

I organize stuff hierarchically in folders.

Say you have a few top-level folders: one for documents, one for pictures, another for music, another for videos (i.e. what Win7 does). Put the stuff into the correct folder, then create folders for subject matter, say a folder named "Summer Vacation" under the Pictures folder. If you take a vacation yearly, then create 2009, 2010, and 2011 folders inside that. Maybe you went to three places in 2010, so if you want to get fancy create a folder for each destination in the 2010 folder. Then stick the pictures where they go. I'd go a step further and make the filenames reflect what's being shown.

For music, I organize by artist, then by album. Sometimes I do it by genre, then artist, then album.

My brain works well with this scheme, but your mileage may vary. Other people may like having a program organize things for them, like Picasa does for pictures. The strength of my system, IMO, is that it doesn't care what program you use to look at stuff.
Hakkaa päälle!
i7-8700K|Asus Z-370 Pro|32GB DDR4|Asus Radeon RX-580|Samsung 960 EVO 1TB|1988 Model M||Logitech MX 518 & F310|Samsung C24FG70|Dell 2209WA|ATH-M50x|Asus Xonar DX
 
Aether
Silver subscriber
Gerbil
Posts: 97
Joined: Sat Dec 20, 2014 8:50 pm

Re: Tips on how to find duplicate files, clean system, etc.?

Sat Jun 10, 2017 11:08 am

The last time I needed to do cleanup and eliminate duplicates and older versions of files, I used Microsoft's free SyncToy:

https://www.microsoft.com/en-us/downloa ... x?id=15155
 
just brew it!
Gold subscriber
Administrator
Posts: 49711
Joined: Tue Aug 20, 2002 10:51 pm
Location: Somewhere, having a beer

Re: Tips on how to find duplicate files, clean system, etc.?

Sat Jun 10, 2017 11:53 am

Aether wrote:
The last time I needed to do cleanup and eliminate duplicates and older versions of files, I used Microsoft's free SyncToy:

https://www.microsoft.com/en-us/downloa ... x?id=15155

The post you replied to was a necro of a really old thread by a spammer. You must've posted as I was deleting/banning...
Nostalgia isn't what it used to be.
 
Aether
Silver subscriber
Gerbil
Posts: 97
Joined: Sat Dec 20, 2014 8:50 pm

Re: Tips on how to find duplicate files, clean system, etc.?

Sat Jun 10, 2017 12:20 pm

Doh! All I saw was the month May; I missed that it was May 2011!
 
agnes8
Gerbil
Posts: 15
Joined: Fri Jun 23, 2017 7:13 am

Re: Tips on how to find duplicate files, clean system, etc.?

Mon Jul 10, 2017 6:43 am

May I try to renew this thread? :roll: Are there any feedback on gzip?
 
just brew it!
Gold subscriber
Administrator
Posts: 49711
Joined: Tue Aug 20, 2002 10:51 pm
Location: Somewhere, having a beer

Re: Tips on how to find duplicate files, clean system, etc.?

Mon Jul 10, 2017 7:26 am

agnes8 wrote:
May I try to renew this thread? :roll: Are there any feedback on gzip?

Gzip is a file compression tool, not a tool for finding duplicate files or cleaning the system. Completely different thing.
Nostalgia isn't what it used to be.

Who is online

Users browsing this forum: No registered users and 2 guests