IPB

Welcome Guest ( Log In | Register )

Testing audio files for corruption, just recovered from hard drive failure
bjackson128
post Jun 6 2006, 03:48
Post #1





Group: Members
Posts: 22
Joined: 15-April 06
From: Knoxville, TN
Member No.: 29582



Today I was finally able to recover all my music files from a hard drive that, to put it simply, had become unreadable. I used GetDataBack for NTFS, and as far as I can tell, 100% of my data has been restored. However, I am still paranoid about some of my files becoming corrupted or damaged somewhere during the process and am hoping that someone can put me at rest. I'm looking for a quick way to tell if any of my files were damaged or corrupted during the recovery process so that I can replace them now before I potentially discover problems later on. I guess I could just play them all, but that would take far too much time... any suggestions, or am I just being paranoid?
Go to the top of the page
+Quote Post
 
Start new topic
Replies (1 - 18)
Jebus
post Jun 6 2006, 04:04
Post #2





Group: Developer
Posts: 1295
Joined: 17-March 03
From: Calgary, AB
Member No.: 5541



what kind of audio files?

Some of them contain CRC checksums you could verify with, but we need to know which formats, first.
Go to the top of the page
+Quote Post
bjackson128
post Jun 6 2006, 13:22
Post #3





Group: Members
Posts: 22
Joined: 15-April 06
From: Knoxville, TN
Member No.: 29582



Sorry, I should've clarified... It's my entire collection of music, so it contains Lame MP3s, Nero AAC LC, WavPack and FLAC... the only ones I'm really concerned about are the lossless files, as those will take much more effort to replace.
Go to the top of the page
+Quote Post
pest
post Jun 6 2006, 13:36
Post #4





Group: Members
Posts: 208
Joined: 12-March 04
From: Germany
Member No.: 12686



my harddisk crashed last week and that was one of the darkest days ever sad.gif
the only good thing is, that i can verify my lossless files. but more than 75% of
my collection are mp3s and these are randomly corrupted...
the lossless codecs you use all have a verify command...use that
Go to the top of the page
+Quote Post
bjackson128
post Jun 6 2006, 13:50
Post #5





Group: Members
Posts: 22
Joined: 15-April 06
From: Knoxville, TN
Member No.: 29582



QUOTE (pest @ Jun 6 2006, 08:36) *
my harddisk crashed last week and that was one of the darkest days ever sad.gif
the only good thing is, that i can verify my lossless files. but more than 75% of
my collection are mp3s and these are randomly corrupted...
the lossless codecs you use all have a verify command...use that


Yeah it's a huge pain isn't it.... I couldn't be too mad about mine because I sort of caused mine to fail. I'll try to verify my lossless files when I get home today, thanks. I guess you just have to play the MP3s before you know if they are corrupted?
Go to the top of the page
+Quote Post
Synthetic Soul
post Jun 6 2006, 14:42
Post #6





Group: Super Moderator
Posts: 4887
Joined: 12-August 04
From: Exeter, UK
Member No.: 16217



I have batch files to verify both WavPack and FLAC files (well, I just created the FLAC one for you smile.gif ).

http://synthetic-soul.co.uk/files/wv-verify.bat
http://synthetic-soul.co.uk/files/flac-verify.bat

Save the files to your desktop and drop the folder that contains all your files onto the icon. It will verify the files using the native verification switches (WVUNPACK -vm file.wv and FLAC -t file.wv) and report any files that fail at the end.

Oh yeah, you may also need to amend the path to the executables near the top of each file, unless they are in the same folder as the batch files or in your PATH. If flac.exe/wvunpack.exe is in the same folder as the batch file (or visa-versa) you can use (for ease, or portability):

CODE
SET pathToFlac="%~dp0flac.exe"

CODE
SET pathToWvUnpack="%~dp0wvunpack.exe"

The benefit of the batch files is that they store the paths of the files that fail and then report them at the end. If you just ran a command at the command line you would lose the output after a few files.

FYI, here's the output from the quick test I ran:

CODE
Checking: "C:\Documents and Settings\npopham\Desktop\flac-verify"

Verifying: "C:\Documents and Settings\npopham\Desktop\flac-verify\test.flac"
________________________________________________________________________

flac 1.1.2, Copyright 2000,2001,2002,2003,2004,2005 Josh Coalson
flac comes with ABSOLUTELY NO WARRANTY. This is free software, and you are
welcome to redistribute it under certain conditions. Type `flac' for details.

test.flac: ok


Verifying: "C:\Documents and Settings\npopham\Desktop\flac-verify\test2.flac"
________________________________________________________________________

flac 1.1.2, Copyright 2000,2001,2002,2003,2004,2005 Josh Coalson
flac comes with ABSOLUTELY NO WARRANTY. This is free software, and you are
welcome to redistribute it under certain conditions. Type `flac' for details.

test2.flac: ok


Verifying: "C:\Documents and Settings\npopham\Desktop\flac-verify\test3.flac"
________________________________________________________________________

flac 1.1.2, Copyright 2000,2001,2002,2003,2004,2005 Josh Coalson
flac comes with ABSOLUTELY NO WARRANTY. This is free software, and you are
welcome to redistribute it under certain conditions. Type `flac' for details.

test3.flac: *** Got error code 0:FLAC__STREAM_DECODER_ERROR_STATUS_LOST_SYNC
test3.flac: *** Got error code 2:FLAC__STREAM_DECODER_ERROR_STATUS_FRAME_CRC_MIS
MATCH


test3.flac: ERROR while decoding data
state = FLAC__STREAM_DECODER_SEARCH_FOR_FRAME_SYNC
File failed verification [ERR#1]...


Verifying: "C:\Documents and Settings\npopham\Desktop\flac-verify\test4.flac"
________________________________________________________________________

flac 1.1.2, Copyright 2000,2001,2002,2003,2004,2005 Josh Coalson
flac comes with ABSOLUTELY NO WARRANTY. This is free software, and you are
welcome to redistribute it under certain conditions. Type `flac' for details.

test4.flac: ok


4 file(s) verified.
1 file(s) returned an error.

Files that failed verification:

"C:\Documents and Settings\npopham\Desktop\flac-verify\test3.flac"


Press any key to exit


This post has been edited by Synthetic Soul: May 24 2008, 12:02


--------------------
I'm on a horse.
Go to the top of the page
+Quote Post
pest
post Jun 6 2006, 15:34
Post #7





Group: Members
Posts: 208
Joined: 12-March 04
From: Germany
Member No.: 12686



QUOTE (bjackson128 @ Jun 6 2006, 04:50) *
I guess you just have to play the MP3s before you know if they are corrupted?


that's the only way i think. the mp3-crc16 don't tell you much about
possible corruption...unless you are sure they all had a correct one before
your harddisk crashed...
Go to the top of the page
+Quote Post
Synthetic Soul
post Jun 6 2006, 15:38
Post #8





Group: Super Moderator
Posts: 4887
Joined: 12-August 04
From: Exeter, UK
Member No.: 16217



QUOTE (bjackson128 @ Jun 6 2006, 13:50) *
I guess you just have to play the MP3s before you know if they are corrupted?
You could try mp3val, or mp3check.


--------------------
I'm on a horse.
Go to the top of the page
+Quote Post
bjackson128
post Jun 6 2006, 16:44
Post #9





Group: Members
Posts: 22
Joined: 15-April 06
From: Knoxville, TN
Member No.: 29582



Wow! Synthetic Soul, those batch files are infinitely useful... only 1 corrupt WavPack so far after checking about 75% of my albums. After reading that thread about mp3val, I think I'm going to try that once I re-rip my corrupted album(s). Thanks to everyone for the help.

edit: word choice

This post has been edited by bjackson128: Jun 6 2006, 16:46
Go to the top of the page
+Quote Post
Michael Sargent
post Apr 20 2013, 16:29
Post #10





Group: Members
Posts: 15
Joined: 28-May 10
Member No.: 80956



QUOTE (Synthetic Soul @ Jun 6 2006, 09:42) *
I have batch files to verify both WavPack and FLAC files (well, I just created the FLAC one for you smile.gif ).

http://synthetic-soul.co.uk/files/wv-verify.bat
http://synthetic-soul.co.uk/files/flac-verify.bat


...


Thanks for the batch file! This will be really helpful. I made two changes that you might be interested in:

1) I added the -s flag to flac.exe to reduce the amount of output.

2) The test for folder/file was failing on my system in some cases. The length of the folder was coming up as 4096, not 0. So I changed the test from:

CODE
IF %~z1 EQU 0 (CALL :FolderAction %1) ELSE (CALL :FileAction %1)


To:

CODE
IF /i "%~x1" NEQ ".flac" (CALL :FolderAction %1) ELSE (CALL :FileAction %1)


That is, I explicitly check to see if the extension is .flac (case insensitive). I'm presuming you don't have a folder named something like: Music.Flac

Hope this helps,

Mike
Go to the top of the page
+Quote Post
Ethan Winer
post Apr 20 2013, 18:38
Post #11





Group: Members
Posts: 248
Joined: 12-May 09
From: New Milford, CT
Member No.: 69730



QUOTE (bjackson128 @ Jun 5 2006, 22:48) *
I guess I could just play them all, but that would take far too much time.

If you just want to verify that all of the files are readable, here's a simple method from an article I wrote for PC Magazine years ago. This was meant to verify that a burned CD-R is valid, but it works just as well for all the files in a folder on a hard drive:

Use Windows search to search the CD-R. Not for file names as usual, but for files containing a text string. Search for something you know is not there, such as "Matthew Perry ate my underwear." This forces Search to read every byte in every file as it tries in vain to find that string of text.

--Ethan


--------------------
I believe in Truth, Justice, and the Scientific Method
Go to the top of the page
+Quote Post
ChronoSphere
post Apr 20 2013, 18:55
Post #12





Group: Members
Posts: 519
Joined: 11-March 07
Member No.: 41384



Why not just use foobar+foo_verifier?
Go to the top of the page
+Quote Post
marc2003
post Apr 20 2013, 18:59
Post #13





Group: Members
Posts: 4593
Joined: 27-January 05
From: England
Member No.: 19379



for other formats, you can always use foobar2000 with foo_verifier. it does have this disclaimer though:

QUOTE
Checks specified media files for decoding errors. Note that with most formats, its accuracy is limited to detecting errors that abort the decoding process.


edit: oops, just the 4 minutes too late. tongue.gif

This post has been edited by marc2003: Apr 20 2013, 18:59
Go to the top of the page
+Quote Post
Porcus
post Apr 25 2013, 11:22
Post #14





Group: Members
Posts: 1920
Joined: 30-November 06
Member No.: 38207



foo_verifier also - at least last time I needed this - fails to detect errors that are so grave that it does not recognize the file. That is, if you have a majorly corrupted song.mp3 in a folder, dump the folder into fb2k, ask it to verify - then it could return OK just because it does not even start verifying it.


--------------------
One day in the Year of the Fox came a time remembered well
Go to the top of the page
+Quote Post
ktf
post Apr 25 2013, 14:33
Post #15





Group: Members
Posts: 398
Joined: 22-March 09
From: The Netherlands
Member No.: 68263



QUOTE (Michael Sargent @ Apr 20 2013, 17:29) *
Thanks for the batch file! This will be really helpful. I made two changes that you might be interested in:

You're probably better of using the FLAC tester which is bundled with the FLAC for Windows installer.

QUOTE (Ethan Winer @ Apr 20 2013, 19:38) *
QUOTE (bjackson128 @ Jun 5 2006, 22:48) *
I guess I could just play them all, but that would take far too much time.

If you just want to verify that all of the files are readable, here's a simple method from an article I wrote for PC Magazine years ago.

You've noticed this post is nearly 7 years old, right?

This post has been edited by ktf: Apr 25 2013, 14:34


--------------------
Music: sounds arranged such that they construct feelings.
Go to the top of the page
+Quote Post
ChronoSphere
post Apr 25 2013, 18:05
Post #16





Group: Members
Posts: 519
Joined: 11-March 07
Member No.: 41384



QUOTE (Porcus @ Apr 25 2013, 12:22) *
foo_verifier also - at least last time I needed this - fails to detect errors that are so grave that it does not recognize the file. That is, if you have a majorly corrupted song.mp3 in a folder, dump the folder into fb2k, ask it to verify - then it could return OK just because it does not even start verifying it.
That shouldn't be happening, if the file fails to decode then the internal checksum will not match the one decoded by foobar, which will be printed out as an error. I don't see how a file that fails to decode can still retain a valid checksum.
Go to the top of the page
+Quote Post
Porcus
post Apr 25 2013, 19:02
Post #17





Group: Members
Posts: 1920
Joined: 30-November 06
Member No.: 38207



QUOTE (ChronoSphere @ Apr 25 2013, 19:05) *
QUOTE (Porcus @ Apr 25 2013, 12:22) *
foo_verifier also - at least last time I needed this - fails to detect errors that are so grave that it does not recognize the file. That is, if you have a majorly corrupted song.mp3 in a folder, dump the folder into fb2k, ask it to verify - then it could return OK just because it does not even start verifying it.
That shouldn't be happening, if the file fails to decode then the internal checksum will not match the one decoded by foobar, which will be printed out as an error. I don't see how a file that fails to decode can still retain a valid checksum.


You are right about the fact, but you missed the issue. Which is:

- Try to rename a .txt file into .mp3 and dump it into the playlist. Then fb2k will simply pretend it does not exist.
- Try a sufficiently corrupted mp3 file. Still fb2k will pretend it does not exist.

In neither of the cases, fb2k will actually warn you that you have fed it something you call an mp3 (by suffix) but which is not recognizable as such. For that, use e.g. Windows Explorer search to find all *.mp3, get the count, dump them to fb2k, count ... and if you are missing one in ten thousand, then good luck hunting.


--------------------
One day in the Year of the Fox came a time remembered well
Go to the top of the page
+Quote Post
Ethan Winer
post Apr 25 2013, 19:52
Post #18





Group: Members
Posts: 248
Joined: 12-May 09
From: New Milford, CT
Member No.: 69730



QUOTE (ktf @ Apr 25 2013, 09:33) *
You've noticed this post is nearly 7 years old, right?

LOL, totally missed that.


--------------------
I believe in Truth, Justice, and the Scientific Method
Go to the top of the page
+Quote Post
ChronoSphere
post Apr 25 2013, 21:49
Post #19





Group: Members
Posts: 519
Joined: 11-March 07
Member No.: 41384



QUOTE (Porcus @ Apr 25 2013, 20:02) *
- Try to rename a .txt file into .mp3 and dump it into the playlist. Then fb2k will simply pretend it does not exist.
- Try a sufficiently corrupted mp3 file. Still fb2k will pretend it does not exist.

In neither of the cases, fb2k will actually warn you that you have fed it something you call an mp3 (by suffix) but which is not recognizable as such. For that, use e.g. Windows Explorer search to find all *.mp3, get the count, dump them to fb2k, count ... and if you are missing one in ten thousand, then good luck hunting.
Hmm I see what you mean now. But this kind of makes the verifier useless, doesn't it? Though probably foobar only skips the file if it cannot detect a valid header...
Go to the top of the page
+Quote Post

Reply to this topicStart new topic
1 User(s) are reading this topic (1 Guests and 0 Anonymous Users)
0 Members:

 



RSS Lo-Fi Version Time is now: 25th October 2014 - 02:30