Getting lots of "Error Reading:" for all files

[ndc168]

Couldn't get any result even if the threshold lowest.

Error msg also doesn't state why there are error reading files. No problems with other dedup apps.

[eazrael]

Please show at least the log ouput from the text field in the main window.

[AccaGihu]

`Vidupe 1.211
Copyright © 2018-2019 Kristian Koskimäki
Licensed under GNU General Public License

Supported file extensions:
.3g2 .3gp .3gpp
.amv .asf .avi .divx .drc
.f4a .f4b .f4p .f4v
.flv .swf
.mts .m2ts .m2v .m4v
.mkv .mov .mj2
.mp2 .mp4 .mpe .mpeg .mpg .mpv
.ogg .ogv
.ram .rm .rmvb
.ts .vob
.webm .wmv .y4m

Searching for videos...
Found 56 video file(s):
[11:17:21] ERROR reading C:\vidupe\file1.mp4
[11:17:22] ERROR reading C:\vidupe\file2.webm`

and after the list

`0 intact video(s) out of 56 total

The following 56 video(s) could not be added due to errors:
C:\vidupe\file1.mp4`

I'm having the same error, I've cut the output as it was very long, I'm trying to compare mp4 and webm files. I've put ffmpeg (ffmpeg-4.2.3-win64-static) in the main dir, I was trying to read from an exfat partition, moved to ntfs but nothing changed, I've disabled my antivirus and windows 10 (1909, build 18363.836) too.
I tried removing read-only from the files, moving the dir with the files closer to the drive root, and launching the program as administrator and in win8 compatibility mode.

Edit:
The program works no problem under Linux
Operating System: Manjaro Linux
KDE Plasma Version: 5.18.5
KDE Frameworks Version: 5.70.0
Qt Version: 5.14.2
Kernel Version: 5.7.0-3-MANJARO
OS Type: 64-bit
Processors: 12 × AMD Ryzen 5 1600 Six-Core Processor
Memory: 15,6 GiB

wine-5.9 (Staging)

[theophanemayaud]

I'm trying to build for Mac, and after a lot of trys I got it .... to do the same as you say happens on Linux... All files cannot seem to be read. And it seems to be that the metadata is all 0 width 0 height ...
I don't know what's up but I might try again and tell you here as well if and how I get it working for me on Mac !

[james-cook]

I'm having the same problem.
The files below are fine and all play in VLC.
Running on W10 with files on an external USB drive: N:\t\recup_dir.1667
I have the 32 bit version of STATIC ffmpeg.exe in the same directory as Vidupe.exe
Should a non STATIC or/and 64 bit version of ffmpeg.exe be used instead?

Searching for videos...
Found 36 video file(s):
[15:42:37] ERROR reading N:\t\recup_dir.1667\f1497132792.mp4
[15:42:37] ERROR reading N:\t\recup_dir.1667\f1500876568.mp4
[15:42:37] ERROR reading N:\t\recup_dir.1667\f1492312336.swf
[15:42:37] ERROR reading N:\t\recup_dir.1667\Agatha Christie's Poirot - Series 6 Episode 3 - Murder on the Links.mp4
[15:42:37] ERROR reading N:\t\recup_dir.1667\f1517725776.mp4
[15:42:37] ERROR reading N:\t\recup_dir.1667\f1523278704.mp4
[15:42:37] ERROR reading N:\t\recup_dir.1667\f1520041104.mp4
<etc>
0 intact video(s) out of 36 total

The following 36 video(s) could not be added due to errors:
N:\t\recup_dir.1667\f1497132792.mp4
N:\t\recup_dir.1667\f1500876568.mp4
N:\t\recup_dir.1667\f1492312336.swf
N:\t\recup_dir.1667\Agatha Christie's Poirot - Series 6 Episode 3 - Murder on the Links.mp4
N:\t\recup_dir.1667\f1520041104.mp4
N:\t\recup_dir.1667\f1524122544.mp4
N:\t\recup_dir.1667\f1523278704.mp4
N:\t\recup_dir.1667\f1517725776.mp4
N:\t\recup_dir.1667\f1529335568.mp4
N:\t\recup_dir.1667\f1531290416.mp4
N:\t\recup_dir.1667\f1532335160.mp4
<etc>

[james-cook]

I tried loading up Qt Creator and compiling the source on W10 but hit a lot of problems to do with 32bit/64bit... AFAICT
In an intermission I tried https://github.com/0x90d/videoduplicatefinder
This tool does not have problems reading the very files vidupe complains about.

[theophanemayaud]

I also used that software but it doesn’t display the screenshots and therefore isn’t really good for manual checking at least some of the duplicates. And doesn’t work on Mac !
What errors do you get ? I had a few and some about 32bit, which because I’m on Catalina wasn’t possible. In the end it compiled fine for 64bit, but now I’m stuck at errors reading file...
More specifically, I had errors with unsupported 32bit flags, which I just removed and then it worked. Once it builds you migh t be able to find where the error reading file comes from... for me it seemed to be at the height width check, but I’m not sure... and didn’t have time to really look for the error source from the QT docs and the code...

[theophanemayaud]

On windows (well, 64bit windows on my MacBook using boot camp), I used the executable for vidupe and ffmpeg.exe 32 bit into the same folder, and that worked ! What do you mean static ?

[james-cook]

it doesn’t display the screenshots

Not sure what you mean here, thumbnails are displayed as can be seen here: https://user-images.githubusercontent.com/46010672/50975469-97e5d900-14e5-11e9-9aba-5a843546ac2c.jpg

And the number of thumbnails per video file can be configured (so not just 1 as shown in the image above

[theophanemayaud]

Hmmm I didn't see the option for multiple thumbnails, that's good, I thought it couldn't do it. But as said, I also needed an option that would run on macOS so I tried to build vidupe for my Mac. But now I get the error reading files...

[theophanemayaud]

It's like this, for all files regardless of extension :

[eazrael]

One of the issues is that internally backslashes are harcoded into the ffmpeg output parsing, so it won't run on unixlike OS. I fixed that and put all the stuff in to a Docker image.

[eazrael]

I have no time to make it proper, there's no documentation and the commit messages are just crap.
https://evilazrael.net/git/eazrael/vidupe
Checkout the master branch, it should work at least in Linux.
Or Build the docker image. It has an VNC Server integratet, so you can run it remotely. The password is hardcoded in the Dockerfile: "Hallo123"

Starthe docker container like this docker run -ti --rm -p 5901:5901 -v /host/path/to/your/videos:/data vidupe
Then you can connect with a VNC client to port 5901.

Build the image with
docker build -t vidupe .

If you want to compile vidupe yourself, have a look at the docker file.

[theophanemayaud]

Well, your hint about the backslashed got me on a good track ! I found out that \n\r from the ffmpeg output on Mac was only \n.
And also, I have a problem with the cache check, where all files seemed already cached but with image width and height set to 0. I think that was the biggest problem for the all the errors, as now it finds accepts almost all videos.
Still a few left where the error is that it failed to take screenshot. But that might be due also to some parsing... well, maybe, I'll try to check it out more thoroughly. I'll also check your source code, see if there are improvements I could also use for my trials !

[eazrael]

You are right, it was the newline, not the windows paths :-)

[theophanemayaud]

I now got it to work back on windows, after the edits I made to the code and the use of the ffmpeg libraries (instead of the executable), which has helped me solve most of the "errors" with files. You could check it out if still needed : https://theophanemayaud.github.io/video-simili-duplicate-cleaner/