Upload of larger files is slow

[nelsonglory]

Hi,
I\'m wondering why I cant find any topic covering the fact that the upload of files bigger than a few MB is incredible slow. I measured a rate of 2s / MB which feels like an eternity if you have to wait for an 100MB file upload to finish. The system I use is an actual server with 16 cores, 16 GB RAM and a fast raid5 sas disc array. I found out that the network connection is not the problem, the upload itself to the server is quite fast but after transfering it takes so much time to import the file into the db.

So this raises the questions:
1. Is it a configuration problem or is no one using OpenKM to share files bigger than a few MBs?
2. Is it nescessary to store files in the database instead of only saving their references ?

Thanks in advance
Nelson

[djdifulvio]

What file type? If it is a compressed file with multi documents, what types are those?

[nelsonglory]

I tried different filetypes - exe,tar,zip and avi-files with no difference in the feld upload speed. I first assumed it is slow due to a slow indexing mechanism but I guess there is none for these kind of files.

[nelsonglory]

Now I was able to speed up the upload by changing the config to use \"File Data Store\" instead of default \"Database Data Store\". Therefore you only have to edit \"repository.xml\" as described in http://wiki.apache.org/jackrabbit/DataStore.
After restart of tomcat everything seems to work fine - hashed files are now created in the filesystem. Thats great - but the problem now is that there seems to be no garbage collection for these files. That leads to persistent files even if you delete them in OpenKM.

Is it possible to implement a garbage mechanism for this file based storage in OpenKM ?
I would do it but I have only poor programing experience in java and one of the authors can surely implement a garbarge collection in minutes ;) (Its also described in the page mentioned above)

Greetings
Nelson

[pavila]

In the upcoming OpenKM release this garbage collection is performed. I hope to make a release candidate soon.