How to save all data in database except in repository.

[Mohd Arif]

Hi Guys,

I want to save all data in database for better security of my files. so the user from the OS levels can also wont be able to see my files even they have admin access.

Please let me know if their is way in openkm.

-Arif

[jllort]

First of all we do not recommend this kind of configuration ( really nobody will recommend it but if you need can be done ).
1- OpenKM must be empty ( without files, if you have uploaded files you should export it and set the repository clean )
2- Stop OpenKM
3- Delete the forlder $TOMCAT_HOME/repository/datastore
3- Modify OpenKM.cfg and add the configuration parameter
repository.datastore.backend=db
4- Start OpenKM

Check
1- Now the folder should not be created $TOMCAT_HOME/repository/datastore
2- Upload a document and download.
3- Try search by content ( upload txt file, run text extractor and check if you are able to find by content ).

This feature is full working in professional edition I'm not 100% sure in community edition might be some issue, because this kind of configuration is not the standard one. The class what take control of the data store is https://github.com/openkm/document-mana ... Store.java

[Mohd Arif]

Thank You!!!
I have configured datastore in database. I am not able to get the files and it's content in filesystem.
I am facing the new error now and that is...

IO Error: Cant' delete file (not exists) '/opt/OpenKM/tomcat-7.0.61/repository/datastore/0d/76/da/76/0d76da76-f1fc-4400-9164-938d7b869906'

Now /repository/datastore does not exits.Still openkm is checking some UUID in the filesystem.

I have checked the repository no error found in repository check.

-Arif

[jllort]

When you configured files to be stored into the database you created a new repository ? that means you started with clean repository configured to datastore, confirm this point.
Are you able to upload and download files ?

[Mohd Arif]

Let me explain in detail..

1) I have uninstall previous installation of Openkm
2) install the fresh installation of OpenKM and configured to save files in database..

[root@openkm tomcat-7.0.61]# cat OpenKM.cfg
# OpenKM Hibernate configuration values
hibernate.dialect=org.hibernate.dialect.MySQL5InnoDBDialect
hibernate.hbm2ddl=none
repository.datastore.backend=db
# Logback configuration file
logback.config=logback.xml

3) then started importing the data from the filesystem. still getting the below errors which should not come in fresh installation..

[Mohd Arif]

I am able to upload and download file without any issue.
importing files are giving issue.

Thank You
-Arif

[Mohd Arif]

Hello Guys,

Could you please help me here? I am trying to troubleshoot but did not get any clue so far.

Regards,
Mohd Arif

[jllort]

Is quite strange, because it is shown in the progress that goes for 3% and then it's raised the error. has been imported some file until there or not ? In case nor document be imported please add an issue here https://github.com/openkm/document-management-system

[Mohd Arif]

Yes - Document has been imported till 3%. every time when i am importing the data it gives error at 3% and may be same UUID of the document.
Sure i will add the issue.

-Arif

[jllort]

What kind of import are you doing, you are enabling some checkbox ?
I suggest you share also the catalina.log file to see the complete stack trace error ( we are only interested in the error, not in the full content of the log file, please cut only the error section )

[Mohd Arif]

This time i am fully surprised. I have installed new OS and then installed openkm but still i am facing the same issue.

I am importing files. I am not enabling any check box.
Please have look of logs below...

RepositoryImporter_20180305.log:

Code: Select all

2018-03-05 17:16:00,736 INFO  Start repository import from '/marif/Documents' to '/okm:root/Intranet/Document'
2018-03-05 17:16:00,893 INFO  Created folder '/okm:root/Intranet/Document/401k information'
2018-03-05 17:16:00,950 INFO  Created folder '/okm:root/Intranet/Document/401k information/Fund Fact Sheet'
2018-03-05 17:16:01,390 INFO  Created document '/okm:root/Intranet/Document/401k information/Fund Fact Sheet/Oppeheimer Rising Div.pdf'
2018-03-05 17:16:01,656 INFO  Created document '/okm:root/Intranet/Document/401k information/Fund Fact Sheet/Pioneer Emerging Market.pdf'
2018-03-05 17:16:01,838 INFO  Created document '/okm:root/Intranet/Document/401k information/Fund Fact Sheet/Aim Constellation.pdf'
2018-03-05 17:16:02,015 INFO  Created document '/okm:root/Intranet/Document/401k information/Fund Fact Sheet/BlackRock Aur-Inv.pdf'
2018-03-05 17:16:02,234 INFO  Created document '/okm:root/Intranet/Document/401k information/Fund Fact Sheet/BlackRock Equity_Dividend_Fund_Client_FS.pdf'
2018-03-05 17:16:02,334 ERROR IOException 'Cant' delete file (not exists) '/opt/tomcat-7.0.61/repository/datastore/02/55/20/45/02552045-43f3-4c53-bbc2-b18aad30e2e2''

I do not have error on my catelina logs..

cat catalina.2018-03-05.log | grep ERROR

cat catalina.out | grep ERROR

Code: Select all

[root@openkm logs]# cat catalina.2018-03-05.log
Mar 05, 2018 4:08:09 PM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: :/opt/tomcat-7.0.61/lib/sigar:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
Mar 05, 2018 4:08:10 PM org.apache.coyote.AbstractProtocol init
INFO: Initializing ProtocolHandler ["http-bio-0.0.0.0-8080"]
Mar 05, 2018 4:08:10 PM org.apache.coyote.AbstractProtocol init
INFO: Initializing ProtocolHandler ["ajp-bio-127.0.0.1-8009"]
Mar 05, 2018 4:08:10 PM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 2104 ms
Mar 05, 2018 4:08:10 PM org.apache.catalina.core.StandardService startInternal
INFO: Starting service Catalina
Mar 05, 2018 4:08:10 PM org.apache.catalina.core.StandardEngine startInternal
INFO: Starting Servlet Engine: Apache Tomcat/7.0.61
Mar 05, 2018 4:08:10 PM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deploying web application archive /opt/tomcat-7.0.61/webapps/OpenKM.war
Mar 05, 2018 4:08:16 PM org.apache.catalina.loader.WebappClassLoader validateJarFile
INFO: validateJarFile(/opt/tomcat-7.0.61/webapps/OpenKM/WEB-INF/lib/servlet-api-2.5-20081211.jar) - jar not loaded. See Servlet Spec 3.0, section 10.7.2. Offending class: javax/servlet/Servlet.class
Mar 05, 2018 4:08:16 PM org.apache.catalina.loader.WebappClassLoader validateJarFile
INFO: validateJarFile(/opt/tomcat-7.0.61/webapps/OpenKM/WEB-INF/lib/servlet-api-6.0.36.jar) - jar not loaded. See Servlet Spec 3.0, section 10.7.2. Offending class: javax/servlet/Servlet.class
Mar 05, 2018 4:08:48 PM org.apache.catalina.util.SessionIdGeneratorBase createSecureRandom
INFO: Creation of SecureRandom instance for session ID generation using [SHA1PRNG] took [236] milliseconds.
Mar 05, 2018 4:09:07 PM org.artofsolving.jodconverter.office.ProcessPoolOfficeManager <init>
INFO: ProcessManager implementation is SigarProcessManager
Mar 05, 2018 4:09:07 PM org.artofsolving.jodconverter.office.OfficeProcess start
INFO: starting process with acceptString 'socket,host=127.0.0.1,port=2002,tcpNoDelay=1' and profileDir '/opt/tomcat-7.0.61/temp/.jodconverter_socket_host-127.0.0.1_port-2002'
Mar 05, 2018 4:09:07 PM org.artofsolving.jodconverter.office.OfficeProcess start
INFO: started process; pid = 31117
Mar 05, 2018 4:09:20 PM org.artofsolving.jodconverter.office.ManagedOfficeProcess$6 attempt
WARNING: office process died with exit code 81; restarting it
Mar 05, 2018 4:09:20 PM org.artofsolving.jodconverter.office.OfficeProcess start
INFO: starting process with acceptString 'socket,host=127.0.0.1,port=2002,tcpNoDelay=1' and profileDir '/opt/tomcat-7.0.61/temp/.jodconverter_socket_host-127.0.0.1_port-2002'
Mar 05, 2018 4:09:20 PM org.artofsolving.jodconverter.office.OfficeProcess start
INFO: started process; pid = 31136
Mar 05, 2018 4:09:20 PM org.artofsolving.jodconverter.office.OfficeConnection connect
INFO: connected: 'socket,host=127.0.0.1,port=2002,tcpNoDelay=1'
Mar 05, 2018 4:09:20 PM net.xeoh.plugins.base.impl.classpath.loader.FileLoader loadFrom
WARNING: Supplied path does not exist. Unable to add plugins from there.
Mar 05, 2018 4:09:20 PM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deployment of web application archive /opt/tomcat-7.0.61/webapps/OpenKM.war has finished in 70,405 ms
Mar 05, 2018 4:09:20 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory /opt/tomcat-7.0.61/webapps/ROOT
Mar 05, 2018 4:09:23 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deployment of web application directory /opt/tomcat-7.0.61/webapps/ROOT has finished in 2,894 ms
Mar 05, 2018 4:09:23 PM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler ["http-bio-0.0.0.0-8080"]
Mar 05, 2018 4:09:23 PM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler ["ajp-bio-127.0.0.1-8009"]
Mar 05, 2018 4:09:23 PM org.apache.catalina.startup.Catalina start
INFO: Server startup in 73642 ms
Mar 05, 2018 4:09:27 PM org.apache.jasper.compiler.TldLocationsCache tldScanJar
INFO: At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.

Thank You
-Arif

[Mohd Arif]

This May help more..

Code: Select all

tomcat-7.0.61/logs/RepositoryImporter_20180305.log:2018-03-05 17:16:02,334 ERROR IOException 'Cant' delete file (not exists) '/opt/tomcat-7.0.61/repository/datastore/02/55/20/45/02552045-43f3-4c53-bbc2-b18aad30e2e2''
tomcat-7.0.61/logs/openkm_2018-03-05.0.log:2018-03-05 17:16:02,334 [http-bio-0.0.0.0-8080-exec-8] [] ERROR c.o.util.impexp.RepositoryImporter - Cant' delete file (not exists) '/opt/tomcat-7.0.61/repository/datastore/02/55/20/45/02552045-43f3-4c53-bbc2-b18aad30e2e2'
tomcat-7.0.61/logs/openkm_2018-03-05.0.log:java.io.IOException: Cant' delete file (not exists) '/opt/tomcat-7.0.61/repository/datastore/02/55/20/45/02552045-43f3-4c53-bbc2-b18aad30e2e2'
tomcat-7.0.61/logs/openkm_2018-03-05.0.log:2018-03-05 17:16:02,336 [http-bio-0.0.0.0-8080-exec-8] [] ERROR repository_import.jsp - Cant' delete file (not exists) '/opt/tomcat-7.0.61/repository/datastore/02/55/20/45/02552045-43f3-4c53-bbc2-b18aad30e2e2'
tomcat-7.0.61/logs/openkm_2018-03-05.0.log:java.io.IOException: Cant' delete file (not exists) '/opt/tomcat-7.0.61/repository/datastore/02/55/20/45/02552045-43f3-4c53-bbc2-b18aad30e2e2'
tomcat-7.0.61/logs/localhost_access_log.2018-03-07.txt:10.203.86.196 - - [07/Mar/2018:13:18:02 -0500] "GET /OpenKM/admin/ListIndexes?action=search&exp=02552045-43f3-4c53-bbc2-b18aad30e2e2 HTTP/1.1" 200 1623
tomcat-7.0.61/logs/localhost_access_log.2018-03-07.txt:10.203.86.196 - - [07/Mar/2018:13:18:04 -0500] "GET /OpenKM/admin/ListIndexes?action=search&exp=02552045-43f3-4c53-bbc2-b18aad30e2e2 HTTP/1.1" 200 1623

[Mohd Arif]

I have submitted the issue on https://github.com/openkm/document-management-system as well.

-Arif

[jllort]

I have seen it. As soon as possible we will start working on it.