How to save all data in database except in repository.
Moderator: dedisoft
Forum rules
Avant de poser une question, merci de regarder la documentation du wiki ou d'utiliser la fonction recherche du forum. Et rappelez vous que nous n'avons ni boule de cristal ni possibilité de lire dans les pensées, aussi pensez à spécifier quelle version d'OpenKM vous utilisez ainsi que la version du navigateur web et du système d'exploitation. Pour de plus amples informations lisez Comment reporter un bug efficacement (anglais).
Avant de poser une question, merci de regarder la documentation du wiki ou d'utiliser la fonction recherche du forum. Et rappelez vous que nous n'avons ni boule de cristal ni possibilité de lire dans les pensées, aussi pensez à spécifier quelle version d'OpenKM vous utilisez ainsi que la version du navigateur web et du système d'exploitation. Pour de plus amples informations lisez Comment reporter un bug efficacement (anglais).
How to save all data in database except in repository.
Hi Guys,
I want to save all data in database for better security of my files. so the user from the OS levels can also wont be able to see my files even they have admin access.
Please let me know if their is way in openkm.
-Arif
I want to save all data in database for better security of my files. so the user from the OS levels can also wont be able to see my files even they have admin access.
Please let me know if their is way in openkm.
-Arif
-
- Moderator
- Posts: 10934
- Joined: Fri Dec 21, 2007 11:23 am
- Location: Sineu - ( Illes Balears ) - Spain
- Contact:
Re: How to save all data in database except in repository.
First of all we do not recommend this kind of configuration ( really nobody will recommend it
but if you need can be done ).
1- OpenKM must be empty ( without files, if you have uploaded files you should export it and set the repository clean )
2- Stop OpenKM
3- Delete the forlder $TOMCAT_HOME/repository/datastore
3- Modify OpenKM.cfg and add the configuration parameter
repository.datastore.backend=db
4- Start OpenKM
Check
1- Now the folder should not be created $TOMCAT_HOME/repository/datastore
2- Upload a document and download.
3- Try search by content ( upload txt file, run text extractor and check if you are able to find by content ).
This feature is full working in professional edition I'm not 100% sure in community edition might be some issue, because this kind of configuration is not the standard one. The class what take control of the data store is https://github.com/openkm/document-mana ... Store.java

1- OpenKM must be empty ( without files, if you have uploaded files you should export it and set the repository clean )
2- Stop OpenKM
3- Delete the forlder $TOMCAT_HOME/repository/datastore
3- Modify OpenKM.cfg and add the configuration parameter
repository.datastore.backend=db
4- Start OpenKM
Check
1- Now the folder should not be created $TOMCAT_HOME/repository/datastore
2- Upload a document and download.
3- Try search by content ( upload txt file, run text extractor and check if you are able to find by content ).
This feature is full working in professional edition I'm not 100% sure in community edition might be some issue, because this kind of configuration is not the standard one. The class what take control of the data store is https://github.com/openkm/document-mana ... Store.java
Re: How to save all data in database except in repository.
Thank You!!!
I have configured datastore in database. I am not able to get the files and it's content in filesystem.
I am facing the new error now and that is...
IO Error: Cant' delete file (not exists) '/opt/OpenKM/tomcat-7.0.61/repository/datastore/0d/76/da/76/0d76da76-f1fc-4400-9164-938d7b869906'
Now /repository/datastore does not exits.Still openkm is checking some UUID in the filesystem.
I have checked the repository no error found in repository check.
-Arif
I have configured datastore in database. I am not able to get the files and it's content in filesystem.
I am facing the new error now and that is...
IO Error: Cant' delete file (not exists) '/opt/OpenKM/tomcat-7.0.61/repository/datastore/0d/76/da/76/0d76da76-f1fc-4400-9164-938d7b869906'
Now /repository/datastore does not exits.Still openkm is checking some UUID in the filesystem.
I have checked the repository no error found in repository check.
-Arif
- Attachments
-
- 1-25-2018 3-46-36 AM.png (7.35 KiB) Viewed 4801 times
-
- Moderator
- Posts: 10934
- Joined: Fri Dec 21, 2007 11:23 am
- Location: Sineu - ( Illes Balears ) - Spain
- Contact:
Re: How to save all data in database except in repository.
When you configured files to be stored into the database you created a new repository ? that means you started with clean repository configured to datastore, confirm this point.
Are you able to upload and download files ?
Are you able to upload and download files ?
Re: How to save all data in database except in repository.
Let me explain in detail..
1) I have uninstall previous installation of Openkm
2) install the fresh installation of OpenKM and configured to save files in database..
[root@openkm tomcat-7.0.61]# cat OpenKM.cfg
# OpenKM Hibernate configuration values
hibernate.dialect=org.hibernate.dialect.MySQL5InnoDBDialect
hibernate.hbm2ddl=none
repository.datastore.backend=db
# Logback configuration file
logback.config=logback.xml
3) then started importing the data from the filesystem. still getting the below errors which should not come in fresh installation..
1) I have uninstall previous installation of Openkm
2) install the fresh installation of OpenKM and configured to save files in database..
[root@openkm tomcat-7.0.61]# cat OpenKM.cfg
# OpenKM Hibernate configuration values
hibernate.dialect=org.hibernate.dialect.MySQL5InnoDBDialect
hibernate.hbm2ddl=none
repository.datastore.backend=db
# Logback configuration file
logback.config=logback.xml
3) then started importing the data from the filesystem. still getting the below errors which should not come in fresh installation..
Re: How to save all data in database except in repository.
I am able to upload and download file without any issue.
importing files are giving issue.
Thank You
-Arif
importing files are giving issue.
Thank You
-Arif
Re: How to save all data in database except in repository.
Hello Guys,
Could you please help me here? I am trying to troubleshoot but did not get any clue so far.
Regards,
Mohd Arif
Could you please help me here? I am trying to troubleshoot but did not get any clue so far.
Regards,
Mohd Arif
-
- Moderator
- Posts: 10934
- Joined: Fri Dec 21, 2007 11:23 am
- Location: Sineu - ( Illes Balears ) - Spain
- Contact:
Re: How to save all data in database except in repository.
Is quite strange, because it is shown in the progress that goes for 3% and then it's raised the error. has been imported some file until there or not ? In case nor document be imported please add an issue here https://github.com/openkm/document-management-system
Re: How to save all data in database except in repository.
Yes - Document has been imported till 3%. every time when i am importing the data it gives error at 3% and may be same UUID of the document.
Sure i will add the issue.
-Arif
Sure i will add the issue.
-Arif
-
- Moderator
- Posts: 10934
- Joined: Fri Dec 21, 2007 11:23 am
- Location: Sineu - ( Illes Balears ) - Spain
- Contact:
Re: How to save all data in database except in repository.
What kind of import are you doing, you are enabling some checkbox ?
I suggest you share also the catalina.log file to see the complete stack trace error ( we are only interested in the error, not in the full content of the log file, please cut only the error section )
I suggest you share also the catalina.log file to see the complete stack trace error ( we are only interested in the error, not in the full content of the log file, please cut only the error section )
Re: How to save all data in database except in repository.
This time i am fully surprised. I have installed new OS and then installed openkm but still i am facing the same issue.
I am importing files. I am not enabling any check box.
Please have look of logs below...
RepositoryImporter_20180305.log:
I do not have error on my catelina logs..
cat catalina.2018-03-05.log | grep ERROR
cat catalina.out | grep ERROR
Thank You
-Arif
I am importing files. I am not enabling any check box.
Please have look of logs below...
RepositoryImporter_20180305.log:
Code: Select all
2018-03-05 17:16:00,736 INFO Start repository import from '/marif/Documents' to '/okm:root/Intranet/Document'
2018-03-05 17:16:00,893 INFO Created folder '/okm:root/Intranet/Document/401k information'
2018-03-05 17:16:00,950 INFO Created folder '/okm:root/Intranet/Document/401k information/Fund Fact Sheet'
2018-03-05 17:16:01,390 INFO Created document '/okm:root/Intranet/Document/401k information/Fund Fact Sheet/Oppeheimer Rising Div.pdf'
2018-03-05 17:16:01,656 INFO Created document '/okm:root/Intranet/Document/401k information/Fund Fact Sheet/Pioneer Emerging Market.pdf'
2018-03-05 17:16:01,838 INFO Created document '/okm:root/Intranet/Document/401k information/Fund Fact Sheet/Aim Constellation.pdf'
2018-03-05 17:16:02,015 INFO Created document '/okm:root/Intranet/Document/401k information/Fund Fact Sheet/BlackRock Aur-Inv.pdf'
2018-03-05 17:16:02,234 INFO Created document '/okm:root/Intranet/Document/401k information/Fund Fact Sheet/BlackRock Equity_Dividend_Fund_Client_FS.pdf'
2018-03-05 17:16:02,334 ERROR IOException 'Cant' delete file (not exists) '/opt/tomcat-7.0.61/repository/datastore/02/55/20/45/02552045-43f3-4c53-bbc2-b18aad30e2e2''
cat catalina.2018-03-05.log | grep ERROR
cat catalina.out | grep ERROR
Code: Select all
[root@openkm logs]# cat catalina.2018-03-05.log
Mar 05, 2018 4:08:09 PM org.apache.catalina.core.AprLifecycleListener lifecycleEvent
INFO: The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: :/opt/tomcat-7.0.61/lib/sigar:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
Mar 05, 2018 4:08:10 PM org.apache.coyote.AbstractProtocol init
INFO: Initializing ProtocolHandler ["http-bio-0.0.0.0-8080"]
Mar 05, 2018 4:08:10 PM org.apache.coyote.AbstractProtocol init
INFO: Initializing ProtocolHandler ["ajp-bio-127.0.0.1-8009"]
Mar 05, 2018 4:08:10 PM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 2104 ms
Mar 05, 2018 4:08:10 PM org.apache.catalina.core.StandardService startInternal
INFO: Starting service Catalina
Mar 05, 2018 4:08:10 PM org.apache.catalina.core.StandardEngine startInternal
INFO: Starting Servlet Engine: Apache Tomcat/7.0.61
Mar 05, 2018 4:08:10 PM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deploying web application archive /opt/tomcat-7.0.61/webapps/OpenKM.war
Mar 05, 2018 4:08:16 PM org.apache.catalina.loader.WebappClassLoader validateJarFile
INFO: validateJarFile(/opt/tomcat-7.0.61/webapps/OpenKM/WEB-INF/lib/servlet-api-2.5-20081211.jar) - jar not loaded. See Servlet Spec 3.0, section 10.7.2. Offending class: javax/servlet/Servlet.class
Mar 05, 2018 4:08:16 PM org.apache.catalina.loader.WebappClassLoader validateJarFile
INFO: validateJarFile(/opt/tomcat-7.0.61/webapps/OpenKM/WEB-INF/lib/servlet-api-6.0.36.jar) - jar not loaded. See Servlet Spec 3.0, section 10.7.2. Offending class: javax/servlet/Servlet.class
Mar 05, 2018 4:08:48 PM org.apache.catalina.util.SessionIdGeneratorBase createSecureRandom
INFO: Creation of SecureRandom instance for session ID generation using [SHA1PRNG] took [236] milliseconds.
Mar 05, 2018 4:09:07 PM org.artofsolving.jodconverter.office.ProcessPoolOfficeManager <init>
INFO: ProcessManager implementation is SigarProcessManager
Mar 05, 2018 4:09:07 PM org.artofsolving.jodconverter.office.OfficeProcess start
INFO: starting process with acceptString 'socket,host=127.0.0.1,port=2002,tcpNoDelay=1' and profileDir '/opt/tomcat-7.0.61/temp/.jodconverter_socket_host-127.0.0.1_port-2002'
Mar 05, 2018 4:09:07 PM org.artofsolving.jodconverter.office.OfficeProcess start
INFO: started process; pid = 31117
Mar 05, 2018 4:09:20 PM org.artofsolving.jodconverter.office.ManagedOfficeProcess$6 attempt
WARNING: office process died with exit code 81; restarting it
Mar 05, 2018 4:09:20 PM org.artofsolving.jodconverter.office.OfficeProcess start
INFO: starting process with acceptString 'socket,host=127.0.0.1,port=2002,tcpNoDelay=1' and profileDir '/opt/tomcat-7.0.61/temp/.jodconverter_socket_host-127.0.0.1_port-2002'
Mar 05, 2018 4:09:20 PM org.artofsolving.jodconverter.office.OfficeProcess start
INFO: started process; pid = 31136
Mar 05, 2018 4:09:20 PM org.artofsolving.jodconverter.office.OfficeConnection connect
INFO: connected: 'socket,host=127.0.0.1,port=2002,tcpNoDelay=1'
Mar 05, 2018 4:09:20 PM net.xeoh.plugins.base.impl.classpath.loader.FileLoader loadFrom
WARNING: Supplied path does not exist. Unable to add plugins from there.
Mar 05, 2018 4:09:20 PM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deployment of web application archive /opt/tomcat-7.0.61/webapps/OpenKM.war has finished in 70,405 ms
Mar 05, 2018 4:09:20 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory /opt/tomcat-7.0.61/webapps/ROOT
Mar 05, 2018 4:09:23 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deployment of web application directory /opt/tomcat-7.0.61/webapps/ROOT has finished in 2,894 ms
Mar 05, 2018 4:09:23 PM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler ["http-bio-0.0.0.0-8080"]
Mar 05, 2018 4:09:23 PM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler ["ajp-bio-127.0.0.1-8009"]
Mar 05, 2018 4:09:23 PM org.apache.catalina.startup.Catalina start
INFO: Server startup in 73642 ms
Mar 05, 2018 4:09:27 PM org.apache.jasper.compiler.TldLocationsCache tldScanJar
INFO: At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
-Arif
Re: How to save all data in database except in repository.
This May help more..
Code: Select all
tomcat-7.0.61/logs/RepositoryImporter_20180305.log:2018-03-05 17:16:02,334 ERROR IOException 'Cant' delete file (not exists) '/opt/tomcat-7.0.61/repository/datastore/02/55/20/45/02552045-43f3-4c53-bbc2-b18aad30e2e2''
tomcat-7.0.61/logs/openkm_2018-03-05.0.log:2018-03-05 17:16:02,334 [http-bio-0.0.0.0-8080-exec-8] [] ERROR c.o.util.impexp.RepositoryImporter - Cant' delete file (not exists) '/opt/tomcat-7.0.61/repository/datastore/02/55/20/45/02552045-43f3-4c53-bbc2-b18aad30e2e2'
tomcat-7.0.61/logs/openkm_2018-03-05.0.log:java.io.IOException: Cant' delete file (not exists) '/opt/tomcat-7.0.61/repository/datastore/02/55/20/45/02552045-43f3-4c53-bbc2-b18aad30e2e2'
tomcat-7.0.61/logs/openkm_2018-03-05.0.log:2018-03-05 17:16:02,336 [http-bio-0.0.0.0-8080-exec-8] [] ERROR repository_import.jsp - Cant' delete file (not exists) '/opt/tomcat-7.0.61/repository/datastore/02/55/20/45/02552045-43f3-4c53-bbc2-b18aad30e2e2'
tomcat-7.0.61/logs/openkm_2018-03-05.0.log:java.io.IOException: Cant' delete file (not exists) '/opt/tomcat-7.0.61/repository/datastore/02/55/20/45/02552045-43f3-4c53-bbc2-b18aad30e2e2'
tomcat-7.0.61/logs/localhost_access_log.2018-03-07.txt:10.203.86.196 - - [07/Mar/2018:13:18:02 -0500] "GET /OpenKM/admin/ListIndexes?action=search&exp=02552045-43f3-4c53-bbc2-b18aad30e2e2 HTTP/1.1" 200 1623
tomcat-7.0.61/logs/localhost_access_log.2018-03-07.txt:10.203.86.196 - - [07/Mar/2018:13:18:04 -0500] "GET /OpenKM/admin/ListIndexes?action=search&exp=02552045-43f3-4c53-bbc2-b18aad30e2e2 HTTP/1.1" 200 1623
-
- Moderator
- Posts: 10934
- Joined: Fri Dec 21, 2007 11:23 am
- Location: Sineu - ( Illes Balears ) - Spain
- Contact:
Re: How to save all data in database except in repository.
I have seen it. As soon as possible we will start working on it.