OCS external connector.

baptou.leitoo0 · June 24, 2013, 9:34am

Hi,

I have get some troubles trying to set the ocs external connector.

I've made the 3 files : cmdbuild-schema.xml, configuration.xml, transform.xsl. They are in folder like presented in the documentation :

.
├── conf
│   ├── cmdbuild-schema.xml
│   ├── configuration.xml
│   ├── logs
│   │   ├── ExternalConnector.log
│   │   └── log4j.conf
│   ├── repository
│   │   ├── conf
│   │   │   └── policy.xml
│   │   └── modules
│   │       └── rampart-1.4.mar
│   └── transform.xsl
└── ExternalConnector.1.4.0.jar

But when I try to launch : java -jar ExternalConnector.1.4.0.jar ./conf/ ImportOCS

I am getting the following error, as the configuration file isn't present.

log4j: Finished configuring.
ERROR: an error has occurred retrieving this file: configuration.xml 
Exception in thread "main" java.lang.NullPointerException
        at org.cmdbuild.externalconnector.configuration.ConfigurationFile.<init>(ConfigurationFile.java:39)
        at org.cmdbuild.externalconnector.update.UpdateCMDBuild.main(UpdateCMDBuild.java:37)

Besides, I don't really understand how to generate or to write the *.xpdl file. The documentation is not really clear, what is the externalsync tool ?

5. Define a new xpdl using the tool externalsync as show in importocs.xpdl. 
This file is a very simple process, working only with a processclass named "ImportOCS"

Thanks for your help,

Regards.

ladislav.kudláček · July 2, 2013, 9:02am

Hi,

i have the same problem.

thanks for help

ladislav.kudláček · July 2, 2013, 2:26pm

I solved problem below as follows:

cd $PATH_CONNECTORS/connectors
ln -s conf/configuration.xml .
java -jar ExternalConnector.1.4.0.jar . ImportOCS

log4j: Finished configuring.
ERROR: an error has occurred retrieving this file: configuration.xml 
Exception in thread "main" java.lang.NullPointerException
        at org.cmdbuild.externalconnector.configuration.ConfigurationFile.<init>(ConfigurationFile.java:39)
        at org.cmdbuild.externalconnector.update.UpdateCMDBuild.main(UpdateCMDBuild.java:37)

baptou.leitoo0 · July 3, 2013, 7:40am

Woww thank you it works !

How did you find that ?

Previously Ladislav wrote:

I solved problem below as follows:

cd $PATH_CONNECTORS/connectors
ln -s conf/configuration.xml .
java -jar ExternalConnector.1.4.0.jar . ImportOCS

log4j: Finished configuring.
ERROR: an error has occurred retrieving this file: configuration.xml 
Exception in thread "main" java.lang.NullPointerException
        at org.cmdbuild.externalconnector.configuration.ConfigurationFile.<init>(ConfigurationFile.java:39)
        at org.cmdbuild.externalconnector.update.UpdateCMDBuild.main(UpdateCMDBuild.java:37)

cjardin · July 17, 2013, 9:04am

Hello,

An error is still present :

(root@myserver) connectors # java -jar ExternalConnector.1.4.0.jar ./conf/ ImportOCS

log4j:WARN No appenders could be found for logger (connector).

log4j:WARN Please initialize the log4j system properly.

log4j: Parsing for [root] with value=[WARN, R].

log4j: Level token is [WARN].

log4j: Category root set to WARN

log4j: Parsing appender named "R".

log4j: Parsing layout options for "R".

log4j: End of parsing for "R".

log4j: Setting property [file] to [./conf//logs/ExternalConnector.log].

log4j: Setting property [maxFileSize] to [100MB].

log4j: Setting property [maxBackupIndex] to [10].

log4j: setFile called: ./conf//logs/ExternalConnector.log, true

log4j: setFile ended

log4j: Parsed "R" options.

log4j: Parsing for [connector] with value=[INFO].

log4j: Level token is [INFO].

log4j: Category connector set to INFO

log4j: Handling log4j.additivity.connector=[null]

log4j: Parsing for [servermail] with value=[INFO].

log4j: Level token is [INFO].

log4j: Category servermail set to INFO

log4j: Handling log4j.additivity.servermail=[null]

log4j: Parsing for [ldap] with value=[INFO].

log4j: Level token is [INFO].

log4j: Category ldap set to INFO

log4j: Handling log4j.additivity.ldap=[null]

log4j: Parsing for [inventory] with value=[INFO].

log4j: Level token is [INFO].

log4j: Category inventory set to INFO

log4j: Handling log4j.additivity.inventory=[null]

log4j: Finished configuring.

ERROR: an error has occurred retrieving this file: configuration.xml
Exception in thread "main" java.lang.NullPointerException
at org.cmdbuild.externalconnector.configuration.ConfigurationFile.<init>(ConfigurationFile.java:39)
at org.cmdbuild.externalconnector.update.UpdateCMDBuild.main(UpdateCMDBuild.java:37)

Also, Is someone from tecnoteca to answer to this following question ?

Previously Baptou wrote:
Besides, I don't really understand how to generate or to write the *.xpdl file. The documentation is not really clear, what is the externalsync tool ?
5. Define a new xpdl using the tool externalsync as show in importocs.xpdl. 
This file is a very simple process, working only with a processclass named "ImportOCS"

Best Regards

cjardin · July 17, 2013, 2:58pm

Any update ? :’(

cjardin · July 18, 2013, 10:53am

For more information about the error and the configuration :

tail -f ExternalConnector.log

>>> Program Started - version (ExternalConnector 1.4.0 - 22/11/2011)<<<

Parsing XML file [./conf//conf/configuration.xml]

tree

-conf

-------cmdbuild-schema.xml

-------configuration.xml

-------logs

-------------- ExternalConnector.log

-------------- log4j.conf

-------repository

-------------- conf

---------------------policy.xml

--------------modules

---------------------rampart-1.4.mar

-------transform.xsl

-configuration.xml -> conf/configuration.xml

-ExternalConnector.1.4.0.jar

-logs

-------log4j.conf

cat configuration.xml

<?xml version="1.0" encoding="UTF-8"?>

<ServerContext>cmdbuild</ServerContext>

<Username>admin</Username>

<Password>password</Password>

</cmdbuild>

<DbType>mysql</DbType>

<DbName>ocsweb</DbName>

</inventory>

</configuration>

(the username & password are used to connect to cmdb webinterface)

transform.xsl & cmdbuild-schema hasn't been modified.

I hope that someone can help me to solve the issue.

BR

tecnoteca · July 18, 2013, 11:24am

Hi,
the connector can't retreive the files needed for configuration.

I think you have something wrong in your file structure.

This is the right structure:

.
|-- ${configuration-folder-name}
|   |
|   |--conf
|   |    |
|   |    |-- repository
|   |    |       |
|   |    |       |--conf
|   |    |       |    |-- policy.xml
|   |    |       |
|   |    |       |-- modules
|   |    |            |--rampart.mar
|   |    |
|   |    |--cmdbuild-schema.xml
|   |    |--configuration.xml
|   |    |--transform.xsl
|   |    
|   |-- logs
|        |--ExternalConnector.log
|        |--log4j.conf
|
|-- ExternalConnector.1.4.0.jar

When you have this exact configuration place yourself in the directory in which you have the ExternalConnector.1.4.0.jar and then type:

java -jar ExternalConnector.1.4.0.jar ${configuration-folder-name} ImportOCS

Obviously ${configuration-folder-name} means that you can give the folder the name you prefer.

Best regards,

Tecnoteca

cjardin · July 19, 2013, 10:18am

Hello,

Thanks ! Now I got that :

(root@myserver) connectors # java -jar ExternalConnector.1.4.0.jar . ImportOCS

log4j:WARN No appenders could be found for logger (connector).

log4j:WARN Please initialize the log4j system properly.

log4j: Parsing for [root] with value=[WARN, R].

log4j: Level token is [WARN].

log4j: Category root set to WARN

log4j: Parsing appender named "R".

log4j: Parsing layout options for "R".

log4j: End of parsing for "R".

log4j: Setting property [file] to [./logs/ExternalConnector.log].

log4j: Setting property [maxFileSize] to [100MB].

log4j: Setting property [maxBackupIndex] to [10].

log4j: setFile called: ./logs/ExternalConnector.log, true

log4j: setFile ended

log4j: Parsed "R" options.

log4j: Parsing for [connector] with value=[DEBUG].

log4j: Level token is [DEBUG].

log4j: Category connector set to DEBUG

log4j: Handling log4j.additivity.connector=[null]

log4j: Parsing for [servermail] with value=[INFO].

log4j: Level token is [INFO].

log4j: Category servermail set to INFO

log4j: Handling log4j.additivity.servermail=[null]

log4j: Parsing for [inventory] with value=[INFO].

log4j: Level token is [INFO].

log4j: Category inventory set to INFO

log4j: Handling log4j.additivity.inventory=[null]

log4j: Parsing for [ldap] with value=[INFO].

log4j: Level token is [INFO].

log4j: Category ldap set to INFO

log4j: Handling log4j.additivity.ldap=[null]

log4j: Finished configuring.

And in the logs :

>>> Program Started - version (ExternalConnector 1.4.0 - 22/11/2011)<<<

Searching for: ./conf/configuration.xml

Parsing XML file [./conf/configuration.xml]

Ended to read configuration file

Reading the transform file.

Parsing XML file [./conf/cmdbuild-schema.xml]

Total objects to check: 4

Reading card nr. 1 - Code: NA

keyNode name is: devicewith id:3

New master card [Code: NA]

A new item has been detected [card master is Computer.Code: NA]

Fault occurred while processing.

Reading card nr. 2 - Code: NA

keyNode name is: devicewith id:4

New master card [Code: NA]

A new item has been detected [card master is Computer.Code: NA]

Fault occurred while processing.

Reading card nr. 3 - Code: QUAL

keyNode name is: devicewith id:1

New master card [Code: QUAL]

A new item has been detected [card master is Computer.Code: QUAL]

Fault occurred while processing.

Reading card nr. 4 - Code: QUAL

keyNode name is: devicewith id:2

New master card [Code: QUAL]

A new item has been detected [card master is Computer.Code: QUAL]

Fault occurred while processing.

>>> Program Terminated <<<

My cmbuild-schema.xml =>

<?xml version="1.0"?>

<Code/>

<SO/>

<RAM/>

</Computer>

</CMDBUILD>

my transform.xsl =>

<?xml version="1.0" encoding="UTF-8"?>

<xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0">

<xsl:output method="xml" version="1.0" encoding="UTF-8" indent="yes"/>

<xsl:template match="/">

<xsl:apply-templates/>

</CMDBUILD>

</xsl:template>

<xsl:template match="*">

<xsl:apply-templates/>

</xsl:template>

<xsl:template match="text()"></xsl:template>

<xsl:template match="/inventory/device">

<Code>

<xsl:value-of select="/inventory/device/TAG"/>

</Code>

<xsl:value-of select="/inventory/device/NAME"/>

</Description>

<SO>

<xsl:value-of select="/inventory/device/OSNAME"/>

</SO>

<RAM>

<xsl:value-of select="sum(/inventory/memory/CAPACITY)"/>

</RAM>

</Computer>

</xsl:template>

<xsl:template match="/CMDBUILD/Computer">

<xsl:attribute name="objid">

<xsl:value-of select="./@objid"/>

</xsl:attribute>

<xsl:value-of select="./Description"/>

</Description>

<SO>

<xsl:value-of select="./SO"/>

</SO>

<RAM>

<xsl:value-of select="./RAM"/>

</RAM>

</Computer>

</xsl:template>

</xsl:stylesheet>

Theses tables / fields exist in ocs database :

CMDBuild_device (TAG / NAME / OSNAME)

CMDBuild_memory (CAPACITY)

Nothing is displayed in the cmdbuild interface.

NB : Default ImportOCS_Shark4.4.xpdl has been renamed to ImportOCS.xpdl and uploaded in the Process from the cmdbuild web interface.

Have you got one idea ?

BR

PS : my shark log in attachment

shark-log (7.1 KB)

cjardin · July 19, 2013, 3:51pm

Hello,

It seems that replies sent from the forum account are not taken into account.

BR

Previously Tecnoteca wrote:

Hi,
the connector can't retreive the files needed for configuration.

I think you have something wrong in your file structure.

This is the right structure:
.
|-- ${configuration-folder-name}
|   |
|   |--conf
|   |    |
|   |    |-- repository
|   |    |       |
|   |    |       |--conf
|   |    |       |    |-- policy.xml
|   |    |       |
|   |    |       |-- modules
|   |    |            |--rampart.mar
|   |    |
|   |    |--cmdbuild-schema.xml
|   |    |--configuration.xml
|   |    |--transform.xsl
|   |    
|   |-- logs
|        |--ExternalConnector.log
|        |--log4j.conf
|
|-- ExternalConnector.1.4.0.jar
When you have this exact configuration place yourself in the directory in which you have the ExternalConnector.1.4.0.jar and then type:

java -jar ExternalConnector.1.4.0.jar ${configuration-folder-name} ImportOCS

Obviously ${configuration-folder-name} means that you can give the folder the name you prefer.

Best regards,

Tecnoteca

tecnoteca · July 22, 2013, 7:22am

Hi, it's seems all ok. Now in the process class you should see all the process instances for the sychronized computer.

Pressing modify & advance you will confirm the change.

If you want to avoid the manual confirmation you have to write:

java -jar ExternalConnector.1.4.0.jar . ImportOCS completeTrask=true

cjardin · July 22, 2013, 8:51am

Hello,

I tried : java -jar ExternalConnector.1.3.1.0.jar . ImportOCS CompleteTask=true

But without succes :(

I still have "Fault occurred while processing."

in the external connector log. And nothing in the cmdbuild interface.

Thanks for the help.

BR

nb : I don't know if it's important to tell but previously theses options -XX:PermSize=256m -XX:MaxPermSize=512m has been needed to upload the XPDL file.

Previously Tecnoteca wrote:

Hi, it's seems all ok. Now in the process class you should see all the process instances for the sychronized computer.

Pressing modify & advance you will confirm the change.

If you want to avoid the manual confirmation you have to write:

java -jar ExternalConnector.1.4.0.jar . ImportOCS completeTrask=true

pawel.domanski · July 22, 2013, 1:38pm

Previously Tecnoteca wrote:

Hi, it's seems all ok. Now in the process class you should see all the process instances for the sychronized computer.

Pressing modify & advance you will confirm the change.

If you want to avoid the manual confirmation you have to write:

java -jar ExternalConnector.1.4.0.jar . ImportOCS completeTrask=true

Everything is ok for me. Process is status completed but I haven`t any data in CMDB.

Please help.

tecnoteca · July 22, 2013, 1:48pm

Please read our previous post more carefully.

Inside the process class, ImportOCS, I think, you have to see your process waiting for approval. press the modify button, and advance it.

Or execute the command you used with completeTask=true.

Regards.

Previously Pawel wrote:

Previously Tecnoteca wrote:

Hi, it's seems all ok. Now in the process class you should see all the process instances for the sychronized computer.

Pressing modify & advance you will confirm the change.

If you want to avoid the manual confirmation you have to write:

java -jar ExternalConnector.1.4.0.jar . ImportOCS completeTrask=true

Everything is ok for me. Process is status completed but I haven`t any data in CMDB.

Please help.

cjardin · July 23, 2013, 8:09am

Hello,

@Pawel : have you got the same error than me in your ExternalConnector log ?

@Tecnoteca : What about this error => Fault occurred while processing.

???

In my case, i don't see my process waiting for approval.

In management interface i can see : Processes / Activity / ImportOCS (we can click on "Start ImportOCS" but nothing happens)

In Administration interface there is nothing on Class List, I only have Process / ImportOCS (with following Attributes : actionList [empty group + active + hidden + text html] / actionDetail [empty group + active + editable + text + html] / Code [null group + active + editable + string + 100] / Description [null group + active + editable + string + 250]

If someone got one idea ?

Thanks

Previously Tecnoteca wrote:

Please read our previous post more carefully.
Inside the process class, ImportOCS, I think, you have to see your process waiting for approval. press the modify button, and advance it.

Or execute the command you used with completeTask=true.

Regards.

Previously Pawel wrote:
Previously Tecnoteca wrote:

Hi, it's seems all ok. Now in the process class you should see all the process instances for the sychronized computer.

Pressing modify & advance you will confirm the change.

If you want to avoid the manual confirmation you have to write:

java -jar ExternalConnector.1.4.0.jar . ImportOCS completeTrask=true

Everything is ok for me. Process is status completed but I haven`t any data in CMDB.

Please help.

tecnoteca · July 23, 2013, 8:26am

Cjardin,

please check inside the xpdl file if the username and the password are ok for your CMDBuild instance.

I guess that now is working with the standard: admin/admin, and maybe you have changed the password?

cjardin · July 23, 2013, 11:25am

Hello,

</DataType>

<InitialValue>usercmdbuild</InitialValue>

</DataField>

</DataType>

<InitialValue>passcmdbuild</InitialValue>

</DataField>

User / password used to log in the web interface, and used also in the workflow setup.

Error is still here.

Previously Tecnoteca wrote:

Cjardin,

please check inside the xpdl file if the username and the password are ok for your CMDBuild instance.

I guess that now is working with the standard: admin/admin, and maybe you have changed the password?

cjardin · July 25, 2013, 4:23pm

The server has been totally reinstalled.

(using the same docs)

xpdl used is the one in your ExternalConnector-1.4.0 zip file.

ImportOCS_Shark2.3.xpdl renammed in ImportOCS.xpdl before the upload (from the web interface)

Now we got this "message" in ExternalConnector.log

=> cannot update process for className 'ImportOCS' and cardId '0'

Still no value in the web interface.

Another idea ?

Thanks

PS : Full ExternalConnector.log =>

>>> Program Started - version (ExternalConnector 1.4.0 - 22/11/2011)<<<

Searching for: ./conf/configuration.xml

Parsing XML file [./conf/configuration.xml]

Ended to read configuration file

Reading the transform file.

Parsing XML file [./conf/cmdbuild-schema.xml]

Total objects to check: 4

Reading card nr. 1 - Code: NA

keyNode name is: devicewith id:3

New master card [Code: NA]

A new item has been detected [card master is Computer.Code: NA]

cannot update process for className 'ImportOCS' and cardId '0'

Reading card nr. 2 - Code: NA

keyNode name is: devicewith id:4

New master card [Code: NA]

A new item has been detected [card master is Computer.Code: NA]

cannot update process for className 'ImportOCS' and cardId '0'

Reading card nr. 3 - Code: QUAL

keyNode name is: devicewith id:1

New master card [Code: QUAL]

A new item has been detected [card master is Computer.Code: QUAL]

cannot update process for className 'ImportOCS' and cardId '0'

Reading card nr. 4 - Code: QUAL

keyNode name is: devicewith id:2

New master card [Code: QUAL]

A new item has been detected [card master is Computer.Code: QUAL]

cannot update process for className 'ImportOCS' and cardId '0'

>>> Program Terminated <<<

cjardin · July 26, 2013, 10:11am

Hello,

Please find the Extract of the cmdbuild log =>

INFO 2013-07-26 12:04:57 [cmdbuild] Trying to login user workflow with group null

INFO 2013-07-26 12:04:57 [cmdbuild] creating guest filter for user 'workflow' with type 'APPLICATION'

WARN 2013-07-26 12:04:57 [cmdbuild] cannot apply filter, user is not guest

INFO 2013-07-26 12:04:57 [cmdbuild] Trying to login user workflow with group null

INFO 2013-07-26 12:04:58 [workflow] getting process classe with name 'ImportOCS'

INFO 2013-07-26 12:04:58 [workflow] starting process for class 'ImportOCS'

INFO 2013-07-26 12:04:58 [workflow] pushing event 'WorkflowEvent[type=START,processDefinitionId=Process_importocs,processInstanceId=304_Package_importocs_Process_importocs]' for session '12'

INFO 2013-07-26 12:04:58 [workflow] pushing event 'WorkflowEvent[type=UPDATE,processDefinitionId=Process_importocs,processInstanceId=304_Package_importocs_Process_importocs]' for session '12'

WARN 2013-07-26 12:04:58 [org.apache.cxf.phase.PhaseInterceptorChain] Application {http://soap.services.cmdbuild.org}WebservicesImplService#{http://soap.services.cmdbuild.org}startWorkflow has thrown exception, unwinding now

org.apache.cxf.interceptor.Fault

at org.apache.cxf.service.invoker.AbstractInvoker.createFault(AbstractInvoker.java:155)

at org.apache.cxf.jaxws.AbstractJAXWSMethodInvoker.createFault(AbstractJAXWSMethodInvoker.java:86)

at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:121)

at org.apache.cxf.jaxws.JAXWSMethodInvoker.invoke(JAXWSMethodInvoker.java:61)

at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:75)

at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58)

at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)

at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)

at java.util.concurrent.FutureTask.run(Unknown Source)

at org.apache.cxf.workqueue.SynchronousExecutor.execute(SynchronousExecutor.java:37)

at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:106)

at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:255)

at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:113)

at org.apache.cxf.transport.servlet.ServletDestination.invoke(ServletDestination.java:102)

at org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:464)

at org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:149)

at org.apache.cxf.transport.servlet.AbstractCXFServlet.invoke(AbstractCXFServlet.java:148)

at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:179)

at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:103)

at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)

at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:159)

at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)