cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

This product reached the end of support date on March 31, 2021.

IBM WebSphere 8.5.5 Agent Installation Issue

mohit_gupta
Inactive

Hi All,

I am trying to configure Websphere 8.5.5 with Dynatrace I have installed Dynatrace agent using the jar file for AIX 64bit os and provided the agent installation path (argument) in JVM arguments using the WebSphere console but the agent is not loading or connection to the collector server throwing the following errors

<vmarg name="-agentpath:/IBMWAS/dynatrace/dynatrace-7.0/agent/lib64/libdtagent.so=name=Conn***,server=10.2****:9998" /> ERROR: Detection of dynaTrace Agent library path failed: Either set the library path to "<dynaTrace base directory>/agent/lib64" 2018-07-27 15:09:54 [00000102] info [native] Loading collector peer list from /tmp/dynaTrace/agent/conf/collectorlist.Connect_*** 2018-07-27 15:09:54 [00000102] info [native] Dynatrace Bootstrap Agent 7.0.12.1011 ERROR: Detection of dynaTrace Agent library path failed: Either set the library path to "<dynaTrace base directory>/agent/lib64"

Agent Logs

root@COL:/tmp/dynaTrace/log#cat dt_Conn***_bootstrap_20709456.0.log 2018-07-27 15:47:33 [00000102] info [native] Loading collector peer list from /tmp/dynaTrace/agent/conf/collectorlist.Conne**** 2018-07-27 15:47:33 [00000102] info [native] 0 entries loaded 2018-07-27 15:47:33 [00000102] warning [native] Could not retrieve command line 2018-07-27 15:47:33 [00000102] info [native] Dynatrace Bootstrap Agent 7.0.12.1011 2018-07-27 15:47:33 [00000102] info [native] Could not read persisted endpoint urls: A file or directory in the path name does not exist. 2018-07-27 15:47:33 [00000102] severe [native] Caught exception at src/technology/java/jvmti/JvmtiAgentBootstrap.cpp:92 - Could not find specified s ocket in poll list.


11 REPLIES 11

Hi Mohit,

Can you paste snapshot of the installation path of the Appmon Java agent directory and also the arguments added into the JVM startup

Regards,

Ravi


Java version

java version "1.5.0"
Java(TM) 2 Runtime Environment, Standard Edition (build pap32devifx-20151009 (SR16 FP14 ))
IBM J9 VM (build 2.3, J2RE 1.5.0 IBM J9 2.3 AIX ppc-32 j9vmap3223ifx-20150401 (JIT enabled)
J9VM - 20150323_240985_bHdSMr
JIT - 20130920_46470ifx2_r8
GC - 20141118_AA)
JCL - 20151009

previously I was using java 64bit agent but after identifying that it is 32bit i installed the Java 32 bit agent but the outcome was same

Also as requested

Jvm arguments

-Dmtp.appdata.root=/IBMWAS/con*******/misys/appdata -Djava.io.tmpdir=/IBMWAS/con*****/misys/appdata/tmp -agentpath:/IBMWAS/dynatrace/dynatrace-7.0/agent/lib64/libdtagent.so=name=App,server=10.2*.**.***:9998


Hi Mohit,

Just want to make sure, have you used diff path as argument in the JVM while you testing the 32bit

If it's 32 bit agent then JVM argument should be as like below you have to replace lib64 with lib

-agentpath:/IBMWAS/dynatrace/dynatrace7.0/agent/lib/

libdtagent.so=name=App,server=10.2..***:9998

as from the log what is see the mentioned file doesn't exist.

Also I could see you have installed the agent with the root privileges, as it is not suppose to be used root for installing the agent, please use the application user for installing the same and add the arguments to the JVM and restart the app.

https://www.dynatrace.com/support/doc/appmon/short...

HTH,

Ravi


Hi Ravi,

Thanks for the suggestions I will try to install the agent as application user today and let you know if this will work

Also, I tried both lib64 and lib directory in the argument and the application is only working with the lib64 directory only, not with the lib directory.


Hi Ravi,

Little update: updated the java version from 32bit to 36bit

now the AIX os is 64bit, java is 64bit and the application is 64bit

I tried all your suggestions like install Dynatrace agent using application user but still getting the same error

provided full read-write access to the Dynatrace home folder

The server is running fine after passing the Dynatrace agent argument but the agent is not loading

The following error is logged in native_stderr file


aix/GetAgentPath(): cannot open file /proc/9568290/map; error 2/A file or directory in the path name does not exist. ERROR: Detection of dynaTrace Agent library path failed: Either set the library path to "<dynaTrace base directory>/agent/lib64" or set the environment variable DT_HOME to specify the base directory explicitly 2018-07-31 16:23:50 [00000102] info [native] Loading collector peer list from /tmp/dynaTrace/agent/conf/collectorlist.Connect_App_77 2018-07-31 16:23:50 [00000102] info [native] 0 entries loaded 2018-07-31 16:23:50 [00000102] warning [native] Could not retrieve command line 2018-07-31 16:23:50 [00000102] info [native] Dynatrace Bootstrap Agent 7.0.12.1011 2018-07-31 16:23:50 [00000102] info [native] Could not read persisted endpoint urls: A file or directory in the path name does not exist. aix/GetAgentPath(): cannot open file /proc/9568290/map; error 2/A file or directory in the path name does not exist. ERROR: Detection of dynaTrace Agent library path failed: Either set the library path to "<dynaTrace base directory>/agent/lib64" or set the environment variable DT_HOME to specify the base directory explicitly 2018-07-31 16:23:50 [00000102] severe [native] Caught exception at src/technology/java/jvmti/JvmtiAgentBootstrap.cpp:92 - Could not find specified socket in poll list.


Here DThome is perfectly defined in init.d as stated in the error log


Hi Mohit,

Appreciate your effort in re-doing this task, as you confirmed earlier the below three steps has been verified. But, however I want to re-check the below points if missed any and provide me the necessary details mentioned.

Root causes of the error:

1. The path specification is incorrect (typo or file does not exist).

- provide me the path of dt agent installed and also the variable which you have mentioned in the Websphere console.

Note: I hope you have added the JVM arguments in the correct JVM instance, which you are restarting.

2. You do not have adequate permission for the file or path.

- Paste me the snapshot of the directory like below

3. The library is not the correct version for your OS platform.

-Even more subtle is if your OS is 64-bit but your application is running in 32-bit then you need the 32-bit version of the library.

- You can use the "file" command on Linux/UNIX/AIX to determine the library file type and ensure it matches your JVM and application, as executed in the above snapshot, paste the results

Regards,

Ravi Kumar


Hi Ravi thanks for your time

As mentioned earlier we are using the 64bit library as the application is running with 64bit arch along with this we have only one cluster currently up and running in which I am trying to install the Dynatrace agent.

Attaching native-stderr.log file for more analysis in this you can find the agent argument passing to the JVM

for point 2 and 3 please find the below snapshot


Hi Ravi,

please provide your inputs should I go for a support ticket?


Hi Mohit,

As I was referring some articles based on the error log so, It got delayed.

Below are my suggestions..

1)Error : src/technology/java/jvmti/JvmtiAgentBootstrap.cpp:92 and cannot open file /proc

- . One of the Dynatrace user mentioned that /proc was not mounted so they were facing this issues which got fixed post mounting the same.

Reference: https://answers.dynatrace.com/comments/198236/view.html

2) Error : 0 entries loaded and Could not retrieve command line

- Also, I could see the collector IP in the argument is mentioned with **, hope it is intentionally edited by you as it's been shared on community.

If not, please correct the collector IP and try restarting the App

"-agentpath:/IBMWAS/dynatrace/dynatrace-7.0/agent/lib64/libdtagent.so=name=Connect_App_77,server=10.27.**.**:9998"

3) Have you tested the port by telnet from the agent to the collector server

on Agent server:$ telnet collector_IP 9998

If you get the result as connected then there is no port issues from the collector to the agent if not you need to work with SA and network team

4) System requirements - Important

  • IBM JVM should be at 6/7/8 for supporting on AIX servers
  • For Websphere Application Server the IBM JVM should be at 7

As I could see your application JVM is running with 5, so you might need to upgrade you JVM as well.

JVM's Supported on the AIX

Yes, if you feel immediate assistance check with the support team as well.

Regards,

Ravi Kumar


Thanks a ton, Ravi

The Issue got resolved by mounting /proc mount point it was not mounted previously now it's loaded and connected successfully.


Awesome good to hear that Mohit... 🙂