OnCommand Insight ElasticSearch service fails to start with an 'AccessDenied' exception

Applies to

OnCommand Insight 7.3.x

Red Hat Enterprise Linux 7.x

CentOS 7.x

Issue

When the ElasticSearch service starts it fails with an "Access Denied" exception.

• The ElasticSearch service is not running:

[root@netapp-oci-lin ~]# oci-service.sh
OnCommand (R) Insight 7.3.9

mysql...............running
elasticsearch.......not running
wildfly.............running
acquisition.........running

• When starting the service, one of the following errors can be seen from the command line interface (CLI) and when checking the journal:

[root@oci739rhel76 ~]# systemctl start elasticsearch
 Job for elasticsearch.service failed because the control process exited with error code. See "systemctl status elasticsearch.service" and "journalctl -xe" for details.

 Sep 11 19:28:27 oci739rhel76 systemd[1]: Starting Elasticsearch...
  -- Subject: Unit elasticsearch.service has begun start-up
  -- Defined-By: systemd
  -- Support:  http://lists.freedesktop.org/mailman.../systemd-devel
  -- Unit elasticsearch.service has begun starting up.
 Sep 11 19:28:27 oci739rhel76 systemd[6445]: Failed at step USER spawning /usr/share/elasticsearch/bin/elasticsearch-systemd-pre-exec: No such process
  -- Subject: Process /usr/share/elasticsearch/bin/elasticsearch-systemd-pre-exec could not be executed
  -- Defined-By: systemd
  -- Support:  http://lists.freedesktop.org/mailman.../systemd-devel
  -- The process /usr/share/elasticsearch/bin/elasticsearch-systemd-pre-exec could not be executed and failed.
  --
  -- The error number returned by this process is 3.
 Sep 11 19:28:27 oci739rhel76 systemd[1]: elasticsearch.service: control process exited, code=exited status=217
 Sep 11 19:28:27 oci739rhel76 systemd[1]: Failed to start Elasticsearch.
  -- Subject: Unit elasticsearch.service has failed
  -- Defined-By: systemd
  -- Support:  http://lists.freedesktop.org/mailman.../systemd-devel
  -- Unit elasticsearch.service has failed.
  --
  -- The result is failed.
 Sep 11 19:28:27 oci739rhel76 systemd[1]: Unit elasticsearch.service entered failed state.
 Sep 11 19:28:27 oci739rhel76 systemd[1]: elasticsearch.service failed.

-----------------------------------------------------------------------------
 [root@oci739rhel76 ~]# systemctl start elasticsearch
 [root@oci739rhel76 ~]# systemctl status elasticsearch
  ● elasticsearch.service - Elasticsearch
     Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled; vendor preset: disabled)
     Active: failed (Result: exit-code) since Tue 2018-09-11 19:54:08 EDT; 5s ago
    
 [root@oci739rhel76 ~]# journalctl -xe
 ...
 Sep 11 19:54:07 oci739rhel76 polkitd[735]: Unregistered Authentication Agent for unix-process:5469:138302 (system bus name :1.61, object path /org/freedesktop/PolicyKit1/AuthenticationA
 Sep 11 19:54:08 oci739rhel76 elasticsearch[5478]: 2018-09-11 19:54:08,124 main ERROR Could not register mbeans java.security.AccessControlException: access denied ("javax.management.MBe
 ...
 Sep 11 19:54:08 oci739rhel76 elasticsearch[5478]: Exception in thread "main" org.elasticsearch.bootstrap.BootstrapException: java.nio.file.AccessDeniedException: /etc/elasticsearch
 
-----------------------------------------------------------------------------
 [root@oci739rhel76 ~]# systemctl start elasticsearch
 [root@oci739rhel76 ~]# systemctl status elasticsearch
  ● elasticsearch.service - Elasticsearch
     Loaded: loaded (/usr/lib/systemd/system/elasticsearch.service; enabled; vendor preset: disabled)
     Active: failed (Result: exit-code) since Tue 2018-09-11 19:57:52 EDT; 3s ago
    
 [root@oci739rhel76 ~]# journalctl -xe
 ...
 Sep 11 19:57:51 oci739rhel76 elasticsearch[5836]: Exception in thread "main" org.elasticsearch.bootstrap.BootstrapException: java.nio.file.AccessDeniedException: /var/run/elasticsearch
 Sep 11 19:57:51 oci739rhel76 elasticsearch[5836]: Likely root cause: java.nio.file.AccessDeniedException: /var/run/elasticsearch