YARN/Hadoop: Bundle#1 start failed: libXt.so.6: cannot open shared object file: No such file or directory

Question

Sambit Tripathy il 10 Apr 2018

1
Link

Link diretto a questa domanda

https://it.mathworks.com/matlabcentral/answers/393945-yarn-hadoop-bundle-1-start-failed-libxt-so-6-cannot-open-shared-object-file-no-such-file-or-dire

Modificato: Tim Griffin il 24 Ago 2018

Apri in MATLAB Online

I am doing the following steps to execute compiled matlab code inside YARN

Step 1:

$mcc -m fileparsers.m -d /home/user/MatLab/fileparsers -o fileparsers

Step 2:

Step 1 produces fileparsers.sh and fileparsers(a binary file). I am copying these files to a shared location on HDFS. I have my Matlab installed

Step 3:

Next, I am putting them in a Oozie workflow and executing it.

The oozie workflow is as follows

 <workflow-app name="_matlab_check" xmlns="uri:oozie:workflow:0.5">
    <start to="shell-d892"/>
    <kill name="Kill">
        <message>Action failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
    </kill>
    <action name="shell-d892">
        <shell xmlns="uri:oozie:shell-action:0.1">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
            <exec>/projects/xxxx/code/_matlab_workflow_runtime/fileparsers.sh</exec>
              <argument>/opt/cloudera/parcels/MATLAB_Runtime/v93</argument>
              <env-var>MCR_CACHE_ROOT=/home/user/tmp</env-var>
            <file>/projects/xxxx/code/_matlab_workflow_runtime/fileparsers.sh#fileparsers.sh</file>
            <file>/projects/xxxx/code/_matlab_workflow_runtime/fileparsers#fileparsers</file>
              <capture-output/>
        </shell>
        <ok to="End"/>
        <error to="Kill"/>
    </action>
    <end name="End"/>
</workflow-app>

Step 4:

I am getting the following error

     Log Upload Time: Tue Apr 10 17:04:21 +0200 2018
                Log Length: 5688
              Bundle#1 start failed: libXt.so.6: cannot open shared object file: No such file or directoryCould not create on-disk crash report: failed opening file: Permission denied
    ------------------------------------------------------------------------
           Segmentation violation detected at Tue Apr 10 17:04:14 2018
    ------------------------------------------------------------------------
    Configuration:
      Crash Decoding      : Disabled - No sandbox or build area path
      Crash Mode          : continue (default)
      Default Encoding    : UTF-8
      GNU C Library       : 2.17 stable
      Host Name           : lol-lmao
      MATLAB Architecture : glnxa64
      MATLAB Root         : /opt/cloudera/parcels/MATLAB_Runtime-R2017b/v93
      MATLAB Version      : 9.3.0.713579 (R2017b)
      Operating System    : Linux 3.10.0-693.17.1.el7.x86_64 #1 SMP Sun Jan 14 10:36:03 EST 2018 x86_64
      Processor ID        : x86 Family 6 Model 79 Stepping 1, GenuineIntel
    Fault Count: 1
    Abnormal termination:
    Segmentation violation
    Register State (from fault):
      RAX = 0000000000000000  RBX = 00007ffee4d62ac0
      RCX = 0000000000000000  RDX = 0000000000000001
      RSP = 00007ffee4d62a20  RBP = 00007ffee4d62a40
      RSI = 00000000000000d8  RDI = 00007ffee4d62ad8
       R8 = 00007ffee4d62c80   R9 = 0000000000000001
      R10 = 0000000000000004  R11 = 00007f18263ae6d0
      R12 = 0000000000000001  R13 = 0000000000842c20
      R14 = 00007ffee4d62ad8  R15 = 00007ffee4d62ac0
      RIP = 00007f181db69c9e  EFL = 0000000000010202
       CS = 0033   FS = 0000   GS = 0000
    Stack Trace (from fault):
    [  0] 0x00007f181db69c9e                 bin/glnxa64/libmwfoundation_usm.so+00056478 _ZN10foundation3usm10management10thisthread16ContextActivatorC1INS0_5scope3MvmEEERNS1_7ContextIT_EE+00000014
    [  1] 0x00007f1815f71c36                            bin/glnxa64/libmwmcr.so+00457782
    [  2] 0x00007f1815fa80df                            bin/glnxa64/libmwmcr.so+00680159 _ZN11mcrInstance27feval_on_interpreter_threadEPKciPP11mxArray_tagiS4_+00000063
    [  3] 0x00007f1815fac051                            bin/glnxa64/libmwmcr.so+00696401 _ZN11mcrInstance18CallMATLABFunctionEPKciPP11mxArray_tagiS4_PNSt15__exception_ptr13exception_ptrE+00000129
    [  4] 0x00007f1815fac293                            bin/glnxa64/libmwmcr.so+00696979 _ZN11mcrInstance10EvalStringERKSbIDsSt11char_traitsIDsESaIDsEEiPP11mxArray_tag+00000131
    [  5] 0x00007f1815fac352                            bin/glnxa64/libmwmcr.so+00697170 _ZN11mcrInstance14clearAllOnExitEv+00000050
    [  6] 0x00007f1815fac5a8                            bin/glnxa64/libmwmcr.so+00697768 _ZN11mcrInstance6DetachEPS_+00000296
    [  7] 0x00007f18044daa1e                       bin/glnxa64/libmwMVMLocal.so+00330270 _ZN10mvm_server6inproc8LocalMVM9terminateEv+00000126
    [  8] 0x00007f1815c0ac82                            bin/glnxa64/libmwmvm.so+02247810 _ZN3mvm6detail14DefaultSession20terminateFactoryMVMsERKNS_7Factory2IDE+00000258
    [  9] 0x00007f1815be98ab                            bin/glnxa64/libmwmvm.so+02111659 _ZN3mvm6detail14DefaultFactory16protectedReleaseEv+00000059
    [ 10] 0x00007f18044ecb04                       bin/glnxa64/libmwMVMLocal.so+00404228 _ZN10mvm_server6inproc12LocalFactory9terminateEv+00000068
    [ 11] 0x00007f18044f0a45                       bin/glnxa64/libmwMVMLocal.so+00420421
    [ 12] 0x00007f1815c4ae8c                            bin/glnxa64/libmwmvm.so+02510476
    [ 13] 0x00007f1815bb9736                            bin/glnxa64/libmwmvm.so+01914678 _ZN3mvm14ProcessSession9terminateEv+00000022
    [ 14] 0x00007f18162425b7                        bin/glnxa64/libmwmclbase.so+00206263 _Z27mclTerminateApplicationImplv+00000103
    [ 15] 0x00007f180516dafe                         bin/glnxa64/libmwmclmcr.so+02202366
    [ 16] 0x00007f181626e240                        bin/glnxa64/libmwmclbase.so+00385600
    [ 17] 0x00007f18044f7735                       bin/glnxa64/libmwMVMLocal.so+00448309 _ZN5boost6detail8function21function_obj_invoker0INS_3_bi6bind_tINS3_11unspecifiedENS_9function1IiRKSt6vectorISbIDsSt11char_traitsIDsESaIDsEESaISB_EEEENS3_5list1INS3_5valueISD_EEEEEEiE6invokeERNS1_15function_bufferE+00000037
    [ 18] 0x00007f1815f91239                            bin/glnxa64/libmwmcr.so+00586297
    [ 19] 0x00007f1815f91788                            bin/glnxa64/libmwmcr.so+00587656
    [ 20] 0x00007f1815f91a93                            bin/glnxa64/libmwmcr.so+00588435 _Z12mcr_run_mainRKN5boost9function0IiEEbb+00000243
    [ 21] 0x00007f18044f25a8                       bin/glnxa64/libmwMVMLocal.so+00427432
    [ 22] 0x00007f1815c4a38d                            bin/glnxa64/libmwmvm.so+02507661
    [ 23] 0x00007f181626e6bd                        bin/glnxa64/libmwmclbase.so+00386749 mclRunMain+00000989
    [ 24] 0x00007f180516af02                         bin/glnxa64/libmwmclmcr.so+02191106 mclStandaloneGenericMain+00001074
    [ 25] 0x00007f1826d3cbd2                   bin/glnxa64/libmwlaunchermain.so+00048082
    [ 26] 0x0000000000408b06                             ./fileparsers+00035590
    [ 27] 0x00007f182624bc05                                   /lib64/libc.so.6+00138245 __libc_start_main+00000245
    [ 28] 0x0000000000404544                             ./fileparsers+00017732
    [ 29] 0x0000000000000000                                   <unknown-module>+00000000
    If this problem is reproducible, please submit a Service Request via:
        http://www.mathworks.com/support/contact_us/
    A technical support engineer might contact you with further information.
    Thank you for your help.
    MATLAB is exiting because of fatal error
    ./fileparsers.sh: line 30: 27040 Killed                  "./fileparsers"
    Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1]