fail POD creation if s3fs process terminates immediately

[mssachan]

What this PR does / why we need it:
This PR is to error out POD creation where s3fs process for that POD terminates immediately when there is something wrong with s3fs parameters passed to s3fs-fuse.

Which issue(s) this PR fixes (optional, in fixes #(, fixes #<issue_number>, ...) format, will close the issue(s) when PR gets merged):
None

Special notes for your reviewer:
Tested with K8S cluster deployed in IBM Cloud Kubernetes Service(IKS).

[mssachan]

Tested in IKS(Ubuntu worker nodes):
When we used ibm.io/tls-cipher-suite: ecdhe_rsa_aes_128_gcm_sha_256 in PVC and then created POD by mounting PVC with above parameter, pod creation is now failing with below error:
Warning FailedMount 7s (x6 over 30s) kubelet, 10.177.155.166 MountVolume.SetUp failed for volume "pvc-1cfed1fd-6fe0-11e9-b702-8a7ea351a047" : mount command failed, status: Failure, reason: Error mounting volume: s3fs mount failed: s3fs process terminated.

$ kubectl describe pod test-pod-sample-postsch92 | tail -n 10
    Optional:    false
QoS Class:       BestEffort
Node-Selectors:  kubernetes.io/hostname=10.177.155.166
Tolerations:     node.kubernetes.io/not-ready:NoExecute for 300s
                 node.kubernetes.io/unreachable:NoExecute for 300s
Events:
  Type     Reason       Age               From                     Message
  ----     ------       ----              ----                     -------
  Normal   Scheduled    31s               default-scheduler        Successfully assigned default/test-pod-sample-postsch92 to 10.177.155.166
  Warning  FailedMount  7s (x6 over 30s)  kubelet, 10.177.155.166  MountVolume.SetUp failed for volume "pvc-1cfed1fd-6fe0-11e9-b702-8a7ea351a047" : mount command failed, status: Failure, reason: Error mounting volume: s3fs mount failed: s3fs process terminated.

S3fs-driver log:

{"level":"info","ts":"2019-05-06T12:48:51.937Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:Target directory before-mount: ","mode:":"drwxr-x---","uid:":0,"gid:":0,"path:":"/var/data/kubelet/pods/3f5c30cb-6ffd-11e9-a96b-b2c0cef50475/volumes/ibm~ibmc-s3fs/pvc-1cfed1fd-6fe0-11e9-b702-8a7ea351a047"}
{"level":"info","ts":"2019-05-06T12:48:51.937Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:Running s3fs","args":["bucket-mstest2224","/var/data/kubelet/pods/3f5c30cb-6ffd-11e9-a96b-b2c0cef50475/volumes/ibm~ibmc-s3fs/pvc-1cfed1fd-6fe0-11e9-b702-8a7ea351a047","-o","multireq_max=20","-o","cipher_suites=ecdhe_rsa_aes_128_gcm_sha_256","-o","use_path_request_style","-o","passwd_file=/var/lib/ibmc-s3fs/c8c9b7faa818094631b2083d61e33c87984b3938cbf55af37151d5dc150183de/passwd","-o","url=https://s3.us-south.cloud-object-storage.appdomain.cloud","-o","endpoint=us-south-standard","-o","parallel_count=2","-o","multipart_size=16","-o","dbglevel=warn","-o","max_stat_cache_size=100000","-o","allow_other","-o","max_background=1000","-o","mp_umask=002","-o","instance_name=/var/data/kubelet/pods/3f5c30cb-6ffd-11e9-a96b-b2c0cef50475/volumes/ibm~ibmc-s3fs/pvc-1cfed1fd-6fe0-11e9-b702-8a7ea351a047","-o","retries=5","-o","kernel_cache","-o","default_acl="]}
{"level":"info","ts":"2019-05-06T12:48:51.946Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:S3FS-Fuse info:","Version":"Amazon Simple Storage Service File System V1.85 (commit:befc2e9) with OpenSSL"}
{"level":"info","ts":"2019-05-06T12:48:51.946Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:S3FS-Driver info:","Version":"1fa5fd53b0574eb14e8295b22b8f20dbdf15f623"}
{"level":"error","ts":"2019-05-06T12:48:52.989Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:s3fs process terminated."}
{"level":"info","ts":"2019-05-06T12:48:52.989Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:Deleting mountpoint","Mount path":"/var/lib/ibmc-s3fs/c8c9b7faa818094631b2083d61e33c87984b3938cbf55af37151d5dc150183de"}
{"level":"info","ts":"2019-05-06T12:48:52.989Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:Checking if path is mountpoint","Pathname":"/var/lib/ibmc-s3fs/c8c9b7faa818094631b2083d61e33c87984b3938cbf55af37151d5dc150183de"}
{"level":"info","ts":"2019-05-06T12:48:52.993Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:Path is a mountpoint","Pathname":"/var/lib/ibmc-s3fs/c8c9b7faa818094631b2083d61e33c87984b3938cbf55af37151d5dc150183de"}
{"level":"info","ts":"2019-05-06T12:48:52.993Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:Calling unmount","Mount path":"/var/lib/ibmc-s3fs/c8c9b7faa818094631b2083d61e33c87984b3938cbf55af37151d5dc150183de"}
{"level":"info","ts":"2019-05-06T12:48:53.011Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:Deleting directory","Mount path":"/var/lib/ibmc-s3fs/c8c9b7faa818094631b2083d61e33c87984b3938cbf55af37151d5dc150183de"}
{"level":"info","ts":"2019-05-06T12:48:53.011Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:Error mounting volume","err":{}}
{"level":"info","ts":"2019-05-06T12:48:53.011Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:S3fsPlugin-Mount()-end"}
{"level":"info","ts":"2019-05-06T12:48:53.011Z","msg":"3f5c30cb-6ffd-11e9-a96b-b2c0cef50475:MountCommand End","response":{"status":"Failure","message":"Error mounting volume: s3fs mount failed: s3fs process terminated.","capabilities":{"attach":false,"fsGroup":false}}}
{"level":"info","ts":"2019-05-06T12:48:53.012Z","msg":":FlexVolumeResponse","output":"{\"status\":\"Failure\",\"message\":\"Error mounting volume: s3fs mount failed: s3fs process terminated.\",\"capabilities\":{\"attach\":false,\"fsGroup\":false}}"}