topic How to upgrade Apache Spark v2.2.0 to 2.4.3 in RUCKUS Cloud

How to upgrade Apache Spark v2.2.0 to 2.4.3

rojen_subedi — Wed, 17 Jul 2019 23:33:29 GMT

current version of sci is running on centos running apache v2.2. I would like to know how to upgrade apache spark2.4.3

Here's the current system info:

NAME="CentOS Linux"
VERSION="7 (Core)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (Core)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/";
BUG_REPORT_URL="https://bugs.centos.org/";

CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"

root@master- ~ #

Re: How to upgrade Apache Spark v2.2.0 to 2.4.3

see_ho_ting — Fri, 19 Jul 2019 04:31:30 GMT

Hi RS,

Unfortunately, you will not be able to upgrade Spark individually due to dependencies on other components.

We regularly update the software components within SCI, so the best thing for you to do is to always upgrade to the latest SCI version 🙂

Thanks!
See Ho

Re: How to upgrade Apache Spark v2.2.0 to 2.4.3

rojen_subedi — Fri, 19 Jul 2019 05:55:28 GMT

We are on the latest version. There’s security issues/concerns on the Apache version. When can we expect this fix?

Re: How to upgrade Apache Spark v2.2.0 to 2.4.3

see_ho_ting — Sun, 21 Jul 2019 05:39:36 GMT

Hi RS,

We are constantly monitoring the security vulnerabilities in the various software components in SCI, and striking a balance between updates and compatibility/stability.

In the meantime, as recommended in the installation guide, please put the SCI VM behind a firewall with only the necessary ports opened (see installation guide for more details).

Thanks!
See Ho