Security Architecture – The Importance of Securing Your Enterprise Data on Hadoop

Corporations today are clearly making significant investments in Big Data and Hadoop-based data platforms. They are doing this to primarily increase their level of customer service by developing advanced analytics capabilities. Of utmost importance to enterprises, but not usually top of mind during transformative Big Data implementations, is security.

Security Architecture Safeguards EDLs

Enterprise Data Lakes (EDLs) usually contain a variety of sensitive customer and business information, including credit card data, customer data, sales information, etc. Furthermore, some data categories are subject to regulations and privacy rules, such as PCI and HIPPA. Due to the sheer breadth of data being ingested, as well as the ability for a wide range of users and consuming applications to access to EDL data, it has become extremely critical for corporations to safeguard their EDLs.

Thankfully, various security technologies can be applied to Hadoop-based platforms and infrastructure. The list is long: Hardened OS, LDAP, Kerberos based authentication, Encryption in flight and at rest, Firewalls, Audit, Monitor, Detection, etc., to name a few. However, no access control security framework currently exists in the industry that unifies Hadoop services, resources and permission provision for an enterprise.

How Does Next Pathway's Security Architecture Work

Next Pathway has defined such an access control security framework that can leverage existing access provisioning, attestation and management processes from an enterprise. The provisioning and management processes are designed based upon data ownership according to data classification, which is defined by the enterprise security policy.

Our framework uses a single scheme to control the access on various Hadoop resources such as HDFS, Hive, and YARN. It can also flexibly support application/organization structure for data ownership and permission provisioning, Data Lake access privileges, and service privileges.

Enterprises need to carefully review their security needs with respect to Big Data, and this needs to be top of the list during any Big Data implementation.

Next Pathway is one of North America’s leading Big Data technology firms. Contact Chetan Mathur, CEO cmathur@54.191.168.181 for further information.