Nimble Storage解決方案詳解

1、Nimble Storage 解決方案詳解目錄Multicloud Flash Fabric 核心技術(shù)詳解Nimble OS 操作系統(tǒng)系統(tǒng)配置規(guī)格InfoSight信息分析預(yù)測(cè)平臺(tái)架構(gòu)使用案例Secondary FlashNimble Storage解決方案總覽All FlashAdaptive Flash跨云閃存融合架構(gòu) Multicloud Flash Fabric應(yīng)用需求通用數(shù)據(jù)管理服務(wù) Technology Foundation Ecosystem Integration and AlliancesInfoSight信息分析預(yù)測(cè)平臺(tái)Cloud Volumes技術(shù)基礎(chǔ)CPU 驅(qū)動(dòng)性能盤數(shù)

2、與性能關(guān)聯(lián)SSDs 的特性是寫比讀慢CPU 驅(qū)動(dòng)的性能讀寫平衡摩爾定律驅(qū)動(dòng)了CPU核的密度Cost / IOPS (core) 持續(xù)下降Cost / IOPS盤的容量在增長, 但不是IOPSCost / IOPS 沒有變化Cost / IOPSCPU驅(qū)動(dòng)性能CPUNimbleOSShared Foundation for AFA and Adaptive ArraysNimble Adaptive Flash ArrayNimble All Flash ArraySeq Layout on Flash(Read cache)VariableBlock InlineCompressionWrit

3、esReads8K4K8K4K4K4KSequential layout on diskVariableBlock InlineCompressionWritesReadsSequential layout on flashVariableBlock InlineDedupeNVRAMwrite cacheNVRAMwrite cache8K4K8K4K4K4KNimbleOSShared Foundation for AFA and Adaptive ArraysVariableBlock InlineCompressionWritesReadsVariableBlock InlineCom

4、pressionWritesReadsVariableBlock InlineDedupe8K4K8K4K4K4KSequential layout on flashSequential layout on diskSeq Layout on Flash(Read cache)8K4K8K4K4K4KNVRAMwrite cacheNVRAMwrite cacheNimble Adaptive Flash ArrayNimble All Flash ArrayNimbleOSShared Foundation for AFA and Adaptive ArraysSeq Layout on F

5、lash(Read cache)VariableBlock InlineCompressionWritesReadsVariableBlock InlineCompressionWritesReadsVariableBlock InlineDedupeSequential layout on diskSequential layout on flashNVRAMwrite cacheNVRAMwrite cacheNimble Adaptive Flash ArrayNimble All Flash ArrayBenefits of NimbleOS Sequential LayoutTrad

6、itional LayoutNimbleOSHDD Write Performance Compression & Dedupe Efficient Performance (IOPS) ScalingSSD Wear-out From Write Amplification100 IOPS10,000 IOPS10 x (short life)Slot-constrainedScales with SSD/spindle countSlot-freeCPUCPUCPUScales with CPU cores1x (long life)先進(jìn)的緩存算法Nimble Storage的SSD Ca

7、che技術(shù)Nimble SSD Cache的數(shù)據(jù)主要來源為Meta、Index主動(dòng)預(yù)存數(shù)據(jù)后續(xù)策略更新卷組強(qiáng)制設(shè)置(Pinning鎖定，No Caching 無Cache，Normal 默認(rèn)等)傳統(tǒng)的SSD Cache更新算法先進(jìn)先出策略 (FIFO First-In First-Out) 優(yōu)點(diǎn)：設(shè)置簡單、效率較好、對(duì)大多數(shù)應(yīng)用場(chǎng)景適用 問題：對(duì)一些高命中度需求場(chǎng)景不適用、對(duì)選定數(shù)據(jù)鎖定不適用、對(duì)Index數(shù)據(jù)無差異對(duì)待Nimble Storage的SSD Cache更新算法基于數(shù)據(jù)訪問熱度的SSD Cache更新策略 (ABE, Access Based Eviction)使用系統(tǒng)內(nèi)存保存、

8、維護(hù)“Cache數(shù)據(jù)塊熱度表” 對(duì)SSD Cache中每個(gè)數(shù)據(jù)塊的訪問熱度進(jìn)行實(shí)時(shí)跟蹤極端的例子包括“鎖定數(shù)據(jù)塊”和“最冷數(shù)據(jù)塊”，最“冷”的數(shù)據(jù)塊會(huì)予以最先驅(qū)除優(yōu)點(diǎn)：運(yùn)行高效、對(duì)Cache數(shù)據(jù)的管理更加精細(xì)，可對(duì)選定數(shù)據(jù)塊保證100%的命中度，如鎖定數(shù)據(jù)、Index數(shù)據(jù)152153365141401120415913155851578915119983131511命中度越高，IOPS值越高命中度越高，越難以繼續(xù)提高。但細(xì)微的提高會(huì)帶來IOPS的顯著增加全面的數(shù)據(jù)消減還有更多：Thin provisioning & Zero copy clones變長數(shù)據(jù)塊在線去重變長數(shù)據(jù)庫在線壓縮0數(shù)據(jù)消除

9、5X 或更多 數(shù)據(jù)消減數(shù)據(jù)消減性能不減總結(jié)：CASL架構(gòu)帶來的收益 2-5x 更優(yōu)的性能/價(jià)格比 2-5x 更優(yōu)的容量/價(jià)格比 4x 減少占地空間，電源和冷卻開銷32K4K8K4K8K4K通常情況在線壓縮: 節(jié)省 30-75%變長數(shù)據(jù)塊讓在線壓縮速度更快避免了讀取-修改-寫人的模式，壓縮可以適用于所有應(yīng)用寫優(yōu)化布局: 100 x 寫入速度確保隨機(jī)寫入聚合成順序、完整條帶寫入。打破了傳統(tǒng)技術(shù)存儲(chǔ)性能對(duì)磁盤轉(zhuǎn)速和數(shù)量的依賴。聚合寫入閃存對(duì)閃存壽命提升500%DISKSSD Cache緩存智能填充 第一次寫入，讀緩存未命中元數(shù)據(jù)位于緩存中 加速所有數(shù)據(jù)訪問 動(dòng)態(tài)緩存: 50 x 讀取速度安全可靠的設(shè)

10、計(jì)一年少于96秒停機(jī)時(shí)間無中斷運(yùn)行備份間隔更短、恢復(fù)速度更快，應(yīng)用集成與一致性保障的SmartSnap & SmartReplicate集成數(shù)據(jù)保護(hù)應(yīng)用級(jí)加密和數(shù)據(jù)安全銷毀SmartSecure 加密可在同一RAID組內(nèi)任意三塊磁盤同時(shí)故障時(shí)正常訪問數(shù)據(jù)，盤內(nèi)校驗(yàn)、盤內(nèi)集成熱備盤Triple+ Parity RAID可承受同一RAID組內(nèi)同時(shí)任意3塊SSD故障內(nèi)置熱備盤可承受第四塊盤故障 盤內(nèi)校驗(yàn)修正內(nèi)部意外數(shù)據(jù)丟失快速RAID重構(gòu)DataMetadataParity01234567891011121314151617181920212223DDDDDDDDDDDDDDDDDDDDPQRSDD

11、DDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDD

12、DDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDPQRSDDDDDDDDDDDDDDDDDDDDQRSDDDDDDDDDDDDDDDDDDDDPRSDDDDDDDDDDDDDDDDDDDDPQSDDDDDDDDDDDDDDDDDDDDPQRTriple+Parity 三校驗(yàn)+內(nèi)置熱備份盤的RAID保護(hù)技術(shù)性能無損的快照技術(shù)Unlike t

13、raditional (COW) snapshots, Nimble snapshots have no performance impactNimbleTraditional Array Nimble snapshots consume the least space due to fine snapshot granularity (and compression)Individual (variable) blocksLarge pages/extentsTimeRelative Performance Snapshot granularity:Traditional arraySnap

14、shot granularity:NimbleRetain hundreds of snapshots for frequent recovery pointsIndustry-leading snapshot space efficiency46142735數(shù)據(jù)中心主存儲(chǔ)核心指標(biāo)IO延時(shí)0.5ms0.1ms任何情況下不打折的性能集群=4x集群=4x產(chǎn)品配置規(guī)格從主存儲(chǔ)到二級(jí)存儲(chǔ)的完整產(chǎn)品線覆蓋存儲(chǔ)級(jí)別主存儲(chǔ)二級(jí)存儲(chǔ)高性能 1級(jí) & 2級(jí) 應(yīng)用任何其他的 1級(jí) & 2級(jí)應(yīng)用備份, 容災(zāi), 測(cè)試/開發(fā), 非關(guān)鍵應(yīng)用 工作負(fù)載自有數(shù)據(jù)中心和公有云服務(wù)性能IOPS容量有效 GBsAF-Series全

15、閃存CS-Series混合閃存SF-Series二級(jí)閃存所有企業(yè)級(jí)功能無需額外許可SmartSnap: 瞬時(shí), 高效, 精細(xì)顆粒 & 應(yīng)用感知Designed for 3D-NAND做的更多代價(jià)更小無需額外許可證SmartReplicate: 精細(xì)顆粒和高效復(fù)制SmartSecure: FIPS 140-2 認(rèn)證加密 (支持復(fù)制) Restore: 接近瞬時(shí)完成, 無數(shù)據(jù)移動(dòng), 減少風(fēng)險(xiǎn) Copies: 零數(shù)據(jù)移動(dòng), 精簡, 高利用率, 低成本 Reduce: 智能數(shù)據(jù)消減, 更聰明的使用空間, 更低的成本企業(yè)級(jí)功能目錄性能優(yōu)化混合閃存加速順序條帶寫入訪問質(zhì)量控制性能無損計(jì)算存儲(chǔ)效率精簡配置在

16、線變長數(shù)據(jù)塊壓縮在線變長數(shù)據(jù)塊重刪零數(shù)據(jù)拷貝克隆數(shù)據(jù)保護(hù)三盤校驗(yàn)保護(hù)性能無損快照遠(yuǎn)程數(shù)據(jù)備份復(fù)制數(shù)據(jù)加密智能管理在線多維度擴(kuò)展開放管理接口應(yīng)用感知與集成Infosight分析預(yù)測(cè)平臺(tái)AFA 硬件概覽4Ux48 機(jī)箱4U高度 支持 48 SSDs 雙SSD模塊12Gbps SAS 最多2x (4Ux48) 擴(kuò)展盤架新!新!雙冗余-X10倍性能的控制器基于Intel Haswell / Broadwell CPUsInterconnect via NTB; NVDIMM-based NVRAMNimble 雙SSD模塊提供了內(nèi)置的擴(kuò)展能力 任意SSD可在線添加/移除而沒有任何服務(wù)中斷 新!全閃存A

17、F系列盤槽位視圖- 雙SSD托架 Dual-Flash Carrier (DFC)4U Chassis24 x 3.5” Slots carry 24 DFC4U48Bank ASlot 1 Slot 2 Slot 3 Slot 4Slot 21 Slot 22 Slot 23 Slot 24Slot 17Slot 13 Slot 9 Slot 5Bank BBank ABank A 鎖扣Bank B 鎖扣DFC 鎖扣很多客戶開始只使用一組槽位即Bank A的24個(gè)槽位安裝24塊SSD盤，這種配置也可以達(dá)到系統(tǒng)標(biāo)稱性能指標(biāo)?？筛鶕?jù)需利用剩余的24個(gè)槽位進(jìn)行容量擴(kuò)充AF-Series Hardw

18、are Tour - Back3547Power SupplyPower Intel7. SAS Ports8. ControllerFansManagement Network5. Data Networks6. KVM/Serial Port1628AFS2 Connections AF7000/AF9000Support up to 2 AFS2. First AFS2 - Use P1 Second AFS2 Use P2Do not daisy chain AFS2SAS expansion port (p2)AFS2 shelves ship with 1 meter cables

19、. If you do not order a 3 meter cable you will need to install one AFS2 shelf above the controller shelf and one below. SSD容量配置容量包物理容量(TB)可用容量*(TB)可用容量比有效容量* (TB)有效容量比AF-6T (24 x 240GB SSD) 5.763.764.2%18.5321%AF-11T (24 x 480GB SSD)11.527.968.6%39.5343%AF-23T (24 x 960GB SSD) 23.0416.571.6%82.5358%

20、AF-46T (24 x 1920GB SSD) 46.0833.672.9%168365%AF-92T (24 x 3840GB SSD) 92.1667.873.6%339368%* 可用容量是盤RAID保護(hù)后的用戶可用容量 有效容量是基于5x 綜合在線數(shù)據(jù)消減容量數(shù)據(jù)是用十進(jìn)制TB. 對(duì)應(yīng)二進(jìn)制TiB 會(huì)減少約10%CS系列盤槽位視圖CS1000, CS3000, CS5000, CS70004U24 機(jī)箱24 x 3.5” 槽位安裝 21x 磁盤 + 3x DFCs磁盤: 18 + 3 RAIDNew Nimble-branded HDD carriersDFCs: 最低配置 3 SS

21、Ds in Bank ABank B 可用來做緩存擴(kuò)充Bank BBank ABank A 鎖扣Bank B 鎖扣DFC 鎖扣Cache: 3x Dual Flash Carriers盤槽位視圖CS1000HFlash Cache:2x Dual Flash Carriers第一組11x 1TB HDDs11TB容量擴(kuò)展4U24 機(jī)箱24 x 3.5” 槽位初始安裝11x 1TB HDDs + 2x DFCs; 空余11個(gè)槽位可做HDD容量升級(jí)HDDs: 8 + 3 RAID11TB capacity upgrade to 22TB rawNew Nimble-branded HDD carr

22、iersDFCs: 至少配置2 SSDs in Bank ABank B 可用于緩存容量升級(jí)CS系列容量擴(kuò)展規(guī)格說明ES2 ModelsTotal HDDsDFCBank A SSDsDFCBank B SSDsRaw Capacity (TB / TiB)Usable Capacity(TB / TiB)(no data reduction)Effective Capacity*(TB / TiB)ES2-21T21 x 1TB HDDs3 x 240GBAvailable for cache upgrades21 / 1816 / 1432 / 30ES2-42T21 x 2TB HDDs

23、1 x 240GB2 x 480GB42 / 3833 / 2966 / 61ES2-84T21 x 4TB HDDs1 x 480GB2 x 960GB84 / 7867 / 61134 / 123ES2-126T21 x 6TB HDDs2 x 960GB1 x 1920GB126 / 117101 / 92202 / 184ES2-210T21 x 10TB HDDs1 x 960GB2 x 1920GB210 / 190169 / 154337 / 308All-Flash ShelfTotal SSDsSSD 4-Packs Supported*Total Cache per Pac

24、kES2-AFS2Up to12 x SSD 4-packs4x 960GB (3.76TB)4x 1920GB (7.68TB)4x 3840GB (15.36TB)3.76TB7.68TB15.36TB* Assumes 2:1 data reduction from compression (dedupe will be supported post-GA)* ES2-AFS2 4-packs are populated by DFC banks混合閃存擴(kuò)展盤柜視圖 ES2Flash Cache: 3x Dual Flash Carriers4U24 機(jī)箱24 x 3.5” 槽位安裝 2

25、1x 磁盤 + 3x DFCs磁盤: 18 + 3 RAIDNew Nimble-branded HDD carriersDFCs: 最低配置 3 SSDs in Bank ABank B 可用來做緩存擴(kuò)充型號(hào)SF100SF300主機(jī)連接端口iSCSI and FC閃存物理容量1.3TB 8.7TB2.6TB 15.7TB數(shù)據(jù)存物理容量21TB 126 TB42 TB 252 TB可用容量16 TB 100 TB30 TB 200 TB有效容量 (8:1)800 TB1.6 PB最大讀寫 IOPS (upto)20K40K最大寫帶寬400 MB/s800 MB/sSF系列產(chǎn)品配置容量配置磁盤S

26、SD磁盤可用容量SF100SF300Controller UnitsHEAD-HDD-21TBHEAD-FLC-1440G-3 16 TBHEAD-HDD-42-TBHEAD-FLC-2880G-3 32 TBHEAD-HDD-84-TB HEAD-FLC-5760G-365 TBHEAD-HDD-126-TBHEAD-FLC-9600G-3 100 TBHEAD-HDD-210-TBHEAD-FLC-11520-3 + HEAD-FLC-5760-3165 TBExpansion ShelvesSF-ES2-H21T16 TBSF-ES2-H42T32 TBSF-ES2-H84T65 TBS

27、F-ES2-H126T100 TBSF-ES2-H210T165 TB系統(tǒng)最大可用容量100 TB200 TB磁盤與SSD的配置容量包(控制器/擴(kuò)展盤柜) 單磁盤容量SSD配置磁盤可用容量Flash與磁盤配比配比用于消重的Flash Cache用于數(shù)據(jù)訪問的Flash Cache HEAD- HDD-21TB + HEAD-FLC-1440G-3 1TB3x 480G16 TB8.60%6%2.60%HEAD-HDD-42-TB + HEAD-FLC-2880G-32TB3x 960G33 TB8.66%6%2.66%HEAD-HDD-84-TB + HEAD-FLC-5760G-34TB3x

28、 1920G66 TB 8.57%6%2.57%HEAD-HDD-126-TB + HEAD-FLC-9600G-36TB1x 1920 + 2x 384099 TB9.49%6%3.49%HEAD-HDD-210-TB + HEAD-FLC-11520G-3 + HEAD-FLC-5760G-310TB3x 3840 + 3x 1920153 TB 10.23%6%4.23%InfoSight Predictive Analytics信息分析預(yù)測(cè)服務(wù)Flash本身不能解決所有性能問題常見IO問題的幾大根本原因存儲(chǔ)設(shè)備相關(guān)12配置問題3兼容性問題4非最佳實(shí)踐造成的性能問題5主機(jī)、虛擬機(jī)、計(jì)算4

29、6%7%28%8%11%Source: InfoSight analysis across more than 7,500 customersStorageNetworkComputeVM/Container/DBInfosight解決了應(yīng)用與數(shù)據(jù)之間的隔閡PredictiveAnalytics Predictive Analytics Cross-stack sensors基于云的分析預(yù)測(cè)系統(tǒng)10,000 客戶對(duì)數(shù)百萬計(jì)的虛擬對(duì)象的持續(xù)監(jiān)測(cè)數(shù)百萬個(gè)軟/硬件傳感器在設(shè)備上持續(xù)收緊運(yùn)行狀態(tài)數(shù)據(jù)全數(shù)據(jù)人工智能機(jī)器自主學(xué)習(xí)跨架構(gòu)堆棧的數(shù)據(jù)感知InfoSight不僅僅是一個(gè)云端的用戶管理界面定制化升級(jí)

30、路線Support 運(yùn)維支持自動(dòng)化容量和性能規(guī)劃Software & Takeover 故障分析Behind-the-Scenes產(chǎn)品運(yùn)行監(jiān)控預(yù)報(bào)未來需求并給出應(yīng)對(duì)計(jì)劃準(zhǔn)確預(yù)測(cè)未來容量與性能需求給出針對(duì)長期性能優(yōu)化的指導(dǎo)預(yù)測(cè)性能熱點(diǎn)并給出如何解決消除規(guī)劃中的猜測(cè)通過使用預(yù)測(cè)性大數(shù)據(jù)分析來找到現(xiàn)有環(huán)境中的潛在熱點(diǎn)問題和未來的需求, 并據(jù)此給出長期性能優(yōu)化的指導(dǎo)關(guān)聯(lián)度為我們指示出問題所在InfoSight將存儲(chǔ)規(guī)劃化繁為簡 現(xiàn)有增長率是多少？那個(gè)應(yīng)用在使用存儲(chǔ)?我們什么時(shí)候需要做容量擴(kuò)展?我們?nèi)绾螌⑿畔⒎治龀晒仞伣o業(yè)務(wù)部門?核心內(nèi)容InfoSight VMVision提供了可以看到虛擬機(jī)層的能力超越存儲(chǔ)的廣闊視野判斷VM IO latency的構(gòu)成: 存儲(chǔ)，主機(jī)或是存儲(chǔ)網(wǎng)絡(luò)對(duì)資源占用多，影響其他VM運(yùn)行的“吵鬧鄰居VM”采用恰當(dāng)?shù)奶幹脧奈闯浞质褂每臻g的VM上回收空間。InfoSi