CHT Project
Progress Report
11/18 Simon
CHT Project
Develop a resource management sche duling algorithm for CHT datacente r.
◦Two types of jobs, interactive/latenc y-sensitive and batch/computation-int ensive.
◦Minimize SLA violation with limited r esources.
# of servers
◦Based on Red Hat Openshift
Current Plan
Two components
◦Scheduler
Deploy container/pod to server
Inside Kubernetes
◦Container Scaler
Decide the number of container/pod for eac h service.
Output the results in JSON
As an input of the scheduler
Container Scaler
Decide the number of container/pod for each service according to the monitoring data.
◦Ex: add one container if the average CPU utilization is higher than 85%.
Add/adjust rules to make better de
cisions.
Adjust According to Monito r
If the QoS of an application can b e measured from the monitor.
◦Add container according to the QoS.
◦Ex: if the average response time is ov er 80% of the SLA, add new container.
If not, need to “derive” from th e monitoring data.
◦Ex: if the CPU utilization over 75% an d the network I/O is larger than 800Mb ps, add new container.
量測資料
資料包含效能數據
比較目前效能及 SLA
效能 >
SLA*0.9
利用硬體資源使用 率，推測目前效能
根據硬體資源使用 率，推測增加容器
數量 開始
以 json 格式寫入輸出檔
結束 紀錄服務目前容器
數量
處理完所有服務 更新容器數量
根據硬體資源使用 率，判斷是否可減
少容器數量
F T
T
T F
F
量測資料
資料包含效能數據
比較目前效能及 SLA
效能 >
SLA*0.9
利用硬體資源使用 率，推測目前效能
根據硬體資源使用 率，推測增加容器
數量 開始
以 json 格式寫入輸出檔
結束 紀錄服務目前容器
數量
處理完所有服務 更新容器數量
根據硬體資源使用 率，判斷是否可減
少容器數量
F T
T
T F
F
Utilization of key resource, regression,
SVM,
…etc
Improving the Rules
Apply data analysis techniques to improve the derivation.
◦SVM(Support Vector Machine)
Find the hyper-plane that separate the dat a points into “safe” and “violation”.
Add containers for those applications being clas sified into “violation”.
Find another hyper-plane that separate the data points into “safe” and “over-provi sion”.
Remove containers for those applications being c lassified into “over-provision”.
Implementation
Working on container scaler with b asic rules.
◦No data analysis techniques are invol ved in current state.
◦Will coordinate the data format with Prof. Lin’s group.
JSON format.
JSON Format
Next
Keep working.
Progress meeting with CHT
◦Early December
Midterm report
◦12/12
