提交 a3163376 编辑于 作者: openaiops's avatar openaiops
浏览文件

Initial commit

上级
加载中
加载中
加载中
加载中

OpenStack_2k.log

0 → 100644
+0 −0

添加文件。

预览已超出大小限制,变更已折叠。

+0 −0

添加文件。

预览已超出大小限制,变更已折叠。

+44 −0
原始行号 差异行号 差异行
EventId,EventTemplate
E1,"[instance: <*>] Attempting claim: memory <*> MB, disk <*> GB, vcpus <*> CPU"
E2,[instance: <*>] Claim successful
E3,[instance: <*>] Creating image
E4,[instance: <*>] Deleting instance files <*>
E5,[instance: <*>] Deletion of <*> complete
E6,"[instance: <*>] disk limit not specified, defaulting to unlimited"
E7,[instance: <*>] During sync_power_state the instance has a pending task (spawning). Skip.
E8,[instance: <*>] Instance destroyed successfully.
E9,[instance: <*>] Instance spawned successfully.
E10,"[instance: <*>] memory limit: <*>.<*> MB, free: <*>.<*> MB"
E11,[instance: <*>] Terminating instance
E12,[instance: <*>] Took <*>.<*> seconds to build instance.
E13,[instance: <*>] Took <*>.<*> seconds to deallocate network for instance.
E14,[instance: <*>] Took <*>.<*> seconds to destroy the instance on the hypervisor.
E15,[instance: <*>] Took <*>.<*> seconds to spawn the instance on the hypervisor.
E16,"[instance: <*>] Total disk: <*> GB, used: <*>.<*> GB"
E17,"[instance: <*>] Total memory: <*> MB, used: <*>.<*> MB"
E18,"[instance: <*>] Total vcpu: <*> VCPU, used: <*>.<*> VCPU"
E19,"[instance: <*>] vcpu limit not specified, defaulting to unlimited"
E20,[instance: <*>] VM Paused (Lifecycle Event)
E21,[instance: <*>] VM Resumed (Lifecycle Event)
E22,[instance: <*>] VM Started (Lifecycle Event)
E23,[instance: <*>] VM Stopped (Lifecycle Event)
E24,"<*> ""DELETE <*>"" status: <*> len: <*> time: <*>.<*>"
E25,"<*> ""GET <*>"" status: <*> len: <*> time: <*>.<*>"
E26,"<*> ""POST <*>"" status: <*> len: <*> time: <*>.<*>"
E27,Active base files: <*>
E28,Auditing locally available compute resources for node <*>
E29,Base or swap file too young to remove: <*>
E30,Compute_service record updated for <*>
E31,Creating event network-vif-plugged:<*>-<*>-<*>-<*>-<*> for instance <*>
E32,Final resource view: name=<*> phys_ram=<*> used_ram=<*> phys_disk=<*> used_disk=<*> total_vcpus=<*> used_vcpus=<*> pci_stats=[]
E33,HTTP exception thrown: No instances found for any event
E34,image <*> at (<*>): checking
E35,"image <*> at (<*>): in use: on this node <*> local, <*> on other nodes sharing this instance storage"
E36,Removable base files: <*>
E37,Removing base or swap file: <*>
E38,Running instance usage audit for host <*> from <*>-<*>-<*> <*>:<*>:<*> to <*>-<*>-<*> <*>:<*>:<*>. <*> instances.
E39,Successfully synced instances from host '<*>'.
E40,The instance sync for host '<*>' did not match. Re-created its InstanceList.
E41,"Total usable vcpus: <*>, total allocated vcpus: <*>"
E42,Unknown base file: <*>
E43,"While synchronizing instance power states, found <*> instances in the database and <*> instances on the hypervisor."

README.md

0 → 100644
+13 −0
原始行号 差异行号 差异行
## OpenStack

OpenStack (https://www.openstack.org) is a cloud operating system that controls large pools of compute, storage, and networking resources throughout a datacenter. This dataset was generated on [CloudLab](https://cloudlab.us/), a flexible, scientific infrastructure for research on cloud computing. Both normal logs and abonormal cases with failure injection are provided, making the data amenable to anomaly detection research. 

For the usage of this dataset, please refer to an example: https://github.com/nailo2c/deeplog/blob/master/example/preprocess.py

### Download
The raw logs are available for downloading at https://github.com/logpai/loghub.

### Citation
If you use this dataset from loghub in your research, please cite the following papers.
+ Min Du, Feifei Li, Guineng Zheng, Vivek Srikumar. [DeepLog: Anomaly Detection and Diagnosis from System Logs through Deep Learning](https://acmccs.github.io/papers/p1285-duA.pdf), in Proc. of ACM Conference on Computer and Communications Security (CCS), 2017. 
+ Jieming Zhu, Shilin He, Pinjia He, Jinyang Liu, Michael R. Lyu. [Loghub: A Large Collection of System Log Datasets for AI-driven Log Analytics](https://arxiv.org/abs/2008.06448). IEEE International Symposium on Software Reliability Engineering (ISSRE), 2023.