er) is t h e s a m e as t h at i n t h e ot h er s a m pl es i n t h e A M D T, a n d i n bi n ar y c o m p aris o n Ls h a n d c h e c ks w h et h er or n ot t h e c o ntr ol c all gr a p h or G UI-c all b a c k m et h o ds h as si mil ar c h ar a ct eristi cs t o t h e ot h er s a m pl es i n t h e

]). S p e ci fi c all y, f or e a c h A M D T Ls h a n d tr ai ns t h e cl assi fi er wit h m al w ar e i n di c at ors of t h e A M D T a n d p u bli cl y k n o w n b e ni g n a p ps, a n d Ls h a n d c o nsi ders a s a m pl e t o b e si mil ar t o its A M D T if t h e cl assi fi er r e p orts t h e s a m pl e " m ali ci o us " , w hi c h is t h e c as e t h at t h e s a m pl e is cl os er t o t h e m al w ar e i n di c at ors t h a n t o t h e ot h er irr el e v a nt a p ps i n t h e f e at ur e s p a c e ( diff er e nt fr o m t h e m ali ci o us n ess t est w h er e w e c o m p ar e bi n ar y f e at ur es wit h k n o w n m al w ar e).

) t h at e a c h h as f e w ki ns (|ki ns | ≤ ). F or si mil arit y t est u p o n a n A M D T, w e s plit A M D T s a m pl es i nt o t w o h al v es b as e d o n t h e d et e cti o n r ati o r u , a n d w e tr ai n e d t h e cl assi fi ers wit h t h e hi g h-r ati o h alf a n d o utsi d er b e ni g n s et t o v erif y t h e l o w-r ati o h alf. F or m ali ci o us n ess t est u p o n a n A M D T, w e tr ai n e d t h e cl assi fi ers wit h o utsi d er m al w ar e s et a n d o utsi d er b e ni g n s et t o v erif y t h e s a m pl es. N ot e t h at, w e tri e d t o i n cl u d e s o m e ot h er t o ols, b ut e a c h of t h e m f ail e d t o diss e ct a l ar g e p orti o n of o ur d at as et, eit h er b e c a us e its d esi g n w as n ot f or t h e l att er

1 0 P erf e ct 8 5. 5 1 % 9 9. 1 6 % 1 0 0. 0 0 % ( 1 0 0 %) 7 9. 4 1 % 9 6. 4 3 % 1 0 0. 0 0 % E x c ell e nt 3. 5 9 % 0. 0 0 % 0. 0 0 % ( 9 0-1 0 0 %) 2. 9 4 % 0. 0 0 % 0. 0 0 % G o o d 2. 8 1 % 0. 0 0 % 0. 0 0 % ( 8 0-9 0 %) 4. 4 1 % 0. 0 0 % 0. 0 0 % F air 0. 0 0 % 0. 0 0 % 0. 0 0 % ( 7 0-8 0 %) 0. 0 0 % 0. 0 0 % 0. 0 0 % Pr o bl e m ati c 0. 0 0 % 0. 4 8 % 0. 0 0 % ( 6 0-7 0 %) 0. 0 0 % 1. 7 9 % 0. 0 0 % B a d 8. 0 9 % 0. 3 6 % * 0. 0 0 % ( 0-6 0 %) 1 3. 2 4 % 1. 7 9 % * 0. 0 0 % h o urs p er r e visi o n 1 6 8. 8 4 2 0 7. 8 1 1 6.

A c k n o wl e d g m e nts

T h e w or k of Z h u w as p arti all y s u p p ort e d t hr o u g h N S C N S-1 6 1 8 6 8 4 a n d A R O W 9 1 1 N F-1 7-S-0 0 0 2. P e n g Li u w as s u pp ort e d b y A R O W 9 1 1 N F-1 3-1-0 4 2 1 ( M U RI), N S F C N S-1 8 1 4 6 7 9, a n d A R O W 9 1 1 N F-1 5-1-0 5 7 6.

R ef e r e n c es