Write a Blog >>
Wed 11 Nov 2020 01:11 - 01:12 at Virtual room 2 - Cloud / Services 1

Increased popularity of `intelligent' web services provides end-users with machine-learnt functionality at little effort to developers. However, these services require a decision threshold to be set which is dependent on problem-specific data. Developers lack a systematic approach for evaluating intelligent services and existing evaluation tools are predominantly targeted at data scientists for pre-development evaluation. This paper presents a workflow and supporting tool, Threshy, to help \textit{software developers} select a decision threshold suited to their problem domain. Unlike existing tools, Threshy is designed to operate in multiple workflows including pre-development, pre-release, and support. Threshy is designed for tuning the confidence scores returned by intelligent web services and does not deal with hyper-parameter optimisation used in ML models. Additionally, it considers the financial impacts of false positives. Threshold configuration files exported by Threshy can be integrated into client applications and monitoring infrastructure. Demo: \url{https://bit.ly/2YKeYhE}.

Wed 11 Nov

Displayed time zone: (UTC) Coordinated Universal Time change

01:00 - 01:30
01:00
2m
Talk
Beware the Evolving ‘Intelligent’ Web Service! An Integration Architecture Tactic to Guard AI-First Components
Research Papers
Alex Cummaudo Deakin University, Australia, Scott Barnett Deakin University, Australia, Rajesh Vasa Deakin University, Australia, John Grundy Monash University, Australia, Mohamed Abdelrazek Deakin University, Australia
DOI
01:03
1m
Talk
Efficient Customer Incident Triage via Linking with System Incidents
Industry Papers
Jiazhen Gu Fudan University, China, Jiaqi Wen Peking University, China, Zijian Wang Fudan University, China, Pu Zhao Microsoft Research, China, Chuan Luo Microsoft Research, China, Yu Kang Microsoft Research, China, Yangfan Zhou Fudan University, China, Li Yang Microsoft Azure, USA, Jeffrey Sun Microsoft Azure, USA, Zhangwei Xu Microsoft, China, Bo Qiao Microsoft Research, China, Liqun Li Microsoft Research, China, Qingwei Lin Microsoft Research, China, Dongmei Zhang Microsoft Research, China
DOI
01:05
1m
Talk
How to Mitigate the Incident? An Effective Troubleshooting Guide Recommendation Technique for Online Service Systems
Industry Papers
Jiajun Jiang Tianjin University, China, Weihai Lu Peking University, China, Junjie Chen Tianjin University, China, Qingwei Lin Microsoft Research, China, Pu Zhao Microsoft Research, China, Yu Kang Microsoft Research, China, Hongyu Zhang University of Newcastle, Australia, Yingfei Xiong Peking University, Feng Gao Microsoft, China, Zhangwei Xu Microsoft, China, Yingnong Dang Microsoft, USA, Dongmei Zhang Microsoft Research, China
DOI
01:07
1m
Talk
Identifying Linked Incidents in Large-Scale Online Service Systems
Research Papers
Yujun Chen Microsoft Research, China, Xian Yang Hong Kong Baptist University, China, Hang Dong Microsoft Research, China, Xiaoting He Chinese Academy of Sciences, China, Hongyu Zhang University of Newcastle, Australia, Qingwei Lin Microsoft Research, China, Junjie Chen Tianjin University, China, Pu Zhao Microsoft Research, China, Yu Kang Microsoft Research, China, Feng Gao Microsoft, China, Zhangwei Xu Microsoft, China, Dongmei Zhang Microsoft Research, China
DOI
01:09
1m
Talk
Mono2Micro: An AI-Based Toolchain for Evolving Monolithic Enterprise Applications to a Microservice Architecture
Tool Demos
Anup K. Kalia IBM Research, USA, Jin Xiao IBM Research, USA, Chen Lin IBM Research, USA, Saurabh Sinha IBM Research, John Rofrano IBM Research, USA, Maja Vukovic IBM Research, USA, Debasish Banerjee IBM, n.n.
DOI
01:11
1m
Talk
Threshy: Supporting Safe Usage of Intelligent Web Services
Tool Demos
Alex Cummaudo Deakin University, Australia, Scott Barnett Deakin University, Australia, Rajesh Vasa Deakin University, Australia, John Grundy Monash University, Australia
DOI
01:13
1m
Talk
Towards Intelligent Incident Management: Why We Need It and How We Make It
Industry Papers
Zhuangbin Chen Chinese University of Hong Kong, China, Yu Kang Microsoft Research, China, Liqun Li Microsoft Research, China, Xu Zhang Microsoft Research, China, Hongyu Zhang University of Newcastle, Australia, Hui Xu Fudan University, China, Yangfan Zhou Fudan University, China, Li Yang Microsoft Azure, USA, Jeffrey Sun Microsoft Azure, USA, Zhangwei Xu Microsoft, China, Yingnong Dang Microsoft, USA, Feng Gao Microsoft, China, Pu Zhao Microsoft Research, China, Bo Qiao Microsoft Research, China, Qingwei Lin Microsoft Research, China, Dongmei Zhang Microsoft Research, China, Michael Lyu CUHK
DOI Media Attached File Attached
01:15
15m
Talk
Conversations on Cloud / Services 1
Paper Presentations
Alex Cummaudo Deakin University, Australia, Anup K. Kalia IBM Research, USA, Jiajun Jiang Tianjin University, China, Zhuangbin Chen Chinese University of Hong Kong, China, M: Satish Chandra Facebook, USA