===================================================================
CALL FOR PAPERS
===================================================================
Bench 2023
The 15th BenchCouncil International Symposium on Benchmarking,
Measuring and Optimizing
December 3-5, 2023
Sanya, China
https://www.benchcouncil.org/bench2023/index.html
In conjunction with
Federated Intelligent Computing and Chip Conference (FICC 2023)
IMPORTANT DATES
Paper Submission Due (full and short papers):
August 21, 2023, 11:59 PM AoE (extended, final deadline)
Notification: September 30, 2023, 11:59 PM AoE
Final Papers Due: October 31, 2023, 11:59 PM AoE
Submission website: https://bench2023.hotcrp.com/
Please note that citizens from up to 59 nations can visit Sanya
without a Visa from the Chinese Government. Sanya is a beautiful
seaside city, well known as Hawaii in China.
===================================================================
ABOUT Bench
———–
Evolving from nine BPOE/SDBA workshops in conjunction with ASPLOS,
VLDB, and ICS, Bench is an international multidisciplinary conference
on benchmarks, standards, data sets, evaluation, and
optimization. Bench 2023 is the fifteenth edition. The Bench
conference encompasses a wide range of topics in benchmarks, datasets,
metrics, indexes, measurement, evaluation, optimization, supporting
methods and tools, and industry best practices in computer science,
AI, medicine, finance, education, management, etc. Bench’s
multidisciplinary and interdisciplinary emphasis provides an ideal
environment for developers and researchers from different areas and
communities to discuss practical and theoretical work.
Bench 2023 invites manuscripts describing original work in the above
areas and topics. All accepted papers will be presented at the Bench
2023 conference and published by Springer (LNCS, Indexed by EI). In
addition, at least one of the authors of the TBench articles published
during the last year is requested to present their work at the Bench
conference.
Regularly, the Bench conference will present the BenchCouncil
Achievement Award ($3000), the BenchCouncil Rising Star Award ($1000),
the BenchCouncil Best Paper Award ($1000), and the BenchCouncil
Distinguished Doctoral Dissertation Awards in Computer Architecture
($1000) and in other areas ($1000). This year, the BenchCouncil
Distinguished Doctoral Dissertation Award includes two tracks:
computer architecture and other areas. Among the submissions of each
track, four candidates will be selected as finalists. They will be
invited to give a 30-minute presentation at the Bench 2023 conference
and contribute research articles to the BenchCouncil Transactions on
Benchmarks, Standards and Evaluation (TBench). Finally, for each
track, one among the four will receive the award for each track, which
carries a $1,000 honorarium.
With generous support from BenchCouncil, Bench 2023 will offer travel
grants for students to defray a portion of their travel cost. The size
and number of these grants will vary depending on funding
availability, the number of student applicants, and their respective
priority. Grant awards will be made before the early registration
deadline; expenses will be reimbursed after the conference; grant
recipients will be asked to submit original receipts to verify their
expenditures as well as a 1-page summary of their involvement during
the conference. While we encourage all in need of a travel grant to
apply, the selection process will give higher priority to students who
would otherwise not be able to attend the conference. We strongly
encourage applications from students that belong to under-represented
groups.
ORGANIZATION
————
General Co-Chairs
* Rakesh Agrawal, Data Insights Laboratories, San Jose, CA, USA
* Aoying Zhou, East China Normal University
Program Co-Chairs
* Weining Qian, East China Normal University
* Sascha Hunold, TU Wien, Austria
Program Vice-Chairs
* Biwei Xie, Institute of Computing Technology, CAS
* Kai Shu, Illinois Institute of Technology
Web Chair
* Jiahui Dai, BenchCouncil
Publicity Chairs
* Weicong Chen, University of California, Merced
* Dipti Shankar, SAP Labs, Munich
Technical Program Committee
* Ahmad Ghazal, PingCAP
* Bartlomiej Przybylski, Adam Mickiewicz University, Poznań
* Ben Blamey, Uppsala University
* Benson Muite, University of Tartu
* Bin Ren, College of William & Mary
* Bo Wu, Colorado School of Mines
* Chen Zheng, Institute of Software, Chinese Academy of Sciences
* Cheol-Ho Hong, Chung-Ang University
* Chunjie Luo, Institute of Computing Technology, Chinese Academy of Sciences
* David Boehme, Lawrence Livermore National Laboratory
* Florina Ciorba, University of Basel
* Francieli Boito, University of Bordeaux
* Guangli Li, Institute of Computing Technology, Chinese Academy of Sciences
* Gwangsun Kim, POSTECH
* Joseph Schuchart, University of Tennessee, Knoxville
* K. Selçuk Candan, Arizona State University
* Khaled Ibrahim, Lawrence Berkeley National Laboratory
* Lucas Mello Schnorr, UFRGS
* Mario Marino, Leeds Beckett University
* Miaoqing Huan, University of Arkansas
* Murali Emani, Argonne National Laboratory
* Philippe Swartvagher, TU Wien
* Piotr Luszczek, University of Tennessee, Knoxville
* Ryan Grant, Sandia National Laboratories
* Salman Zubair Toor, Uppsala University
* Shu Yin, ShanghaiTech University
* Sophie Cerf, INRIA
* Steven Farrell, Lawrence Berkeley National Laboratory
* Todor Ivanov, Lead Consult
* Woongki Baek, UNIST
* Xiaoyi Lu, University of California, Merced
* Zhen Jia, Amazon
* Zhihui Du, New Jersey Institute of Technology
Award Committees
2023 BenchCouncil Achievement Award Committee
* D. K. Panda, The Ohio State University
* Lizy Kurian John, the University of Texas at Austin
* Geoffrey Fox, Indiana University
* Jianfeng Zhan, University of Chinese Academy of Sciences
* Tony Hey, Rutherford Appleton Laboratory STFC
* David J. Lilja, University of Minnesota, Minneapolis
* Jack J. Dongarra, University of Tennessee
* John L. Henning, Oracle
2023 BenchCouncil Rising Star Award Committees
* D. K. Panda, The Ohio State University
* Lizy Kurian John, the University of Texas at Austin
* Geoffrey Fox, Indiana University
* Jianfeng Zhan, University of Chinese Academy of Sciences
* Torsten Hoefler, ETH Zürich
* Vijay Janapa Reddi, Harvard University
* Peter Mattson, Google, USA
* Douwe Kiela, Stanford University
BenchCouncil Distinguished Doctoral Dissertation Award Committee in Other Areas
* Jack J. Dongarra, University of Tennessee
* Xiaoyi Lu, The University of California, Merced
* Jeyan Thiyagalingam, STFC-RAL
* Lei Wang, ICT, Chinese Academy of Sciences
* Spyros Blanas, The Ohio State University
BenchCouncil Distinguished Doctoral Dissertation Award Committee in Computer Architecture
* Resit Sendag, University of Rhode Island, USA
* Peter Mattson, Google
* Vijay Janapa Reddi, Harvard University
* Wanling Gao, Chinese Academy of Sciences
Bench Steering Committee
* Jack J. Dongarra, University of Tennessee
* Geoffrey Fox, Indiana University
* D. K. Panda, The Ohio State University
* Felix Wolf, TU Darmstadt
* Xiaoyi Lu, University of California, Merced
* Resit Sendag, University of Rhode Island, USA
* Wanling Gao, ICT, Chinese Academy of Sciences & UCAS
* Jianfeng Zhan, BenchCouncil
TOPICS
——
The Bench conference encompasses a wide range of topics in benchmarks,
datasets, metrics, indexes, measurement, evaluation, optimization,
supporting methods and tools, and other best practices in computer
science, medicine, finance, education, management, etc. Bench’s
multidisciplinary and interdisciplinary emphasis provides an ideal
environment for developers and researchers from different areas and
communities to discuss practical and theoretical work. The topics of
interest include, but are not limited to the following:
Benchmark science and engineering across multi-disciplines:
* The formulation of problems or challenges in emerging and future computing
* The benchmarks, datasets, and indexes in multidisciplinary applications,
e.g., medical, finance, education, management, psychology, etc.
* Benchmark-based quantitative approaches to tackle multidisciplinary and
interdisciplinary challenges, industry best practices
Benchmark and standard specifications, implementations, and validations
* Big Data, Artificial Intelligence (AI), High-Performance Computing (HPC)
* Machine learning, Big scientific data, Datacenter, Cloud, Warehouse-scale computing
* Mobile robotics, Edge and fog computing, Internet of Things (IoT), Blockchain
* Data management and storage, Financial, Education, Medical or other application domains
Datasets
* Detailed descriptions of research or industry datasets,
including the methods used to collect the data and technical analyses
supporting the quality of the measurements
* Analyses or meta-analyses of existing data and original articles on systems,
technologies, and techniques that advance data sharing and reuse
to support reproducible research
* Evaluating the rigor and quality of the experiments used to generate
the data and the completeness of the data description
* Tools that can generate large-scale data while preserving their
original characteristics
Workload characterization, quantitative measurement, design, and evaluation studies
* Computer and communication networks, protocols and algorithms
* Wireless, mobile, ad-hoc and sensor networks, IoT applications
* Computer architectures, hardware accelerators, multi-core processors, memory systems
and storage networks
* HPC systems; Operating systems, file systems and databases; Virtualization, data centers,
distributed and cloud computing, fog and edge computing
* Mobile and personal computing systems, energy-efficient computing systems; real-time and
fault-tolerant systems, security and privacy of computing and networked systems,
software systems and services, and enterprise applications, social networks,
multimedia systems, web services, cyber-physical systems, including the smart grid
Methodologies, metrics, abstractions, algorithms, and tools
* Analytical modeling techniques and model validation
* Workload characterization and benchmarking
* Performance, scalability, power and reliability analysis
* Sustainability analysis and power management
* System measurement, performance monitoring and forecasting
* Anomaly detection, problem diagnosis and troubleshooting
* Capacity planning, resource allocation, run-time management and scheduling
* Experimental design, statistical analysis, and simulation
Measurement and evaluation
* Measurement standards, evaluation methodologies and metrics,
testbed methodologies and systems
* Instrumentation, sampling, tracing and profiling of large-scale,
real-world applications and systems;
* Measurement-based modeling (e.g., workloads, scaling behavior, assessment of
performance bottlenecks)
* Methods and tools to monitor and visualize measurement and evaluation data
* Systems and algorithms that build on measurement-based findings
* Advances in data collection, analysis and storage
(e.g., anonymization, querying, sharing)
* Reappraisal of previous empirical measurements and measurement-based conclusions
* Descriptions of challenges and future directions that the measurement and
evaluation community should pursue
PAPER SUBMISSION
—————-
Papers must be submitted in PDF. For full papers, the page limit is
15 pages in the LNCS format, not including references. For short
papers, the page limit is 8 pages in the LNCS format, not including
references. The review process follows a strict double-blind policy
per the established Bench conference norms. The submissions will be
judged based on the merit of the ideas rather than the length. After
the conference, the proceedings will be published by Springer LNCS
(Indexed by EI). Please note that the LNCS format is the final one for
publishing.
At least one author must pre-register for the symposium, and at least
one author must attend the symposium to present the paper. Papers for
which no author is pre-registered will be removed from the
proceedings.
Formatting Instructions
Please make sure your submission satisfies ALL of the following
requirements: All authors and affiliation information must be
anonymized. The paper must be submitted in printable PDF format (LNCS
format). Please number the pages of your submission. The submission
must be formatted for black-and-white printers. Please make sure your
figures are readable when printed in black and white. The submission
must describe novel, unpublished work that is not currently under
review of any other conference venue or journal.
Submission site: https://bench2023.hotcrp.com/
LNCS LaTeX template: https://www.benchcouncil.org/file/llncs2e.zip
AWARDS
——
BenchCouncil Achievement Award ($3,000)
* This award recognizes a senior member who has made long-term
contributions to benchmarking, measuring, and optimizing. The winner
is eligible for the status of a BenchCouncil Fellow.
BenchCouncil Rising Star Award ($1,000)
* This award recognizes a junior member who demonstrates outstanding
potential for research and practice in benchmarking, measuring, and
optimizing.
BenchCouncil Best Paper Award ($1,000)
* This award recognizes a paper presented at the Bench conferences,
which demonstrates potential impact on research and practice in
benchmarking, measuring, and optimizing.
BenchCouncil Distinguished Doctoral Dissertation Award ($2000)
* This award recognizes and encourages superior research and writing by
doctoral candidates in the broad field of benchmarks, data, standards,
evaluations, and optimizations community. This year, the award
includes two tracks, including the BenchCouncil Distinguished Doctoral
Dissertation Award in Computer Architecture ($1000) and BenchCouncil
Distinguished Doctoral Dissertation Award in other areas ($1000).