IMPACT SCORE JOURNAL RANKING CONFERENCE RANKING Conferences Journals Workshops Seminars SYMPOSIUMS MEETINGS BLOG LaTeX 5G Tutorial Free Tools
HOO 2022 : Order up! The Benefits of Higher-Order Optimization in Machine Learning: NeurIPS 2022
HOO 2022 : Order up! The Benefits of Higher-Order Optimization in Machine Learning: NeurIPS 2022

HOO 2022 : Order up! The Benefits of Higher-Order Optimization in Machine Learning: NeurIPS 2022

New Orleans, LA
Event Date: December 02, 2022 - December 02, 2022
Submission Deadline: September 22, 2022
Notification of Acceptance: October 20, 2022




Call for Papers

Optimization is a cornerstone of nearly all modern machine learning (ML) and deep learning (DL). Simple first-order gradient-based methods dominate the field for convincing reasons: low computational cost, simplicity of implementation, and strong empirical results.

Yet second- or higher-order methods are rarely used in DL, despite also having many strengths: faster per-iteration convergence, frequent explicit regularization on step-size, and better parallelization than SGD. Additionally, many scientific fields use second-order optimization with great success.

A driving factor for this is the large difference in development effort. By the time higher-order methods were tractable for DL, first-order methods such as SGD and it’s main variants (SGD + Momentum, Adam, …) already had many years of maturity and mass adoption.

The purpose of this workshop is to address this gap, to create an environment where higher-order methods are fairly considered and compared against one-another, and to foster healthy discussion with the end goal of mainstream acceptance of higher-order methods in ML and DL.

Plenary Speakers:
- Amir Gholami (UC Berkeley)
- Coralia Cartis (University of Oxford)
- Frank E. Curtis (Lehigh University)
- Donald Goldfarb (Columbia University)
- Madeleine Udell (Stanford University)

****CALL FOR PAPERS****
We welcome submissions to the workshop under the general theme of “Order up! The Benefits of Higher-Order Optimization in Machine Learning”. Some examples of acceptable topics include:
- Higher-order methods,
- Adaptive gradient methods,
- Novel higher-order-friendly models,
- Higher-order theory papers,
- and many more.

For submission details, please see https://order-up-ml.github.io/CFP/. Please use our CMT submission portal which can be found at the following link: https://cmt3.research.microsoft.com/HOOML2022.

Important Dates:
Submission deadline: September 22, 2022 (AOE)
Acceptance notification: October 20, 2022 (AOE)
Final version due: TBD

Organizers:
- Albert S. Berahas (University of Michigan)
- Jelena Diakonikolas (University of Wisconsin-Madison)
- Jarad Forristal (University of Texas at Austin)
- Brandon Reese (SAS Institute Inc.)
- Martin Takáč (MBZUAI)
- Yan Xu (SAS Institute Inc.)


Credits and Sources

[1] HOO 2022 : Order up! The Benefits of Higher-Order Optimization in Machine Learning: NeurIPS 2022


Check other Conferences, Workshops, Seminars, and Events


OTHER OPTIMIZATION EVENTS

CSoNet 2025: The 14th International Conference on Computational Data and Social Networks
Danang, Vietnam
Dec 14, 2025
ISAAC 2025: International Symposium on Algorithms and Computation
Tainan, Taiwan
Dec 7, 2025
ANTS 2026: 15th International Conference on Swarm Intelligence
Darmstadt, Germany
Jun 8, 2026
TSMO 2025: KDD-2025 Workshop on Two-sided Marketplace Optimization: Search, Discovery, Matching, Pricing & Growth
Toronto, ON
Aug 4, 2025
ACDA 2025: SIAM Conference on Applied and Computational Discrete Algorithms
Montréal, Québec, Canada
Jul 30, 2025
SHOW ALL

OTHER MACHINE LEARNING EVENTS

ArIT 2025: 6th International Conference on Advances in Artificial Intelligence Techniques
Toronto, Canada
Jul 19, 2025
ICSIE--EI 2026: 2026 14th International Conference on Software and Information Engineering (ICSIE 2026)
Himeji, Japan
Jan 16, 2026
ICoSSE--Ei 2026: 2026 9th International Conference on Software and System Engineering (ICoSSE 2026)
Lyon, France
Apr 13, 2026
ICHCSC 2025: 4th International Conference on Human-Centric Smart Computing (ICHCSC 2025)
Jaipur, India
Oct 10, 2025
CMLA 2025: 7th International Conference on Machine Learning & Applications
Toronto, Canada
Jul 19, 2025
SHOW ALL