<?xml-model href='http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng' schematypens='http://relaxng.org/ns/structure/1.0'?><TEI xmlns="http://www.tei-c.org/ns/1.0">
	<teiHeader>
		<fileDesc>
			<titleStmt><title level='a'>A General Framework for Learning-Augmented Online Allocation</title></titleStmt>
			<publicationStmt>
				<publisher>Schloss Dagstuhl – Leibniz-Zentrum für Informatik</publisher>
				<date>01/01/2023</date>
			</publicationStmt>
			<sourceDesc>
				<bibl> 
					<idno type="par_id">10520508</idno>
					<idno type="doi">10.4230/LIPICS.ICALP.2023.43</idno>
					
					<author>Ilan Reuven Cohen</author><author>Debmalya Panigrahi</author><author>Kousha Etessami</author><author>Uriel Feige</author><author>Gabriele Puppis</author>
				</bibl>
			</sourceDesc>
		</fileDesc>
		<profileDesc>
			<abstract><ab><![CDATA[Online allocation is a broad class of problems where items arriving online have to be allocated to agents who have a fixed utility/cost for each assigned item so to maximize/minimize some objective. This framework captures a broad range of fundamental problems such as the Santa Claus problem (maximizing minimum utility), Nash welfare maximization (maximizing geometric mean of utilities), makespan minimization (minimizing maximum cost), minimization of &#x1d4c1;_p-norms, and so on. We focus on divisible items (i.e., fractional allocations) in this paper. Even for divisible items, these problems are characterized by strong super-constant lower bounds in the classical worst-case online model. In this paper, we study online allocations in the learning-augmented setting, i.e., where the algorithm has access to some additional (machine-learned) information about the problem instance. We introduce a general algorithmic framework for learning-augmented online allocation that produces nearly optimal solutions for this broad range of maximization and minimization objectives using only a single learned parameter for every agent. As corollaries of our general framework, we improve prior results of Lattanzi et al. (SODA 2020) and Li and Xian (ICML 2021) for learning-augmented makespan minimization, and obtain the first learning-augmented nearly-optimal algorithms for the other objectives such as Santa Claus, Nash welfare, &#x1d4c1;_p-minimization, etc. We also give tight bounds on the resilience of our algorithms to errors in the learned parameters, and study the learnability of these parameters.]]></ab></abstract>
		</profileDesc>
	</teiHeader>
	<text><body xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1">Introduction</head><p>Recent research has focused on obtaining learning-augmented algorithms for many online problems to overcome pessimistic lower bounds in competitive analysis. In this paper, we consider the online allocation framework in the learning-augmented setting. In this framework, a set of (divisible) items have to be allocated online among a set of agents, where each agent has a non-negative utility/cost for each item. This framework captures a broad range of classic problems depending on the objective one seeks to optimize. In load balancing (also called makespan minimization), the goal is to minimize the maximum (MinMax) cost of any agent. A more general goal is to minimize the &#8467; p -norm of the cost vector defined on the agents, for some p &#8805; 1. Both makespan minimization (which is &#8467; &#8734; -minimization) and &#8467; p -minimization are classic problems in scheduling theory and have been extensively studied in competitive analysis. In a different vein, the online allocation framework also applies to information about the problem instance (we call these learned parameters) can help overcome these lower bounds and obtain a near-optimal solution. In this paper, we answer this question in the affirmative. In particular, we give a simple, unified framework for obtaining near-optimal (fractional) allocations using a single learned parameter for every agent. Our result holds for both maximization and minimization problems, and applies to all objective functions that satisfy two mild technical conditions that we define below. Indeed, the most interesting aspect of our techniques and results is this generality: prior work for online allocation problems, both in competitive analysis and beyond worst-case algorithms, has typically been specific to the objective at hand, and the techniques for maximization and minimization objectives bear no similarity. In contrast, our techniques surprisingly handles not only a broad range of objectives but applies both to maximization and minimization problems simultaneously. We hope that the generality of our methods will cast a new light on what is one of the most important classes of problems in combinatorial optimization.</p><p>Before proceeding further, we define the two technical conditions that the objective function of the online allocation problem needs to satisfy for our results to apply. Let f : R m &gt;0 &#8594; R &gt;0 be the objective function defined on the vector of costs/utilities of the agents.</p><p>Then, the conditions are:</p><p>Monotonicity: f is said to be monotone if the following holds: for any &#8467;, &#8467; &#8712; R m &gt;0 such that &#8467; i &#8805; &#8467; i for all i &#8712; [m], we have f (&#8467;) &#8805; f (&#8467; ).</p><p>Homogeneity: f is said to be homogeneous if the following holds: for any &#8467;, &#8467; &#8712; R m &gt;0 such that &#8467; i = &#945; &#8226; &#8467; i for all i &#8712; [m], then we have f (&#8467; ) = &#945; &#8226; f (&#8467;).</p><p>We say an objective function is well-behaved if it is both monotone and homogeneous. All online allocation objectives studied previously that we are aware of are well-behaved, including the examples given above.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.1">Our Results</head><p>We now state our main result below:</p><p>Theorem 1 (Informal). Fix any &gt; 0. For any online allocation problem with a well-behaved objective, there is an algorithm that achieves a competitive ratio of 1 -for maximization problems or 1 + for minimization problems using a single learned parameter for every agent.</p><p>We remark that the role of in the above theorem is to ensure that the learned parameter vector is of bounded precision.</p><p>Comparison to Prior Work. Lattanzi et al. <ref type="bibr">[17]</ref> were the first to consider online allocation in a learning-augmented setting. They considered a special case of the load balancing problem called restricted assignment, and showed the surprising result that a single (learned) parameter for each agent is sufficient to bypass the lower bound and obtain a nearly optimal (fractional) allocation. This result was further generalized by Li and Xian <ref type="bibr">[20]</ref> to the full generality of the load balancing problem, but instead of a single parameter, they now required two parameters for every agent. At a high level, their algorithm first uses one set of parameters to restrict the set of agents who can receive an item, and then solves the resulting restricted assignment problem using the second set of parameters. A a corollary of Theorem 1, we improve this result by obtaining a near-optimal solution using a single learned parameter for every agent. In both these papers, as well as in our paper, the (fractional) allocation uses proportional allocation. In the setting of online optimization, proportional allocations were used earlier by Agrawal et al. <ref type="bibr">[1]</ref> for the (weighted) b-matching problem. As in our paper, they also gave an iterative algorithm for computing the parameters of the allocation.</p><p>However, because the two problems are structurally very different (e.g., matching is a packing problem while our allocation problems are covering problems), the iterative algorithm in the Agrawal et al. paper is different from ours. To the best of our knowledge, our results for the other problems, namely Santa Claus, Nash welfare maximization, &#8467; p -norm minimization, and other objectives that can be defined in the online allocation framework are the first results in learning-augmented algorithms for these problems.</p><p>We now state our additional results.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Resilience to Prediction Error.</head><p>A key desiderata of learning-augmented online algorithms is resilience to errors in the learned parameters. In other words, one desires that the competitive ratio of the algorithm should gracefully degrade when the learned parameters used in the algorithm deviate from their optimal values. For well-behaved objectives for both minimization and maximization problems, we give an error-resilient algorithm whose competitive ratio degrades gracefully with prediction error:</p><p>Theorem 2 (Informal). For any online allocation problem with a well-behaved objective, there is an (learning-augmented) algorithm that achieves a competitive ratio of O(&#945;) when the learned parameter input to the algorithm is within a multiplicative factor of &#945; of the optimal learned parameter for every agent. This holds for both minimization and maximization objectives.</p><p>The above theorem is asymptotically tight for the MaxMin objective. But, interestingly, for the MinMax objective we can do better:</p><p>Theorem 3 (Informal). For the load balancing problem (MinMax objective), there is an (learning-augmented) algorithm that achieves a competitive ratio of O(log &#945;) when the learned parameter input to the algorithm is within a multiplicative factor of &#945; of the optimal learned parameter for every agent. Moreover, the dependence O(log &#945;) in the above statement is asymptotically tight.</p><p>An analogous statement was previously known only in the special case of restricted assignment <ref type="bibr">[17]</ref>.</p><p>Remark 4. We use a multiplicative measure of error &#945; similar to <ref type="bibr">[17]</ref>. Learnability of Parameters. We also study the learnability of the parameters used in our algorithm. Following <ref type="bibr">[20]</ref> and <ref type="bibr">[18]</ref>, we adopt the PAC framework. We assume that each item is drawn independently (but not necessarily identically) from a distribution, and show a bound on the sample complexity of approximately learning the parameter vector under this setting. For the MaxMin and MinMax objectives, we show the following:</p><p>Theorem 5 (Informal). Fix any &gt; 0. For the online allocation problem with MaxMin or</p><p>MinMax objectives, the sample complexity of learning a parameter vector that gives a 1 -</p><p>We note that a similar result was previously known for the MinMax objective <ref type="bibr">(Li and</ref> Xian <ref type="bibr">[20]</ref>). We also generalize this result to all well-behaved objectives subject to a technical condition of superadditivity for maximization or subadditivity for minimization. All the objectives described earlier in the introduction satisfy these conditions.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.2">Our Techniques</head><p>Our learning-augmented online algorithms for both minimization and maximization objectives follow from a single, unified algorithmic framework that we develop in this paper. This is quite surprising because in the worst-case setting, the online algorithms for the different objectives do not share any similarity (indeed have different competitive ratios), particularly between maximization and minimization problems. First, let us first consider the MinMax and MaxMin objectives. To use common terminology across these problems, let us call the cost/utility of an item j to an agent i the weight of item j for agent i and denote it p i,j . Our common algorithmic framework uses proportional allocation according to the learned parameters of the agents. Let w i denote the parameter for agent i. Normally, proportional allocation would entail that we allocate a fraction x i,j of item j to agent i where x i,j = wipi,j</p><p>. But, this is clearly not adequate, since it would produce the same allocation for both the MaxMin and MinMax objectives. Specifically, if p i,j is large for a pair i, j, then x i,j should be large for the MaxMin objective and small for the MinMax objective respectively. To implement this intuition, we exponentiate the weight p i,j by a fixed value &#945; that depends on the objective (i.e., is different for MaxMin and MinMax) and then allocate using fractions x i,j =</p><p>. We call this an exponentiated proportional allocation (or EP-allocation in short), and call &#945; the exponentiation constant.</p><p>Let us fix any value of &#945;. It is clear that for both the MinMax and MaxMin objectives, an optimal allocation has uniform cumulative fractional weights (called load) across all agents.</p><p>(Note that otherwise, an infinitesimal fraction of an item can be repeatedly moved from the most loaded to the least loaded agent to eventually improve the competitive ratio.) Following this intuition, we define a canonical allocation as one that sets learned parameters on the agents in a way that equalizes the loads on all agents. We show that the canonical allocation always exists and is unique. Indeed, this is true not only for all EP-allocation algorithms, but for a much broader class of proportional allocation schemes that we called generalized proportional allocations (or GP-allocations). In the latter class, we allow any transformation of the weights p i,j before applying proportional allocation. Thus, EP-allocations represent the subclass of GP-allocations where the transformation is exponentiation by the fixed value &#945;. We also give a simple iterative (Sinkhorn-like) algorithm for computing the optimal learned parameters, and establish its convergence properties, for GP-allocations. GP-allocations give an even larger palette of proportional allocation schemes to choose from than EP-allocations, and we hope it will be useful in future work for problem settings that are not covered in this paper (e.g., non-linear utilities).</p><p>Finally, we need to set the value of &#945; specifically for the MinMax and MaxMin objectives. Intuitively, it is clear that we need to set &#945; to a large positive value for the MaxMin objective and a large negative value for the MinMax objective. Indeed, we show that in the limit of &#945; &#8594; &#8734; and &#945; &#8594; -&#8734;, the canonical allocation defined above recovers optimal allocations for the MaxMin and MinMax objectives respectively. We also show a monotonicity property of the optimal objective (with the value of &#945;) that can be used to set &#945; to a finite value (function of ) and obtain a 1 -(resp., 1 + ) approximation for the MaxMin (resp., MinMax) objective, for any &gt; 0.</p><p>Now that we have described the EP-allocation scheme for obtaining nearly optimal algorithms for the MinMax and MaxMin objectives, we generalize to all well-behaved objective functions. This is quite simple. The main advantage of the MinMax and MaxMin objectives that is not shared by other objectives is the property that the optimal solution has uniform load across all agents. Now, suppose for a maximization objective, the load of agent i in an optimal solution is s i (we call this the scaling parameter for agent i). For now, suppose these values s i are also provided offline as a second set of parameters. Then, we can first scale the weights p i,j using these parameters to obtain a new instance q i,j = pi,j si .</p><p>Clearly, the optimal solution for the original instance has uniform load across all agents for the transformed instance. Indeed, by the monotonicity of the maximization objective, this solution for the transformed instance is also optimal for the MaxMin objective. Using the above analysis for the MaxMin objective, we can now claim that there exist learned</p><p>gives an optimal solution to the original instance of the problem. Now, note that</p><p>It follows that by using learned parameters w i in an EP-allocation on the original instance, we can obtain an optimal solution for the original maximization objective. (The case for a minimization objective is identical to the above argument, with the MaxMin objective being replaced by the MinMax objective.) Finally, using the homogeneity of the objective function, we can also set &#945; to a finite value (function of ) and obtain a 1 -(resp., 1 + ) approximation for the maximization (resp., minimization) objective, for any &gt; 0.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="1.3">Related Work</head><p>Learning-augmented online algorithms were pioneered by the work of Lykouris and Vassilvikskii <ref type="bibr">[21]</ref> for the caching problem, and has become a very popular research area in the last few years.</p><p>The basic idea of this framework is to augment an online algorithm with (machine-learned) predictions about the future, which helps overcome pessimistic worst case lower bounds in competitive analysis. Many online allocation problems have been considered in this framework in scheduling <ref type="bibr">[27,</ref><ref type="bibr">5,</ref><ref type="bibr">6,</ref><ref type="bibr">8,</ref><ref type="bibr">15,</ref><ref type="bibr">24]</ref>, online matching <ref type="bibr">[2,</ref><ref type="bibr">13,</ref><ref type="bibr">16]</ref>, ad delivery <ref type="bibr">[22,</ref><ref type="bibr">19]</ref>,</p><p>etc. The reader is referred to the survey by Mitzenmacher and Vassilvitskii <ref type="bibr">[25,</ref><ref type="bibr">26]</ref> for further examples of online learning-augmented algorithms. The papers specifically related to our work are those of Lattanzi et al. <ref type="bibr">[17]</ref> and Li and Xian [20] that we described above, and that of Lavastida et al. <ref type="bibr">[18]</ref> that focuses on the learnability of the parameters for the same problem. As mentioned earlier, Agrawal et al. We now give a brief summary of online allocation in the worst-case model. For minimization problems, two classic objectives are makespan (i.e., &#8467; &#8734; norm) and &#8467; p norm minimization for p &gt; 1. The former was studied in several works (e.g., <ref type="bibr">[7,</ref><ref type="bibr">3]</ref>), eventually leading to an asymptotically tight bound of &#920;(log m). This was later generalized to arbitrary &#8467; p norms, and a tight bound of &#920;(p) was obtained for this case <ref type="bibr">[4,</ref><ref type="bibr">12]</ref>. For maximization objectives, there are &#8486;(m) lower bounds for many natural objectives such as MaxMin (see, e.g., <ref type="bibr">[14]</ref>) and Nash welfare <ref type="bibr">[9]</ref>. Some recent work has focused on overcoming these lower bounds using additional information such as monopolist values for the agents <ref type="bibr">[9,</ref><ref type="bibr">10]</ref>. While this improves the competitive ratio to sub-linear in m, lower bounds continue to rule out near-optimal solutions (or even constant factor approximations) that we seek in this paper.</p><p>Organization. For most of the paper, we only consider the MinMax and MaxMin objectives. We establish the notation in Section 2 and give an overview of the results.</p><p>Then, we prove these results by showing properties of GP-allocations in Section 3 and of EP-allocations in Section 4. Next, we give noise resilient algorithms in Section 5 and discuss learnability of the parameters in Section 6. Finally, in Section 7, we extend our results to all well-behaved objective functions via simple reductions to the MaxMin and MinMax objectives.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2">Preliminaries and Results</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.1">Problem Definition</head><p>We have n (divisible) items that arrive online and have to be (fractionally) allocated to m agents. The weight of item j &#8712; [n] for agent i &#8712; [m] is denoted p i,j and is revealed when item j arrives. We denote the weight matrix</p><p>A feasible allocation is given by an assignment matrix</p><p>Note that every item has to be fully allocated among all the agents. We use X to denote the set of feasible solutions. The total weight of an agent i corresponding to an allocation X (we call this the load of i) is given by</p><p>x i,j &#8226; p i,j , and the vector of loads of all the agents is denoted &#8467;(P, X).</p><p>The load balancing problem is now defined as</p><p>while the Santa Claus problem is defined as</p><p>50:7</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="2.2">Exponentiated and Generalized Proportional Allocations</head><p>Our algorithmic framework is simple: when allocating item j, we first exponentiate the weights p i,j to p &#945; i,j for some fixed &#945; (called the exponentiation constant) that only depends on the objective being optimized. Next, we perform proportional allocation weighted by the learned parameters w i for agents i &#8712; [m]:</p><p>We call this an exponentiated proportional allocation or EP-allocation in short.</p><p>Our main theorem is the following: Theorem 6. For the load balancing and Santa Claus problems, there are EP-allocations that achieve a competitive ratio of 1 + and 1 -respectively, for any &gt; 0.</p><p>The Canonical Allocation. In order to define an EP-allocation and establish Theorem 6, we need to specify two things: the vector of learned parameters w &#8712; R m &gt;0 and the exponentiation constant &#945;. First, we focus on the learned parameters. For any fixed &#945; and a weight matrix P , we use learned parameters w &#8712; R m &gt;0 that result in equal load for every agent. We call this the canonical allocation. The corresponding learned parameters and the load of every agent are respectively called the canonical parameters (denoted w * ) and the canonical load (denoted &#8467; * ).</p><p>Apriori, it is not clear that a canonical allocation should even exist, and even if it does, that it is unique. Interestingly, we show this existence and uniqueness not just from EP-allocations but for the much broader class of proportional allocations where any function f : R &gt;0 &#8594; R &gt;0 (called the transformation function) can be used to transform the weights rather than just an exponential function. I.e.,</p><p>We call this a generalized proportional allocation or GP-allocation in short.</p><p>We show the following theorem for GP-allocations:</p><p>Theorem 7. For any weight matrix P &#8712; R m&#215;n &gt;0 and any transformation function f : R &gt;0 &#8594; R &gt;0 , the canonical load for a GP-allocation exists and is unique. Moreover, it is attained by a unique (up to scaling) set of canonical parameters.</p><p>We prove Theorem 7 algorithmically by giving a simple iterative (offline) algorithm that converges to the set of canonical parameters (see Algorithm 1). We will show later that the canonical allocations produced by appropriately setting the value of the exponentiation constant &#945; are respectively optimal (fractional) solutions for the Santa Claus and the load balancing problems. Therefore, an interesting consequence of the iterative convergence of this algorithm to the canonical allocation is that it gives a simple alternative offline algorithm for computing an optimal fractional solution for these two problems. To the best of our knowledge, this was not explicitly known before our work.</p><p>An interesting direction for future research would be to explore other natural classes of transformation functions, other than the exponential functions considered in this paper. Since problem since it is a minimization problem. Indeed, the second property that we show is that in the limit of &#945; &#8594; &#8734;, the canonical load converges to the optimal objective for the Santa Claus problem (we denote this optimal value &#8467; SNT ) and in the limit of &#945; &#8594; -&#8734;, the canonical load converges to the optimal objective for the load balancing problem (we denote this optimal value &#8467; MKS ).</p><p>For a fixed &#945;, let X(P, &#945;, w) denote the assignment matrix and &#8467;(P, &#945;, w) the load vector for a learned parameter vector w. Let &#8467; * (P, &#945;) denote the corresponding canonical load. We show the following properties of canonical EP-allocations:</p><p>Theorem 8. For any weight matrix P &#8712; R m&#215;n &gt;0 , the following properties hold for canonical</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>EP-allocations:</head><p>The monotonicity property: For</p><p>The convergence property:</p><p>Clearly, Theorem 8 implies Theorem 6 as a corollary when &#945; is set sufficiently large for the Santa Claus problem and sufficiently small for the load balancing problem.</p><p>In the rest of the paper, we will prove Theorem 7 and Theorem 8.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3">Canonical Properties of Generalized Proportional Allocations</head><p>In this section, we prove Theorem 7. For notational convenience, we define a transformation</p><p>where G(i, j) = f (p i,j ) for the transformation function f . Using this notation, we denote by x i,j (G, w) the fractional allocation of item j to agent i, and by &#8467; i (P, G, w) the load of agent i (we use &#8467;(P, G, w) to denote the vector of agent loads) under the GP-allocation corresponding to the transformation matrix G and learned parameters w.</p><p>We say two sets of learned parameters w, w are equivalent (denoted w &#8801; w ) if there exists some constant c &gt; 0 such that</p><p>The following is a simple observation from the GP-allocation scheme that two equivalent sets of learned parameters produce the same allocation:</p><p>We also note that GP-allocations are monotone in the sense that if one agent's parameter decreases while the rest increase, then the allocation on this agent decreases as well. </p><p>Similarly, we show that if the canonical load exists (i.e., a load vector where all loads are identical), it must be unique. </p><p>Here, the second equality is by Observation 9, and the inequality is by Observation 10, since &#373;k = w k , and &#373;i &#8804; w i for i &#8712; [m].</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.1">Convergence of Algorithm 1</head><p>The rest of this section focuses on showing the existence of a canonical allocation for GPallocations. We do so by showing convergence of the following simple iterative algorithm (Algorithm 1):</p><p>Algorithm 1 The iterative algorithm showing the existence of a canonical allocation for GP-allocations.</p><p>Initialize:</p><p>where &#8467; i (P, G, w (r) ) is the load of agent i under the GP-allocation with transformation matrix G and learned parameters w (r) . Set w (r+1) as w</p><p>Here, &#947; (r) &#8712; R &gt;0 is a scaling factor whose value does not affect the load (by Observation 9). But, by using, e.g., &#947; (r) = &#8467; (r) 1 , we can ensure that the algorithm terminates with a single set of learned parameters instead of repeatedly finding equivalent sets of parameters after it has converged.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>I C A L P 2 0 2 3 50:10 A General Framework for Learning-Augmented Online Allocation</head><p>Note that Algorithm 1 ensures that if the loads of all agents are uniform at any stage, then the iterative process has converged and the algorithm terminates. So, it remains to show that for any P, G &#8712; R m&#215;n &gt;0 , this iterative process reaches a set of parameters w * &#8712; R m &gt;0 such that &#8467; i (P, G, w * ) = &#8467; i (P, G, w * ) for all i, i &#8712; [m].</p><p>Our proof has two parts. The first part shows that the maximum and minimum loads are (weakly) monotone over the course of the iterative process. For this, we focus on a single iteration. For a vector &#8467; &#8712; R m &gt;0 , let &#8467; max = max i&#8712;[m] &#8467; i and &#8467; min = min i&#8712;[m] &#8467; i be the maximum and minimum coordinates of &#8467;. We will show that if &#8467; where</p><p>min for some &#8712; (0, 1]. Then, in the next iteration, we have &#8467;</p><p>min for some constant c &gt; 0 that only depends on P and G.</p><p>Using Lemma 13 and Lemma 14, we complete the proof of Theorem 7.</p><p>Proof of Theorem 7. We are given fixed matrices</p><p>min denote the maximum and the minimum load respectively in iteration r of Algorithm 1. Let c &gt; 0 be the constant (that depends only on P, G) in Lemma 14.</p><p>For a non-negative integer a, let r a be defined recursively as follows:</p><p>We will show for any a, in any iteration r &#8805; r a , we have &#8467; (r) max/&#8467; (r) min &#8804; 1 + 2 -a . First, we prove it for a = 0. If there exists some r &#8804; r 0 such that &#8467; (r) max/&#8467; (r) min &#8804; 2, then this also holds for r &#8805; r 0 by Lemma 13. Otherwise, for all r &#8804; r 0 we have &#8467; (r) max/&#8467; (r) min &gt; 2. Then, using Lemma 14 with = 1, we get &#8467;</p><p>max by our choice of r 0 . This contradicts Lemma 13, thereby showing that &#8467; (r) max/&#8467; (r) min &#8804; 2 for any r &#8805; r 0 . Now, we show the inductive case. Assume the inductive hypothesis that &#8467; (r a-1 ) max /&#8467; (r a-1 ) min &#8804; 1 + 2 -(a-1) . We will prove that &#8467; (ra ) max/&#8467; (ra )</p><p>. The proof is similar to the base case of a = 0. If there exists some r &#8804; r a such that &#8467; (r) max/&#8467; (r) min &#8804; 1 + 2 -a , then this inequality also holds for any r &#8805; r a by Lemma 13. Otherwise, for all r &#8804; r a we have</p><p>Then, for all r a-1 &#8804; r &#8804; r a , using Lemma 14 with = 2 -a , we have &#8467;</p><p>min . By our choice of r a , this implies &#8467; </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="3.2">Weak Monotonicity of the Maximum and Minimum Loads in Algorithm 1: Proof of Lemma 13</head><p>For ease of description, we assume that G and w are normalized in the following sense:</p><p>This transformation is local to the current iteration, and only for the purpose of this proof. First, we explain why this change of notation is w.l.o.g. Suppose &#284;, &#373; represent the actual transformation matrix and learned parameters respectively. Now, we define G as follows:</p><p>and our new learned parameters is given by 1 m .</p><p>Note that the fractional allocation remains unchanged, i.e., x i,j ( &#284;, &#373;) = x i,j (G, 1 m ) = g i,j , and therefore the loads are also unchanged:</p><p>In the normalized notation, the new parameters are w i = &#8467;1 &#8467;i . Again, the allocation is unchanged whether we use the original notation or the normalized one:</p><p>, and we have,</p><p>The case of Two Agents. First, we consider the case of two agents here, i.e., m = 2.</p><p>Later, we will show the reduction from general m to m = 2.</p><p>We have</p><p>and the parameter for the second agent after the update is given by: w 2 = &#8467;1 &#8467;2 (note that</p><p>Accordingly, the loads after the update are given by:</p><p>and</p><p>.</p><p>Assume w.l.o.g that &#8467; 1 &lt; &#8467; 2 . First, note that, from monotonicity (Observation 10) we have:</p><p>.</p><p>Next, we have to show that</p><p>The proof of the lower bound on &#8467; 1 is similar and is omitted for brevity.</p><p>We use the following standard inequality:</p><p>Fact 15 (Milne's Inequality <ref type="bibr">[23]</ref>). For any a, b &#8712; R n , we have</p><p>(a j + b j ) .</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>I C A L P 2 0 2 3 50:12 A General Framework for Learning-Augmented Online Allocation</head><p>In using this inequality, we set for any j &#8712; [n],</p><p>First, we calculate each term in Milne's inequality separately:</p><p>Using Fact 15, we get</p><p>By our assumption that &#8467; 1 &lt; &#8467; 2 , and therefore w 2 &lt; 1. We now get Equation ( <ref type="formula">1</ref>) by rearranging terms. This completes the proof for the lemma for the case of two agents.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="4">Monotonicity and Convergence of Exponentiated Proportional Allocations</head><p>In this section, we prove the monotonicity and convergence of EP-allocations (Theorem 8).</p><p>First, we establish monotonicity of EP-allocations (first part of Theorem 8). We compare two EP-allocations with arbitrary learned parameters but different exponential constants.</p><p>We show that with a larger exponent, at least one agent's load will be higher, regardless of the parameters used.</p><p>Lemma 16. Fix a weight matrix P &#8712; R m&#215;n &gt;0 . Let &#945;, &#945; &#8712; R such that &#945; &gt; &#945; . Now, for any two sets of learned parameters w &#945; , w &#945; &#8712; R m &gt;0 , there exists an agent k &#8712; [m] such that</p><p>Proof. Let &#8710; denote the vector of differences of loads of the machines in the two allocations, namely &#8710; i = &#8467; i (P, &#945;, w &#945; ) -&#8467; i (P, &#945; , w &#945; ). Our goal is to show that &#8710; has at least one nonnegative coordinate.</p><p>To show this, we define a vector in the positive orthant c &#8712; R m &gt;0 as follows:</p><p>, where &#961; = &#945; -&#945; &gt; 0 and show that this vector c has a nonnegative inner product with the vector &#8710;. Note that this suffices since the inner product of a vector with all positive coordinates and one with all negative coordinates cannot be nonnegative. In other words, we want to show the following:</p><p>Let us denote the fractional allocation of an item j in the two cases by x i,j and x i,j respectively. Then, Equation ( <ref type="formula">2</ref>) can be rewritten as</p><p>Changing the order of the two summations, we rewrite further as</p><p>We will prove this inequality separately for each item j &#8712; [n]. Namely, we will show that</p><p>Fix an item j. Since the item is fixed, we will drop j from the notation and define u &#8712; R m as</p><p>So, we need to show that</p><p>We have</p><p>where</p><p>Now, on the right hand side of the above equation, we replace &#945; by &#945; + &#961; and w &#945;,i by</p><p>This gives us:</p><p>where</p><p>Rearranging the summations on the two terms on the right hand side, we get</p><p>2 0 2 3 50:14 A General Framework for Learning-Augmented Online Allocation Now, let z i = a 1/2 i , and</p><p>, and &#952; = |&#961;-1| &#961;+1 . Then, we have</p><p>In the last equation, the first term follows directly from</p><p>The second term is more complicated. There are two cases.</p><p>then the roles get reversed and we get</p><p>Now, note that T &#8805; 0. So, to establish i c i &#8226; u i &#8805; 0, it suffices to show that the right hard side of the equation is nonnegative. We do so by employing Callebaut's inequality which we state below:</p><p>Fact 17 (Callebaut's Inequality <ref type="bibr">[11]</ref>). For any y, z &#8712; R n and &#952; &#8804; 1, we have</p><p>Note that we can apply Callebaut's inequality because &#961; &#8805; 0 implies that &#952; &#8804; 1. This completes the proof of the lemma. Using Lemma 18, we complete the proof of Theorem 8.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Proof of</head><p>Theorem 8. First by Lemma 11, there exists w * &#945; and w * &#945; , such that, for all i &#8712; [m], &#8467; i (P, &#945;, w * &#945; ) = &#8467; * (P, &#945;) and &#8467; i (P, &#945; , w * &#945; ) = &#8467; * (P, &#945; ). Now, if &#8467; * (P, &#945;) &lt; &#8467; * (P, &#945; ), it would contradict Lemma 16. And combining Lemma 16 and Lemma 18, we completed the proof the second part of Theorem 8.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="5">Noise Resilience: Handling Predictions with Error</head><p>In this section, we show the noise resilience of our algorithms, namely that we can handle errors in the learned parameters. First, we will show that for both objectives (MaxMin and MinMax), an &#951;-approximate set of learned parameters yields an online algorithm with a competitive ratio of at least/at most &#951;. Second, for the MinMax objective, we show that it is possible to improve the competitive ratio further in the following sense: using a set of learned parameters with a multiplicative error of &#951; with respect to the optimal parameters, we can obtain a O(log &#951;)-competitive algorithm. (This was previously shown by Lattanzi et al. <ref type="bibr">[17]</ref> but only for the special case of restricted assignment.) We also rule out a similar guarantee for the MaxMin objective, i.e., we show that using &#951;-approximate learned parameters, an algorithm cannot hope to obtain a competitive ratio better than &#951;/c for some constant c.</p><p>Finally, we show that noise-resilient bounds can be obtained not just for the MinMax and MaxMin objectives but also for any homogeneous monotone minimization or maximization objective function. Formally, a weight vector w is &#951;-approximate with respect to a weight vector to w * , if for any two agents i, i &#8712; [m], w i wi &#8804; &#951; &#8226; w * i w * i . First, we show a basic noise resilience property that holds for both the MinMax and MaxMin objectives: Lemma 19. Fix a weight matrix P &#8712; R m&#215;n &gt;0 and a transformation matrix G &#8712; R m&#215;n &gt;0 . For any two parameter vectors w * , w &#8712; R m &gt;0 , such that w is &#951;-approximate to w * , we have that for any agent k:</p><p>Proof. Let y i,j = x i,j (G, w * ) and z i,j = x i,j (G, w) be the respective fractional allocations under proportional allocation using the transformation matrix G. For an agent i, let &#964; i = w i /w * i . Then for any two agents i, k, we have that</p><p>Hence, y i,j /&#951; &#8804; z i,j &#8804; y i,j &#8226; &#951;. Finally, the lemma hold by summing over all items.</p><p>The next theorem follows immediately by using a proportional allocation according to the parameter vector w: Theorem 20. Fix any P, G &#8712; R m&#215;n &gt;0 . Let w be a learned parameter vector that gives a solution of value &#947; for the MaxMin (resp., MinMax) objective using proportional allocation.</p><p>Let w be &#951;-approximate to w for some &#951; &gt; 1. Then, there exists an online algorithm that given w generates a solution with value at least &#8486;(&#947;/&#951;) (resp., at most O(&#951;&#947;)).</p><p>In particular, if w is the optimal learned parameter vector in the above theorem and w is an &#951;-approximation to it, then we obtain a competitive ratio of &#8486;(1/&#951;).</p><p>The rest of this section focuses on the MinMax objective for which we can obtain an improved bound. In the next lemma, we establish an upper bound on the load, using</p><p>Lemma 19 and monotonicity. Lemma 21. Fix a weight matrix P &#8712; R m&#215;n &gt;0 and a transformation matrix G &#8712; R m&#215;n &gt;0 . For any two parameter vectors w * , w &#8712; R m &gt;0 such that there exists an agent k &#8712; [m] for which w * k /2 &#8804; w k &#8804; w * k and for all other agents i = k, we have w i &#8805; w * i /2, then the following holds: &#8467; k (P, G, w) &#8804; 2 &#8226; &#8467; k (P, G, w * ). Proof. Define w where w k = w * k (i.e., the maximum in its allowed range) and w i = w * i /2 for all i = k (i.e., the minimum in their allowed ranges). Now, by monotonicity (Observation 10), we have x k,j (G, w) &#8804; x k,j (G, w ), and therefore, &#8467; k (P, G, w) &#8804; &#8467; k (P, G, w ). Note that for w , for any two agents i 1 , i 2 , wi 1 wi 2 &#8804; 2 &#8226; w * i 1 w * i 2 . Therefore, by Lemma 19, we have &#8467; k (P, G, w ) &#8804; 2 &#8226; &#8467; k (P, G, w * ). By combining the two inequalities, we have &#8467; k (P, G, w) &#8804; &#8467; k (P, G, w ) &#8804; 2 &#8226; &#8467; k (P, G, w * ), as required. I C A L P 2 0 2 3</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Generalization to Well-Behaved Objectives</head><p>We first generalize Theorem 6 to all well-behaved functions.</p><p>Theorem 26. Fix any instance of an online allocation problem with divisible items where the goal is to maximize or minimize a monotone homogeneous objective function. Then, there exists an online algorithm and a learned parameter vector in R m &gt;0 that achieves a competitive ratio of 1 -(for maximization) or 1 + (for minimization).</p><p>Proof. Fix an objection function f and a matrix P &#8712; R m&#215;n &gt;0 . Let &#8467; f i denote the load of agent i in an optimal solution for objective function f . Also, let x i,j denote the fraction of item j assigned to agent i in this optimal solution. Now, consider the matrix P , where pi,j = pi,j &#8467; f i .</p><p>By the monotonicity property of f , the optimal objective value for P is 1. Therefore, by Theorem 8, there exist &#945; and w, such that using an EP-allocation, we get &#8467; * ( P , &#945;, w) &#8805; 1 -</p><p>maximization and &#8467; * ( P , &#945;, w) &#8804; 1 + for minimization. Let x * i,j be the fraction of item j assigned to agent i in this approximate solution. By the definition of EP-allocation, x * i,j is proportional to p&#945; i,j &#8226; wi = pi,j &#8467; f i &#945; &#8226; wi = p &#945; i,j &#8226; wi (&#8467; f i ) &#945; . Thus, if we define w such that w i = wi (&#8467; f i ) &#945; , then the corresponding EP-allocation gives a (1 -)-approximate solution for maximization and (1 + )-approximate solution for minimization.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="7.1">Noise Resilience</head><p>Next, we consider noise resilience for well-behaved functions, i.e., we generalize Theorem 20 to all well-behaved objective functions. This follows immediately from Lemma 19 and the observation that if all loads are scaled by &#951;, then the objective value for a well-behaved objective is also scaled by &#951;. We state this generalized theorem below: Theorem 27. Fix any P, G &#8712; R m&#215;n &gt;0 and any monotone, homogeneous function f . Let w be a learned parameter vector that gives a solution of objective value &#947; using EP-allocation.</p><p>Let w be &#951;-approximate to w for some &#951; &gt; 1. Then, the EP-allocation for w gives a solution with value at least &#947;/&#951; for maximization and at most &#951;&#947; for minimization.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head n="7.2">Learnability</head><p>Finally, we consider learnability of parameters for well-behaved functions, i.e., we generalize Theorem 23 and by assuming additional property of the objective function:</p><p>For a maximization objective f , we need superadditivity: f ( r &#8467; r ) &#8805; r f (&#8467; r ).</p><p>For a minimization objective f , we need subadditivity: f ( r &#8467; r ) &#8804; r f (&#8467; r ).</p><p>Theorem 28. Let f be a well-behaved function. If f is superadditive, the following theorem holds for maximization of f , while if f is subadditive, the following theorem holds for minimization of f . Let T be the expectation of the maximum value of f over instances sampled from D. Fix an &gt; 0 for which the small items assumption holds. Then, there is an </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Conclusion and Future Directions</head><p>In this paper, we gave a unifying framework for designing near-optimal algorithm for fractional allocation problems for essentially all well-studied minimization and maximization objectives in the literature. The existence of this overarching framework is rather surprising because the corresponding worst-case problems exhibit a wide range of behavior in terms of the best competitive ratio achievable, as well as the techniques required to achieve those bounds.</p><p>It would be interesting to gain further understanding of the optimal learned parameters introduced in this paper. One natural conjecture is that these are optimal dual variables for a suitably defined convex program (for instance, such convex programs are known for restricted assignment and b-matching <ref type="bibr">[1]</ref>). Another interesting direction of future work would be to explore other polytopes beyond the simple assignment polytope considered in this paper, such as that corresponding to congestion minimization problems.</p></div><note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_0"><p>We consider the learning model introduced by<ref type="bibr">[18]</ref>, and show that under this model, the parameter vector w can be learned efficiently from sampled instances. Specifically, we consider</p></note>
		</body>
		</text>
</TEI>
