%PDF-1.6
%
110 0 obj
<>]/Pages 105 0 R/Type/Catalog>>
endobj
200 0 obj
<>/Font<>>>/Fields[]>>
endobj
51 0 obj
<>stream
application/pdf
Planning with Abstract Markov Decision Processes
Nakul Gopalan, Marie desJardins, Michael L. Littman, James MacGlashan, Shawn Squire, Stefanie Tellex, John Winder, Lawson L.S. Wong
2017-04-06T16:14:48Z
TeX
2017-07-06T22:07:36-04:00
2017-07-06T22:07:36-04:00
pdfTeX-1.40.17
False
uuid:29c85b61-d365-5146-bb44-3b29081e3ed9
uuid:67f26120-8044-a144-bb1f-d7ab575be488
default
1
converted
uuid:359f0187-60c1-514c-ac5a-ae64e5dec231
converted to PDF/A-1b
Preflight
2017-07-06T22:07:35-04:00
1
B
http://ns.adobe.com/pdf/1.3/
pdf
Adobe PDF Schema
internal
A name object indicating whether the document has been modified to include trapping information
Trapped
Text
http://ns.adobe.com/xap/1.0/mm/
xmpMM
XMP Media Management Schema
internal
UUID based identifier for specific incarnation of a document
InstanceID
URI
internal
The common identifier for all versions and renditions of a document.
OriginalDocumentID
URI
http://www.aiim.org/pdfa/ns/id/
pdfaid
PDF/A ID Schema
internal
Part of PDF/A standard
part
Integer
internal
Amendment of PDF/A standard
amd
Text
internal
Conformance level of PDF/A standard
conformance
Text
endstream
endobj
164 0 obj
<>
endobj
105 0 obj
<>
endobj
106 0 obj
<>
endobj
107 0 obj
<>
endobj
204 0 obj
<>/Font<>/ProcSet[/PDF/Text/ImageC]/XObject<>>>/Rotate 0/Type/Page>>
endobj
24 0 obj
<>/ProcSet[/PDF/Text/ImageC]/XObject<>>>/Rotate 0/Type/Page>>
endobj
31 0 obj
<>/ProcSet[/PDF/Text/ImageC]/XObject<>>>/Rotate 0/Type/Page>>
endobj
41 0 obj
<>/ProcSet[/PDF/Text]>>/Rotate 0/Type/Page>>
endobj
205 0 obj
<>/Font<>/ProcSet[/PDF/Text/ImageC]/XObject<>>>/Rotate 0/Type/Page>>
endobj
214 0 obj
<>stream
q
/GS0 gs
121.2626359 0 0 121.8719959 53.84766 605.5466405 cm
/Im0 Do
Q
BT
/GS1 gs
/T1_0 1 Tf
8.966 0 0 8.966 69.896 592.748 Tm
[(\(a\))-250(Cleanup)-250(W)80(orld)-250(\(4rm\))]TJ
ET
1 g
190.078 605.699 176.4 132.3 re
f
190.078 605.699 176.4 132.3 re
f
211.813 625.859 149.625 108.36 re
f
0.149 G
0.473 w 1 j 2 J
q 1 0 0 1 211.813 625.8589 cm
0 0 m
149.625 0 l
S
Q
q 1 0 0 1 211.813 625.8589 cm
0 0 m
0 1.496 l
S
Q
q 1 0 0 1 261.688 625.8589 cm
0 0 m
0 1.496 l
S
Q
q 1 0 0 1 311.5631 625.8589 cm
0 0 m
0 1.496 l
S
Q
q 1 0 0 1 361.4381 625.8589 cm
0 0 m
0 1.496 l
S
Q
q 1 0 0 1 226.8269 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 235.6095 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 241.8408 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 246.6742 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 250.6234 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 253.9623 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 256.8547 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 259.4059 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 276.7019 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 285.4845 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 291.7158 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 296.5492 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 300.4984 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 303.8373 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 306.7297 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 309.2809 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 326.577 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 335.3596 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 341.5909 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 346.4243 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 350.3734 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 353.7124 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 356.6047 625.8589 cm
0 0 m
0 0.748 l
S
Q
q 1 0 0 1 359.156 625.8589 cm
0 0 m
0 0.748 l
S
Q
BT
0.149 g
/C2_0 1 Tf
6.3 0 0 6.3 206.773 615.779 Tm
<00140013>Tj
5.04 0 0 5.04 214.018 618.929 Tm
<0017>Tj
6.3 0 0 6.3 256.543 615.779 Tm
<00140013>Tj
5.04 0 0 5.04 263.788 618.929 Tm
<0018>Tj
6.3 0 0 6.3 306.628 615.779 Tm
<00140013>Tj
5.04 0 0 5.04 313.873 618.929 Tm
<0019>Tj
6.3 0 0 6.3 356.398 615.779 Tm
<00140013>Tj
ET
q
189.721 605.022 176.835 133.797 re
W n
BT
/C2_0 1 Tf
5.04 0 0 5.04 363.643 618.929 Tm
<001A>Tj
6.93 0 0 6.93 240.163 607.274 Tm
<0031005800500045004800550003005200490003004500440046004E005800530003005200530048005500440057004C005200510056>Tj
ET
Q
q 1 0 0 1 211.813 625.8589 cm
0 0 m
0 108.36 l
S
Q
q 1 0 0 1 211.813 625.8589 cm
0 0 m
1.496 0 l
S
Q
q 1 0 0 1 211.813 647.5309 cm
0 0 m
1.496 0 l
S
Q
q 1 0 0 1 211.813 669.2029 cm
0 0 m
1.496 0 l
S
Q
q 1 0 0 1 211.813 690.8749 cm
0 0 m
1.496 0 l
S
Q
q 1 0 0 1 211.813 712.5469 cm
0 0 m
1.496 0 l
S
Q
q 1 0 0 1 211.813 734.219 cm
0 0 m
1.496 0 l
S
Q
BT
/C2_0 1 Tf
6.3 0 0 6.3 206.143 623.4965 Tm
<0013>Tj
-0.55 3.44 Td
<00150013>Tj
0 3.44 TD
<00170013>Tj
T*
<00190013>Tj
T*
<001B0013>Tj
ET
q
189.721 605.022 176.835 133.797 re
W n
BT
/C2_0 1 Tf
6.3 0 0 6.3 199.213 731.8564 Tm
<001400130013>Tj
0 6.93 -6.93 0 196.693 631.6865 Tm
<00330048005500460048005100570044004A00480003005200490003005700440056004E005600030046005200500053004F0048005700480047>Tj
ET
Q
1 0 0 RG
1.417 w 0 J
q 1 0 0 1 226.8269 630.0849 cm
0 0 m
15.014 6.827 l
30.028 21.672 l
45.042 76.611 l
60.055 102.834 l
75.069 104.134 l
90.083 104.134 l
105.097 104.134 l
120.111 104.134 l
S
Q
1 M 2 j [1.26 1.26]0 d
q 1 0 0 1 226.8269 625.8589 cm
0 0 m
15.014 0 l
30.028 0 l
45.042 0 l
60.055 0 l
75.069 5.201 l
90.083 35.976 l
105.097 97.849 l
120.111 108.36 l
S
Q
10 M 1 j []0 d
q 1 0 0 1 227.7205 626.0164 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 242.8405 626.0164 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 257.6456 626.0164 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
q 1 0 0 1 272.7656 626.0164 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 287.8856 626.0164 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
q 1 0 0 1 302.6906 631.0564 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
q 1 0 0 1 317.8106 661.9264 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
q 1 0 0 1 332.9306 723.6664 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 347.7357 734.3765 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
0 G
q 1 0 0 1 226.8269 734.219 cm
0 0 m
15.014 0 l
30.028 0 l
45.042 0 l
60.055 0 l
75.069 0 l
90.083 0 l
105.097 0 l
120.111 0 l
S
Q
1 M 2 j [1.26 1.26]0 d
q 1 0 0 1 226.8269 668.4444 cm
0 0 m
15.014 31.424 l
30.028 64.366 l
45.042 64.149 l
60.055 64.799 l
75.069 64.583 l
90.083 64.258 l
105.097 64.041 l
120.111 64.041 l
S
Q
10 M 1 j []0 d
q 1 0 0 1 227.7205 668.5414 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 242.8405 699.7264 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 257.6456 732.8015 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
q 1 0 0 1 272.7656 732.4865 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 287.8856 733.1165 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
q 1 0 0 1 302.6906 733.1165 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
q 1 0 0 1 317.8106 732.8015 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
q 1 0 0 1 332.9306 732.4865 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 347.7357 732.4865 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
1 g
317.968 658.619 46.305 -29.61 re
f
BT
0 g
/C2_0 1 Tf
5.67 0 0 5.67 329.623 652.2971 Tm
<00240030002700330003000B001600550050000C>Tj
ET
q 1 0 0 1 319.2281 654.502 cm
0 0 m
9.45 0 l
S
Q
BT
/C2_0 1 Tf
5.67 0 0 5.67 329.623 645.1716 Tm
<00240030002700330003000B001700550050000C>Tj
ET
1 M 2 j [1.26 1.26]0 d
q 1 0 0 1 319.2281 647.3766 cm
0 0 m
9.45 0 l
S
Q
10 M 1 j []0 d
q 1 0 0 1 325.0556 647.4364 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
BT
/C2_0 1 Tf
5.67 0 0 5.67 329.623 638.0463 Tm
<002500350037002700330003000B001600550050000C>Tj
ET
1 0 0 RG
q 1 0 0 1 319.2281 640.2512 cm
0 0 m
9.45 0 l
S
Q
BT
/C2_0 1 Tf
5.67 0 0 5.67 329.623 630.9209 Tm
<002500350037002700330003000B001700550050000C>Tj
ET
1 M 2 j [1.26 1.26]0 d
q 1 0 0 1 319.2281 633.1258 cm
0 0 m
9.45 0 l
S
Q
10 M 1 j []0 d
q 1 0 0 1 325.0556 633.2614 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
0.149 G
0.473 w 0 j
q 1 0 0 1 317.9681 629.0089 cm
0 0 m
0 29.61 l
46.305 29.61 l
46.305 0 l
h
S
Q
BT
/T1_0 1 Tf
8.966 0 0 8.966 195.176 592.748 Tm
[(\(b\))-250(T)80(asks)-250(completed)-250(within)-250(a)-250(planning)-250(b)20(udget.)]TJ
ET
1 g
381.597 605.699 176.4 132.3 re
f
381.597 605.699 176.4 132.3 re
f
399.867 625.859 153.09 108.36 re
f
1 j 2 J
q 1 0 0 1 399.867 625.8589 cm
0 0 m
153.09 0 l
S
Q
q 1 0 0 1 399.867 625.8589 cm
0 0 m
0 1.531 l
S
Q
q 1 0 0 1 450.897 625.8589 cm
0 0 m
0 1.531 l
S
Q
q 1 0 0 1 501.9271 625.8589 cm
0 0 m
0 1.531 l
S
Q
q 1 0 0 1 552.9572 625.8589 cm
0 0 m
0 1.531 l
S
Q
q 1 0 0 1 415.2286 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 424.2145 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 430.5901 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 435.5355 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 439.5761 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 442.9924 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 445.9517 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 448.562 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 466.2586 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 475.2445 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 481.6202 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 486.5655 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 490.6061 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 494.0225 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 496.9818 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 499.5921 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 517.2886 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 526.2746 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 532.6502 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 537.5955 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 541.6362 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 545.0525 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 548.0118 625.8589 cm
0 0 m
0 0.765 l
S
Q
q 1 0 0 1 550.6221 625.8589 cm
0 0 m
0 0.765 l
S
Q
BT
0.149 g
/C2_0 1 Tf
6.3 0 0 6.3 394.827 615.779 Tm
<00140013>Tj
5.04 0 0 5.04 402.072 618.929 Tm
<0017>Tj
6.3 0 0 6.3 445.857 615.779 Tm
<00140013>Tj
5.04 0 0 5.04 453.102 618.929 Tm
<0018>Tj
6.3 0 0 6.3 496.887 615.779 Tm
<00140013>Tj
5.04 0 0 5.04 504.132 618.929 Tm
<0019>Tj
6.3 0 0 6.3 547.917 615.779 Tm
<00140013>Tj
5.04 0 0 5.04 555.162 618.929 Tm
<001A>Tj
ET
q
381.24 605.022 176.835 133.173 re
W n
BT
/C2_0 1 Tf
6.93 0 0 6.93 429.9495 607.274 Tm
<0031005800500045004800550003005200490003004500440046004E005800530003005200530048005500440057004C005200510056>Tj
ET
Q
q 1 0 0 1 399.867 625.8589 cm
0 0 m
0 108.36 l
S
Q
q 1 0 0 1 399.867 625.8589 cm
0 0 m
1.531 0 l
S
Q
q 1 0 0 1 399.867 647.5309 cm
0 0 m
1.531 0 l
S
Q
q 1 0 0 1 399.867 669.2029 cm
0 0 m
1.531 0 l
S
Q
q 1 0 0 1 399.867 690.8749 cm
0 0 m
1.531 0 l
S
Q
q 1 0 0 1 399.867 712.5469 cm
0 0 m
1.531 0 l
S
Q
q 1 0 0 1 399.867 734.219 cm
0 0 m
1.531 0 l
S
Q
BT
/C2_0 1 Tf
6.3 0 0 6.3 390.732 623.4965 Tm
<00150013>Tj
T*
<00160013>Tj
T*
<00170013>Tj
T*
<00180013>Tj
T*
<00190013>Tj
ET
q
381.24 605.022 176.835 133.173 re
W n
BT
/C2_0 1 Tf
6.3 0 0 6.3 390.732 731.8564 Tm
<001A0013>Tj
0 6.93 -6.93 0 388.212 635.624 Tm
<00240059004800550044004A004800030056005700480053005600030057005200030046005200500053004F00480057004C00520051>Tj
ET
Q
1 0 0 RG
1.417 w 0 J
q 1 0 0 1 430.5901 642.8256 cm
0 0 m
0 3.164 l
S
Q
q 1 0 0 1 445.9517 642.2805 cm
0 0 m
0 2.195 l
S
Q
q 1 0 0 1 461.3133 640.275 cm
0 0 m
0 1.323 l
S
Q
q 1 0 0 1 476.6749 636.7729 cm
0 0 m
0 0.287 l
S
Q
q 1 0 0 1 492.0364 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 507.398 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 522.7596 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 538.1212 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 427.1682 642.8256 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 442.5297 642.2805 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 457.8913 640.275 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 473.2529 636.7729 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 488.6144 636.6949 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 503.976 636.6949 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 519.3376 636.6949 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 534.6992 636.6949 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 427.1682 645.9896 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 442.5297 644.4752 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 457.8913 641.5977 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 473.2529 637.06 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 488.6144 636.6949 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 503.976 636.6949 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 519.3376 636.6949 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 534.6992 636.6949 cm
0 0 m
6.844 0 l
S
Q
q 1 0 0 1 430.5901 644.4076 cm
0 0 m
15.362 -1.03 l
30.723 -3.471 l
46.085 -7.491 l
61.446 -7.713 l
76.808 -7.713 l
92.169 -7.713 l
107.531 -7.713 l
S
Q
q 1 0 0 1 507.398 698.0048 cm
0 0 m
0 3.704 l
S
Q
q 1 0 0 1 522.7596 696.5057 cm
0 0 m
0 1.986 l
S
Q
q 1 0 0 1 538.1212 686.9738 cm
0 0 m
0 0.434 l
S
Q
q 1 0 0 1 504.038 698.0048 cm
0 0 m
6.72 0 l
S
Q
q 1 0 0 1 519.3996 696.5057 cm
0 0 m
6.72 0 l
S
Q
q 1 0 0 1 534.7612 686.9738 cm
0 0 m
6.72 0 l
S
Q
q 1 0 0 1 504.038 701.7094 cm
0 0 m
6.72 0 l
S
Q
q 1 0 0 1 519.3996 698.4921 cm
0 0 m
6.72 0 l
S
Q
q 1 0 0 1 534.7612 687.4076 cm
0 0 m
6.72 0 l
S
Q
1 M 2 j [1.26 1.26]0 d
q 1 0 0 1 507.398 699.8571 cm
0 0 m
15.362 -2.358 l
30.723 -12.666 l
S
Q
10 M 1 j []0 d
q 1 0 0 1 508.3846 699.7264 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 523.8196 697.5214 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.709 0.555 l
-1.89 0 l
-1.709 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 538.9396 687.1265 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
0 G
q 1 0 0 1 415.2286 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 430.5901 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 445.9517 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 461.3133 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 476.6749 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 492.0364 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 507.398 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 522.7596 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 538.1212 636.6949 cm
0 0 m
0 0 l
S
Q
q 1 0 0 1 411.8057 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 427.1673 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 442.5288 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 457.8904 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 473.252 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 488.6136 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 503.9752 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 519.3367 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 534.6983 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 411.8057 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 427.1673 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 442.5288 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 457.8904 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 473.252 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 488.6136 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 503.9752 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 519.3367 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 534.6983 636.6949 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 415.2286 636.6949 cm
0 0 m
15.362 0 l
30.723 0 l
46.085 0 l
61.446 0 l
76.808 0 l
92.169 0 l
107.531 0 l
122.893 0 l
S
Q
q 1 0 0 1 415.2286 717.4713 cm
0 0 m
0 10.698 l
S
Q
q 1 0 0 1 430.5901 704.9745 cm
0 0 m
0 5.765 l
S
Q
q 1 0 0 1 445.9517 690.5722 cm
0 0 m
0 1.471 l
S
Q
q 1 0 0 1 461.3133 691.4045 cm
0 0 m
0 2.563 l
S
Q
q 1 0 0 1 476.6749 691.6342 cm
0 0 m
0 2.562 l
S
Q
q 1 0 0 1 492.0364 690.5164 cm
0 0 m
0 1.716 l
S
Q
q 1 0 0 1 507.398 691.1671 cm
0 0 m
0 1.882 l
S
Q
q 1 0 0 1 522.7596 691.3879 cm
0 0 m
0 2.066 l
S
Q
q 1 0 0 1 538.1212 691.5422 cm
0 0 m
0 2.731 l
S
Q
q 1 0 0 1 411.8057 717.4713 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 427.1673 704.9745 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 442.5288 690.5722 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 457.8904 691.4045 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 473.252 691.6342 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 488.6136 690.5164 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 503.9752 691.1671 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 519.3367 691.3879 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 534.6983 691.5422 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 411.8057 728.1697 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 427.1673 710.7398 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 442.5288 692.0428 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 457.8904 693.9669 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 473.252 694.1964 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 488.6136 692.2327 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 503.9752 693.049 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 519.3367 693.4542 cm
0 0 m
6.846 0 l
S
Q
q 1 0 0 1 534.6983 694.2734 cm
0 0 m
6.846 0 l
S
Q
1 M 2 j [1.26 1.26]0 d
q 1 0 0 1 415.2286 722.8205 cm
0 0 m
15.362 -14.963 l
30.723 -31.513 l
46.085 -30.135 l
61.446 -29.905 l
76.808 -31.446 l
92.169 -30.713 l
107.531 -30.399 l
122.893 -29.913 l
S
Q
10 M 1 j []0 d
q 1 0 0 1 416.0895 722.7214 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 431.5245 707.9164 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
q 1 0 0 1 446.9595 691.2214 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 462.3946 692.7964 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
q 1 0 0 1 477.5146 692.7964 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
q 1 0 0 1 492.9496 691.2214 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
q 1 0 0 1 508.3846 692.1664 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 523.8196 692.4814 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.709 0.555 l
-1.89 0 l
-1.709 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
q 1 0 0 1 538.9396 692.7964 cm
0 0 m
-0.181 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.181 -0.555 l
h
S
Q
1 g
500.667 678.464 46.305 -29.61 re
f
BT
0 g
/C2_0 1 Tf
5.67 0 0 5.67 512.322 672.1421 Tm
<00240030002700330003000B001600550050000C>Tj
ET
q 1 0 0 1 501.9271 674.347 cm
0 0 m
9.45 0 l
S
Q
BT
/C2_0 1 Tf
5.67 0 0 5.67 512.322 665.0167 Tm
<00240030002700330003000B001700550050000C>Tj
ET
1 M 2 j [1.26 1.26]0 d
q 1 0 0 1 501.9271 667.2216 cm
0 0 m
9.45 0 l
S
Q
10 M 1 j []0 d
q 1 0 0 1 507.7546 667.2814 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
BT
/C2_0 1 Tf
5.67 0 0 5.67 512.322 657.8912 Tm
<002500350037002700330003000B001600550050000C>Tj
ET
1 0 0 RG
q 1 0 0 1 501.9271 660.0962 cm
0 0 m
9.45 0 l
S
Q
BT
/C2_0 1 Tf
5.67 0 0 5.67 512.322 650.7659 Tm
<002500350037002700330003000B001700550050000C>Tj
ET
1 M 2 j [1.26 1.26]0 d
q 1 0 0 1 501.9271 652.9708 cm
0 0 m
9.45 0 l
S
Q
10 M 1 j []0 d
q 1 0 0 1 507.7546 653.1064 cm
0 0 m
-0.18 0.555 l
-0.653 0.899 l
-1.237 0.899 l
-1.71 0.555 l
-1.89 0 l
-1.71 -0.555 l
-1.237 -0.899 l
-0.653 -0.899 l
-0.18 -0.555 l
h
S
Q
0.149 G
0.473 w 0 j
q 1 0 0 1 500.6671 648.8539 cm
0 0 m
0 29.61 l
46.305 29.61 l
46.305 0 l
h
S
Q
BT
/T1_0 1 Tf
8.966 0 0 8.966 390.787 592.748 Tm
[(\(c\))-250(Steps)-250(tak)10(en)-250(to)-250(mo)15(v)15(e)-250(an)-250(object)-250(to)-250(a)-250(room.)]TJ
9.963 0 0 9.963 54 572.125 Tm
[(Figure)-316(4:)-631(\(a\))-316(Cleanup)-315(W)80(orld)-316(\()]TJ
/T1_1 1 Tf
(\035)Tj
/T1_0 1 Tf
[(-room)-316(con\002guration)-315(sho)25(wn\))-316(using)-315(AMDPs)-316(and)-316(base-le)25(v)15(el)-315(\(BR)60(TDP\))-316(planning.)-316(\(b-c\))-315(AMDPs)]TJ
0 -1.1 TD
[(\(black\))-250(ha)20(v)15(e)-250(near)20(-perfect)-250(completion)-250(rates,)-250(\002nding)-250(plans)-250(of)-250(similar)-250(length)-250(orders)-250(of)-250(magnitude)-250(f)10(aster)-250(than)-250(BR)60(TDP)-250(\(red\).)]TJ
1 -3.33 Td
[(In)-198(both)-198(con\002gurations,)-198(AMDPs)-198(solv)15(ed)-198(the)-198(task)-198(with)-198(an)-198(or)20(-)]TJ
-1 -1.1 Td
[(der)-227(of)-228(magnitude)-227(fe)25(wer)-228(backups)-227(than)-228(the)-227(base-le)25(v)15(el)-228(BR)60(TDP)111(,)]TJ
0 -1.1 TD
[(as)-218(sho)25(wn)-218(in)-218(Figure)-217(4.)-218(AMDPs)-218(solv)15(ed)-218(3rm)-218(and)-218(4rm)-218(to)-218(almost)]TJ
/T1_1 1 Tf
0 -1.1 TD
(\037\036\036\033)Tj
/T1_0 1 Tf
2.566 0 Td
[(completion)-232(rate)-233(with)-232(about)]TJ
/T1_1 1 Tf
10.928 0 Td
(\034\036\036\036)Tj
/T1_0 1 Tf
2.232 0 Td
(and)Tj
/T1_1 1 Tf
1.676 0 Td
(\027\036)Tj
/T1_2 1 Tf
(\036)Tj
/T1_1 1 Tf
1.278 0 Td
(\036\036\036)Tj
/T1_0 1 Tf
1.732 0 Td
(backups,)Tj
-20.412 -1.1 Td
[(respecti)25(v)15(ely)65(,)-282(whereas)-282(BR)60(TDP)-282(needed)]TJ
/T1_1 1 Tf
15.375 0 Td
(\032\031\036)Tj
/T1_2 1 Tf
(\036)Tj
/T1_1 1 Tf
1.778 0 Td
(\036\036\036)Tj
/T1_0 1 Tf
1.782 0 Td
(and)Tj
/T1_1 1 Tf
1.726 0 Td
(\034\037\031)Tj
/T1_2 1 Tf
(\036)Tj
/T1_1 1 Tf
1.778 0 Td
(\036\036\036)Tj
/T1_0 1 Tf
-22.439 -1.1 Td
[(backups,)-250(respecti)25(v)15(ely)65(,)-250(to)-250(achie)25(v)15(e)-250(the)-250(same)-250(performance.)]TJ
1 -1.184 Td
[(W)80(e)-390(also)-389(solv)15(ed)-390(a)-389(basic)-390(Cleanup)-390(W)80(orld)-389(problem)-390(with)]TJ
/T1_1 1 Tf
22.439 0 Td
(\032)Tj
/T1_0 1 Tf
-23.439 -1.1 Td
[(rooms)-213(and)-212(one)-213(object)-213(\()]TJ
/T1_1 1 Tf
(\031\034)Tj
/T1_2 1 Tf
(\036)Tj
/T1_1 1 Tf
10.294 0 Td
(\036\036\036)Tj
/T1_0 1 Tf
1.712 0 Td
[(states\),)-213(in)-212(which)-213(both)-213(AMDPs)]TJ
-12.006 -1.1 Td
[(and)-477(the)-477(base-le)25(v)15(el)-477(planners)-477(could)-477(\002nd)-477(the)-477(optimal)-477(solu-)]TJ
T*
[(tion)-321(within)]TJ
/T1_1 1 Tf
4.754 0 Td
(\034\036\036)Tj
/T1_0 1 Tf
1.821 0 Td
[(backups,)-321(sho)25(wing)-322(that)-321(the)-321(task)-322(w)10(a)1(s)-322(simple)]TJ
-6.576 -1.1 Td
[(enough)-210(not)-209(to)-210(need)-209(comple)15(x)-210(hierarchies.)-209(Ho)25(we)25(v)15(er)40(,)-210(we)-210(found)]TJ
T*
[(that,)-325(e)25(v)15(en)-325(in)-326(this)-325(simpli\002ed)-325(con\002guration,)-325(MAXQ)-325(w)10(as)-326(un-)]TJ
T*
[(able)-250(to)-250(\002nd)-250(a)-250(solution)-250(with)]TJ
/T1_1 1 Tf
10.944 0 Td
(\027)Tj
/T1_2 1 Tf
(\036)Tj
/T1_1 1 Tf
0.778 0 Td
(\036\036\036)Tj
/T1_2 1 Tf
(\036)Tj
/T1_1 1 Tf
1.778 0 Td
(\036\036\036)Tj
/T1_0 1 Tf
1.75 0 Td
(backups.)Tj
-14.25 -1.184 Td
[(AMDPs)-417(ha)20(v)15(e)-417(a)-416(particular)-417(adv)25(antage)-417(in)-417(Cleanup)-417(W)80(orld)]TJ
-1 -1.1 Td
[(because)-372(long)-371(plans)-372(are)-371(needed,)-372(and)-371(solving)-372(tasks)-372(requires)]TJ
T*
[(manipulating)-359(one)-359(out)-359(of)-359(man)15(y)-360(present)-359(objects.)-359(Such)-360(com-)]TJ
T*
[(binatorial)-268(state)-267(spaces)-268(are)-268(present)-267(in)-268(e)25(v)15(eryday)-268(manipulation)]TJ
0 -1.1 TD
[(tasks,)-267(and)-268(AMDPs)-267(are)-268(better)-267(equipped)-268(than)-267(other)-268(hierarchi-)]TJ
0 -1.1 TD
[(cal)-250(methods)-250(or)-250(base-le)25(v)15(el)-250(planning)-250(to)-250(tackle)-250(them.)]TJ
/T1_3 1 Tf
10.909 0 0 10.909 54.0001 305.4042 Tm
[(4.3)-1000(Continuous)-250(Cleanup)-250(W)75(orld)-250(on)-250(T)92(urtlebot)]TJ
/T1_0 1 Tf
9.963 0 0 9.963 54.0001 288.9392 Tm
[(T)80(o)-268(illustrate)-268(the)-268(ability)-268(of)-268(AMDP)-268(hierarchies)-268(to)-268(transfer)-269(be-)]TJ
T*
[(tween)-237(domains)-237(and)-237(use)-237(dif)25(ferent)-237(planners)-237(at)-238(dif)26(ferent)-238(le)25(v)15(els,)]TJ
T*
[(we)-332(constructed)-331(a)-332(continuous)-332(v)15(ersion)-331(of)-332(a)]TJ
/T1_1 1 Tf
17.136 0 Td
(\032)Tj
/T1_0 1 Tf
(-room,)Tj
/T1_1 1 Tf
3.526 0 Td
(\037)Tj
/T1_0 1 Tf
(-object)Tj
-20.662 -1.1 Td
[(Cleanup)-224(W)80(orld)-223(domain,)-224(which)-223(we)-224(tested)-224(on)-223(a)-224(T)45(urtlebot.)-224(The)]TJ
T*
[(agent)-258(in)-258(Continuous)-258(Cleanup)-258(W)80(orld)-258(is)-258(a)-259(m)1(odi\002ed)-259(T)45(urtleBot)]TJ
T*
[(with)-386(a)-386(pair)-386(of)-386(appendages)-386(that)-386(can)-387(gui)1(de)-387(blocks.)-386(The)-387(ap-)]TJ
T*
[(pendages)-243(mak)10(e)-243(pushing)-244(the)-243(block)-243(easy;)-243(ho)25(we)25(v)15(er)40(,)-243(the)15(y)-244(mak)10(e)]TJ
T*
[(mo)15(v)15(ement)-212(within)-212(the)-212(domain)-212(hard,)-212(as)-212(a)-212(point)-212(turn)-212(is)-212(not)-212(pos-)]TJ
T*
[(sible)-250(in)-250(most)-250(places,)-250(increasing)-250(the)-250(o)15(v)15(erall)-250(plan)-250(lengths.)]TJ
1 -1.184 Td
[(At)-195(le)25(v)15(el)]TJ
/T1_1 1 Tf
3.294 0 Td
(\036)Tj
/T1_0 1 Tf
[(,)-195(the)-196(agent)-195(has)-195(a)-196(continuous)-195(position)-195(in)-196(Cartesian)]TJ
-4.294 -1.1 Td
[(coordinates,)-340(in)-340(a)]TJ
/T1_1 1 Tf
7.101 0 Td
(\026)Tj
/T1_0 1 Tf
(ft)Tj
/T1_4 1 Tf
(\036)Tj
/T1_1 1 Tf
1.889 0 Td
(\026)Tj
/T1_0 1 Tf
[(ft)-340(w)10(orld.)-340(The)-340(agent)-340(also)-340(has)-339(a)-340(con-)]TJ
-8.99 -1.1 Td
[(tinuous)-275(angle)-275(attrib)20(ute)-276(for)-275(its)-275(orientation.)-275(The)-275(T)45(urtlebot)-276(can)]TJ
T*
[(mo)15(v)15(e)-429(forw)10(ard)-428(and)-429(turn)-429(clockwise/counter)20(-clockwise.)-430(The)]TJ
T*
[(continuous)-208(forw)10(ard)-207(action)-208(mo)15(v)15(es)-207(the)-208(robot)-207(forw)10(ard)-208(by)-208(about)]TJ
/T1_1 1 Tf
T*
(\036)Tj
/T1_2 1 Tf
(\035)Tj
/T1_1 1 Tf
0.778 0 Td
(\037)Tj
/T1_0 1 Tf
[(ft.)-355(The)-355(turn)-355(actions)-355(change)-355(the)-354(orientation)-355(of)-355(the)-355(agent)]TJ
-0.778 -1.1 Td
(about)Tj
/T1_1 1 Tf
2.558 0 Td
(\036)Tj
/T1_2 1 Tf
(\035)Tj
/T1_1 1 Tf
0.778 0 Td
(\037\034)Tj
/T1_0 1 Tf
1.336 0 Td
[(radians.)-337(The)-336(object)-336(also)-336(has)-336(a)-336(continuous)-336(posi-)]TJ
-4.672 -1.1 Td
[(tion)-268(attrib)20(ute.)-269(The)-269(objecti)25(v)15(e)-268(ag)5(ain)-269(is)-268(to)-269(mo)15(v)15(e)-268(the)-269(object)-268(to)-269(a)]TJ
T*
[(goal)-250(room,)-250(from)-250(an)15(y)-250(location)-250(in)-250(the)-250(w)10(orld.)]TJ
1 -1.184 Td
[(Our)-325(abstraction)-325(of)-326(the)-325(continuous)-325(source)-325(MDP)-326(connects)]TJ
25.649 43.962 Td
[(to)-316(the)-316(\(discrete\))-317(Cleanup)-316(W)80(orld)-316(AMDP)-316(hierarch)5(y)-316(from)-317(the)]TJ
T*
[(pre)25(vious)-255(subsection.)-255(At)-255(le)25(v)15(el)]TJ
/T1_1 1 Tf
11.815 0 Td
(\037)Tj
/T1_0 1 Tf
[(,)-255(we)-255(discretize)-255(the)-255(w)10(orld)-255(into)]TJ
/T1_1 1 Tf
-11.815 -1.1 Td
(\026)Tj
/T1_4 1 Tf
0.726 0 Td
(\036)Tj
/T1_1 1 Tf
1.004 0 Td
(\026)Tj
/T1_0 1 Tf
0.755 0 Td
[(cells)-255(and)-255(the)-254(agent')55(s)-255(bearing)-255(into)-255(the)]TJ
/T1_1 1 Tf
14.892 0 Td
(\035)Tj
/T1_0 1 Tf
0.755 0 Td
[(cardinal)-255(direc-)]TJ
-18.131 -1.1 Td
[(tions.)-287(The)-287(subtasks)-287(at)-287(this)-286(le)25(v)15(el)-287(are)-287(mo)15(ving)-287(forw)10(ard)-287(by)-287(one)]TJ
T*
[(grid)-267(cell,)-268(and)-267(turning)-267(clockwise/counter)20(-clockwise)-267(by)]TJ
/T1_5 1 Tf
6.974 0 0 6.974 538.174 488.0783 Tm
(\037)Tj
ET
0 G
0.398 w
q 1 0 0 1 538.174 486.646 cm
0 0 m
4.909 0 l
S
Q
BT
/T1_6 1 Tf
6.974 0 0 6.974 538.643 480.72 Tm
(\037)Tj
/T1_0 1 Tf
9.963 0 0 9.963 546.942 484.155 Tm
(ra-)Tj
-22.829 -1.1 Td
[(dians.)-193(This)-192(le)25(v)15(el-)]TJ
/T1_1 1 Tf
(\037)Tj
/T1_0 1 Tf
7.453 0 Td
[(AMDP)-192(corresponds)-193(to)-192(the)-193(source)-192(MDP)-193(of)]TJ
-7.453 -1.1 Td
[(\(discrete\))-240(Cleanup)-241(W)80(orld,)-240(so)-240(we)-241(immediately)-240(obtain)-241(higher)20(-)]TJ
T*
[(le)25(v)15(el)-410(abstractions)-409(for)-410(Continuous)-410(Cleanup)-409(W)80(orld)-410(as)-410(well.)]TJ
T*
[(Additionally)65(,)-382(the)-381(top-do)25(wn)-382(nature)-381(of)-382(AMDP)-381(planning)-382(en-)]TJ
0 -1.1 TD
[(ables)-247(the)-246(retention)-247(of)-246(all)-247(higher)20(-le)25(v)15(el)-246(models)-247(and)-247(pre)25(viously)]TJ
0 -1.1 TD
[(computed)-315(polici)1(es.)-315(In)-315(contrast,)-315(bott)1(om-up)-315(approaches)-315(such)]TJ
0 -1.1 TD
[(as)-250(MAXQ)-250(w)10(ould)-250(ha)20(v)15(e)-250(needed)-250(to)-250(re-solv)15(e)-250(all)-250(subtasks.)]TJ
1 -1.136 Td
[(In)-270(addition)-270(to)-270(the)-270(abo)15(v)15(e)-270(le)25(v)15(el-)]TJ
/T1_1 1 Tf
(\037)Tj
/T1_0 1 Tf
12.826 0 Td
[(abstraction,)-270(we)-270(also)-270(need)]TJ
-13.826 -1.1 Td
[(to)-364(specify)-363(ho)25(w)-364(to)-363(solv)15(e)-364(le)25(v)15(el-)]TJ
/T1_1 1 Tf
(\037)Tj
/T1_0 1 Tf
13.155 0 Td
[(subtasks.)-364(Since)-364(the)-363(source)]TJ
-13.155 -1.1 Td
[(MDP)-505(is)-504(continuous,)-505(lo)25(w-le)25(v)15(el)-505(planners)-505(such)-505(as)-505(Rapidly)]TJ
0 -1.1 TD
[(Exploring)-392(Randomized)-393(T)35(re)1(es)-393(\(LaV)111(alle)-392(and)-392(K)15(uf)25(fner)-393(2001\))]TJ
0 -1.1 TD
[(could)-314(ha)20(v)15(e)-315(been)-314(used)-315(to)-314(plan)-315(short)-314(distances)-315(of)-314(single)-315(grid)]TJ
T*
[(mo)15(v)15(ement.)-454(Ho)25(we)25(v)15(er)40(,)-453(we)-453(use)-453(closed-loop)-453(controllers,)-453(be-)]TJ
T*
[(cause)-253(the)15(y)-252(allo)25(w)-253(f)10(aster)-252(planning)-253(and)-252(are)-253(less)-252(complicated)-253(to)]TJ
T*
[(specify)-230(for)-230(these)-230(small)-230(mo)15(v)15(ements.)-230(This)-231(domai)1(n)-231(application)]TJ
T*
[(sho)25(ws)-263(ho)25(w)-262(dif)25(ferent)-263(planners)-262(can)-263(be)-263(used)-262(at)-263(dif)25(ferent)-263(le)25(v)15(els)]TJ
0 -1.1 TD
[(of)-250(the)-250(AMDP)-250(hierarch)5(y)65(,)-250(depending)-250(on)-250(their)-250(suitability)65(.)]TJ
1 -1.136 Td
[(The)-475(T)45(urtlebot)-475(is)-475(controlled)-475(using)-475(mo)15(v)15(ement)-475(messages)]TJ
-1 -1.1 Td
[(sent)-240(by)-240(our)-240(planner)-240(o)15(v)15(er)-240(R)40(OS)-240(\(Quigle)15(y)-240(et)-240(al.)-240(2009\))-240(at)]TJ
/T1_1 1 Tf
21.523 0 Td
(\031\036)Tj
/T1_0 1 Tf
(Hz.)Tj
-21.523 -1.1 Td
[(Our)-461(planners)-461(can)-461(publish)-461(commands)-461(at)-460(o)15(v)15(er)]TJ
/T1_1 1 Tf
19.304 0 Td
(\037\036\036)Tj
/T1_0 1 Tf
[(Hz,)-461(b)20(ut)]TJ
/T1_1 1 Tf
-19.304 -1.1 Td
(\031\036)Tj
/T1_0 1 Tf
[(Hz)-350(is)-351(the)-351(s)1(tandard)-351(rate)-351(at)-350(which)-351(the)-350(T)45(urtlebot)-351(publishes)]TJ
0 -1.1 TD
[(commands)-218(to)-217(its)-218(mobile)-218(base.)-218(The)-218(robot)-217(can)-218(be)-218(mo)15(v)15(ed)-218(f)10(aster)]TJ
0 -1.1 TD
[(by)-202(publishing)-202(higher)-201(v)15(elocities)-202(per)-202(motion)-202(command,)-202(b)20(ut)-202(we)]TJ
T*
[(do)-216(not)-215(w)10(ant)-216(the)-215(T)45(urtlebot)-216(to)-215(mo)15(v)15(e)-216(too)-215(quickly)-216(within)-215(the)-216(lab)40(.)]TJ
T*
[(The)-226(location)-227(and)-226(pose)-226(of)-227(the)-226(T)45(urtlebot)-226(and)-227(the)-226(object)-226(are)-227(ob-)]TJ
T*
[(tained)-250(using)-250(a)-250(motion)-250(capture)-250(system.)]TJ
1 -1.136 Td
[(Put)-409(together)40(,)-409(our)-409(AMDP)-409(hierarch)5(y)-409(solv)15(es)-409(this)-409(continu-)]TJ
-1 -1.1 Td
[(ous)-300(problem)-299(in)-300(real)-299(time.)-300(W)80(e)-300(can)-300(see)-299(in)-300(the)-299(video)]TJ
6.974 0 0 6.974 520.927 179.8312 Tm
(2)Tj
9.963 0 0 9.963 527.897 176.2162 Tm
[(that)-300(the)]TJ
-20.917 -1.1 Td
[(robot)-345(plans)-346(in)-345(real)-345(time)-345(to)-346(complete)-345(the)-345(manipulation)-346(task)]TJ
T*
[(as)-256(sho)25(wn)-256(in)-256(Figure)-256(5.)-256(The)-256(robot)-256(mak)10(es)-256(minor)-257(corre)1(ctions)-257(to)]TJ
T*
[(its)-240(trajectory)-240(and)-240(reco)15(v)15(ers)-240(from)-240(mistak)10(es)-240(in)-240(real)-240(time.)-241(It)-240(also)]TJ
T*
[(reco)15(v)15(ers)-298(when)-298(the)-297(object)-298(is)-298(remo)15(v)15(ed)-298(from)-297(its)-298(arms,)-298(and)-298(re-)]TJ
T*
[(plans)-207(to)-207(reco)15(v)15(er)-207(the)-206(object)-207(instantaneously)-207(to)-207(push)-207(the)-207(object)]TJ
T*
[(to)-335(the)-335(goal)-335(location)-335(as)-335(sho)25(wn)-334(in)-335(Figure)-335(6.)-336(This)-335(sho)25(ws)-335(that)]TJ
ET
q 1 0 0 1 319.5 100.675 cm
0 0 m
59.776 0 l
S
Q
BT
/T1_0 1 Tf
5.978 0 0 5.978 332.153 93.809 Tm
(2)Tj
8.966 0 0 8.966 335.64 90 Tm
(https://youtu.be/Bp3VEO66WSg)Tj
ET
endstream
endobj
219 0 obj
<>/Filter/FlateDecode/Height 800/Length 32422/Name/X/Subtype/Image/Type/XObject/Width 796>>stream
H]lw=m
1YxabLL0^ę1v:q:\xq(f06=mO{vSc)A#*x
.LK^yisS ptu$I.znd!ʒ$)us#W$IY$IJ]B%IRF¯,IR=7~eI蹑+KEύ,_Y$.znd!ʒ$)us#W$IY$IJ]B%IRF¯,IR=7~eI蹑+KEύ,_Y$.znd!ʒ$)us#W$IY$IJ]B%IRF¯,IR=7~eI蹑+KEύ,_Y$.znd!ʒ$)us#W$IY$IJ]B%IRF¯,IR=7~eI蹑+KEύ,_Y$.znd!ʒ$)us#W$IY$IJ]B%IRF¯,IR=7~eI蹑+KEύ,_Y$.znd!ʒ$)us#W$IY$IJ]B%IRF¯,IR=7~eI蹑+KEύ,_Y$.znd!ʒ$)us#W$IY$IJ]B%IRF¯,IR=7~eI蹑+KEύ,_Y$.znd!ʒ$)us#W$IY$IJ]B%IRF¯,IR=7~깑һˏ>yG9Ǯl *IEύ,_Fh+K.}8ooܾ|y\/Ꙫw?V7ZsWUl6o5HJTB;?,_|~Υ˯
Í+w?z7?ѮKͻo9To'̈́?t__5~kv]cЩ;kۯe[o=JbTT;5~ڦ.&.kܽn}Nߴpg<={z`}|I蹑+v{]rmyo~ußS9xtWcѢo+7;981(w4}p+/u+w&7x{[uj
)U6:.o3LOi(ۋ9EhqwcȾ?==7~V~;7Ϟy?`_.:-7xR+yֲzՋَZ{i~iotx<zŵS\`rr:
ҵڋbn-jon,^2Q*jE{T[L4yG}O3ݢF¯Ձ;ͿԮ
o5V>#K.?
mڰuf`N{+?Z_48uɅZ<9Q.nGEu|vQ`jV=4ic{P[{c0"
QAqDz,ΠQ1j|]%!ǝw;-{g>_?
*?EJpہ!t2jj@PP
n_@oP@+=7?Gs:?~?
Y)Ӣhȍc(_vf}d[Gܧy