# Fileset

[monte_carlo_tree_search_for_materials_design_and_discovery.pdf](https://mdr.nims.go.jp/filesets/a5d316cf-6a5e-4805-93ab-4cc287198450/download)

## Creator

Ju, Shenghong, [Tsuda, Koji](https://orcid.org/0000-0002-4288-1606), Shiomi, Junichiro, [Dieb, Thaer M.](https://orcid.org/0000-0002-8111-2009)

## Rights



## Other metadata

[Monte Carlo tree search for materials design and discovery](https://mdr.nims.go.jp/datasets/090e7531-770a-4683-b4da-54adb4795944)

## Fulltext

S2159685919000405jrv 532..536Artificial Intelligence ProspectiveMonte Carlo tree search for materials design and discoveryThaer M. Dieb, National Institute for Materials Science, Tsukuba, Japan; Graduate School of Frontier Sciences, the University of Tokyo, Kashiwa, Japan;RIKEN, AIP, Tokyo, JapanShenghong Ju, National Institute for Materials Science, Tsukuba, Japan; Department of Mechanical Engineering, the University of Tokyo, Tokyo, JapanJunichiro Shiomi, National Institute for Materials Science, Tsukuba, Japan; Department of Mechanical Engineering, the University of Tokyo, Tokyo, Japan;CREST, JST, Tokyo, JapanKoji Tsuda, National Institute for Materials Science, Tsukuba, Japan; Graduate School of Frontier Sciences, the University of Tokyo, Kashiwa, Japan; RIKEN,AIP, Tokyo, JapanAddress all correspondence to Koji Tsuda at tsuda@k.u-tokyo.ac.jp(Received 15 January 2019; accepted 18 March 2019)AbstractMaterials design and discovery can be represented as selecting the optimal structure from a space of candidates that optimizes a target prop-erty. Since the number of candidates can be exponentially proportional to the structure determination variables, the optimal structure must beobtained efficiently. Recently, inspired by its success in the Go computer game, several approaches have applied Monte Carlo tree search(MCTS) to solve optimization problems in natural sciences including materials science. In this paper, we briefly reviewed applications ofMCTS in materials design and discovery, and analyzed its future potential.IntroductionThe ability to design a material with desired properties a prioriusing computational methods has been promised by computa-tional materials science for many years.[1] This problem canbe framed as selecting the optimal composite material structurethat meets certain quality metrics from a space of candi-dates.[2,3] One example is the structural determination of a sub-stitutional alloy problem in solid-state materials design,[4,5]where optimal atoms (or vacancies) assignment in a crystal struc-ture is determined to maximize or minimize a target property.To accelerate this process, researchers have emphasizeddata-driven and machine learning approaches as the fourth par-adigm of science.[6,7] Data-driven materials design approachesare iterative design algorithms. Given a space of candidates S,the algorithm aims to find the optimal candidate pbst that opti-mizes a black-box function f (p) (usually the target property).Starting with a random selection, and within a predefined num-ber of iterations, the algorithm evaluates a set of selected can-didates and obtains feedback for a more informed selection onthe next iteration. The function f (p) is evaluated by experimentor simulation and it is computationally expensive to query. It isnecessary to reach the optimal candidate with as few queries aspossible[8] (Fig. 1).Several methods have been applied for data-driven materialsdesign. Evolutionary algorithms, such as genetic algo-rithms[9,10] that use human evolution mechanisms (such ascrossover and mutation), have been used to solve optimizationproblems at a large scale. Genetic algorithms need adequatedata available a priori to tune many parameters for optimal per-formance. However, a priori data are often limited in materialsdesign and discovery.Another approach is Bayesian optimization (BO)[11,12] thatiteratively selects an optimal candidate from a search spacethat optimizes an expensive black-box function f (p). A deceiveadvantage of BO is that, it uses the predicated merit of the can-didate as well as the uncertainty of the prediction when select-ing the next promising candidate. This feature has beensuccessful in several materials design problems.[2,5,13–15]However, as the uncertainty of the prediction needs to beassessed for all candidates in the search space, excessive com-putation in BO faces serious challenges in large-scale prob-lems, a common case in materials design.The recent success of Monte Carlo tree search (MCTS)[16] incomputer games[17,18] has encouraged researchers to apply it tonatural science domains. For example, Yang et al. used MCTSfor de novo molecular generation by selecting an optimaldesign with a predefined desired criterion from a vast chemicalspace.[19] Segler et al. applied MCTS to discover retrosyntheticroutes to plan the syntheses of small organic molecules.[20]MCTS has also been applied in materials science and engi-neering. In this study, we reviewed the utilization of MCTS inmaterials design and discovery, particularly, to analyze its abil-ity to solve large-scale optimization problems. To the best ofour knowledge, no such review has been published yet. Thispaper is organized into four sections. The section “MonteCarlo tree search” presents the MCTS algorithm. In the sectionMRS Communications (2019), 9, 532–536© Materials Research Society, 2019. This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creative-commons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.doi:10.1557/mrc.2019.40532▪ MRS COMMUNICATIONS • VOLUME 9 • ISSUE 2 • www.mrs.org/mrchttps://www.cambridge.org/core/terms. https://doi.org/10.1557/mrc.2019.40Downloaded from https://www.cambridge.org/core. National Institute of Materials Science (NIMS), on 02 Oct 2020 at 03:29:23, subject to the Cambridge Core terms of use, available atmailto:tsuda@k.u-tokyo.ac.jphttps://www.cambridge.org/core/termshttps://doi.org/10.1557/mrc.2019.40https://www.cambridge.org/core“Applications in materials design”, we discuss the utilization ofseveral variations of MCTS for finding optimal materialsdesign. Finally, “Concluding remarks” section summarizesthe paper with forward-looking remarks.Monte Carlo tree searchMCTS[16] is an iterative, guided, random best-first tree searchalgorithm that systemically searches a space of candidates toobtain an optimal solution that maximizes the black-boxfunction f (p). A distinguishing feature of MCTS is that itencodes the search space into a shallow tree that iterativelyexpands in the direction of the promising solutions, eliminat-ing the need to construct a full tree. MCTS then utilizesguided randomization to obtain full solutions from this shal-low tree.Within a computational budget, MCTS explores the searchspace over multiple iterations. Initially, only the root nodeexists. Then, each iteration consists of four steps: selection,expansion, simulation, and back-propagation (Fig. 2). In theselection step, the tree is traversed from the root to the mostpromising leaf using a comparative score. The chosen leaf isthen expanded by adding a child node to it in the expansionstep. Only partial solutions can be obtained from this shallowtree. In the simulation step, a full solution is generated by ran-dom rollout[16] starting from a node; the remaining variables arerandomly determined. The merit of the obtained solution isevaluated. In the back-propagation step, the nodes’ informationis updated along the path back to the root. MCTS balancesexploration against exploitation using a hyper parameter thatdepends on the range of maximum and minimum merits valuesof the candidates.Applications in materials designA Python package for an optimal atomassignment problemAn open source implementation of MCTS was developed byDieb et al. using the Python programing language.[21] Thepackage MDTS (materials design using tree search) is availableat https://github.com/tsudalab/MDTS. MDTS solves structuredetermination problems by optimal atom (or vacancy) assign-ment with composition constraints. This method assumes amaterial structure P with n positions {p1, p2, . . ., pn} thatneed to be assigned with several types of atoms (or vacancies).It searches for the optimal configuration pbst (subject to compo-sition constraints) that maximizes a black-box function f (p)(usually the target property). MDTS uses the MCTS model toencode the candidate space into a tree where a node at level lrepresents a possible atom assignment in the position l in thestructure. MDTS uses the upper confidence bound (UCB)score[16] to compare child nodes when traversing the tree.The UCB score is computed following Eq. (1):ucbi = zivi+ C�����������2 ln vparentvi√(1)where zi is the accumulated merit of the node (i.e., the sum ofthe immediate merits of all downstream nodes), vi is the visitcount of the node, vparent is the visit count of the parent node,and C is the constant to balance exploration and exploitation.MDTS adaptively sets C at each node following similaridea to[22]:C =��2√J4( fmax − fmin) (2)where J is a meta-parameter initially set to one, which increaseswhenever the algorithm encounters a dead-end leaf, to allow formore exploration. The parameters fmax and fmin are the maxi-mum and minimum immediate merits in the downstreamnodes, respectively. The automatic setting of C allows MDTSto work parameter-free with optimal performance on severalapplications. For example, MDTS successfully designed largesilicon–germanium (Si–Ge) alloy structures when BO couldnot be used due to its high computational cost.Grain boundary segregationAnalysis of the grain boundary segregation behavior of impuri-ties, dopants, and vacancies is very important for broad materi-als development due to its effect on material properties.Kiyohara et al.[23] recently applied the MCTS method to deter-mine a stable segregation configuration of copper Σ5[001]/(210) and Σ37[001]/(750) with silver impurities. A binaryMonte Carlo tree was constructed where a node representedeither a copper or silver atom assigned to a segregation site;the process searched for an optimum candidate with minimalsegregation energy. A stable copper Σ5[001]/(210) configura-tion was reached by searching only 1% of all candidateFigure 1. A data-driven materials design approach. Starting randomly, analgorithm selects a candidate set for experimentation within a computationalbudget. The experimental feedback is then used for a more informedselection in the next iteration.Artificial Intelligence ProspectiveMRS COMMUNICATIONS • VOLUME 9 • ISSUE 2 • www.mrs.org/mrc ▪ 533https://www.cambridge.org/core/terms. https://doi.org/10.1557/mrc.2019.40Downloaded from https://www.cambridge.org/core. National Institute of Materials Science (NIMS), on 02 Oct 2020 at 03:29:23, subject to the Cambridge Core terms of use, available athttps://github.com/tsudalab/MDTShttps://github.com/tsudalab/MDTShttps://www.cambridge.org/core/termshttps://doi.org/10.1557/mrc.2019.40https://www.cambridge.org/coreconfigurations (Fig. 3). This result was identical to a previousstudy using theoretical calculations, where empirical potentialsfor copper–silver alloys were generated to systematically inves-tigate the segregation.[24] The optimal solution of copper Σ37[001]/(750) (which had a significantly larger search space)was achieved after exploring only 0.34% of the search space.It is reported that the search efficiency was significantlyaffected by the order of the search (a search by order of segre-gation energy was more efficient than a random search).Additionally, the analysis of the search path and the numberof rollouts were important for understanding the backgroundof the search.Optimizing the energy gap for graphenenanoflakesThe study of the band gap in graphene is important for nanoe-lectronic applications. Cao et al. investigated the optimizationof graphene nanoflakes’ (GNFs) energy gaps by selecting theoptimal structure.[25] This study was challenged by the largenumber of candidate structures increasing as the number of car-bon atoms (Nc) in the graphene increased and the expensivecomputation of the energy gap (Eg) for a specific structure.The researchers proposed an effective tight-binding model forthe electronic properties of the hydrogen-terminated GNFsfocusing on the effect of carbon atom local bonding. Theparameters of this model were fit using first-principles calcula-tion results on structures with Nc≤ 34. For larger search spaces(Nc > 34), they used the MCTS method in combination with thecongruence check to search for larger GNFs structures withlarge Eg based on the properties of the smaller GNFs.Using this approach, they efficiently obtained optimal struc-tures with the largest Eg for each Nc. The reported results wereconfirmed with first-principles calculations.Surface/interface roughness optimizationMore recently, Ju et al.[26] employed MCTS to study the effectof surface/interface design in nanostructures for optimal ther-mal transport. They investigated the limits of inhibition andenhancement of phonon transport in the interfacial roughnessbetween a silicon–germanium (Si–Ge) bi-layer nanofilm(Fig. 4). In this setting, the number of possible roughnessFigure 2. MCTS encodes the search space as a shallow decision tree. MCTS repeats four steps. In the selection step, a promising leaf node is chosen byfollowing the child node with the best score. The expansion step adds a child node to the selected node. During simulation, a full solution is created by randomrollout and its merit is evaluated. The back-propagation step updates information for the nodes along the path back to the root for better selection in the nextiteration.Figure 3. (a) The promising configuration of the grain boundary structure ofcopper Σ5[001]/(210) up to the 16th site. Yellow and gray circles representsilver and copper atoms, respectively. (b) Strain map at each site at the grainboundary. The sites with a positive strain are larger spatially (red); the reverseholds for the negative strain (blue). Reprinted from Kiyohara andMizoguchi[23]; with the permission of AIP Publishing.534▪ MRS COMMUNICATIONS • VOLUME 9 • ISSUE 2 • www.mrs.org/mrchttps://www.cambridge.org/core/terms. https://doi.org/10.1557/mrc.2019.40Downloaded from https://www.cambridge.org/core. National Institute of Materials Science (NIMS), on 02 Oct 2020 at 03:29:23, subject to the Cambridge Core terms of use, available athttps://www.cambridge.org/core/termshttps://doi.org/10.1557/mrc.2019.40https://www.cambridge.org/coreconfigurations increased exponentially with the number of lay-ers in the nanofilm and the degree of roughness (e.g., there were1,048,576 candidates for 10 layers and four degrees).Researchers used the MDTS package[21] with the atomisticGreen’s function[27,28] to search for candidates with maximumand minimum interfacial thermal conductance. The reportedoptimal surface/interface roughness configurations were non-intuitive, and they were in the middle range between flat andvery rough. This study confirmed the scalability and efficiencyof MCTS because it applied MCTS to a large search space.Determination of boron-doping in a graphenestructureTuning material properties by incorporating additional ele-ments is a common practice in materials science and engineer-ing. Both optimal composition and spatial distribution ofincorporated atoms affect the target property. Dieb et al. inves-tigated the most stable structures of doped boron atoms in gra-phene (for a boron concentration up to 31.25%) using aMCTS-based method in conjunction with atomistic simula-tions.[29] They considered a supercell constructed of a hexago-nal unit cell of graphene and carbon substituted by boron.To increase the efficiency of MCTS, researchers engineeredthe rollout in the expansion step with a more sophisticated sol-ution using BO[11,12] (i.e., a Bayesian rollout). In this mecha-nism, a random pool of full candidates is enumerated underthe expanded node with a predefined size, Z. BO is then usediteratively to select the optimal candidate from the pool. BOmaintains a Gaussian process (GP)[30] as the surrogate modelof the objective function. As the MCTS progresses, moredata points are observed and included in the GP for training,which optimizes the model for the target function (Fig. 5).Using this method, researchers have reported atomic struc-tures of the most stable configurations of B–graphene at differentB concentrations. The stability of these structures has also beenverified by the density functional theory calculations with the useof the Vienna Ab initio Simulation Package (VASP).[31]Concluding remarksOur review of MCTS in materials design and discovery con-firmed that MCTS can successfully solve large-scale optimiza-tion problems in materials design. An interesting feature ofMCTS is that it does not require a complicated descriptor ora large dataset to tune many parameters. Instead, a singlehyper parameter can be tuned automatically and adaptivelybased on the target application. On the other hand, MCTScan be most useful when experimenting (simulation) time isshort. A significantly long experiment time will wipe out theadvantage of quick design time of MCTS. Additionally, currentimplementations of MCTS are only available for discretesearch spaces. Enhancing MCTS for continuous spaces cansupport a wider range of materials design applications.MCTS may have potential not yet fully exploited in materi-als science. A recent trend of combining MCTS with othermachine learning methods, such Bayesian learning and neuralnetworks, has emerged to increase MCTS’s efficiency, andthis has shown promising results.AcknowledgmentThis work was supported by the “Materials research byInformation Integration” Initiative (MI2I) project, the CRESTGrant No. JPMJCR16Q5 from the Japan Science andTechnology Agency (JST), and KAKENHI Grants No.16H04274 from the Japan Society for the Promotion ofScience (JSPS).References1. S.B. Sinnott: Material design and discovery with computational materialsscience. J. Vac. Sci. Technol. A 31, 050812 (2013).Figure 5. Bayesian rollout. A random pool of full candidates is generatedunder the expanded node. Initially, GP uses a random selection of data pointsfor evaluation. As the search progresses down the tree, more observationsare accumulated in the GP for a more informed future selection. To determinethe next selection, the Bayesian rollout uses an acquisition function thatconsiders the predicted value and prediction uncertainty.Figure 4. Interfacial roughness in a bi-layer nanofilm of Si–Ge. The numberof possible configurations increased exponentially with the number of layersand the degree of roughness.Artificial Intelligence ProspectiveMRS COMMUNICATIONS • VOLUME 9 • ISSUE 2 • www.mrs.org/mrc ▪ 535https://www.cambridge.org/core/terms. https://doi.org/10.1557/mrc.2019.40Downloaded from https://www.cambridge.org/core. National Institute of Materials Science (NIMS), on 02 Oct 2020 at 03:29:23, subject to the Cambridge Core terms of use, available athttps://www.cambridge.org/core/termshttps://doi.org/10.1557/mrc.2019.40https://www.cambridge.org/core2. A. Seko, A. Togo, H. Hayashi, K. Tsuda, L. Chaput, and I. Tanaka:Prediction of low-thermal-conductivity compounds with first-principlesanharmonic lattice-dynamics calculations and Bayesian optimization.Phys. Rev. Lett. 115, 205901 (2015).3. P.V. Balachandran, D. Xue, J. Theiler, J. Hogden, and T. Lookman:Adaptive strategies for materials design using uncertainties. Sci. Rep.6, 19660 (2016).4. K. Okhotnikov, T. Charpentier, and S. Cadars: Supercell program: a com-binatorial structure-generation approach for the local-level modeling ofatomic substitutions and partial occupancies in crystals. J. Cheminf. 8,17 (2016).5. S. Ju, T. Shiga, L. Feng, Z. Hou, K. Tsuda, and J. Shiomi: Designing nano-structures for phonon transport via Bayesian optimization. Phys. Rev. X 7,021024 (2017).6. A. Agrawal and A. Choudhary: Perspective: Materials informatics and bigdata: Realization of the “fourth paradigm” of science in materials science.APL Mater. 4, 053208 (2016).7. M. Drosback, Materials Genome Initiative: Advances and Initiatives, JOM,66, 334–335, (2014).8. T.M. Dieb and K. Tsuda: Machine learning-based experimental design inmaterials science. In Nanoinformatics, edited by I. Tanaka (Springer,Singapore, 2018). pp. 65–74.9. T.K. Patra, V. Meenakshisundaram, J. Hung, and D. Simmons:Neural-network-biased genetic algorithms for materials design:Evolutionary algorithms that learn. ACS Comb. Sci. 19, 96 (2017).10.W. Paszkowicz, K.D. Harris, and R.L. Johnston: Genetic algorithms: Auniversal tool for solving computational tasks in Materials Science.Comput. Mater. Sci. 45, ix (2009).11. J. Snoek, H. Larochelle, and R. Adams: Practical Bayesian optimization ofmachine learning algorithms. Adv. Neural Inf. Process. Syst. 25, 2951–2959 (2012).12.D.R. Jones, M. Schonlau, and W.J. Welch: Efficient global optimization ofexpensive black-box functions. J. Global Optim. 13, 455 (1998).13.T. Ueno, T. Rhone, Z. Hou, T. Mizoguchi, and K. Tsuda: COMBO: an effi-cient Bayesian optimization library for materials science.Mater. Discov. 4,18–21 (2016).14.S. Kiyohara, H. Oda, K. Tsuda, and T. Mizoguchi: Acceleration of stableinterface structure searching using a kriging approach. Jpn. J. Appl.Phys. 55, 045502 (2016).15.R. Aggarwal, M.J. Demkowicz, and Y.M. Marzouk: Bayesian inference ofsubstrate properties from film behavior. Modell. Simul. Mater. Sci. Eng.23, 015009 (2015).16.C. Browne, E. Powley, D. Whitehouse, S.M. Lucas, P.I. Cowling, P.Rohlfshagen, S. Tavener, D. Perez, S. Samothrakis, and S. Colton: A sur-vey of Monte Carlo tree search methods. IEEE Trans. Comput. Intell. AIGames 4, 1–43 (2012).17.D. Silver, A. Huang, C. Maddison, A. Guez, L. Sifre, G. van den Driessche,J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot, S.Dieleman, D. Grewe, J. Nham, N. Kalchbrenner, I. Sutskever, T.Lillicrap, M. Leach, K. Kavukcuoglu, T. Graepel, and D. Hassabis:Mastering the game of Go with deep neural networks and tree search.Nature 529, 484 (2016).18. J. Mehat, and T. Cazenave: Combining UCT and nested Monte Carlosearch for single-player general game playing. IEEE Trans. Comp. Intell.AI Games 2, 271 (2010).19.X. Yang, J. Zhang, K. Yoshizoe, K. Terayama, and K. Tsuda: ChemTS: anefficient python library for de novo molecular generation. Sci. Technol.Adv. Mater. 18, 972 (2017).20.M.H.S. Segler, M. Preuss, and M. P. Waller: Planning chemical syntheseswith deep neural networks and symbolic AI. Nature 555(7698), 604–610(2018).21.T.M. Dieb, S. Ju, K. Yoshizoe, Z. Hou, J. Shiomi, and K. Tsuda: MDTS:automatic complex materials design using Monte Carlo tree search.Sci. Technol. Adv. Mater. 18, 498 (2017).22.L. Kocsis and C. Szepesvári: Bandit based Monte-Carlo Planning inMachine Learning: ECML 2006 (Springer, Berlin, Heidelberg, 2006) pp.282–293.23.S. Kiyohara and T. Mizoguchi: Searching the stable segregation configu-ration at the grain boundary by a Monte Carlo tree search. J. Chem. Phys.148, 241741 (2018). https://doi.org/10.1063/1.5023139.24.S. Kiyohara and T. Mizoguchi: Investigation of segregation of silver atcopper grain boundaries by first principles and empirical potential calcu-lations. AIP Conf. Proc. 1763, 040001 (2016). https://doi.org/10.1063/1.4961349.25.Z. Cao, Y. Zhao, J. Liao, and X. Yang: Gap maximum of graphene nano-flakes: a first principles study combined with the Monte Carlo tree searchmethod. RSC Adv. 7, 37881 (2017).26.S. Ju, T.M. Dieb, K. Tsuda, and J. Shiomi: Optimizing Interface/SurfaceRoughness for Thermal Transport. Machine Learning for Molecules andMaterials NIPS 2018 Workshop (2018).27.W. Zhang, T. S. Fisher, and N. Mingo: Simulation of interfacial phonontransport in Si–Ge heterostructures using an atomistic Green’s functionmethod. J. Heat Transfer 129, 483–491, (2006).28. J. Wang, J. Wang, and N. Zeng: Nonequilibrium Green’s functionapproach to mesoscopic thermal transport. Phys. Rev. B 74, 033408,(2006).29.T.M. Dieb, Z. Hou, and K. Tsuda: Structure prediction of boron-dopedgraphene by machine learning. J. Chem. Phys. 148, 241716 (2018).https://doi.org/10.1063/1.5018065.30.C.E. Rasmussen and C.K.I. Williams, eds.: Gaussian Processes forMachine Learning (MIT Press, Cambridge, MA, 2006).31.G. Kresse, and J. Furthmuller: Efficiency of ab-initio total energy calcula-tions for metals an semiconductors using a plane-wave basis set.Comput. Mater. Sci. 6, 15 (1996).536▪ MRS COMMUNICATIONS • VOLUME 9 • ISSUE 2 • www.mrs.org/mrchttps://www.cambridge.org/core/terms. https://doi.org/10.1557/mrc.2019.40Downloaded from https://www.cambridge.org/core. National Institute of Materials Science (NIMS), on 02 Oct 2020 at 03:29:23, subject to the Cambridge Core terms of use, available athttps://doi.org/10.1063/1.5023139https://doi.org/10.1063/1.5023139https://doi.org/10.1063/1.4961349https://doi.org/10.1063/1.4961349https://doi.org/10.1063/1.4961349https://doi.org/10.1063/1.5018065https://doi.org/10.1063/1.5018065https://www.cambridge.org/core/termshttps://doi.org/10.1557/mrc.2019.40https://www.cambridge.org/core Monte Carlo tree search for materials design and discovery Introduction Monte Carlo tree search Applications in materials design A Python package for an optimal atom assignment problem Grain boundary segregation Optimizing the energy gap for graphene nanoflakes Surface/interface roughness optimization Determination of boron-doping in a graphene structure Concluding remarks Acknowledgment References<<  /ASCII85EncodePages false  /AllowTransparency false  /AutoPositionEPSFiles false  /AutoRotatePages /None  /Binding /Left  /CalGrayProfile (Dot Gain 20%)  /CalRGBProfile (sRGB IEC61966-2.1)  /CalCMYKProfile (U.S. Web Coated \050SWOP\051 v2)  /sRGBProfile (sRGB IEC61966-2.1)  /CannotEmbedFontPolicy /Error  /CompatibilityLevel 1.3  /CompressObjects /Tags  /CompressPages true  /ConvertImagesToIndexed true  /PassThroughJPEGImages true  /CreateJobTicket false  /DefaultRenderingIntent /Default  /DetectBlends true  /DetectCurves 0.1000  /ColorConversionStrategy /LeaveColorUnchanged  /DoThumbnails false  /EmbedAllFonts true  /EmbedOpenType false  /ParseICCProfilesInComments true  /EmbedJobOptions true  /DSCReportingLevel 0  /EmitDSCWarnings false  /EndPage -1  /ImageMemory 1048576  /LockDistillerParams true  /MaxSubsetPct 100  /Optimize false  /OPM 1  /ParseDSCComments true  /ParseDSCCommentsForDocInfo true  /PreserveCopyPage false  /PreserveDICMYKValues true  /PreserveEPSInfo false  /PreserveFlatness true  /PreserveHalftoneInfo false  /PreserveOPIComments false  /PreserveOverprintSettings true  /StartPage 1  /SubsetFonts true  /TransferFunctionInfo /Remove  /UCRandBGInfo /Remove  /UsePrologue false  /ColorSettingsFile ()  /AlwaysEmbed [ true  ]  /NeverEmbed [ true  ]  /AntiAliasColorImages false  /CropColorImages true  /ColorImageMinResolution 150  /ColorImageMinResolutionPolicy /OK  /DownsampleColorImages true  /ColorImageDownsampleType /Bicubic  /ColorImageResolution 300  /ColorImageDepth -1  /ColorImageMinDownsampleDepth 1  /ColorImageDownsampleThreshold 1.50000  /EncodeColorImages true  /ColorImageFilter /DCTEncode  /AutoFilterColorImages true  /ColorImageAutoFilterStrategy /JPEG  /ColorACSImageDict <<    /QFactor 0.15    /HSamples [1 1 1 1] /VSamples [1 1 1 1]  >>  /ColorImageDict <<    /QFactor 0.15    /HSamples [1 1 1 1] /VSamples [1 1 1 1]  >>  /JPEG2000ColorACSImageDict <<    /TileWidth 256    /TileHeight 256    /Quality 30  >>  /JPEG2000ColorImageDict <<    /TileWidth 256    /TileHeight 256    /Quality 30  >>  /AntiAliasGrayImages false  /CropGrayImages true  /GrayImageMinResolution 150  /GrayImageMinResolutionPolicy /OK  /DownsampleGrayImages true  /GrayImageDownsampleType /Bicubic  /GrayImageResolution 300  /GrayImageDepth -1  /GrayImageMinDownsampleDepth 2  /GrayImageDownsampleThreshold 1.50000  /EncodeGrayImages true  /GrayImageFilter /DCTEncode  /AutoFilterGrayImages true  /GrayImageAutoFilterStrategy /JPEG  /GrayACSImageDict <<    /QFactor 0.15    /HSamples [1 1 1 1] /VSamples [1 1 1 1]  >>  /GrayImageDict <<    /QFactor 0.15    /HSamples [1 1 1 1] /VSamples [1 1 1 1]  >>  /JPEG2000GrayACSImageDict <<    /TileWidth 256    /TileHeight 256    /Quality 30  >>  /JPEG2000GrayImageDict <<    /TileWidth 256    /TileHeight 256    /Quality 30  >>  /AntiAliasMonoImages false  /CropMonoImages true  /MonoImageMinResolution 400  /MonoImageMinResolutionPolicy /OK  /DownsampleMonoImages true  /MonoImageDownsampleType /Bicubic  /MonoImageResolution 1200  /MonoImageDepth -1  /MonoImageDownsampleThreshold 1.50000  /EncodeMonoImages true  /MonoImageFilter /CCITTFaxEncode  /MonoImageDict <<    /K -1  >>  /AllowPSXObjects false  /CheckCompliance [    /None  ]  /PDFX1aCheck false  /PDFX3Check false  /PDFXCompliantPDFOnly false  /PDFXNoTrimBoxError true  /PDFXTrimBoxToMediaBoxOffset [    0.00000    0.00000    0.00000    0.00000  ]  /PDFXSetBleedBoxToMediaBox true  /PDFXBleedBoxToTrimBoxOffset [    0.00000    0.00000    0.00000    0.00000  ]  /PDFXOutputIntentProfile (None)  /PDFXOutputConditionIdentifier ()  /PDFXOutputCondition ()  /PDFXRegistryName ()  /PDFXTrapped /False  /CreateJDFFile false  /Description <<    /CHS <FEFF4f7f75288fd94e9b8bbe5b9a521b5efa7684002000410064006f006200650020005000440046002065876863900275284e8e9ad88d2891cf76845370524d53705237300260a853ef4ee54f7f75280020004100630072006f0062006100740020548c002000410064006f00620065002000520065006100640065007200200035002e003000204ee553ca66f49ad87248672c676562535f00521b5efa768400200050004400460020658768633002>    /CHT <FEFF4f7f752890194e9b8a2d7f6e5efa7acb7684002000410064006f006200650020005000440046002065874ef69069752865bc9ad854c18cea76845370524d5370523786557406300260a853ef4ee54f7f75280020004100630072006f0062006100740020548c002000410064006f00620065002000520065006100640065007200200035002e003000204ee553ca66f49ad87248672c4f86958b555f5df25efa7acb76840020005000440046002065874ef63002>    /DAN <FEFF004200720075006700200069006e0064007300740069006c006c0069006e006700650072006e0065002000740069006c0020006100740020006f007000720065007400740065002000410064006f006200650020005000440046002d0064006f006b0075006d0065006e007400650072002c0020006400650072002000620065006400730074002000650067006e006500720020007300690067002000740069006c002000700072006500700072006500730073002d007500640073006b007200690076006e0069006e00670020006100660020006800f8006a0020006b00760061006c0069007400650074002e0020004400650020006f007000720065007400740065006400650020005000440046002d0064006f006b0075006d0065006e0074006500720020006b0061006e002000e50062006e00650073002000690020004100630072006f00620061007400200065006c006c006500720020004100630072006f006200610074002000520065006100640065007200200035002e00300020006f00670020006e0079006500720065002e>    /DEU <FEFF00560065007200770065006e00640065006e0020005300690065002000640069006500730065002000450069006e007300740065006c006c0075006e00670065006e0020007a0075006d002000450072007300740065006c006c0065006e00200076006f006e002000410064006f006200650020005000440046002d0044006f006b0075006d0065006e00740065006e002c00200076006f006e002000640065006e0065006e002000530069006500200068006f006300680077006500720074006900670065002000500072006500700072006500730073002d0044007200750063006b0065002000650072007a0065007500670065006e0020006d00f60063006800740065006e002e002000450072007300740065006c006c007400650020005000440046002d0044006f006b0075006d0065006e007400650020006b00f6006e006e0065006e0020006d006900740020004100630072006f00620061007400200075006e0064002000410064006f00620065002000520065006100640065007200200035002e00300020006f0064006500720020006800f600680065007200200067006500f600660066006e00650074002000770065007200640065006e002e>    /ESP <FEFF005500740069006c0069006300650020006500730074006100200063006f006e0066006900670075007200610063006900f3006e0020007000610072006100200063007200650061007200200064006f00630075006d0065006e0074006f00730020005000440046002000640065002000410064006f0062006500200061006400650063007500610064006f00730020007000610072006100200069006d0070007200650073006900f3006e0020007000720065002d0065006400690074006f007200690061006c00200064006500200061006c00740061002000630061006c0069006400610064002e002000530065002000700075006500640065006e00200061006200720069007200200064006f00630075006d0065006e0074006f00730020005000440046002000630072006500610064006f007300200063006f006e0020004100630072006f006200610074002c002000410064006f00620065002000520065006100640065007200200035002e003000200079002000760065007200730069006f006e0065007300200070006f00730074006500720069006f007200650073002e>    /FRA <FEFF005500740069006c006900730065007a00200063006500730020006f007000740069006f006e00730020006100660069006e00200064006500200063007200e900650072002000640065007300200064006f00630075006d0065006e00740073002000410064006f00620065002000500044004600200070006f0075007200200075006e00650020007100750061006c0069007400e90020006400270069006d007000720065007300730069006f006e00200070007200e9007000720065007300730065002e0020004c0065007300200064006f00630075006d0065006e00740073002000500044004600200063007200e900e90073002000700065007500760065006e0074002000ea0074007200650020006f007500760065007200740073002000640061006e00730020004100630072006f006200610074002c002000610069006e00730069002000710075002700410064006f00620065002000520065006100640065007200200035002e0030002000650074002000760065007200730069006f006e007300200075006c007400e90072006900650075007200650073002e>    /ITA <FEFF005500740069006c0069007a007a006100720065002000710075006500730074006500200069006d0070006f007300740061007a0069006f006e00690020007000650072002000630072006500610072006500200064006f00630075006d0065006e00740069002000410064006f00620065002000500044004600200070006900f900200061006400610074007400690020006100200075006e00610020007000720065007300740061006d0070006100200064006900200061006c007400610020007100750061006c0069007400e0002e0020004900200064006f00630075006d0065006e007400690020005000440046002000630072006500610074006900200070006f00730073006f006e006f0020006500730073006500720065002000610070006500720074006900200063006f006e0020004100630072006f00620061007400200065002000410064006f00620065002000520065006100640065007200200035002e003000200065002000760065007200730069006f006e006900200073007500630063006500730073006900760065002e>    /JPN <FEFF9ad854c18cea306a30d730ea30d730ec30b951fa529b7528002000410064006f0062006500200050004400460020658766f8306e4f5c6210306b4f7f75283057307e305930023053306e8a2d5b9a30674f5c62103055308c305f0020005000440046002030d530a130a430eb306f3001004100630072006f0062006100740020304a30883073002000410064006f00620065002000520065006100640065007200200035002e003000204ee5964d3067958b304f30533068304c3067304d307e305930023053306e8a2d5b9a306b306f30d530a930f330c8306e57cb30818fbc307f304c5fc59808306730593002>    /KOR <FEFFc7740020c124c815c7440020c0acc6a9d558c5ec0020ace0d488c9c80020c2dcd5d80020c778c1c4c5d00020ac00c7a50020c801d569d55c002000410064006f0062006500200050004400460020bb38c11cb97c0020c791c131d569b2c8b2e4002e0020c774b807ac8c0020c791c131b41c00200050004400460020bb38c11cb2940020004100630072006f0062006100740020bc0f002000410064006f00620065002000520065006100640065007200200035002e00300020c774c0c1c5d0c11c0020c5f40020c2180020c788c2b5b2c8b2e4002e>    /NLD (Gebruik deze instellingen om Adobe PDF-documenten te maken die zijn geoptimaliseerd voor prepress-afdrukken van hoge kwaliteit. De gemaakte PDF-documenten kunnen worden geopend met Acrobat en Adobe Reader 5.0 en hoger.)    /NOR <FEFF004200720075006b00200064006900730073006500200069006e006e007300740069006c006c0069006e00670065006e0065002000740069006c002000e50020006f0070007000720065007400740065002000410064006f006200650020005000440046002d0064006f006b0075006d0065006e00740065007200200073006f006d00200065007200200062006500730074002000650067006e0065007400200066006f00720020006600f80072007400720079006b006b0073007500740073006b00720069006600740020006100760020006800f800790020006b00760061006c0069007400650074002e0020005000440046002d0064006f006b0075006d0065006e00740065006e00650020006b0061006e002000e50070006e00650073002000690020004100630072006f00620061007400200065006c006c00650072002000410064006f00620065002000520065006100640065007200200035002e003000200065006c006c00650072002000730065006e006500720065002e>    /PTB <FEFF005500740069006c0069007a006500200065007300730061007300200063006f006e00660069006700750072006100e700f50065007300200064006500200066006f0072006d00610020006100200063007200690061007200200064006f00630075006d0065006e0074006f0073002000410064006f0062006500200050004400460020006d00610069007300200061006400650071007500610064006f00730020007000610072006100200070007200e9002d0069006d0070007200650073007300f50065007300200064006500200061006c007400610020007100750061006c00690064006100640065002e0020004f007300200064006f00630075006d0065006e0074006f00730020005000440046002000630072006900610064006f007300200070006f00640065006d0020007300650072002000610062006500720074006f007300200063006f006d0020006f0020004100630072006f006200610074002000650020006f002000410064006f00620065002000520065006100640065007200200035002e0030002000650020007600650072007300f50065007300200070006f00730074006500720069006f007200650073002e>    /SUO <FEFF004b00e40079007400e40020006e00e40069007400e4002000610073006500740075006b007300690061002c0020006b0075006e0020006c0075006f00740020006c00e400680069006e006e00e4002000760061006100740069007600610061006e0020007000610069006e006100740075006b00730065006e002000760061006c006d0069007300740065006c00750074007900f6006800f6006e00200073006f00700069007600690061002000410064006f0062006500200050004400460020002d0064006f006b0075006d0065006e007400740065006a0061002e0020004c0075006f0064007500740020005000440046002d0064006f006b0075006d0065006e00740069007400200076006f0069006400610061006e0020006100760061007400610020004100630072006f0062006100740069006c006c00610020006a0061002000410064006f00620065002000520065006100640065007200200035002e0030003a006c006c00610020006a006100200075007500640065006d006d0069006c006c0061002e>    /SVE <FEFF0041006e007600e4006e00640020006400650020006800e4007200200069006e0073007400e4006c006c006e0069006e006700610072006e00610020006f006d002000640075002000760069006c006c00200073006b006100700061002000410064006f006200650020005000440046002d0064006f006b0075006d0065006e007400200073006f006d002000e400720020006c00e4006d0070006c0069006700610020006600f60072002000700072006500700072006500730073002d007500740073006b00720069006600740020006d006500640020006800f600670020006b00760061006c0069007400650074002e002000200053006b006100700061006400650020005000440046002d0064006f006b0075006d0065006e00740020006b0061006e002000f600700070006e00610073002000690020004100630072006f0062006100740020006f00630068002000410064006f00620065002000520065006100640065007200200035002e00300020006f00630068002000730065006e006100720065002e>    /ENU (Use these settings to create Adobe PDF documents best suited for high-quality prepress printing.  Created PDF documents can be opened with Acrobat and Adobe Reader 5.0 and later.)  >>  /Namespace [    (Adobe)    (Common)    (1.0)  ]  /OtherNamespaces [    <<      /AsReaderSpreads false      /CropImagesToFrames true      /ErrorControl /WarnAndContinue      /FlattenerIgnoreSpreadOverrides false      /IncludeGuidesGrids false      /IncludeNonPrinting false      /IncludeSlug false      /Namespace [        (Adobe)        (InDesign)        (4.0)      ]      /OmitPlacedBitmaps false      /OmitPlacedEPS false      /OmitPlacedPDF false      /SimulateOverprint /Legacy    >>    <<      /AddBleedMarks false      /AddColorBars false      /AddCropMarks false      /AddPageInfo false      /AddRegMarks false      /ConvertColors /ConvertToCMYK      /DestinationProfileName ()      /DestinationProfileSelector /DocumentCMYK      /Downsample16BitImages true      /FlattenerPreset <<        /PresetSelector /MediumResolution      >>      /FormElements false      /GenerateStructure false      /IncludeBookmarks false      /IncludeHyperlinks false      /IncludeInteractive false      /IncludeLayers false      /IncludeProfiles false      /MultimediaHandling /UseObjectSettings      /Namespace [        (Adobe)        (CreativeSuite)        (2.0)      ]      /PDFXOutputIntentProfileSelector /DocumentCMYK      /PreserveEditing true      /UntaggedCMYKHandling /LeaveUntagged      /UntaggedRGBHandling /UseDocumentProfile      /UseDocumentBleed false    >>  ]>> setdistillerparams<<  /HWResolution [2400 2400]  /PageSize [612.000 792.000]>> setpagedevice