Welcome to the CartoRedux (karto re-ducks) channel where I cover all sorts of ArcGIS Pro tutorials, cartography related goodness, and occasional general tech stuff.
What is it you say ya do? I'm a principal technical consultant, cartographer, basemap designer, and just your average run-of-the-mill map geek at Esri. I've been making maps for customers for quite a while and I love sharing what I've learned over the past 20+ years doing this GIS (Geographic Information Systems) thing. I enjoy talking about anything related to map design, cartography, and general best practices when it comes to navigating the ArcGIS family of software products; but my real passion lies in designing and caching basemaps (raster tiles and vector tiles).
Why CartoRedux? Occasionally, I have a good idea or two. But to be honest, I don't think I'm very original. I do have a knack for being able to re-create maps that I find, or maps that customers want me to duplicate using their data.
Esri just added this functionality to the JSAPI in a recent update. I’ve got a sample app that shows how to use the enhancements made to hitTest() over here: github.com/tfauvell/vt_popups
One word of caution, vector tiles aren’t always the most efficient at delivering full feature attribution. Be cautious with how much data you force into your tilesets.
Thanks, if you haven't already I reckon a vid on this would be good as well as the different between vector tiles and tile layers and why you would use one over the other
some of my symbols produce empty output after creating vtpk file. Only thing that has outputs in symbols are circle, any symbols such as planes or hospital are all empty. Can you help me out?
What types of point symbols are you using? Picture marker and or shape marker based point symbols? Is it possible to share your vtpk or tile layer service?
Hello Tommy, I cached a mosaic with imagery with a country in arcgis pro with manage tile cache. I have other cache made in arcmap on server with the whole Europe. What I try to do is update the cache obtained from the mosaic into the whole cache of Europe. I try this with import tile cache (target is the whole cache, source is the new cache, unchecked overwrite tiles). The result is not good, some white gaps (data) appear outside the country that was cached after the import tool runs. The new cache is not merged perfectly into the old cache. Both caches ( old one and new one ) have the same coordinate system and cache format . The tiling scheme used is Arcgis Online. Do you have a solution?
Usually I see this when the import polygon extends beyond where I have cache (source) or if I mix up the tile format (png vs jpeg vs mixed) between the target and source cache datasets. Can you confirm if the target and source are both using PNG or JPEG or MIXED for tile format?
Also for source is MIXED format, but I have other caches with the same problem with PNG and PNG 8 format. How can I set the tile format before caching a Mosaic with manage tile cache?
For manage tile cache: 1. Set input tiling scheme to "import scheme", that will list a new input parameter called "Import Tiling Scheme" 2. Download sample tiling schemes from: www.arcgis.com/home/item.html?id=58a8aeab660c4d2cbaa2d66a9784d6a5 3. modify the <CacheTileFormat> (PNG, PNG8, PNG24, PNG32, JPEG, MIXED) and <CompressionQuality> as required 4. Browse to the appropriate tiling scheme file in the "Import Tiling Scheme" parameter
I agree the follow up to this video is long overdue. How did you find the process of importing the SVG’s? Was it straight forward and well documented? Or were there any confusing parts in the process?
I tried tackling basemap designs - it's a whole disclipine in itself. Much kudos to the people who are trained in this field - but how do I find them? Who are the companies that will design a basemap for me, or who are the people in this field?
Great lead in with the Ferris Buehler reference. I have never really got a chance to dive into Arc Pro stuff out side of my own curiosity. Difficult to find time to play when shops you work in are malingering with older systems like Hexagon , Smallworld and Desktop. Great job at easing the anxiety.
Sure thing. Just know the dataset schemas will likely be different and the layer file approach may not work. But to your second question: yes layer files retain all that glorious multi-scale information. I’ll post a link to download the layer file in the description shortly.
Well, it looks like I have some clean up work to do. I'm wondering if this will make the difference with the labeling. Right now my project has separate road and label classes for 7 different levels of detail, maybe this is causing some performance issues or conflicts with the labeling engine.
Hi :) Thanks for a great video. I accidentally posted my comment on another of your videos instead of this one - sorry for any confusion. Can you let me know whether it is essential to have the same origin and levels of detail as the vector basemap? For ArcGIS Online, the Map Viewer can show a tile layer with a different tiling scheme than the basemap, but the coordinate systems must match. What I'm after is when is it essential to match origins and levels of detail? Finally, do you know of a way to work out the tiling scheme of a raster tile layer as easily as this?
Hi Georgina, in terms combining basemaps / tile layers in the same map, all of the tiling schemes need to have the same coordinate reference system, origin, and levels of detail. The map viewer may be doing some magic behind the scenes to more gracefully switch between basemaps of different tiling schemes; but it's still not able to show two tile layers with different tiling schemes. The fastest way to find the tiling scheme of a tile layer is to dig in to the item details page and find the rest endpoint URL. Not the friendliest of things to navigate; but all the info is there.
Hello, Great info I'm glad I found your channel. I found you because I am trying to figure out the best method to use in exporting a night mode basemap. The roads and ecological data covers, Kern, Ventura, San Bernardino, Orange. Los Angeles County data is far more dense. The smallest file I have been able to create using PNG 8 was 18G and took 3.5 days to process. I've tried to export a .vtpk however the exported file is not labeling the roads the same way it does on the .tpk file. Scales are all set and different labeling class visibility levels are set correctly. I'm not sure if this is just a limitation between the maplex engine and writing a .vtpk. The Vector tile package exports in hours and would be the ideal format for the application if I could get the same result as when I export as a .tpk. What do you think is my best option? Based on your videos and my experience thus far I would say the JPEG 90 but I'd love to know what you think. Cheers-
Great question. For vector based content, it's a tough sell to stay with raster tiles. Hours seems like a very long time to cook even the entire state of California. There are quite a few tricky spots when authoring a vector tile basemap, have you checked out this video ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-GaJ_8cQvBmc.html ?
I will check it out, thanks. Currently I’m using your 2 part method and creating the cache I figured out I needed up to level 19 and it’s running. That started 09:30 Friday hopefully it’s ready by tomorrow.
Just found your channel yesterday. Thanks for the great video. For those of us that don't have access something like Affinity Designer, is there any way to do this IN pro? Or possibly a web tool that can do it? I'll have to see if my work has any similar graphics tools that we can use.
Welcome to the community and I’m glad you found this helpful! As far as importing the raw SVG’s into Pro, absolutely. You don’t have to do the “conditioning” steps. But if you want to make your own custom icon shapes using vector graphics tools, you will need something that can create an SVG. I’ve been hard pressed to find as robust a solution at the price point (and one time purchase) of Affinity Designer. Keep an eye out, as they often run sales. There are several other options out there like InkScape or GIMP to author custom SVG’s. I’ve definitely got InkScape icon design on the list of possible videos in the future.
@@CartoRedux thanks, it's not really a price issue it's the limitations of what we can install from my employer. I'll have to look through our software catalog and see if there's something we can use, thanks.
I am using "Create Map Tile Package" with the default AGOL tile scheme to create a tpkx from a map with a set of raster files. The raster's visibility is controlled by visibility ranges in ArcGIS Pro. However, the resulting tpkx has the visibility breaks at completely different scales than what I specified in ArcGIS Pro. Does anyone know why that is? Is there a conversion factor? For example, I set the visibility of a raster image to maximum scale 1:25.000 but in the tpkx it becomes visible at 1:35.932.
Interesting...could you clarify a few things? The raster datasets, what scale dependencies do you have set for those layers? Are you using the AGOL tiling scheme scales for those, or are you using more human readable / rounded scales? For the Create Map Tile Package tool, is this Pro 3.0 (this tool got some upgrades)? Did you use the "package for arcgis online" option?
Yes I am using ArcGIS Pro 3. I am using a custom tiling scheme with the following breaks 10000, 30000, 50000. I set the scale dependency of the raster to “in beyond 30000”. I calculate the tpkx and open it directly in ArcGIS Pro. In ArcGIS Pro the raster in the tpkx will only become visible at roughly 49900. I think I realised that “in beyond 30000” means visible starting with 30001. So it sort of makes sense that in the tile level of 30000 the raster isn’t visible yet. What I don’t understand is why the raster appears at approximately 49900 and not 50000? Do you have any idea why that is? Is tpkx even even meant for exact scale breaks like 30000 or 50000? Why is it 49900 and not 50000? Or am I misusing the tpkx by opening it in ArcGIS Pro directly and not in AGOL where there are no exact scales (I think?)
Amazing video!! I wish I would find it before I struggle myself learning how to do this!! I would love to see a in depth technical talk about the Vector Tile Style specification, including how to use expressions and how to debug them. Thanks for this great video again! 🤩
Do vector tile basemaps make for good mobile map packages, specifically ones for offline use, say with first responders? Trying to replace a old school map book and need something quick and useful.
Absolutely. They’re light weight and can pack a ton of detail into a small package…vector tile package that is 😉 Especially useful in disconnected and sometimes connected scenarios. For example a full detailed basemap of NYC (all 5 boroughs, buildings etc…) weighs in at less than 250MB.
Thanks for great video. Please also tell me about the standard size for symbolizing Point of intrest e.g hospital, airport in creating vector tile package thanks in advance
One more query, when it does not conclude in .tpkx and the process of the tool is interrupted and you are left with a folder and a .json file.... The process can be resumed or it has to be processed again, you no longer have to use it. indicted. I have examined and it seems that it would be missing to process the last L19 cache folder assuming that it is the maximum level.
I’ve not seen lingering intermediate files left behind from running the Create Map Tile Package tool. Manage tile cache on the other hand will leave the bundles it has completed behind and you can update subsequent jobs with missing LOD and regions of missing bundles with tailored AOI polygons.
Thanks for the answer, but I think it's not due to storage disk space: I have space on my computer of 1tb, but I think it's because of the geographical dimension, it's large. Then you recommend me for Manage tile cache and Export tile cache, with these steps the process to obtain a .tpkx file will be faster, confirm me and if there is another recommendation I would appreciate it
Overall processing time should be about the same. Depending on the version of ArcGIS Pro you are using, you may have better options to control the cache AOI with Manage Tile Cache and Export Tile Cache, which can make a world of difference when it comes to processing time and overall storage impact.
Hello, a query in arcgis, I use the Create Map tile package tool for a mosaic, it does not finish processing, that is, the result must be a .tpkx file, but it freezes in days and the result is displayed in a windows folder (folder tile (contains more folders called L 5 to l 19 + layers file), root.json file)...................the question is why it takes time to finish as . tpkx and in some cases it doesn't finish and stays in folders and time is wasted waiting for it to finish, thanks for any help
There are a number of reasons that the tool can take a long time to run, and in some cases not finish completely. One of the more common issues is running out of disk space in the output location of the TPKX. Another factor that affects the time to process and size is the geographic region and map complexity.
This is also one of the reasons I prefer to use the manage tile cache tool first, and then use the export tile cache tool. I find this process gives me more control.
Thank you so much. I have one question when I create vtpk some symbols pixelated after creating vtpk. In some pc it look fine but in some pc it seem pixilated. What should I do to fix this
Great question. In some cases the type of symbol used affects how crisp the symbols look in a web map. Did you use a picture marker symbol or shape marker? Shape markers are preferred and if they still look pixelated then I tend to make them a little larger in pro and then scale them back in the Vector Tile Style Editor (symbol size decreased from 1 to 0.8 or slightly smaller).
How would you suggest completing the following curve in ArcPro? THENCE SOUTH 03°33'15" EAST 94.04 FEET TO A POINT ON A CURVE TO THE LEFT, THE RADIUS POINT BEING AN IRRIGATION PIVOT WHICH BEARS NORTH 86°26'45" EAST 1318.52 FEET: THENCE EASTERLY ALONG SAID CURVE 4017.93 FEET:
Great question! So you’re looking to do some sort of bulk edits for lots of individual lines? I’ll have to do a bit of research on that one. Don’t have a good answer at the moment.
Hi, is there a way to find the origin in arcgis pro itself? I couldn't find the Origin with Chrome, because I have No expierence with the Developer Tools.
Not that I could find. If you have a raster tile or vector tile layer in ArcGIS Pro, the layer properties source tab has a server URL that you can open in a browser, and it should list the origin under the tile info heading. If the page you launch doesn't appear to be formatted, it's likely a vector tile service. Copy all of the text, and paste it into Notepad++. Make sure you have the JSTool plugin loaded. Paste the text into Notepad++, and use the JSTool plugin - "JSFormat" (ctrl+alt+m), to make the text a bit easier to read and locate the tiling scheme origin. I hope this helps!
You need to challenge the Legendary Mr Swason to an Arcgis battle! He is the Australian head of Arcgis and can make walk time maps in the time it takes to walk between them
@@CartoRedux yeah most definitely. I’m trying to come up with something for proposal type graphics for my work other than hi res imagery. Typically a zoomed in area of water and wastewater systems
@@PBandHoneySammich yeah this combo of large scales (zoomed in) and availability of high-res terrain might be hard to pull off. The USGS 10m NED, while widely available in the states, will start to fall apart at scales larger than 1:18,000.
I can't guarantee that I'll always have John bugging me; but I'll certainly do my best! Do you prefer these longer varying technical depth exercises? Or do you all like shorter but high level overviews, and then an equally shorter but more specific deep dive as a separate video?
Great video. I love this type of advanced techniques video. Shared it with my whole team at the office. Question for you,Is there any way to edit the font list if I want to add a different one later?
Thanks @Herman! To include additional fonts, you would need a tileset that has the desired font in the glyphs / fontstack. It would then be a matter of referencing that url in the glyphs url in your style. Then for the label layers, you would reference the font name and style you desire. Word of caution with licensed typefaces (like Frutiger). These can get pricy depending on how the foundry charges for its use. It's for this reason that I try to stick with SIL Open Font License (OFL) or similarly "free for commercial use" fonts like google fonts.
This is exactly the video I was looking for, Big Thanks. The ability to directly alter the style json is incredibly powerful and I'm thrilled that you all implemented it.
