GS214-2-Preparing-for-Autodesk-Topobase by stariya


									Preparing for Autodesk® Topobase™ Using
AutoCAD® Map Utility Toolkits
Neil Brooker - Autodesk
Lynda Sharkey - Autodesk

GS214-2            The new AutoCAD Map Utility toolkits are designed to help engineers and other utility
designers and managers to structure their CAD data to local industry standards. Standardized feature classes
enable organizations to create and maintain critical asset data to exact specifications, largely eliminating data
ambiguities and errors. Autodesk Topobase is based on a similar paradigm, but adds additional benefits of
central data storage, sophisticated data management and editing tools and powerful workflows. This class
shows how the Utility Toolkits can be used to standardize and organize file-based CAD data, and how
organizations can then move to the next level of data management using Autodesk Topobase data models
based on the same standards as the Toolkits, but seamlessly and centrally managed.

About the Speaker:
Neil lives in Farnham, UK, with his wife, dog, horse, fish (RIP), and frogs. Neil was born in a volcano and loves
pickled chilies and playing cricket. He has worked for Autodesk for nine years as a pre-sales technical
engineer in the Geospatial group. The work involves pre-sales consultancy, training, technical benchmarking
and application specification, product demonstration, GIS industry presentations and post-implementation
consultancy, and technical support. The products he has supported include Autodesk Topobase, AutoCAD
Map, MapGuide, Land Desktop, Civil Design, Civil Survey, Civil 3D, Envision, OnSite.
Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

                                                  Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

The new AutoCAD® Map Utility toolkits are designed to help engineers and other utility designers and
managers to structure their CAD data to local industry standards. Standardized feature classes enable
organisations to create and maintain critical asset data to exact specifications, largely eliminating data
ambiguities and errors.

Autodesk® Topobase™ is based on a similar paradigm but adds additional benefits of central data
storage, sophisticated data management and editing tools and powerful workflows. The Utility Toolkits
can be used to standardize and organise file based CAD data enabling organisations to move to the next
level of data management using Autodesk Topobase data models based on the same standards as the
Toolkits, but seamlessly and centrally managed.

Applications Overview
AutoCAD Map3D

AutoCAD Map 3D is used as the application for creating and editing geospatial data. AutoCAD Map 3D
uses AutoCAD as it’s drafting engine but makes it easier for engineers, drafting technicians, and GIS
specialists to collaborate on projects and to share mapping information. Project teams can use their
AutoCAD knowledge and training while taking advantage of GIS tools and functions.

AutoCAD Map 3D provides specific functionality that is not available in AutoCAD:

       Multi-user access—access DWG drawings at the same time.
       Work across tiles—attach and query multiple DWG files, which makes it easier to work with tiled
        data sets.
       Coordinate systems—bring in DWG, GIS, and raster data with different coordinate systems and
        have the data overlay properly.
       Drawing cleanup—detect and fix geometric errors in DWG files.
       Import/Export—bring in data from other departments and vendors and combine it with data in
        your DWG files (for example, ESRI SHP).
       Direct connection to GIS data
       Geospatial analysis tool
       Geospatial data management tools

Autodesk Topobase

Autodesk Topobase makes it easier to build and manage geospatial data models by adding additional
tools, such as business rules, topology, long transactions, workflows, network analysis, and reporting.

Autodesk Topobase provides vertical applications to manage different types of infrastructure, such as
water, wastewater, and power. These individual applications come preconfigured with industry-specific
data models. The data models capture relations between features. For example, the water module
manages features such as pipes, hydrants, and valves, the relationships between those features, and all
the underlying attributes relevant to those features. By providing centralized access to spatial data and

                                                  Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

enhanced processes, Autodesk Topobase improves the way vital tasks get done throughout

Design data and associated intelligence can be managed, analyzed and updated as real world features in
Topobase. This provides a central ‘source of truth’, eliminating redundant data, errors that occur through
duplication and time consuming data exchange procedures. Everyone knows that the data they view is
the most recent and accurate data available. Further, Topobase allows intelligent rules to be applied to
the data, business workflows to be followed and powerful analysis and reporting to be available.

For example, we can connect our new water pipes to houses in the development using a workflow: a set
procedure that designers and engineers adhere to that provides consistency and reduces errors, based
on Oracle rules and triggers. These will handle such steps as object snapping, feature validation and
correct attribute assignment in the central data store itself. Further, the live data is not updated until a
series of checks is undertaken, as engineers work on their own version of the data (a long transaction in
Oracle Spatial known as a ‘Job’). The system even notifies on design conflicts.

As well as providing a consistent editing and updating platform for real world features, Topobase enables
the management and analysis of assets to the organization. For example, what-if scenario’s can be
performed to assess impact of faults, outages or other disruptive influences. Because Topobase supports
topological relationships between assets and features we can perform traces and generate reports

Such data centric, mission critical applications are also available on the web, using MapGuide Enterprise.
This allows many remote workers to perform maintenance and analysis tasks seamlessly on the centrally
stored data. Finally, while Topobase comes with some industry specific data models, it is a flexible, open
and robust system which allows rapid configuration and customization for any purpose.

Utility Toolkits

The AutoCAD Map 3D Industry Toolkits have been developed as an add-on for utilities using AutoCAD
Map 3D. They are composed of object class definitions, object data tables for attributes, a drawing
template, annotation templates, and documentation.

About Object Classification

You can use object classification to organize your drawing based on real-world features (roads or
manholes, for example). When you create an object using object classification, the object automatically
has properties and values assigned to it based on its object class definition. In addition, you can easily
find or select all objects in an object class.

Object Classification requires two primary components:

1. A definition file (in XML format), and
2. Drawing objects to be classified.

                                                   Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

Once the definition file is created, users with the correct privileges can create object classes or edit
existing ones. When you create an object class, you use an example object to define the object class.
The object class is then created by choosing properties associated with the example object, including
layer, block references, object data, and so on. Once the example definitions are established, you can
modify default values for layers, establish default object data values, and so on.

Creating a New Object Class

An object class definition is based on an object in the drawing, such as a line, block, or polygon. Before
the drawing object is used to define an object class, it should have all properties such as, layer, linetype,
object data tables, etc applied as you want the object class to be defined.

1. Verify that the objects from which you want to create an Object Class exist in the drawing with all the
appropriate properties.

2. In the Task Pane, right-click over the Object Classes branch, select Define Object Class…. (Figure 1).

                                  Figure 1: Define Object Class

3. Select the drawing object that represents the object class to be defined.

4. In the Define Object Classification dialog, enter a class name and description (Figure 2).

                                                   Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

                                            Figure 2: Class Name

5. Select the Applies To tab.

6. Select the object type that this object class represents.

7. Select the Properties List tab (Figure 3).

                                       Figure 3: Select Properties List

8. Select the default properties to be applied to the Object Class from the Available Properties: window.

9. In the Property Attributes window select the appropriate values.

                                                  Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

10. Use the Class Icon drop down list from the Class Settings tab, to add a specific icon to be displayed in
the task pane.

11. Click Save Definition.

Feature Classification using the Utility Toolkits

Autodesk has created such object classes for selected utility industries; Water, Waste Water and Electric.
These contain over 30 industry object classes each (a lot of effort from scratch!). Using these you can
create new classified objects or classify existing dwg entities. You can also amend or extend the default
object classes to suit.

Example: Using the Water Utility Toolkit to classify a DWG

The Utility Toolkits are extremely powerful but simple to use. Once installed, to classify existing drawings
there are two methods you can use.

    1. Open the dwg you wish to classify and add the object class xml definition file to your drawing.
       This is done by:

                       i. Clicking on the Map Explorer Tab on the Task Pane
                      ii. Right clicking on the Object Classes folder
                     iii. Selecting Attach Definition File .. (Figure 4)

                                                  Figure 4: Attach Definition

By default the Utility Toolkits are installed at C:\Program Files\Autodesk\Industry Kits

                      i. Open the Water Toolkit Folder and select Water Toolkit.xml
                     ii. The Water object classes will be added to the Map Explorer Panel

                                                 Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

       Note that if you use this method to access the utility object classes you will not have default
       symbology available for the classes as these are stored in the dwt file. You will however have all
       the attribute definitions and layer definitions available.

   2. Use the Utility template file, for example Water Toolkit.dwt. This stores all the definitions for the
      object classes including symbology.

                     i. Open the Water Toolkit.dwt. By default this is stored at C:\Program
                        Files\Autodesk\Industry Kits\Water Toolkit
                    ii. Attach the dwg you wish to classify in Map Explorer (See Map3D help)
                   iii. Query in the dwg entities you wish to classify (See Map3D help).

                                        Figure 5: Attach and Query dwg

Now you can classify the DWG entities using the appropriate object classes. For example

                      i.    Right click on the Pipe Object class and select Classify Objects.. (Figure 6)

                                       Figure 6: Classify Objects

                      ii.   Select the pipe entities in the drawing you want to classify

                                                   Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

                       iii.   Select one of the newly classified objects and view its properties. You will
                              see that the object has been put on a specific drawing layer with a specific
                              line style
                       iv.    In the Property Dialog click on the Object Class tab. You will see that pre-
                              defined attributes have been added to the object properties. You can add
                              values in the attribute fields. Some may have value constraints, either ranges
                              of values or lists that you must conform to.

You can alter the properties of any object class as long as you have administration rights. Follow the
same procedures as for creating a new object class.

Exporting DWG Object Classification to an FDO Data Store
You can export your DWG Object Classification data to an FDO data store, such as Autodesk SDF. You
can also export to SHP, Oracle, ESRI ArcSDE, and other non-FDO formats. Moving your data from DWG
files to the SDF format allows you to manage your data more effectively and with better scalability. It also
allows you to take advantage of theming and styling tools in the Display Manager, data management
through the Data Table, and other functionality only available for geospatial features. You can still share
your data with AutoCAD users by saving out to and importing from DWG format. For detailed information
on working with FDO data, see the AutoCAD Map 3D User’s Guide.

1. Click File menu > Convert DWG To > Autodesk SDF.

2. On the Selection Tab of the Map Export dialog box, specify which objects to export.

3. On the Feature Class Tab, click Select Attributes.

4. In the Select Attributes dialog box, check the attributes you would like to export.

5. Click OK.

6. In the Map Export dialog box, click OK.

The next section shows how you can export your classified data into a Topobase Data Model and take
advantage of Topobase’s sophisticated analysis and data management features.

Topobase is an Oracle spatial database application. All geometries, attributes, rules, workflows,
reports and additional capabilities are stored in a central database. However the feature classes
in its’ data models are based on similar schema constructs as the Utility toolkits (in fact the
Utility Toolkit Object Classes are derived from the corresponding Topobase Utility Modules).

Getting Classified Data into Topobase
There are theoretically two main ways to get the classified DWG objects into a Topobase schema; copy
directly from Map using the DWG export to FDO connection or using a Classify tool that has been created
specifically for mapping DWG features and object classes to Feature Classes in a Topobase. There are
also two types of schemas you can use in Topobase; one created manually from scratch, or using the
pre-built Topobase utility modules.

                                                   Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

Configuring the Topobase Data Model

Before you can export your classified DWG objects into Topobase, you need to create a Topobase
project, or Workspace. It is beyond the scope of this class to go into the details of this. In brief, you can
use the Topobase Administrator to create a new workspace that will hold the oracle schemas, or
Documents, that your data will populate. You can create brand new Documents and define new Feature
Classes and associated attributes, or you can use pre-defined industry specific modules to create the
documents. (For more detail please refer to the Topobase Administrators Guide). Here we will use the
Topobase Water module to create a new Document in a new workspace.

Option 1: Using Topobase tools

Out of the box, Topobase Client allows the user to classify DWG entities into its data models. However
these only apply to geometries and not object data of object classes. Therefore the user needs to re-enter
attribute values in the attribute forms. This is manually intensive and negates any advantage of using the
Utility Toolkits.

Option 2: Using Map 3D FDO tools to populate Topobase

Because Topobase Oracle schemas are viewed by FDO in Map as foreign schemas you might
theoretically use the Oracle connection in Map and the copy tools provided. There are two potential
options here for getting data into a Topobase schema:

                 1. Create a data model using Topobase Administrator that mimics exactly the Object
                    Classes you want to copy. Then you can attach the new Topobase data source as a
                    foreign Oracle schema using the FDO connection dialog and use the Map Convert
                    DWG to FDO Connection capability to copy the geometries and features into
                 2. Create a new data model using Topobase Administrator, using a pre-defined Utility
                    Model as a template.

The first option is fine if you want data storage. However, the data model will not include workflows,
topologies, business rules and reports. You can of course configure these if required.

The second option gives you all of those capabilities but is more complex by nature. While you can still
use the FDO copy tools to get data into a Utility Data Model there are some considerations.

                 1. In the Topobase Utility Data Models, the physical geometries are often stored
                    separately from the attributes. For example, the Pipes in the Water Module are stored
                    in the WA_LINE table, while the attributes are stored in WA_PIPE table. They are
                    linked by a unique attribute where FID_ATTR in the WA_LINE table relates to FID in
                    the WA_PIPE table
                 2. The Utility Data Models include predefined Topologies for analysis. These are stored
                    separately as Utility models. There are two table, one containing line features and
                    one containing point features. In the Water Model these are WA_LINE (as above)
                    and WA_POINT.

                                              Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

This added complexity means that you cannot simply use the Convert DWG to FDO Connection tool to
populate the Topobase schema. The following workflow illustrates one potential way to populate the
Topobase model. It involves creating a temporary feature source to hold the classified objects and
attributes. This can be SDF or Oracle.

Workflow 1.
               1. Create the Topobase Data Store based on the Water Utility Module using Topobase
               2. In Map 3D, open your classified DWG
               3. Using the Data Connect dialog in Map 3D create a new Oracle data store (Figure 7)

                              Figure 7: Create new Oracle Data Store

               4. Once created, connect to your new empty data store
               5. Using Convert DWG to FDO Connection you can populate the new data store.
                               i. Filter the selection on Layer, i.e. WA_PIPE
                              ii. On the Feature Class Tab of the Export dialog map your drawing
                                  object classes to a new feature class in Oracle.
                             iii. Select the attributes to copy (Figure 8)
                             iv. You can copy multiple object classes to the new data store.

                                Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

              Figure 8: Export classified objects to Oracle

6. Use the Data Connect Dialog to attach your Topobase schema as a foreign Oracle
7. Using Bulk Copy you can start to copy data from your temporary FDO data store to
   Topobase. You do this is two steps:

                i. Copy the Geometry and Featid to the WA_LINE table in Topobase,
                   mapping the Geometry columns and Featid to the FID_ATTR
                   attribute (Figure 9)
               ii. Repeat the copy procedure but copy the attributes to the WA_PIPE
                   table in Topobase. Don’t copy the Geom column, as WA_PIPE only
                   holds attributes.

         Figure 9: Bulk Copy Geometry to Topobase Schema

                                                  Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

                8. Map the Object Class attributes from the temporary data store to the attributes in
                   WA_PIPE (Figure 10). In this case Featid should be mapped to FID in the WA_PIPE

                               Figure 10: Bulk Copy Attributes to Topobase

You should now have the geometry in WA_LINE table in Topobase and the attributes in WA_PIPE table.
Because the Featid has been used as the unique linking value in both tables you should be able to view
geometries and associated attributes in Topobase. Also, because you have populated WA_LINE with the
geometry objects you can should be able use the Topobase topology and workflows on your data.

The Reality!!

Unfortunately, neither of the above options currently gives the required results. True, Geometry is copied
into the WA_LINE geometry column but no attributes are written to WA_PIPE. This is because Topobase
schemas are read only EXCEPT if using Topobase tools with edit credentials! Essentially, Map3D can be
used as a view only tool for Topobase. The purpose of performing the above migration scenarios was to
highlight current status (and limitations) of data migration into Topobase. BUT …. There is a solution!

Option 2: Using the ACCLASSIFY tool to populate Topobase

While the above workflow will allow you to get create a Topobase Data Model based on pre-defined
structures and capabilities, there is a more elegant, sophisticated and purpose built application available,
ACCLASSIFY. This was written to facilitate extracting the geometry and attribute information from DWG
entities and migrating them to more rigidly and logically defined database structures such as Oracle
Spatial, SDF and Autodesk Topobase. It is available as an add on from Autodesk Consulting.

Workflow 2.

                                             Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

1. Open Topobase Client. Do not open a workspace
2. Open your classified DWG
3. Type ACCLASSIFY at the command line. The ACCLASSIFY tool opens
4. Create a new Profile to store your migration settings. These can be reused for other DWG’s and
   in batch mode.
5. Add Input Feature classes. These are based on geometric primitives and the data in the DWG.
   For example, create one called Pipes defined as Polylines (Figure 11).

                        Figure 11: Create a profile and input feature class

6. You now define an expression that will extract required DWG entities into your input feature class
   based on DWG properties. Click the Expression Button. The Classification Criteria dialog
   appears. Click the button next to Property.
7. The Property Chooser exposes all the Properties associated with the Polyline Geometry type.
   From these you can build up simple or complex filters to extract exactly the data you need. In this
   case we will simply filter on the Layer value (Figure 12).

                                             Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

                                  Figure 12: Property Chooser

8. Back in the Classification Criteria dialog we can extract the value of the layer by clicking the
   button next to criteria and manually selecting a pipe entity in the DWG. The ACCLASSIFY tool
   will automatically pick up the Layer name (Figure 13).

                                 Figure 13: Classification Criteria

9. Now we can map our extracted entities to a Target Schema. By clicking on the Target Schema
    button we can add target schemas in the Target Schemas Mapping Rules dialog.
10. Click the Import button under Schemas, and login to your Topobase Schema
11. Under Input -> Target Mappings click the Add Button and select the tables you want to put data
    into, i.e. WA_PIPE and WA_LINE (Figure 14)
12. When you select each target table, the attribute columns from the Topobase schema will be
    displayed. You map each of these to attributes in the object classes of the DWG.

                                            Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

13. Once all the properties have been matched, click the Analyze/Output button. The classification
    report shows you successful classifications and any problem features (Figure 15)
14. The Execute/Output button then allows you to log in to your Topobase schema and pushes the
    selected DWG entities and attributes into the corresponding Topobase features.

                               Figure 14: Target Schema Mapping Rules

                                Figure 15: Classification Report

                                                 Preparing for Autodesk® Topobase™ Using AutoCAD® Map Utility Toolkits

By using the new Utility Toolkits for AutoCAD Map3D, designers and engineers can easily create
structured data to set standards. Whole organisation can standardize on these so that information is more
easily accessed and understood. The standards for the Toolkits are based on Autodesk Topobase
industry schemas. Topobase allows organisations to more effectively manage and analyze critical data
using central controlled data storage, intelligent attribution and reporting and configured workflows. The
Map3D utility toolkits are a good introduction to such managed data structures.

Because the Utility Toolkits are based on Topobase Schemas it follows that the two should be
compatible. There are a few options to migrate from structured DWG to Topobase given in this paper.
The only effective one is to use the custom built ACCLASSIFY tool. It is currently only possible to use out
of the box Map3D functionality to store geometry.


To top