Using FME Realize (FME AR Mobile App)

Introduction

In the previous tutorial, we published an AR workspace to FME Flow and created an FME Flow AR App. With the app created, we are ready to go outside and explore the model in the real world. If you created a service with the tutorial data, you will need to fit the model into reality with your imagination. If you used real data, you can visualize it at the location it belongs to.

FME Realize comes with demo AR Apps to try out without needing to create your own. 

Requirements

• FME Form 2025.1+ 
• FME Flow 2025.1+
• An iOS mobile device with FME Realize app installed 
• FME Flow AR App created

Installing and Launching FME Realize

Install from the iOS App Store if it is not installed yet. Make sure you are connected to the Internet.

Launch the app on your device. 

You will see the camera view, which is used for scanning the environment. There will also be a button in the lower right corner to open the menu containing all available FME Flow AR apps.

Retrieving Model Data

• Choosing Your FME Flow AR App: Tap the button to access the list of available FME Flow AR apps. These apps are displayed as large, easy-to-select buttons or tiles. Each tile represents an FME Flow AR app, which runs a workspace. 
• If you don’t log in, you will only see a few demo apps that run on a Safe Software FME Flow demo instance.
• Log in to your own instance of FME Flow—tap the “Log In” button on the top of the screen. On the Log In page, either use a QR code or type in your Host URL, then tap “Next”. On the next screen, fill out Username and Password, and then tap the “Log In” button.
• Now you should get back to the Home screen with all the AR apps you created (or the app you have access to in your organization). Find the app you created and tap on it.
• You will see your app page. We didn’t configure any parameters, so you should see the app title, the description, and the “Run” button. Press the button to request the model. If you configured it with “Run Immediately” on, this page won’t appear and the model will be requested automatically.
• For a few moments, you will see a screen “App Request Processing" consisting of two steps—running the app on FME Flow and retrieving the model. For our dataset, it should take just a few seconds to generate and deliver the model to our device. For bigger workspaces and larger datasets, the waiting time can be longer, but the numbers depend very much on your FME Flow engine, your decisions during the workspace creation and parameters set. A square AOI with 100-120 m each side with a city-wide dataset that Safe Software uses for internal testing, the data processing and model delivery takes about 25-40 seconds.
• You can have multiple buttons configured to use the same workspace (each configured differently), or each button can represent a separate workspace—it's entirely up to the creator of the workspaces and Flow AR Apps. A single app can also deliver different models depending on the location you specify.
• Switching Flow AR Apps: If at any moment you would like to switch to a different FME Flow AR app or re-run the current app, simply tap the same button again to return to the main app selection screen and choose another app to explore.

Placing a Model

The most crucial step is to accurately place the model in the real world:

• Finding the Right Surface: Ensure that you point the device at the correct surface before placing the model. For example, if the model is meant to be placed on the floor, avoid pointing the camera at a nearby table when loading the model. Selecting the right surface initially will help prevent incorrect placement and save time during adjustments. Currently, vertical adjustments are not supported, so if the model is placed on the wrong surface, you may need to reload the cached model to correct its vertical position.
• Moving and Rotating the Model: Use your fingers to move and rotate the model on the screen. One finger allows you to move the model, while using two fingers will enable you to rotate it. This provides fine control to ensure the model is placed precisely as desired.
• Positioning with Landmarks: GPS positioning might not always be perfectly accurate, so it's helpful to use local landmarks to anchor the scene. These landmarks are typically created by the workspace creator and are vital for verifying the accuracy of model placement. Use visible objects such as poles, hydrants, manholes, or even custom survey marks as reference points. For indoor use, existing structures such as walls can also serve as effective landmarks to help ensure the model is accurately positioned. If these landmarks are not available, it will be challenging to confirm that the model sits correctly in its intended position. If you have access to custom surveyed physical points, these can provide excellent accuracy.
• Aligning Orientation: Due to compass limitations on mobile devices, initial rotation might be off by a few degrees. Use the two-point orientation technique: stand over one landmark (e.g., align the real and augmented hydrants), and rotate the model until a second AR landmark lines up with its real counterpart. This helps establish accurate alignment for the entire model. Additionally, you can use real linear features, such as walls or sidewalks, to align their augmented counterparts along these features for better accuracy. Aligning orientation can be done at any time during the session to correct both positional (XY) and angular misalignments, ensuring the model remains accurately placed as you continue to explore.
• Once you are satisfied with the model positioning, lock it with the special “Lock” button.

Interacting with the Model

Once placed, you can interact with the model:

• Visual Exploration: Move around to view the model from different angles. You can walk normally, but avoid panning or pointing the device in different directions too quickly—let the device track the ground effectively. It is possible to look up for a while, but try not to move during this time and avoid doing it for too long.
• Summary Annotations: Point the center of your screen at different parts of the model to view summary annotations. These annotations may include simple text, attributes, or links that open in the WebView for further interaction.

• Web view Interactions: When hyperlinks are included in the summary annotations, a powerful range of integrations becomes available. These hyperlinks open within the Web view, where users can experience a wide variety of functionalities without needing to understand the underlying technology.
  • What to Expect from the Web view: The Web view enables advanced interactions, such as running FME Flow apps, displaying FME Gallery Apps (which are collections of Flow apps), viewing static pages, playing videos, or visualizing 3D content. It also allows seamless integration with other products and services via API. Whether it's showing additional information, triggering new workflows, or viewing dynamic content, the Web view provides a versatile way to enhance the AR experience. Note that Web View integrations are not explored in this tutorial but are worth considering for extending the functionality of your AR models.

Configuring FME AR

• Model Settings Button: There is a button to access the model settings, which contains two tabs:
  • Assets Tab: This tab displays a list of all asset types (layers) available in the model. You can toggle the visibility of each asset type on or off, allowing you to customize the view to suit your needs.
  • Settings Tab: This tab provides options to adjust the model's opacity and scale. Use these settings to modify how the model appears in your environment, making it more transparent or adjusting its size to better fit the context of your surroundings.
  • 
• Render Settings Button: The Render Settings button allows you to control the visibility of various items within the scene, such as detected planes, anchor point, feature summaries, compass, and other rendering features. Additionally, there is an option to toggle between metric and imperial units.

Tips for Best Performance

• Device Handling: Hold the device steady, let the camera detect the surface, and avoid quick movements. Rushing or sudden movements can lead to loss of tracking, causing the model to drift or become unstable.
• Maintaining Surface Visibility: The app relies on good surface tracking, which means you need to keep the target surface in view as much as possible. If you lose sight of the surface, the model may shift, requiring repositioning.
• 
• Adjusting Position: As you explore, you may notice slight drifting of the model. To prevent accidental shifts, use the lock button to fix the model in place once it is correctly positioned. When adjustments are needed, unlock the model, make the necessary adjustments, and then lock it back in place to maintain stability, especially if moving long distances around the model.
• Screen Recording: If you are recording the AR experience, move even more deliberately. Start by holding the camera steady for a few seconds before beginning any movement—this allows for a stable reference at the start of the recording. When you begin moving, pan smoothly and avoid quick directional changes. Show an object, such as a hydrant, for a few seconds before walking or making other movements. Once you finish moving, stop and hold the camera steady again for a few seconds before ending the recording. This ensures smoother transitions and provides the viewer with clear, stable footage that is easy to follow. Reducing rapid movement during recording will help maintain tracking consistency and result in a more professional-looking video.

Practice and Training

To build your skills and confidence, start by practicing with simple models:

• Place a basic model in your environment.
• Adjust and align it using landmarks.
• Walk around and explore to ensure the model remains stable.

Repeat this process until you feel comfortable with positioning and alignment. Practicing with smaller, simpler scenes can significantly improve your ability to work with more complex models later.

Additional Resources

Tutorial: Getting Started with Augmented Reality | FME Realize

Creating an FME Flow AR App

Introduction to Connected Experiences in FME Realize

Placing 3D Models in the Real World (or Near You): A Guide to Location, Landmarks, and Accuracy in FME Realize