Feature Extraction from Imagery & Lidar

Kurt Schwoppe, Esri

Mark Romero, Esri
Gregory Bacon, Fairfax County
Today’s Speakers
Image Processing Experts and Good Colleagues

Kurt Schwoppe Mark Romero Gregory Bacon

Imagery Industry Lead Imagery Specialist GIS Analyst III
Esri Esri Fairfax County
GISP
The Science of Where
Integrates Dynamic Data About Everything

Built Environment Natural Environment

I oT
Think Big - National Imagery Programs

ArcGIS Image Server

Think Small – Micro Geographies

Drone2Map
It Leverages All Types of Remotely Sensed Data
Turning imagery into information

Image Analysis
Drone Mapping

Advanced Imagery
Workstation

All Major Sensors

Drone2Map Full-Motion Video

Ortho Mapping
High-Resolution Satellites
Small Sats
Dynamic Image Classification
Aerial Photos Processing Server
DTM Stereo View
Generation Seamless
Orthophotos
Change Analysis

Image Space and

Mensuration

. . . New Image Analyst Extension

Imagery is Not an Addition to GIS - It is Part of One

Feature Analytics Raster Analytics

GeoAnalytics Server Image Server

Large Observation Collections Large Imagery Collection

Space-Time Cube Riparian Areas

Hot Spots
Lidar:
First Return
Density
Lidar:
Power Bare Earth
Outages
(50+ Million)
Imagery

Faster (10x+)

Leveraging Distributed Computing and Parallel Processing

. . . Accessible from ArcGIS Pro and Python API
Modernizing
Built Upon an Enterprise Model
Imagery

ArcGIS Pro
Image Analyst
Extension

Web App Builder

Imagery Services
(WABIS)
GIS
Professionals

Server Image Server

See the Earth, Find the Patterns, Share with Others

Modernizing
In Highly Scalable Configurations
Imagery

Clients
Desktop Web Device
2D & 3D
• ArcGIS Pro
• Excalibur
Imagery
• Web Maps
Specialist
ArcGIS Pro Portal • Scenes

Enterprise Image
Server(s) Server(s)

Data
GeoDataBases Store
(Mosaic Dataset) Configured
for Raster
The Science of Where is Multidimensional
Delineating both 3D Space and Time

CAD/BIM

Photogrammetry

Lidar
Oblique Imagery
GIS Data
Modernizing
Image Server “Hyper Extends” Imagery in Pro
Imagery

Infinite
Scalability

=
Raster Analytics
• Deploy to as many Servers as Needed
• Full Distributed Processing
• Elastic Pricing Model*
Modernizing
Imagery Bundles Support Implementation Patterns
Imagery

ArcGIS Pro 2.1 &

Robust Image Processing Image Analyst
OrthoMapping and
Stereo Extension

Image Analytics Ortho Mapping

Extracting Features &

Accurate basemaps and
Change Detection
Elevation products
Image Management
Make massive
collections of imagery
accessible
Modernizing
Image Analyst Extension for Pro 2.1
Imagery

Improved UI & Ortho Mapping

Mensuration Raster Analytics Stereo
Display for Imagery Workflow & 3D

- View imagery - Sensor model based - Workflows and tools for - Stereo visualization and - Production level
undistorted, with vectors measurements based on image classification and data capture capabilities, photogrammetry including
transformed to the image sensor orientation from machine learning enabling detailed and triangulation, block
- Image coordinate high resolution satellite - All raster functions that accurate elevations and bundle adjustments, DEM
system based imagery and oblique currently require the SA height measurements extraction, and ortho
measurement aerial imagery extension, will be rectification
- Improved UX for oblique available through the - Extraction of features
imagery Image Analyst extension from point cloud data

The Image Analyst Extension extends ArcGIS Pro with advanced

tools and user experiences for Image Analysts who perform:
• Image interpretation and exploitation of imagery
• Creation of information products from imagery
• Advanced feature interpretation and measurements from imagery
• Detailed data capture and measurement on stereo imagery
• Advanced raster and image analysis workflows for machine
learning and feature extraction
Modernizing
Image Centric View
Imagery

Improved UI:
• ELT Like
• Linked Views
• Ribbon(s) for Imagery
• Dedicated Workflows

Image Coordinate Space:

• Up is Up!
• Oblique Viewing
- Overlay feature layers
- Create and Edit feature layers
Modernizing
Precise Measurements
Imagery
Capabilities:
• Measure distance, area, centroid, azimuth – with georeferenced imagery
• Measure height – requires sensor model
• Measure height from shadow – requires sun angle
• Measure 3D objects
• Style and annotate measurements
• Track, store, and manage measurements
• Report generation for decision makers
Modernizing
Raster Analytics Feature Extraction
Imagery
Modernizing Raster Analytics for Land Cover Mapping
Imagery
CBP Land Cover Classification
Barren

Impervious Roads

Impervious Surfaces

Low Vegetation

Shrubland

Structures

Tree Canopy

Tree Canopy over Impervious Roads

Tree Canopy over Impervious Surfaces

Tree Canopy over Structures

Water

Wetlands
Modernizing
Feature Extraction Workflow
Imagery
Step 1:
Call up an Image
Service

Step 2:
Define your AOI

Step 3:
Run
Classification
Wizard

Step 4:
Vectorize the
results

Step 5:
Publish
Modernizing
Imagery Raster Changes
Identifies Analytics for Change Detection
Imagery
It shows where we’ve been and the direction we are going
Modernizing
Working with Stereo
Imagery

Capabilities:
• Works with aerial, satellite, and drone
imagery
• Leverages Mosaic Datasets to work with
large collections of stereo pairs
• Consistent Pro editing UX – familiar tools,
feature template support, etc.
• New cursor modes, and shapes
• Shutter glass, and anaglyph stereo viewing

Application:
• Accurate 3D Mapping
• Improved Image Analysis and Targeting
• 3D Modeling for Mission Rehearsal
Modernizing
Production Ortho Mapping
Imagery

Mobile
Raw Apps
Imagery
New
Web
UI
Ortho
Block
Bundle ArcGIS
Adjust
DSM

Derived
Refined Mosaic
Source Bundled Datasets
Mosaic DTM
Adjustment
Dataset

Point
Cloud Computer
Added
ArcGIS
Design
Pro

Image
Server
Modernizing
Accurate and Authoritative
Imagery
Modernizing
Ortho Mapping Information Products
Imagery

Base Mapping Site Modeling Inspect & Measure

Orthomosaics Digital Surface Point Cloud (LAS) 3D Mesh (.OBJ) Annotate Images Volumetric
(.TIFF & .TPK) Model (DSM) (imagery derived)

NDVI Contours Scene Layer Package 3D GeoPDF Inspection Viewer 3D Measure*

(.SLPK)
Modernizing
Working with LIDAR
Imagery

DEM DSM Hillshade Slope Aspect Hydro Solar Features Contours

And New Data Models
Modernizing
Extend Imagery Capabilities to the Web
Imagery

Web App Builder for Imagery Services:

ArcGIS Pro
Feature Extraction Demo
Mark Romero
Dissemination & Applications
Gregory Bacon
The Science of
Where