Kirsten Odendaal

A Step in the Right Direction: Surrogates and Optimization Workshop

surrogate optimization

This interactive blog demonstrates how data preparation, surrogate modeling, active learning, and optimization methods can be applied to real engineering design problems. Interactive demos show:


Usecase 1: Mooring Line Optimization (Data Science Workflow)

Interactive demo: Usecase 1 Link

Why It Matters


Objective

Accelerate optimization of mooring line parameters by replacing repeated simulations with surrogate models.

Design variables

Performance targets

Goal: minimize load while keeping mass low.


Workflow Overview

  1. Exploratory Data Analysis

    • Inspect distributions, correlations, and outliers.
  2. Modeling

    • Compare Linear, Ridge, RF, and GP models (R², RMSE, residuals).
  3. Cross-Validation

    • 5–10 fold CV to assess generalization.
  4. Optimization

    • GA (single objective) or NSGA-II (multi-objective).
    • Visualize Pareto trade-offs.

Key Observations


Learning Outcomes


Usecase 2: Hull Form Optimization (Multi-Fidelity Workflow)

Interactive demo: Usecase 2 Link

Why It Matters


Overview

Minimize calm-water resistance using 14 design parameters with bounds ([-1, 1]).

Three fidelity levels differ in mesh density, cost, and accuracy. Multi-fidelity learning uses many LF samples plus a few HF samples to improve prediction quality within a fixed compute budget.


Simulation Fidelity Summary

Fidelity Total Nodes Resistance [N] Grid Error [%] NCC
High 16.5k 41.5 1.16 1.00
Medium 5.7k 43.5 5.97 0.11
Low 2.1k 48.9 19.3 0.03

Diagnostics include Pearson r, BPB, and Kendall τ to judge MF suitability.


Workflow Overview

  1. Reference & DoE

    • Generate HF/LF samples that meet the set computational budget.
  2. Modeling

    • GP surrogate with Matern kernel + WhiteKernel.
  3. Diagnostics & Comparison

    • Compare MF vs HF-only vs LF-only at equal cost using RMSE and parity plots.

Key Observations


Learning Outcomes


Usecase 3: Active Learning (Bayesian Optimization Workflow)

Interactive demo:

Usecase 3 Link

Why It Matters


Objective

Introduce adaptive learning / Bayesian optimization:


Workflow Overview

  1. Initialize

    • Small DoE (5–10 samples).
    • GP with Matern kernel.
  2. Acquire

    • Evaluate EI or HVI to select next samples.
  3. Evaluate

    • Run simulation or function at selected point.
  4. Update

    • Retrain and repeat until convergence or budget limit.

Key Observations


Learning Outcomes