Cryo platform

Cryo platform An architecture diagram generated by Archify. Iceberg REST · catalog · Sources (read) Iceberg REST catalog Hive or Glue · metastore · Sources (read) Hive or Glue metastore Scanner · metadata read · Cryo Scanner metadata read PostgreSQL · stats and audit · Cryo PostgreSQL stats and audit Web UI · operator · Cryo Web UI operator API · FastAPI · Cryo API FastAPI Scheduler · presets · Cryo Scheduler presets Redis · queue and locks · Cryo Redis queue and locks Governor · admission · Cryo Governor admission Workers · one table · Cryo Workers one table Planner · no SQL · Cryo Planner no SQL Trino · SQL · Destinations (write) Trino SQL Spark on EMR · Spark SQL · Destinations (write) Spark on EMR Spark SQL Object storage · Iceberg data · Architecture component Object storage Iceberg data metadata metadata stats REST enqueue slots admit plan live load job slots execute execute write write Sources (read) Cryo Destinations (write) Legend Frontend Backend Database Cloud Message bus External