Introduction: The Evolution of Snowflake Table Formats
In June 2024, Snowflake announced General Availability (GA) of Iceberg table support. Today in 2026, itβs matured into a critical capability for enterprises building modern lakehouses. If youβre still storing all your data in Snowflake-native format, youβre missing the flexibility and interoperability that Managed Iceberg Tables provide.
This article is a comprehensive guide to understanding, implementing, and optimizing Snowflake Managed Iceberg Tablesβbased on official Snowflake documentation and real-world best practices.
What is Apache Iceberg?
Apache Iceberg is an open-source, high-performance table format designed to manage large-scale analytical datasets. Originally created by Netflix and donated to the Apache Software Foundation, Iceberg has evolved into the industry standard for modern data lakehouses.
Key difference from traditional data lakes: Iceberg treats data as tables (with ACID guarantees), not just files in folders.
Why Iceberg Matters
| Problem | Traditional Data Lakes | Iceberg Solution |
|---|---|---|
| Concurrent reads/writes | File-based conflicts | ACID transactions |
| Schema changes | Manual rewrites | Schema evolution |
| Performance | Read entire dataset | Partition pruning + predicate pushdown |
| Time travel | Not possible | Full snapshot history |
| Multi-engine access | Data duplication | Single source of truth |
Snowflake Managed Iceberg Tables: Whatβs Different?
Snowflake introduced two types of Iceberg table support:
1. Snowflake-Managed Iceberg Tables β (Recommended)
What it means: Snowflake manages the catalog, metadata, and coordination.
Characteristics:
- β Full read/write access
- β Full ACID transactions
- β Native Snowflake features (time travel, CLONE, etc.)
- β Performance parity with native Snowflake tables
- β Automatic metadata management
- β Supported by all Snowflake features (Cortex AI, Iceberg optimization, etc.)
Storage: Data lives in your S3, GCS, or Azure Storage (you pay cloud provider)
2. Externally-Managed Iceberg Tables
What it means: External system (AWS Glue, Delta Lake, etc.) manages metadata.
Characteristics:
- β Read-only access from Snowflake
- β Can write from external engines
- β 2x better performance than external tables
- β Limited Snowflake feature support
- β Manual refresh required
Use case: Query datasets managed by Spark/Databricks while others write to them.
Architecture: How Snowflake Managed Iceberg Tables Work
Three-Layer Architecture
Config snippet β βββββββββββββββββββββββββββββββββββββββββββββ¦
ββββββββββββββββββββββββββββββββββββββββββββββββ Catalog Layer ββ (Snowflake manages metadata pointers) ββ - Table names & locations ββ - Current metadata file pointers ββ - Atomic metadata updates βββββββββββββββββββ¬βββββββββββββββββββββββββββββ ββββββββββββββββββββ΄ββββββββββββββββββββββββββββββ Metadata Layer ββ (Stored in External Cloud Storage) ββ - Table snapshots (version history) ββ - Manifest files (which data files used) ββ - Statistics (min/max, row counts) ββ - Schema definitions βββββββββββββββββββ¬βββββββββββββββββββββββββββββ ββββββββββββββββββββ΄ββββββββββββββββββββββββββββββ Data Layer ββ (Parquet files in your cloud storage) ββ - Actual data in Parquet format ββ - Organized by snapshots/versions ββ - You pay cloud storage provider βββββββββββββββββββββββββββββββββββββββββββββββββ
Key insight: Snowflake manages catalog & metadata. You manage data storage costs (billed by cloud provider).
Snowflake Managed Iceberg vs. Native Tables: Real Performance Comparison
Snowflake-managed Iceberg tables perform at parity with Snowflake native tables while storing data in public cloud storage.
Performance Metrics (2026)
| Metric | Native Table | Snowflake-Managed Iceberg | External Table | Externally-Managed Iceberg |
|---|---|---|---|---|
| Query Speed | Baseline | 98-100% | 40-50% | 80-90% |
| Write Speed | Baseline | 98-100% | N/A | N/A |
| Storage Location | Snowflake | Your cloud | Your cloud | Your cloud |
| Storage Cost | Snowflake (expensive) | Cloud provider (cheaper) | Cloud provider (cheaper) | Cloud provider (cheaper) |
| Read-Write | Full | Full | Read-only | Read/Limited write |
Reality: If query performance is your only concern, go native. If cost matters, Managed Iceberg wins.
Setting Up Snowflake Managed Iceberg Tables
Step 1: Create External Volume
The external volume is the connection between Snowflake and your cloud storage.
AWS S3:
SQL β Create external volume for Iceberg tables.
-- Create external volume for Iceberg tablesCREATE OR REPLACE EXTERNAL VOLUME iceberg_storage STORAGE_LOCATIONS = (('s3://my-bucket/iceberg/', ROLE_ARN = 'arn:aws:iam::123456789012:role/snowflake-role')); -- Verify connectionDESC EXTERNAL VOLUME iceberg_storage;
Google Cloud Storage:
SQL DDL statement β review object names and account permissions before running.
CREATE OR REPLACE EXTERNAL VOLUME iceberg_gcs STORAGE_LOCATIONS = (('gs://my-bucket/iceberg/', GCS_ACCESS_TOKEN = 'YOUR_TOKEN'));
Azure Blob Storage:
SQL DDL statement β review object names and account permissions before running.
CREATE OR REPLACE EXTERNAL VOLUME iceberg_azure STORAGE_LOCATIONS = (('azure://mycontainer/iceberg/', AZURE_SAS_TOKEN = 'YOUR_SAS_TOKEN'));
Step 2: Create an Iceberg Table
Option A: Create empty Iceberg table
sql
SQL β Create managed Iceberg table in Snowflake.
-- Create managed Iceberg table in SnowflakeCREATE OR REPLACE ICEBERG TABLE my_iceberg_data ( customer_id INT, customer_name VARCHAR, email VARCHAR, signup_date DATE, lifetime_value DECIMAL(10, 2))CATALOG = 'SNOWFLAKE'EXTERNAL_VOLUME = 'iceberg_storage'PARTITION BY (DATE_TRUNC('MONTH', signup_date));
Option B: Create from existing data
SQL β Convert native table to Iceberg.
-- Convert native table to IcebergCREATE OR REPLACE ICEBERG TABLE customer_iceberg ASSELECT * FROM snowflake_native_table;
Option C: Convert existing Iceberg table from external catalog
Config β Convert externally-managed to Snowflake-managed.
-- Convert externally-managed to Snowflake-managed-- No data rewrite, just metadata conversionALTER ICEBERG TABLE external_iceberg_tableCONVERT TO MANAGED CATALOG;
Step 3: Load Data
SQL β Insert data.
-- Insert dataINSERT INTO my_iceberg_data VALUES (1, 'John Doe', 'john@example.com', '2024-01-15', 5000.00), (2, 'Jane Smith', 'jane@example.com', '2024-02-20', 8500.00); -- Bulk load with COPY INTOCOPY INTO my_iceberg_dataFROM @stage_name/file.parquetFILE_FORMAT = (TYPE = 'PARQUET')MATCH_BY_COLUMN_NAME = CASE_INSENSITIVE; -- Use Snowpipe for continuous ingestionCREATE PIPE customer_ingest AS COPY INTO my_iceberg_data FROM @stage_name FILE_FORMAT = (TYPE = 'PARQUET') AUTO_INGEST = TRUE;
Step 4: Query the Iceberg Table
SQL β Standard SQLβno difference.
-- Standard SQLβno differenceSELECT customer_name, COUNT(*) as purchase_count, AVG(lifetime_value) as avg_valueFROM my_iceberg_dataWHERE signup_date >= '2024-01-01'GROUP BY customer_name; -- Time travel (snapshot history)SELECT * FROM my_iceberg_data AT (TIMESTAMP => '2025-12-15 10:00:00'::TIMESTAMP); -- View snapshotsSELECT * FROM TABLE( INFORMATION_SCHEMA.ICEBERG_TABLE_SNAPSHOTS('my_iceberg_data'));
Real-World Use Cases
Use Case 1: Multi-Engine Analytics
Problem: Data team uses Snowflake, ML team uses Spark, Analytics team uses Dbt/SQL.
Solution: Single Iceberg table, multiple compute engines.
SQL β Create table in Snowflake.
-- Create table in SnowflakeCREATE OR REPLACE ICEBERG TABLE ml_features ( feature_id INT, feature_name VARCHAR, feature_value FLOAT, created_date TIMESTAMP)CATALOG = 'SNOWFLAKE'EXTERNAL_VOLUME = 'shared_storage'; -- Snowflake reads/writesINSERT INTO ml_features SELECT * FROM raw_data_snowflake; -- Spark can read/write same table# df.write.mode("append").parquet("s3://bucket/iceberg/ml_features") -- Dbt can materialize as Iceberg-- dbt_project.yml: table_format = 'iceberg'
Benefits:
- β Single source of truth
- β No data duplication
- β Concurrent reads/writes (ACID guarantees)
- β 50% storage savings vs. duplicate tables
Use Case 2: Cost Optimization (Iceberg vs. Native)
Scenario: 10TB customer data table, mostly queried for recent data.
Native Snowflake Table:
- Storage cost: 10TB Γ $23/TB/month = $230/month
- Compute (queries): $50/month
- Total: $280/month
Managed Iceberg Table:
- Storage cost: 10TB Γ $0.023/GB (S3 standard) = $230/month (to cloud provider, not Snowflake)
- Compute (Snowflake): $50/month
- Total: $280/month cost, butβ¦
- Snowflake storage is gone (massive long-term savings)
- Cloud storage is cheaper if using Intelligent-Tiering
- Performance is identical
Real savings: Over 2 years, 30-40% reduction by moving to Iceberg.
Use Case 3: Time Travel & Compliance
Scenario: Financial data needs 7-year audit trail with point-in-time reconstruction.
SQL β Create Iceberg table with retention.
-- Create Iceberg table with retentionCREATE OR REPLACE ICEBERG TABLE transactions ( txn_id INT, account_id INT, amount DECIMAL, txn_date TIMESTAMP)EXTERNAL_VOLUME = 'compliance_storage'PARTITION BY YEAR(txn_date)DATA_RETENTION_TIME_IN_DAYS = 2555; -- 7 years -- Query specific point in timeSELECT * FROM transactions AT (TIMESTAMP => '2023-06-15 09:00:00'::TIMESTAMP)WHERE account_id = 12345; -- See all snapshots (audit trail)SELECT snapshot_id, committed_at, summaryFROM TABLE(INFORMATION_SCHEMA.ICEBERG_TABLE_SNAPSHOTS('transactions'))ORDER BY committed_at DESC;
Benefits:
- β Full audit trail
- β Regulatory compliance
- β Immediate point-in-time recovery
- β No separate backup infrastructure
Pricing: How Much Do Managed Iceberg Tables Cost?
What Snowflake Charges You
| Service | Cost |
|---|---|
| Compute (queries) | Standard warehouse rates (1 credit = $2-4 per second of compute) |
| Cloud Services | Typically 10-20% overhead on compute |
| Automatic Clustering | Optional, billed separately if enabled |
| Snowpipe | Credits for data loading |
| Cross-region data transfer | $0.02-0.10/GB depending on regions |
What Cloud Provider Charges You
| Provider | Cost |
|---|---|
| AWS S3 storage | $0.023/GB/month (standard tier) |
| Google Cloud Storage | $0.020/GB/month |
| Azure Blob | $0.0184/GB/month |
Real Cost Example: 10TB Iceberg Table
YAML configuration β sets Total, Verdict.
Monthly costs: Snowflake (compute + services): - 1,000 queries Γ 2 credits avg = 2,000 credits - 2,000 credits Γ $3/credit = $6,000/month Cloud Storage (S3): - 10TB Γ $0.023/GB = 10,240GB Γ $0.023 = $235/month Total: $6,235/month Compare to native Snowflake table: - Compute: $6,000/month (same) - Snowflake storage: 10TB Γ $23/TB = $230/month - Total: $6,230/month Verdict: Same cost short-term, but: - Iceberg gives you cloud flexibility (migrate engines) - Iceberg allows multi-engine access - Iceberg enables cost optimization strategies
Optimization: Getting the Most Out of Managed Iceberg Tables
Optimization 1: Set Target File Size
Snowflake automatically compacts files, but you can guide it:
Config β Optimize for query performance.
-- Optimize for query performanceALTER ICEBERG TABLE my_iceberg_dataSET (ICEBERG_CONFIG = '{ "write.target-file-size-bytes": 134217728 -- 128MB, default for balance}'); -- For smaller frequent updatesSET (ICEBERG_CONFIG = '{ "write.target-file-size-bytes": 67108864 -- 64MB, more files but faster updates}'); -- For big analytics (fewer files)SET (ICEBERG_CONFIG = '{ "write.target-file-size-bytes": 536870912 -- 512MB, fewer files, better scan}');
Optimization 2: Partitioning Strategy
SQL β Good: Partition by frequently filtered column.
-- Good: Partition by frequently filtered columnCREATE ICEBERG TABLE events ( event_id INT, user_id INT, event_type VARCHAR, event_date DATE, event_time TIMESTAMP)PARTITION BY (event_date, event_type); -- Most queries filter by date & type -- Query on partitioned columns: Scans only relevant filesSELECT * FROM eventsWHERE event_date = '2026-01-15' AND event_type = 'purchase'; -- Fast: only 1 partition scanned
Optimization 3: Use Automatic Clustering (Optional)
SQL β Enable auto-clustering on hot columns.
-- Enable auto-clustering on hot columnsALTER ICEBERG TABLE my_iceberg_dataCLUSTER BY (customer_id, signup_date); -- Check clustering qualitySELECT table_name, clustering_key, ave_depth_per_dimension, total_depth_per_dimension, depth_improvement_percentFROM INFORMATION_SCHEMA.CLUSTERING_INFORMATIONWHERE table_name = 'my_iceberg_data';
Cost: Automatic Clustering is billed separately at ~0.5-2 credits per GB/day reorganized. Use only for frequently queried columns.
Optimization 4: Remove Orphan Files
Failed transactions sometimes leave orphan Parquet files in cloud storage (tracked but unreferenced).
SQL β Check for orphan files (manual process).
-- Check for orphan files (manual process)-- Snowflake doesn't auto-remove them yet-- Use this to identify storage waste: SELECT table_name, active_bytes, retained_bytes, (retained_bytes - active_bytes) as orphan_bytesFROM ACCOUNT_USAGE.TABLE_STORAGE_METRICSWHERE table_schema = 'your_schema' AND (retained_bytes - active_bytes) > 0; -- If discrepancy found, contact Snowflake Support for cleanup
Snowflake Managed Iceberg vs. Alternatives
vs. Native Snowflake Tables
| Aspect | Iceberg | Native |
|---|---|---|
| Performance | Equal (parity) | Equal (parity) |
| Storage location | Your cloud | Snowflake owned |
| Storage cost | Cloud provider | Snowflake (3x more) |
| Time Travel | Snapshots | Up to 90 days |
| Multi-engine | Yes (Spark, Dbt, etc.) | No |
| Schema evolution | Native support | Requires ALTER |
| Setup complexity | Medium (needs external volume) | Low |
| When to use | Cost-sensitive, multi-engine | Performance-first, Snowflake-only |
vs. External Tables
| Aspect | Iceberg | External Tables |
|---|---|---|
| Performance | 2x better | Baseline |
| Write support | Full | No (read-only) |
| ACID | Yes | No |
| Time Travel | Yes | No |
| Supported formats | Parquet only | CSV, Avro, ORC, Parquet |
| Setup | Medium | Simple |
| Use case | Modern lakehouse | Legacy data lake query |
Common Gotchas & Solutions
Gotcha 1: Cross-Cloud/Cross-Region Not Supported
Problem: You canβt create Iceberg table with S3 storage while Snowflake account is in Azure.
SQL β β This will fail.
-- β This will failCREATE ICEBERG TABLE cross_cloud_table (...)EXTERNAL_VOLUME = 'aws_s3_volume'; -- Error if in Azure -- β
Use same cloud as account-- If you really need cross-cloud, use catalog integration instead
Solution: Keep Snowflake and storage in same cloud region, or use Catalog Integration for cross-cloud.
Gotcha 2: Orphan File Accumulation
Problem: Failed transactions leave behind Parquet files you still pay storage for.
SQL β Monitor storage metrics.
-- Monitor storage metricsSELECT table_name, DATEDIFF(day, last_modified, current_date) as days_since_update, active_bytes, retained_bytesFROM ACCOUNT_USAGE.TABLE_STORAGE_METRICSWHERE TABLE_TYPE = 'ICEBERG' AND database_name = 'your_db'; -- If gap between active_bytes and retained_bytes, contact Snowflake Support
Solution: Snowflake is working on auto-cleanup. Until then, monitor and contact support if discrepancies appear.
Gotcha 3: Refresh Required for Externally-Managed Tables
Problem: Changes from external systems (Spark, Delta) arenβt immediately visible.
SQL β For externally-managed tables only:.
-- For externally-managed tables only:ALTER ICEBERG TABLE external_table REFRESH; -- Set up automated refreshCREATE TASK refresh_external_table WAREHOUSE = compute_wh SCHEDULE = '5 MINUTES'AS ALTER ICEBERG TABLE external_table REFRESH;
Solution: Always refresh before querying externally-managed Iceberg tables. Or use Snowflake-managed (no refresh needed).
Real-World Implementation Checklist
1: Planning (Week 1)
- Identify tables for Iceberg migration (large, multi-access)
- Calculate current storage costs
- Choose cloud storage (S3, GCS, Azure)
- Plan partition strategy
- Identify multi-engine requirements
2: Setup (Week 2-3)
- Create cloud storage bucket
- Set up IAM roles/permissions
- Create external volume in Snowflake
- Create test Iceberg table
- Load sample data (1% of production)
- Run performance benchmarks
3: Migration (Week 4-6)
- Create Iceberg tables (use CREATE AS SELECT)
- Validate data integrity
- Update ETL pipelines
- Update queries (usually no changes needed)
- Monitor performance & costs
- Archive old native tables (donβt delete yet)
4: Optimization (Ongoing)
- Monitor storage costs
- Review partition effectiveness
- Enable automatic clustering if needed
- Set up orphan file monitoring
- Plan for multi-engine access
Key Takeaways
- Snowflake-managed Iceberg tables are production-ready β GA since June 2024, widely adopted
- Performance is identical to native tables β No trade-off
- Storage costs are lower β Cloud provider rates beat Snowflake
- Multi-engine access enabled β Spark, Dbt, other engines can use same data
- Time travel & ACID built-in β Full transaction guarantees
- External volume is required β Setup takes 15 minutes
- Pricing is predictable β Compute (Snowflake) + Storage (cloud provider)
- Not a magic bullet β Only migrate if you have specific use cases (cost, multi-engine, flexibility)
External References (Official Snowflake Docs)
- Apache Iceberg Tables Documentation
- Managing Iceberg Tables
- Catalog Integration Setup
- External Volumes Configuration
- Snowflake Engineering Blog: Managed Iceberg Tables
- Unifying Iceberg Tables on Snowflake
Next Steps
- Assess your tables β Which ones would benefit from Iceberg?
- Create an external volume β Takes 15 minutes
- Run a pilot β Create Iceberg table from 1% of production data
- Benchmark β Compare performance with native table
- Plan migration β Identify production timeline
- Scale gradually β Donβt convert everything at once
Disclaimer: Information current as of January 2026. Always verify with official Snowflake documentation for latest features and capabilities. Pricing and features subject to change.
Questions this article answers
Short answers first. Open a question to read the working note.
Can Spark write to Snowflake-managed Iceberg tables?
Not directly via Spark. Snowflake-managed catalog is Snowflake-exclusive. But Spark can read them:
What's the performance overhead of Iceberg?
Zero. Snowflake-managed Iceberg tables perform at parity with native Snowflake tables.
