All Data and AI Weekly #219: 08 Dec 2025

All Data and AI Weekly #219: 08 Dec 2025

( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, MCP, LLM, RAG, Cortex AI, AISQL, Search, Unstructured Data )

https://bsky.app/profile/paasdev.bsky.social

https://www.reddit.com/r/DataEngineeringForAI/hot/

Monthly NYC and Youtube Events

https://lu.ma/PINSAI

Code and Open Source Projects

https://github.com/tspannhw/TrafficAI/tree/main/Agents

https://github.com/tspannhw/conferences

📅 Urgent: Catch Tim Spann Live Tomorrow!

Event: PyData Global 2025 (Online)
Time: Tomorrow, December 9, 2025 @ 10:30 AM EST
Tim will be presenting on the latest trends in streaming data and Python. Don't miss this session.
👉 View Schedule & Join

🛠 Project Spotlight: Massive Performance Updates

RPi Thermal Streaming

A massive update has been deployed for the Raspberry Pi Thermal Streaming project, featuring significant performance optimizations.

• Repo: GitHub - RPIThermalStreaming

• Demo 1: Watch Performance Short 1

• Demo 2: Watch Performance Short 2

Cortex Code Demos

New examples added, including ADSB data handling.

• Repo: Cortex Code Demos

• New Guide: ADSB Documentation

❄️ Snowflake Horizon & Iceberg Ecosystem

The interoperability story for Snowflake continues to mature with major updates to the Catalog and External Query Engines.

• Iceberg REST Catalog Updates:

  • Private Connectivity Support (Release Note)

  • Unlock Open Interoperability with Horizon Catalog

  • Deep Dive: Horizon for Managed Iceberg Tables (Part 1) & Part 2

• External Engines on Snowflake:

  • Spark: Querying Managed Iceberg Tables with Spark via Horizon REST

  • Trino: Reading Iceberg Tables via Horizon APIs

  • Flink: Reading Iceberg Tables via Horizon APIs

🤖 AI, Agents & Cortex

Snowflake Intelligence and Agentic workflows are taking center stage for 2026 planning.

• Strategic Insights:

  • Data & AI Predictions for 2026

  • 5 AI Predictions for 2026 (LinkedIn Pulse)

  • Security & Governance in Snowflake Intelligence

• Technical Implementations:

  • Cortex AI SQL: Query Optimization Blog and Usage History Documentation.

  • Vision Agents: GetStream Vision Agents GitHub

  • DeepSeek/Arctic: Suffix Decoding Inference Optimization

  • Predictive AI: Using Cortex AI to Predict Customer LTV

🏗 Data Engineering & Modern Stack

• dbt & Semantic Layer:

  • dbt Semantic View Package

  • dbt Snowflake ML Package

  • Snowflake dbt Demo Repo

• Streaming & Fraud: OpenFlow and Streams to AWS for Real-time Fraud Alerting

• Cost Management: Stop Overpaying for Storage (Lifecycle Policies)

💻 Developer Tools & "Cool Stuff"

• Terminal: Ghostty and Terminal Text Effects

• Hardware: FydeOS for Raspberry Pi 4

• Utilities:

  • Local File Organizer (Python)

  • Uptime Kuma (Monitoring)

  • PGLite (Postgres in WASM)

• Learning: Peter Norvig's Advent of Code 2025 AI Notebook

📝 Snippet of the Week: Neo4j Graph Analytics

Neo4j has introduced experimental features for Snowflake Graph Analytics.

-- Enable experimental feature for Agents
CALL Neo4j_Graph_Analytics.experimental.enable_experimental_feature('fabjqraa');

• Read the Neo4j Agents Docs

Stay tuned for next week's update.

Thanks

https://sessionize.com/tspann

https://github.com/timothyspann

© 2020-2025 Tim Spann https://www.youtube.com/@FLaNK-Stack