All Data and AI Weekly #216:17Nov2025

( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, MCP, LLM, RAG, Cortex AI, AISQL, Search, Unstructured Data )

https://www.reddit.com/r/DataEngineeringForAI/hot/

Monthly NYC and Youtube Events

https://lu.ma/PINSAI

Code and Open Source Projects

https://github.com/tspannhw/SnowGhostBreakers

💡 Developer Spotlight: Tim Spann on Semantic Views

This week's top story is the innovative work being done by Tim Spann around Semantic Views. His recent presentation at NODE Conference 2025 provides a compelling look at the future of data interaction. We highly recommend watching the talk and exploring the accompanying code repositories.

• Watch: Tim Spann at NODE Conference 2025 - A deep dive into building real-time data applications.

• Explore: GitHub: SemanticView for Traffic Events - A practical, event-driven example of Semantic Views.

• Explore: GitHub: SemanticView (General) - The main repository for this new concept.

🤖 The AI & LLM Frontier: MCP and Snowflake Intelligence

The push toward an AI-native platform is accelerating. Here are the key resources on Snowflake Intelligence, Generative AI, and the Model Context Protocol (MCP).

• The General-Purpose MCP Server: A foundational read on the new MCP server that allows SQL operations through natural language.

  • Read the Medium Article

  • Get Started (Dev Guide)

  • MCP Hands-On Lab (BUILD 2025)

• Building Knowledge Graphs: A new post on creating a complete Knowledge Graph on Snowflake, powered entirely by Snowflake Intelligence.

  • Read the Guide

• Semantic Models & Views: The layer between natural language and SQL is evolving.

  • Automatically Generate Semantic Models - A new technique using Cursor.

  • Semantic Views with Standard SQL (Limited Access) - Official documentation on the new preview.

• New AI Features & Guides:

  • Online Feature Store - An introductory guide for developers.

  • GenAI for Time-Series - A fascinating look at optimizing market tick data.

  • Document Processing Playground (Limited Access) - See the new multimodal capabilities in action.

❄️ Core Platform: New Features & Engineering Deep Dives

Updates to the core Snowflake platform that enhance performance, security, and data management.

• Managed Iceberg Tables: The official engineering blog post on one of the biggest announcements from BUILD 2025.

  • Read the Engineering Blog

  • See the Replication Docs

• Security & Governance (Must-Reads):

  • Why True RBAC Matters - A critical analysis of role-based access control.

  • The Power of Roles for Data Segregation - A practical guide to enterprise data segregation.

  • Aggregation Policies - A look at enterprise-grade privacy protection.

• Data Pipelines & Performance:

  • Snowpipe Streaming High Performance - Getting started with the new high-performance capabilities.

  • Anomaly Detection for Data Quality (Preview) - New monitoring features are now in preview.

  • Storage Lifecycle Policies - Official documentation on managing storage lifecycles.

🤝 Partner Ecosystem & Customer Wins

How customers and partners are building with Snowflake.

• Case Study: Intercontinental Exchange (ICE) - A great look at how ICE leverages Snowflake for their data needs.

• Microsoft: Activate Data and Deliver AI - Detailing the expanding partnership between Snowflake and Microsoft.

• Datometry: Accelerate Data Migration - How Datometry's technology is speeding up migrations.

• Hex: Introducing the Hex Agent in Slack and MCP - A powerful example of the MCP in a partner application.

• OSI: The OSI Initiative Expands its Partners - Growing the ecosystem for open standards.

🗓️ Upcoming Events & Learning Opportunities

Key webinars and labs to get hands-on experience with these new features.

• Hands-On Lab (Nov 20): From SQL to Agentic Analytics - Build a semantic layer with AI.

• Hands-On Lab (Dec 4): Building Your First Multimodal Document Pipeline - A practical lab on the new document AI features.

• Demo (Dec 9): The End of Data Silos - Unify transactions and analytics on a single platform.

• Course: Introduction to Generative AI in Snowflake - A new DataCamp course for getting up to speed.

• Event: Snowflake BUILD 2025 - If you missed it, catch the Summary of New Features.

🤖 Work in Progress / Cursor AI Enhanced

• https://github.com/tspannhw/SemanticViewBuilder

• https://github.com/tspannhw/SemanticViewPlanes

• https://github.com/tspannhw/SemanticViewOzone

• https://github.com/tspannhw/RDFOwlVisualizerAndEditor

Cool Tech

• https://iggy.apache.org/

• https://github.com/microsoft/call-center-ai

• https://github.com/IsmaelMartinez/teams-for-linux

• https://codeberg.org/IDEmacs/IDEmacs

• https://github.com/iagooar/qqqa

• https://github.com/Eppie-io/Eppie-App

• https://github.com/usestrix/strix

• https://superset.apache.org/docs/intro/#

• https://github.com/comet-ml/opik

• https://github.com/gradio-app/trackio

• https://huggingface.co/datasets/HuggingFaceFW/finepdfs

• https://github.com/langchain-ai/open-swe

• https://github.com/kfir-liron-snowflake/SI_Data_Generator/

Thanks

https://sessionize.com/tspann

https://github.com/timothyspann

© 2020-2025 Tim Spann https://www.youtube.com/@FLaNK-Stack