About 85 results
Open links in new tab
  1. Group: Snowpipe - community.snowflake.com

    Hi Snowpipe expert, I'm trying to configure a snowpipe auto-ingest via SNS topics (since we have multiple subscribers) for company, but what I'm allowed to add to SNS policy is IAM role instead of …

  2. FAQ: Snowflake Kafka connector with Snowpipe Streaming

    For Snowpipe mode, please see the article: FAQ: Snowflake Kafka connector with Snowpipe. I want to move from Snowpipe mode to Snowpipe Streaming mode, what steps should I perform?

  3. How to calculate consumed credits from use of Snowpipe Streaming

    This article summarizes two options available to calculate costs incurred from the use of Snowpipe Streaming features and provides examples that to calculate a monthly cost report.

  4. The difference between snowflake stream and snowpipe

    Dec 6, 2021 · 3 A stream is a bookmark, that is managed by snowflake, while a snowpipe is an ingestion process. The former could be read by ether code you manual call/your infrastructure calls/a task …

  5. Snowpipe with a pattern does not auto ingest files into Snowflake

    Snowpipe not loading files into tables when the pattern is used with the auto-ingest feature, however manually running the same COPY INTO command with the pattern works as expected.

  6. COPY INTO/SNOWPIPE fails due to “Failed to access remote file: access ...

    COPY INTO or SNOWPIPE fails due to “Failed to access remote file: access denied. Please check your credentials”

  7. Where to find the Snowpipe errror log - Stack Overflow

    Apr 10, 2023 · COPY_HISTORY This table function can be used to query Snowflake data loading history along various dimensions within the last 14 days. The function returns load activity for both …

  8. How to PURGE Stage or delete files from Stage when using SNOWPIPE?

    Apr 25, 2021 · Snowflake provides Snowpipe to Copy data into a Table as soon as it is available in a Stage, but it misses the option of Purge. Is there another way to achieve this?

  9. How to exclude specific files from Snowpipe Ingestion

    The PATTERN clause in the Snowpipe COPY statement can be used to specify which file names and/or paths to match and ingest from an external stage containing various files. When you want to ingest …

  10. How to fetch latest file from cloud stage to ingest into Snowflake ...

    Mar 15, 2023 · Is there any function in Snowflake snowpipe to fetch such file from stage and ingest. Answers: Generally there is no such function from snowpipe Snowflake to get the latest file from …