将文件从 GCP 存储桶发送到端点 URL
我正在寻找一种将存储在GCP存储存储桶中的数据自动导出到端点URL（HTTPS源）的方法。
我要导出的数据是雪花日志文件，根据本指南，将复制到GCP存储中：
我想导出这些日志文件（csv或json） Sumo逻辑HTTPS收集器。我已经看到了一个情况，可以使用日志探索器中的日志使用日志路由器 + pub/sub发送到类似的端点URL。
我这样做的最好方法是什么？
查看了Firbaes，BigQuery和其他GCP产品，目前没有找到解决方案。
I am looking for a way to automatically export data stored in a GCP Storage Bucket to an Endpoint URL (https source).
The data I would like to export are Snowflake log files, which are copied into GCP storage following this guide:
I would like to export these log files (csv or json) to a Sumo Logic https collector. I have seen a case where logs in the log explorer could be sent to a similar Endpoint URL using Logs Router + Pub/Sub.
What's the best way for me to do this?
Looked at Firebaes, Bigquery, and other GCP products, no solution found for my current issue.
如果你对这篇内容有疑问，欢迎到本站社区发帖提问 参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
发布评论
评论（1）
我认为（！？） log router 仅适用于日志条目（记录（记录） ）正在发送到Google的云记录服务。
IIUC在这种情况下，Snowflake将其日志文件直接发射到云存储中，您想根据创建的这些范围触发行为。
基于更改云存储存储桶和对象的更改触发行为的一种方法是使用 cloud Storage triggers 具有云功能。
我尚未使用 eventarc ，但它被描述为事件驱动的机制，似乎要成为一种更普遍的方式（将支持更广泛的事件）来触发行动。云存储是EventArc的事件来源，IIUC-您可以将云运行服务（但不使用云功能）用作目标。
Next-gen >平台将云功能作为云运行服务部署。因此，如果我是您（并且要重申一下，我还没有为自己构建），我想我会开始尝试将EventArc与Cloud Run一起使用，如果那不起作用，请恢复为云存储触发器。
I think (!?) Logs Router is only applicable to log entries (records) that are being sent to Google's Cloud Logging service.
IIUC in this case, Snowflake is emitting its log files directly to Cloud Storage and you want to trigger behavior based on these being created.
One way to trigger behavior based on changes to Cloud Storage buckets and objects is to use Cloud Storage Triggers with Cloud Functions.
I've not yet used EventArc but it's described as an event-driven mechanism and seems to be intended to become a more universal way (a broader set of events will be supported) to trigger actions. Cloud Storage is an event source for EventArc and -- IIUC -- you can use a Cloud Run service (but not Cloud Functions) as a target.
The next-gen Cloud Functions platform deploys Cloud Function as Cloud Run services. So, if I were you (and, to reiterate, I've not built this for myself), I think I'd start trying to use EventArc with Cloud Run and, if that doesn't work, revert to Cloud Storage Triggers.