对文件夹中的所有文件运行终端命令

发布于 2025-01-14 12:04:05 字数 669 浏览 3 评论 0原文

我有一个 models 文件夹，其中包含一堆 sql 文件 models/mart/table1.sql、models/mart/table2.sql、models/mart/table3 .sql

我在终端上手动运行此命令：

dbt run-operation generate_model_yaml --args '{"model_name": "table1"}'

但是，我不想为每个表单独运行它，而是想将其包含在 Bitbucket 管道中。如何修改该命令，使其在循环中运行？它应该从指定文件夹（models/mart）中提取所有文件的表名（文件名），然后通过每次用文件名替换 model_name 来相应地运行命令？

pipelines:
  custom: 
    dbt-run-default:
          - step:
              name: 'Compile'
              image: fishtownanalytics/dbt:1.0.0
              script:
                - cd dbt_4flow
                - dbt deps --profiles-dir ./profiles

原文

I have a models folder which contains a bunch of sql files models/mart/table1.sql, models/mart/table2.sql, models/mart/table3.sql

I run this command manually on the terminal:

dbt run-operation generate_model_yaml --args '{"model_name": "table1"}'

However, instead of running it individually for each table, I want to include it in the Bitbucket pipeline. How can I modify the command such that it runs in a a loop? It should extract the tablename (filename) for all files from a specified folder (models/mart) and then run the command accordingly by replacing the model_name by the filename each time?

pipelines:
  custom: 
    dbt-run-default:
          - step:
              name: 'Compile'
              image: fishtownanalytics/dbt:1.0.0
              script:
                - cd dbt_4flow
                - dbt deps --profiles-dir ./profiles

分享到QQ

分享到微博

如果你对这篇内容有疑问，欢迎到本站社区发帖提问参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。

发布评论

需要登录才能够评论，你可以免费注册一个本站的账号。

薯片软お妹 2025-01-21 12:04:05

试试这个 Shellcheck - 干净的代码：

#! /bin/bash -p

sql_dir=$1

shopt -s nullglob
for sql_path in "$sql_dir"/*.sql; do
    sql_name=${sql_path##*/}
    table_name=${sql_name%.sql}
    dbt run-operation generate_model_yaml --args '{"model_name": "'"${table_name}"'"}'
done

它是一个程序，它获取包含“.sql”文件的目录的路径作为命令行参数。
如果目录中没有“.sql”文件，shopt -s nullglob 可防止代码中的 "$sql_dir"/*.sql 扩展为垃圾。
请参阅删除字符串的一部分 (BashFAQ/100 (How do I do string opera in bash?)) 了解 ${sql_path##*/} 和 ${sql_name%.sql} 的解释。

Try this Shellcheck-clean code:

#! /bin/bash -p

sql_dir=$1

shopt -s nullglob
for sql_path in "$sql_dir"/*.sql; do
    sql_name=${sql_path##*/}
    table_name=${sql_name%.sql}
    dbt run-operation generate_model_yaml --args '{"model_name": "'"${table_name}"'"}'
done

It's a program that takes the path to a directory containing '.sql' files as a command line argument.
The shopt -s nullglob prevents the "$sql_dir"/*.sql in the code expanding to garbage if there are no '.sql' files in the directory.
See Removing part of a string (BashFAQ/100 (How do I do string manipulation in bash?)) for an explanation of ${sql_path##*/} and ${sql_name%.sql}.

回复收藏 0 原文

~没有更多了~