GNU make 中的递归通配符？

发布于 2024-08-26 02:47:49 字数 355 浏览 7 评论 0原文

我已经有一段时间没有使用 make 了，所以请耐心等待...

我有一个目录 flac，其中包含 .FLAC 文件。我有一个相应的目录，mp3，其中包含 MP3 文件。如果 FLAC 文件比相应的 MP3 文件更新（或者相应的 MP3 文件不存在），那么我想运行一堆命令将 FLAC 文件转换为 MP3 文件，并复制标签。

更关键的是：我需要递归搜索 flac 目录，并在 mp3 目录中创建相应的子目录。目录和文件的名称中可以包含空格，并以 UTF-8 命名。

我想使用 make 来驱动它。

原文

分享到QQ

分享到微博

如果你对这篇内容有疑问，欢迎到本站社区发帖提问参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。

发布评论

需要登录才能够评论，你可以免费注册一个本站的账号。

水染的天色ゝ 2024-09-02 02:47:49

我会尝试一些

FLAC_FILES = $(shell find flac/ -type f -name '*.flac')
MP3_FILES = $(patsubst flac/%.flac, mp3/%.mp3, $(FLAC_FILES))

.PHONY: all
all: $(MP3_FILES)

mp3/%.mp3: flac/%.flac
    @mkdir -p "$(@D)"
    @echo convert "lt;" to "$@"

针对 make 初学者的快速说明：

命令前面的 @ 会阻止 make 打印命令在实际运行之前。
$(@D) 是目标文件名的目录部分 ($@)
确保其中包含 shell 命令的行以制表符开头，而不是空格。

即使这应该处理所有 UTF-8 字符和内容，它也会在文件或目录名中的空格处失败，因为 make 使用空格来分隔 makefile 中的内容，并且我不知道有什么方法可以解决这个问题。恐怕只剩下一个 shell 脚本了:-/

I would try something along these lines

FLAC_FILES = $(shell find flac/ -type f -name '*.flac')
MP3_FILES = $(patsubst flac/%.flac, mp3/%.mp3, $(FLAC_FILES))

.PHONY: all
all: $(MP3_FILES)

mp3/%.mp3: flac/%.flac
    @mkdir -p "$(@D)"
    @echo convert "lt;" to "$@"

A couple of quick notes for make beginners:

The @ in front of the commands prevents make from printing the command before actually running it.
$(@D) is the directory part of the target file name ($@)
Make sure that the lines with shell commands in them start with a tab, not with spaces.

Even if this should handle all UTF-8 characters and stuff, it will fail at spaces in file or directory names, as make uses spaces to separate stuff in the makefiles and I am not aware of a way to work around that. So that leaves you with just a shell script, I am afraid :-/

回复收藏 0 原文

彼岸花ソ最美的依靠 2024-09-02 02:47:49

您可以像这样定义自己的递归通配符函数：

rwildcard=$(foreach d,$(wildcard $(1:=/*)),$(call rwildcard,$d,$2) $(filter $(subst *,%,$2),$d))

第一个参数（$1）是目录列表，第二个参数（$2）是您想要的模式列表匹配。

示例：

查找当前目录中的所有 C 文件：

$(call rwildcard,.,*.c)

查找 src 中的所有 .c 和 .h 文件：

$(call rwildcard,src,*.c *.h)

该函数是基于本文的实现，一些改进。

You can define your own recursive wildcard function like this:

rwildcard=$(foreach d,$(wildcard $(1:=/*)),$(call rwildcard,$d,$2) $(filter $(subst *,%,$2),$d))

The first parameter ($1) is a list of directories, and the second ($2) is a list of patterns you want to match.

Examples:

To find all the C files in the current directory:

$(call rwildcard,.,*.c)

To find all the .c and .h files in src:

$(call rwildcard,src,*.c *.h)

This function is based on the implementation from this article, with a few improvements.

回复收藏 0 原文

归属感 2024-09-02 02:47:49

如果您使用的是 Bash 4.x，则可以使用新的 globbing 选项，例如：

SHELL:=/bin/bash -O globstar
list:
  @echo Flac: $(shell ls flac/**/*.flac)
  @echo MP3: $(shell ls mp3/**/*.mp3)

这种递归通配符可以找到您感兴趣的所有文件（.flac、.mp3 或其他文件）。氧

If you're using Bash 4.x, you can use a new globbing option, for example:

SHELL:=/bin/bash -O globstar
list:
  @echo Flac: $(shell ls flac/**/*.flac)
  @echo MP3: $(shell ls mp3/**/*.mp3)

This kind of recursive wildcard can find all the files of your interest (.flac, .mp3 or whatever). O

回复收藏 0 原文

猫性小仙女 2024-09-02 02:47:49

FWIW，我在 Makefile 中使用了类似的内容：

RECURSIVE_MANIFEST = `find . -type f -print`

上面的示例将从当前目录（'.'）中搜索所有“纯文件”（ >'-type f') 并将 RECURSIVE_MANIFEST make 变量设置为其找到的每个文件。然后，您可以使用模式替换来减少此列表，或者向 find 提供更多参数以缩小其返回的范围。请参阅find 的手册页。

FWIW, I've used something like this in a Makefile:

RECURSIVE_MANIFEST = `find . -type f -print`

The example above will search from the current directory ('.') for all "plain files" ('-type f') and set the RECURSIVE_MANIFEST make variable to every file it finds. You can then use pattern substitutions to reduce this list, or alternatively, supply more arguments into find to narrow what it returns. See the man page for find.

回复收藏 0 原文

秋千易 2024-09-02 02:47:49

我的解决方案基于上面的解决方案，使用 sed 而不是 patsubst 来破坏 find 的输出并转义空格。

从 flac/ 到 ogg/

OGGS = $(shell find flac -type f -name "*.flac" | sed 's/ /\\ /g;s/flac\//ogg\//;s/\.flac/\.ogg/' )

警告：

如果文件名中有分号，仍然会呕吐，但这种情况很少见。
$(@D) 技巧不起作用（输出乱码），但 oggenc 会为您创建目录！

My solution is based on the one above, uses sed instead of patsubst to mangle the output of find AND escape the spaces.

Going from flac/ to ogg/

OGGS = $(shell find flac -type f -name "*.flac" | sed 's/ /\\ /g;s/flac\//ogg\//;s/\.flac/\.ogg/' )

Caveats:

Still barfs if there are semi-colons in the filename, but they're pretty rare.
The $(@D) trick won't work (outputs gibberish), but oggenc creates directories for you!

回复收藏 0 原文

横笛休吹塞上声 2024-09-02 02:47:49

这是我快速编写的一个 Python 脚本，用于解决最初的问题：保留音乐库的压缩副本。该脚本会将 .m4a 文件（假定为 ALAC）转换为 AAC 格式，除非 AAC 文件已存在并且比 ALAC 文件新。库中的 MP3 文件将被链接，因为它们已经被压缩。

请注意，中止脚本（ctrl-c）将留下半转换的文件。

我最初也想编写一个 Makefile 来处理这个问题，但由于它无法处理文件名中的空格（请参阅已接受的答案），而且编写 bash 脚本肯定会让我陷入痛苦的世界，所以 Python 就是这样。它相当简单且简短，因此应该很容易根据您的需求进行调整。

from __future__ import print_function


import glob
import os
import subprocess


UNCOMPRESSED_DIR = 'Music'
COMPRESSED = 'compressed_'

UNCOMPRESSED_EXTS = ('m4a', )   # files to convert to lossy format
LINK_EXTS = ('mp3', )           # files to link instead of convert


for root, dirs, files in os.walk(UNCOMPRESSED_DIR):
    out_root = COMPRESSED + root
    if not os.path.exists(out_root):
        os.mkdir(out_root)
    for file in files:
        file_path = os.path.join(root, file)
        file_root, ext = os.path.splitext(file_path)
        if ext[1:] in LINK_EXTS:
            if not os.path.exists(COMPRESSED + file_path):
                print('Linking {}'.format(file_path))
                link_source = os.path.relpath(file_path, out_root)
                os.symlink(link_source, COMPRESSED + file_path)
            continue
        if ext[1:] not in UNCOMPRESSED_EXTS:
            print('Skipping {}'.format(file_path))
            continue
        out_file_path = COMPRESSED + file_path
        if (os.path.exists(out_file_path)
            and os.path.getctime(out_file_path) > os.path.getctime(file_path)):
            print('Up to date: {}'.format(file_path))
            continue
        print('Converting {}'.format(file_path))
        subprocess.call(['ffmpeg', '-y', '-i', file_path,
                         '-c:a', 'libfdk_aac', '-vbr', '4',
                         out_file_path])

当然，这可以增强以并行执行编码。这留给读者作为练习;-)

Here's a Python script I quickly hacked together to solve the original problem: keep a compressed copy of a music library. The script will convert .m4a files (assumed to be ALAC) to AAC format, unless the AAC file already exists and is newer than the ALAC file. MP3 files in the library will be linked, since they are already compressed.

Just beware that aborting the script (ctrl-c) will leave behind a half-converted file.

I originally also wanted to write a Makefile to handle this, but since it cannot handle spaces in filenames (see the accepted answer) and because writing a bash script is guaranteed to put in me in a world of pain, Python it is. It's fairly straightforward and short, and thus should be easy to tweak to your needs.

from __future__ import print_function


import glob
import os
import subprocess


UNCOMPRESSED_DIR = 'Music'
COMPRESSED = 'compressed_'

UNCOMPRESSED_EXTS = ('m4a', )   # files to convert to lossy format
LINK_EXTS = ('mp3', )           # files to link instead of convert


for root, dirs, files in os.walk(UNCOMPRESSED_DIR):
    out_root = COMPRESSED + root
    if not os.path.exists(out_root):
        os.mkdir(out_root)
    for file in files:
        file_path = os.path.join(root, file)
        file_root, ext = os.path.splitext(file_path)
        if ext[1:] in LINK_EXTS:
            if not os.path.exists(COMPRESSED + file_path):
                print('Linking {}'.format(file_path))
                link_source = os.path.relpath(file_path, out_root)
                os.symlink(link_source, COMPRESSED + file_path)
            continue
        if ext[1:] not in UNCOMPRESSED_EXTS:
            print('Skipping {}'.format(file_path))
            continue
        out_file_path = COMPRESSED + file_path
        if (os.path.exists(out_file_path)
            and os.path.getctime(out_file_path) > os.path.getctime(file_path)):
            print('Up to date: {}'.format(file_path))
            continue
        print('Converting {}'.format(file_path))
        subprocess.call(['ffmpeg', '-y', '-i', file_path,
                         '-c:a', 'libfdk_aac', '-vbr', '4',
                         out_file_path])

Of course, this can be enhanced to perform the encoding in parallel. That is left as an exercise to the reader ;-)

回复收藏 0 原文

只有影子陪我不离不弃 2024-09-02 02:47:49

要递归查找文件而不求助于 find 等外部依赖项，您可以使用函数。然后使用其他答案中的结果来转换文件。

rwildcard=$(wildcard $1) $(foreach d,$1,$(call rwildcard,$(addsuffix /$(notdir $d),$(wildcard $(dir $d)*))))

FLAC_FILES = $(call rwildcard,flac/*.flac)
MP3_FILES = $(patsubst flac/%.flac, mp3/%.mp3, $(FLAC_FILES))

.PHONY: all
all: $(MP3_FILES)

mp3/%.mp3: flac/%.flac
        @mkdir -p "$(@D)"
        @echo convert "lt;" to "$@"

To find files recursively without resorting to external dependencies like find, you can use functions. Then use the result as in the other answer to convert the files.

rwildcard=$(wildcard $1) $(foreach d,$1,$(call rwildcard,$(addsuffix /$(notdir $d),$(wildcard $(dir $d)*))))

FLAC_FILES = $(call rwildcard,flac/*.flac)
MP3_FILES = $(patsubst flac/%.flac, mp3/%.mp3, $(FLAC_FILES))

.PHONY: all
all: $(MP3_FILES)

mp3/%.mp3: flac/%.flac
        @mkdir -p "$(@D)"
        @echo convert "lt;" to "$@"

回复收藏 0 原文

~没有更多了~