连接到使用Azure Blob作为Apache Nifi中存储的HDFS
我正在尝试连接到HDFS，并添加使用Azure Blob作为存储的文件。在Apache Nifi中，我已经使用HDFS-site.xml和core-site.xml文件配置了HDFS连接。
Apache Nifi中的puthdfs组件会引发以下错误。
10:01:39 UTC ERROR
PutHDFS. Failed to properly initialize Processor. If still scheduled to run, NiFi will attempt to initialize and run the Processor again after the 'Administrative Yield Duration' has elapsed. Failure is due to java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found ↳ causes: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found
10:01:39 UTC ERROR
PutHDFS HDFS Configuration error - java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found ↳ causes: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found
10:01:39 UTC ERROR
PutHDFS org.apache.hadoop.fs.azure.NativeAzureFileSystem: java.lang.ClassNotFoundException: org.apache.hadoop.fs.azure.NativeAzureFileSystem
在建立HDFS连接时是否需要添加其他属性？
如果还有其他连接到HDFS的方法，将欢迎使用Azure Blob存储。
I am trying to connect to HDFS and add files that uses Azure Blob as Storage. In Apache Nifi I have configured the HDFS connection using hdfs-site.xml and core-site.xml files.
The PutHDFS component in Apache Nifi throws the following error.
10:01:39 UTC ERROR
PutHDFS. Failed to properly initialize Processor. If still scheduled to run, NiFi will attempt to initialize and run the Processor again after the 'Administrative Yield Duration' has elapsed. Failure is due to java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found ↳ causes: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found
10:01:39 UTC ERROR
PutHDFS HDFS Configuration error - java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found ↳ causes: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found
10:01:39 UTC ERROR
PutHDFS org.apache.hadoop.fs.azure.NativeAzureFileSystem: java.lang.ClassNotFoundException: org.apache.hadoop.fs.azure.NativeAzureFileSystem
Are there additional properties that have to be added while establishing the HDFS connection?
If there are other ways of connecting to HDFS that uses Azure Blob Storage will be welcomed.
如果你对这篇内容有疑问，欢迎到本站社区发帖提问 参与讨论，获取更多帮助，或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱，如果其他用户或者作者回复了您的评论，将不能在第一时间通知您！
发布评论
评论（1）
好像您的NIFI JVM ClassPath没有
Hadoop-azurejar文件。选择与您的Hadoop安装相匹配的版本 -
https://search.maven.org/artifact/artifact/org.apache。 hadoop/hadoop-azure
另外，不要使用puthdfs;使用
putazureblobstorageSeems like your Nifi JVM classpath does not have
hadoop-azureJAR files.Pick the version that matches your hadoop installation -
https://search.maven.org/artifact/org.apache.hadoop/hadoop-azure
Alternatively, don't use PutHDFS; use
PutAzureBlobStorage