Question

我正在尝试从azure数据湖获取一些数据到azure数据仓库，但我无法做到这一点我已经按照文档链接

https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-load-from-azure-data-lake-store

但是当我尝试创建外部表时，我收到此错误，我创建了另一个web / api应用程序，但仍然无法访问此应用程序，这是我面临的错误

EXTERNAL TABLE access failed due to internal error: 'Java exception raised on call to HdfsBridge_IsDirExist. Java exception message:
GETFILESTATUS failed with error 0x83090aa2 (Forbidden. ACL verification failed. Either the resource does not exist or the user is not authorized to perform the requested operation.). [0ec4b8e0-b16d-470e-9c98-37818176a188][2017-08-14T02:30:58.9795172-07:00]: Error [GETFILESTATUS failed with error 0x83090aa2 (Forbidden. ACL verification failed. Either the resource does not exist or the user is not authorized to perform the requested operation.). [0ec4b8e0-b16d-470e-9c98-37818176a188][2017-08-14T02:30:58.9795172-07:00]] occurred while accessing external file.'

这是我试图使用

的脚本

CREATE DATABASE SCOPED CREDENTIAL ADLCredential2
WITH
    IDENTITY = '2ec11315-5a30-4bea-9428-e511bf3fa8a1@https://login.microsoftonline.com/24708086-c2ce-4b77-8d61-7e6fe8303971/oauth2/token',
    SECRET = '3Htr2au0b0wvmb3bwzv1FekK88YQYZCUrJy7OB3NzYs='
;

CREATE EXTERNAL DATA SOURCE AzureDataLakeStore11
WITH (
    TYPE = HADOOP,
    LOCATION = 'adl://test.azuredatalakestore.net/',
    CREDENTIAL = ADLCredential2
);

CREATE EXTERNAL FILE FORMAT TextFileFormat
WITH
(   FORMAT_TYPE = DELIMITEDTEXT
,    FORMAT_OPTIONS    (   FIELD_TERMINATOR = '|'
                    ,    DATE_FORMAT         = 'yyyy-MM-dd HH:mm:ss.fff'
                    ,    USE_TYPE_DEFAULT = FALSE
                    )
);

CREATE EXTERNAL TABLE [extccsm].[external_medication] 
(
   person_id              varchar(4000),
   encounter_id           varchar(4000),
   fin                    varchar(4000),
   mrn                    varchar(4000),
   icd_code               varchar(4000),
   icd_description        varchar(300),
   priority               integer,
   optional1              varchar(4000),
   optional2              varchar(4000),
   optional3              varchar(4000),
   load_identifier        varchar(4000),
   upload_time            datetime2,
   xx_person_id           varchar(4000),--Person ID is the ID that we will use to represent the person through out the process uniquely, This requires initial analysis to determine how to set it
   xx_encounter_id        varchar(4000),--Encounter ID is the ID that will represent the encounter uniquely through out the process, This requires initial analysis to determine hos to set it based on client data
   mod_optional1      varchar(4000),
   mod_optional2      varchar(4000),
   mod_optional3      varchar(4000),
   mod_optional4      varchar(4000),
   mod_optional5      varchar(4000),
   mod_loadidentifier     datetime2 
)
WITH 
(
    LOCATION='\testfiles\procedure_azure.txt000\',
    DATA_SOURCE = AzureDataLakeStore11,   --DATA SOURCE THE BLOB STORAGE
    FILE_FORMAT = TextFileFormat,   --TYPE OF FILE FORMAT
    REJECT_TYPE = percentage,
    REJECT_VALUE = 1,
    REJECT_SAMPLE_VALUE = 0
);

请告诉我这里有什么问题？

Answer 1

我可以重现这一点，但很难完全缩小范围。我认为与权限有关。从Azure门户网站：

Data Lake Store＆gt; yourDataLakeAccount＆gt;你的文件夹＆gt;访问

从那里，确保您的AD应用程序对相关文件/文件夹具有Read，Write和Execute权限。最初从一个文件开始。我可以通过分配/取消分配执行权限来重现错误，但需要重复步骤进行确认。我将回溯我的步骤，但现在集中你的搜索。在下面的示例中，我的Azure Active Directory应用程序称为adwAndPolybase;你可以看到我Read，Write和Execute。我还尝试了Advanced和“适用于儿童”＃39;选项：

任何人都可以帮我解决这个错误

1 个答案: