Skip to content

Commit 5c560d4

Browse files
authored
[fix](fe) Preload paimon jindo for paimon scanner (#62350)
`paimon-scanner` runs under a dedicated scanner classloader, while `preload-extensions` is loaded from the parent classpath with higher priority. Doris currently uses parent-first classloading for scanner jars. When `paimon-jindo` is packaged only inside `paimon-scanner`, runtime may still resolve `org.apache.paimon.*` classes from the parent classpath first. In this case, the Paimon `FileIO`/ `ServiceLoader` view seen at runtime is split across different classloaders, and the Jindo file IO loader is not discovered correctly. This can lead to errors like: `org.apache.paimon.fs.UnsupportedSchemeException: Could not find a file io implementation for scheme 'oss'` This PR removes `paimon-jindo` from `paimon-scanner` and moves it to `preload-extensions`, so the Jindo FileIO implementation is available from the highest-priority parent classpath and stays consistent with the Paimon core classes used during scanner execution. This keeps the runtime dependency layout aligned with Doris' existing classloading model and avoids scanner-local plugin jars being hidden by parent-first resolution.
1 parent 795a4d0 commit 5c560d4

2 files changed

Lines changed: 5 additions & 4 deletions

File tree

fe/be-java-extensions/paimon-scanner/pom.xml

Lines changed: 0 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -60,10 +60,6 @@ under the License.
6060
<groupId>org.apache.paimon</groupId>
6161
<artifactId>paimon-format</artifactId>
6262
</dependency>
63-
<dependency>
64-
<groupId>org.apache.paimon</groupId>
65-
<artifactId>paimon-jindo</artifactId>
66-
</dependency>
6763

6864
</dependencies>
6965

fe/be-java-extensions/preload-extensions/pom.xml

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -83,6 +83,11 @@ under the License.
8383
<groupId>org.apache.paimon</groupId>
8484
<artifactId>paimon-s3</artifactId>
8585
</dependency>
86+
87+
<dependency>
88+
<groupId>org.apache.paimon</groupId>
89+
<artifactId>paimon-jindo</artifactId>
90+
</dependency>
8691
<!-- For Avro and Hudi Scanner PreLoad -->
8792
<dependency>
8893
<groupId>org.apache.hadoop</groupId>

0 commit comments

Comments
 (0)