sqoop-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From a..@apache.org
Subject sqoop git commit: SQOOP-2155: Sqoop2: KiteDatasetExecutor is not cleaning up merged datasets
Date Tue, 03 Mar 2015 02:25:17 GMT
Repository: sqoop
Updated Branches:
  refs/heads/sqoop2 68595856f -> c408ac5a4


SQOOP-2155: Sqoop2: KiteDatasetExecutor is not cleaning up merged datasets

(Jarek Jarcec Cecho via Abraham Elmahrek)


Project: http://git-wip-us.apache.org/repos/asf/sqoop/repo
Commit: http://git-wip-us.apache.org/repos/asf/sqoop/commit/c408ac5a
Tree: http://git-wip-us.apache.org/repos/asf/sqoop/tree/c408ac5a
Diff: http://git-wip-us.apache.org/repos/asf/sqoop/diff/c408ac5a

Branch: refs/heads/sqoop2
Commit: c408ac5a4b997183758a201628b07c4db48bdb48
Parents: 6859585
Author: Abraham Elmahrek <abe@apache.org>
Authored: Mon Mar 2 18:09:55 2015 -0800
Committer: Abraham Elmahrek <abe@apache.org>
Committed: Mon Mar 2 18:24:07 2015 -0800

----------------------------------------------------------------------
 .../java/org/apache/sqoop/connector/kite/KiteDatasetExecutor.java | 3 +++
 1 file changed, 3 insertions(+)
----------------------------------------------------------------------


http://git-wip-us.apache.org/repos/asf/sqoop/blob/c408ac5a/connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteDatasetExecutor.java
----------------------------------------------------------------------
diff --git a/connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteDatasetExecutor.java
b/connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteDatasetExecutor.java
index 8a7bda4..4381717 100644
--- a/connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteDatasetExecutor.java
+++ b/connector/connector-kite/src/main/java/org/apache/sqoop/connector/kite/KiteDatasetExecutor.java
@@ -146,6 +146,9 @@ public class KiteDatasetExecutor {
     FileSystemDataset<GenericRecord> update = Datasets.load(uri);
     if (dataset instanceof FileSystemDataset) {
       ((FileSystemDataset<GenericRecord>) dataset).merge(update);
+
+      // And let's completely drop the temporary dataset
+      Datasets.delete(uri);
     } else {
       throw new SqoopException(
           KiteConnectorError.GENERIC_KITE_CONNECTOR_0000, uri);


Mime
View raw message