并行导出clob大表_exclude="constraint,grant,index,statistics-程序员宅基地

技术标签: oracle  

脚本参考:

SQL> desc MEDICAL_CHECK_SYSINFO_H
 Name                                               Null?    Type
 ----------------------------------------------------------------------------------------- -------- ------------------------------------------------------------
 ID                                               NOT NULL NUMBER(10)
 REGISTER_NO                                           NOT NULL VARCHAR2(50 CHAR)
 PATIENT_ID                                           NOT NULL NUMBER(10)
 ORG_CODE                                           NOT NULL VARCHAR2(50 CHAR)
 MICODE                                            NOT NULL VARCHAR2(50 CHAR)
 ICNO                                               NOT NULL VARCHAR2(50 CHAR)
 SERVER_DATE                                           NOT NULL TIMESTAMP(9)
 ALLOW_QUERY_FLAG                                       NOT NULL NUMBER(10)
 SIGNINFO                                           NOT NULL VARCHAR2(50 CHAR)
 RAW_DATA                                                CLOB
 

查看导出job:

SET lines 200 
COL owner_name FORMAT a10;
COL job_name FORMAT a20;
COL state FORMAT a12;
COL operation LIKE state;
COL job_mode LIKE state;
COL owner.object for a50;
 
-- locate Data Pump jobs: 
SELECT owner_name, job_name, rtrim(operation) "OPERATION", 
    rtrim(job_mode) "JOB_MODE", state, attached_sessions
FROM dba_datapump_jobs
 WHERE job_name NOT LIKE 'BIN$%'
 ORDER BY 1,2; 

SELECT o.status, o.object_id, o.object_type, 
       o.owner||'.'||object_name "OWNER.OBJECT" 
  FROM dba_objects o, dba_datapump_jobs j 
 WHERE o.owner=j.owner_name AND o.object_name=j.job_name 
   AND j.job_name NOT LIKE 'BIN$%' ORDER BY 4,2;

异常终止expdp处理:

expdp xxx/xxx@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:\"where mod\(dbms_rowid.rowid_block_number\(rowid\), 10\) = 7\" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_7.dmp logfile=log_test_7.log 

SQL> SET lines 200 
COL owner_name FORMAT a10;
COL job_name FORMAT a20;
COL state FORMAT a12;
COL operation LIKE state;
COL job_mode LIKE state;
COL owner.object for a50;

SQL> SELECT o.status, o.object_id, o.object_type, 
       o.owner||'.'||object_name "OWNER.OBJECT" 
  FROM dba_objects o, dba_datapump_jobs j 
 WHERE o.owner=j.owner_name AND o.object_name=j.job_name 
   AND j.job_name NOT LIKE 'BIN$%' ORDER BY 4,2;  2    3    4    5  

STATUS	 OBJECT_ID OBJECT_TYPE
------- ---------- -----------------------
OWNER.OBJECT
--------------------------------------------------------------------------------
VALID	     94147 TABLE
xxx.SYS_EXPORT_TABLE_10

SQL> -- locate Data Pump jobs: 
SQL>SELECT owner_name, job_name, rtrim(operation) "OPERATION", 
    rtrim(job_mode) "JOB_MODE", state, attached_sessions
FROM dba_datapump_jobs
 WHERE job_name NOT LIKE 'BIN$%';

OWNER_NAME JOB_NAME		OPERATION    JOB_MODE	  STATE        ATTACHED_SESSIONS
---------- -------------------- ------------ ------------ ------------ -----------------
xxx	   SYS_EXPORT_TABLE_10	EXPORT	     TABLE	  STOP PENDING		       0

SQL> /

OWNER_NAME JOB_NAME		OPERATION    JOB_MODE	  STATE        ATTACHED_SESSIONS
---------- -------------------- ------------ ------------ ------------ -----------------
xxx	   SYS_EXPORT_TABLE_10	EXPORT	     TABLE	  STOP PENDING		       0

SQL> /

OWNER_NAME JOB_NAME		OPERATION    JOB_MODE	  STATE        ATTACHED_SESSIONS
---------- -------------------- ------------ ------------ ------------ -----------------
xxx	   SYS_EXPORT_TABLE_10	EXPORT	     TABLE	  STOPPING		       0

SQL> /

no rows selected

SQL> SELECT o.status, o.object_id, o.object_type, 
       o.owner||'.'||object_name "OWNER.OBJECT" 
  FROM dba_objects o, dba_datapump_jobs j 
 WHERE o.owner=j.owner_name AND o.object_name=j.job_name 
   AND j.job_name NOT LIKE 'BIN$%' ORDER BY 4,2;   2    3    4    5  

no rows selected



[oracle@rac1 dmp]$ expdp xxx/xxx@xxxdb attach=SYS_EXPORT_TABLE_10

Export: Release 19.0.0.0.0 - Production on Sat Jun 19 13:11:41 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Job: SYS_EXPORT_TABLE_10
  Owner: xxx                            
  Operation: EXPORT                         
  Creator Privs: TRUE                           
  GUID: C5186FACCC327C75E053820AA8C04187
  Start Time: Saturday, 19 June, 2021 13:08:53
  Mode: TABLE                          
  Instance: xxx1
  Max Parallelism: 1
  Timezone: +00:00
  Timezone version: 32
  Endianness: LITTLE
  NLS character set: ZHS16GBK
  NLS NCHAR character set: AL16UTF16
  EXPORT Job Parameters:
  Parameter Name      Parameter Value:
     CLIENT_COMMAND        xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 7" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_7.dmp logfile=log_test_7.log 
     TRACE                 0
  State: STOP PENDING                   
  Bytes Processed: 0
  Current Parallelism: 1
  Job Error Count: 0
  Job heartbeat: 112
  Dump File: /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_7.dmp
    bytes written: 32,768
  
Worker 1 Status:
  Instance ID: 1
  Instance name: xxx1
  Host name: rac1
  Object start time: Saturday, 19 June, 2021 13:09:17
  Object status at: Saturday, 19 June, 2021 13:09:17
  Process Name: DW03
  State: EXECUTING                      
  Object Schema: xxx
  Object Name: MEDICAL_CHECK_SYSINFO_H
  Object Type: TABLE_EXPORT/TABLE/TABLE_DATA
  Completed Objects: 1
  Total Objects: 1
  Completed Rows: 163,321
  Worker Parallelism: 1

Export> kill_job
Are you sure you wish to stop this job ([yes]/no): yes

查看lob表大小:

select a.owner,a.table_name,a.column_name,b.segment_name,ROUND(b.BYTES / 1024 / 1024)
  from dba_lobs a, dba_segments b
 where a.segment_name = b.segment_name
   and a.owner = 'XXX'
   and a.table_name = 'MEDICAL_CHECK_SYSINFO_H'
union all
select a.owner,a.table_name,a.column_name,b.segment_name,ROUND(b.BYTES / 1024 / 1024)
  from dba_lobs a, dba_segments b
 where a.index_name = b.segment_name
   and a.owner = 'XXX'
   and a.table_name = 'MEDICAL_CHECK_SYSINFO_H'
union all
select a.owner,'','',a.segment_name,ROUND(sum(a.BYTES) / 1024 / 1024)
  from dba_segments a
 where a.owner = 'XXX'
   and a.segment_name = 'MEDICAL_CHECK_SYSINFO_H' group by a.owner,a.segment_name;

1.sh内容:注意i必须从0开始

导出:
#!/bin/bash
chunk=10
for ((i=0;i<=9;i++));
do
expdp xxx/xxx@xxxTABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:\"where mod\(dbms_rowid.rowid_block_number\(rowid\)\, ${chunk}\) = ${i}\" directory=DMP cluster=N exclude=statistics dumpfile=MEDICAL_CHECK_SYSINFO_H_${i}.dmp logfile=log_test_${i}.log &
echo $i
sleep 2  #不加延迟2秒,将导致输出太快报错ORA-31626: job does not exist
done

导入:需要先导入元表结构并排除索引exclude=index,constraint,trigger,statistics,然后执行下面脚本导入content=data_only最后导入include=index,constraint,trigger,statistics

#!/bin/bash
chunk=10
for ((i=0;i<=9;i++));
do
impdp xxx/xxx@xxx  directory=DMP REMAP_TABLE=MEDICAL_CHECK_SYSINFO_H:MEDICAL_CHECK_SYSINFO_H  remap_schema=xxx:target dumpfile=MEDICAL_CHECK_SYSINFO_H_${i}.dmp logfile=TABLE_imp_log_test_${i}.log  DATA_OPTIONS=DISABLE_APPEND_HINT CONTENT=DATA_ONLY cluster=N exclude=statistics &
sleep 2
done

DISABLE_APPEND_HINT — Specifies that you do not want the import operation to use the APPEND hint while loading the data object. Disabling the APPEND hint can be useful if there is a small set of data objects to load that already exist in the database and some other application may be concurrently accessing one or more of the data objects. 

https://docs.oracle.com/en/database/oracle/oracle-database/12.2/sutil/datapump-import-utility.html#GUID-5FFA128D-B7F5-41D0-A72C-EB2CE384765D

并行导出操作记录参考:13分钟,120GB大小

查看job任务:


select owner_name, job_name, operation, job_mode, state, attached_sessions 
from dba_datapump_jobs 
where job_name not like 'BIN$%' 
order by 1, 2;

执行窗口:

[oracle@rac1 dmp]$ chmod +x 1.sh
[oracle@rac1 dmp]$ ./1.sh
0
1
2
3
4
5
6
7
8
9
[oracle@rac1 dmp]$ 
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.


Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0
Version 19.11.0.0.0


Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.

Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0



Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Version 19.11.0.0.0
Version 19.11.0.0.0



Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Version 19.11.0.0.0


Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.


Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0
Version 19.11.0.0.0


Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
ORA-31626: job does not exist
ORA-31633: unable to create master table "xxx.SYS_EXPORT_TABLE_07"
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 95
ORA-06512: at "SYS.KUPV$FT", line 1163
ORA-00955: name is already used by an existing object
ORA-06512: at "SYS.KUPV$FT", line 1056
ORA-06512: at "SYS.KUPV$FT", line 1044


ORA-31626: job does not exist
ORA-31633: unable to create master table "xxx.SYS_EXPORT_TABLE_08"
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 95
ORA-06512: at "SYS.KUPV$FT", line 1163
ORA-00955: name is already used by an existing object
ORA-06512: at "SYS.KUPV$FT", line 1056
ORA-06512: at "SYS.KUPV$FT", line 1044


Starting "xxx"."SYS_EXPORT_TABLE_01":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 1" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_1.dmp logfile=log_test_1.log 
Starting "xxx"."SYS_EXPORT_TABLE_02":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 0" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_0.dmp logfile=log_test_0.log 
Starting "xxx"."SYS_EXPORT_TABLE_08":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 4" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_4.dmp logfile=log_test_4.log 
Starting "xxx"."SYS_EXPORT_TABLE_07":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 6" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_6.dmp logfile=log_test_6.log 
Starting "xxx"."SYS_EXPORT_TABLE_04":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 2" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_2.dmp logfile=log_test_2.log 
Starting "xxx"."SYS_EXPORT_TABLE_03":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 3" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_3.dmp logfile=log_test_3.log 
Starting "xxx"."SYS_EXPORT_TABLE_05":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 9" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_9.dmp logfile=log_test_9.log 
Starting "xxx"."SYS_EXPORT_TABLE_06":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(rowid), 10) = 5" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_5.dmp logfile=log_test_5.log 
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.80 GB  313975 rows
Master table "xxx"."SYS_EXPORT_TABLE_08" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_08 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_4.dmp
Job "xxx"."SYS_EXPORT_TABLE_08" successfully completed at Fri Jun 18 16:35:26 2021 elapsed 0 00:11:08

. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.88 GB  314981 rows
Master table "xxx"."SYS_EXPORT_TABLE_05" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_05 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_9.dmp
Job "xxx"."SYS_EXPORT_TABLE_05" successfully completed at Fri Jun 18 16:35:34 2021 elapsed 0 00:11:18

. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.85 GB  313992 rows
Master table "xxx"."SYS_EXPORT_TABLE_01" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_01 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_1.dmp
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.78 GB  314160 rows
Job "xxx"."SYS_EXPORT_TABLE_01" successfully completed at Fri Jun 18 16:35:39 2021 elapsed 0 00:11:24

. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.85 GB  314894 rows
Master table "xxx"."SYS_EXPORT_TABLE_06" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_06 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_5.dmp
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.91 GB  316471 rows
Master table "xxx"."SYS_EXPORT_TABLE_03" successfully loaded/unloaded
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.97 GB  317177 rows
Job "xxx"."SYS_EXPORT_TABLE_06" successfully completed at Fri Jun 18 16:35:42 2021 elapsed 0 00:11:26

******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_03 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_3.dmp
Master table "xxx"."SYS_EXPORT_TABLE_07" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_07 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_6.dmp
Job "xxx"."SYS_EXPORT_TABLE_03" successfully completed at Fri Jun 18 16:35:44 2021 elapsed 0 00:11:29

Master table "xxx"."SYS_EXPORT_TABLE_04" successfully loaded/unloaded
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.91 GB  316566 rows
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_04 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_2.dmp
Job "xxx"."SYS_EXPORT_TABLE_07" successfully completed at Fri Jun 18 16:35:45 2021 elapsed 0 00:11:27

Job "xxx"."SYS_EXPORT_TABLE_04" successfully completed at Fri Jun 18 16:35:46 2021 elapsed 0 00:11:30

Master table "xxx"."SYS_EXPORT_TABLE_02" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_02 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_0.dmp
Job "xxx"."SYS_EXPORT_TABLE_02" successfully completed at Fri Jun 18 16:35:47 2021 elapsed 0 00:11:33

另一窗口记录:

SQL> col state for a10
SQL> 
 select owner_name, job_name, operation, job_mode, state, attached_sessions
 from dba_datapump_jobs
 where job_name not like 'BIN$%'
 order by 1, 2

OWNER_NAME JOB_NAME			  OPERAT JOB_MO STATE	   ATTACHED_SESSIONS
---------- ------------------------------ ------ ------ ---------- -----------------
xxx	   SYS_EXPORT_TABLE_01		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_02		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_03		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_04		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_05		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_06		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_07		  EXPORT TABLE	EXECUTING		   1
xxx	   SYS_EXPORT_TABLE_08		  EXPORT TABLE	EXECUTING		   1

8 rows selected.

SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0
[oracle@rac1 ~]$ cd /oracle/dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_0.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_1.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_2.dmp
8.0G	MEDICAL_CHECK_SYSINFO_H_3.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_4.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_5.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_6.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_0.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_1.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_2.dmp
8.0G	MEDICAL_CHECK_SYSINFO_H_3.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_4.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_5.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_6.dmp
8.1G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
16G	MEDICAL_CHECK_SYSINFO_H_0.dmp
16G	MEDICAL_CHECK_SYSINFO_H_1.dmp
16G	MEDICAL_CHECK_SYSINFO_H_2.dmp
16G	MEDICAL_CHECK_SYSINFO_H_3.dmp
16G	MEDICAL_CHECK_SYSINFO_H_4.dmp
16G	MEDICAL_CHECK_SYSINFO_H_5.dmp
16G	MEDICAL_CHECK_SYSINFO_H_6.dmp
16G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
16G	MEDICAL_CHECK_SYSINFO_H_0.dmp
16G	MEDICAL_CHECK_SYSINFO_H_1.dmp
16G	MEDICAL_CHECK_SYSINFO_H_2.dmp
16G	MEDICAL_CHECK_SYSINFO_H_3.dmp
16G	MEDICAL_CHECK_SYSINFO_H_4.dmp
16G	MEDICAL_CHECK_SYSINFO_H_5.dmp
16G	MEDICAL_CHECK_SYSINFO_H_6.dmp
16G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
16G	MEDICAL_CHECK_SYSINFO_H_0.dmp
16G	MEDICAL_CHECK_SYSINFO_H_1.dmp
16G	MEDICAL_CHECK_SYSINFO_H_2.dmp
16G	MEDICAL_CHECK_SYSINFO_H_3.dmp
16G	MEDICAL_CHECK_SYSINFO_H_4.dmp
16G	MEDICAL_CHECK_SYSINFO_H_5.dmp
16G	MEDICAL_CHECK_SYSINFO_H_6.dmp
16G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ sar 1 10
Linux 5.4.17-2011.6.2.el7uek.x86_64 (rac1) 	06/18/2021 	_x86_64_	(64 CPU)

04:31:35 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
04:31:36 PM     all      3.41      0.00      2.59      3.39      0.00     90.62
04:31:37 PM     all      3.40      0.00      2.25      3.22      0.00     91.13
04:31:38 PM     all      3.33      0.00      2.21      2.95      0.00     91.52
04:31:39 PM     all      3.31      0.00      2.16      3.70      0.00     90.83
04:31:40 PM     all      3.28      0.00      2.11      4.65      0.00     89.96
04:31:41 PM     all      3.21      0.00      2.38      5.04      0.00     89.36
04:31:42 PM     all      3.15      0.00      1.97      4.43      0.00     90.44
04:31:43 PM     all      3.21      0.00      1.86      3.72      0.00     91.21
04:31:44 PM     all      3.06      0.00      2.02      4.56      0.00     90.37
04:31:45 PM     all      3.15      0.00      1.92      4.47      0.00     90.46
Average:        all      3.25      0.00      2.15      4.01      0.00     90.59
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
12G	MEDICAL_CHECK_SYSINFO_H_0.dmp
12G	MEDICAL_CHECK_SYSINFO_H_1.dmp
12G	MEDICAL_CHECK_SYSINFO_H_2.dmp
12G	MEDICAL_CHECK_SYSINFO_H_3.dmp
12G	MEDICAL_CHECK_SYSINFO_H_4.dmp
12G	MEDICAL_CHECK_SYSINFO_H_5.dmp
12G	MEDICAL_CHECK_SYSINFO_H_6.dmp
12G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
12G	MEDICAL_CHECK_SYSINFO_H_0.dmp
12G	MEDICAL_CHECK_SYSINFO_H_1.dmp
12G	MEDICAL_CHECK_SYSINFO_H_2.dmp
12G	MEDICAL_CHECK_SYSINFO_H_3.dmp
12G	MEDICAL_CHECK_SYSINFO_H_4.dmp
12G	MEDICAL_CHECK_SYSINFO_H_5.dmp
12G	MEDICAL_CHECK_SYSINFO_H_6.dmp
12G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO*.dmp
12G	MEDICAL_CHECK_SYSINFO_H_0.dmp
12G	MEDICAL_CHECK_SYSINFO_H_1.dmp
12G	MEDICAL_CHECK_SYSINFO_H_2.dmp
12G	MEDICAL_CHECK_SYSINFO_H_3.dmp
12G	MEDICAL_CHECK_SYSINFO_H_4.dmp
12G	MEDICAL_CHECK_SYSINFO_H_5.dmp
12G	MEDICAL_CHECK_SYSINFO_H_6.dmp
12G	MEDICAL_CHECK_SYSINFO_H_9.dmp
[oracle@rac1 dmp]$ ls -lt|more
total 239233592
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_0.log
-rw-r----- 1 oracle asmadmin 12790267904 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_0.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_2.log
-rw-r----- 1 oracle asmadmin 12857425920 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_2.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_6.log
-rw-r----- 1 oracle asmadmin 12797472768 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_6.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_3.log
-rw-r----- 1 oracle asmadmin 12729819136 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_3.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_5.log
-rw-r----- 1 oracle asmadmin 12649000960 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_5.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_1.log
-rw-r----- 1 oracle asmadmin 12726243328 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_1.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_9.log
-rw-r----- 1 oracle asmadmin 12764639232 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_9.dmp
-rw-r--r-- 1 oracle asmadmin        1380 Jun 18 16:35 log_test_4.log
-rw-r----- 1 oracle asmadmin 12672323584 Jun 18 16:35 MEDICAL_CHECK_SYSINFO_H_4.dmp
-rwxr-xr-x 1 oracle oinstall         304 Jun 18 16:23 1.sh

[oracle@rac1 dmp]$ more log_test_4.log
;;; 
Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:24:08 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.
;;; 
Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Starting "xxx"."SYS_EXPORT_TABLE_08":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H QUERY=MEDICAL_CHECK_SYSINFO_H:"where mod(dbms_rowid.rowid_block_number(ro
wid), 10) = 4" directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H_4.dmp logfile=log_test_4.log 
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             11.80 GB  313975 rows
Master table "xxx"."SYS_EXPORT_TABLE_08" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_08 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H_4.dmp
Job "xxx"."SYS_EXPORT_TABLE_08" successfully completed at Fri Jun 18 16:35:26 2021 elapsed 0 00:11:08
[oracle@rac1 dmp]$ sqlplus xxx/xxx123890@xxxdb

SQL*Plus: Release 19.0.0.0.0 - Production on Fri Jun 18 16:37:44 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2020, Oracle.  All rights reserved.

Last Successful login time: Fri Jun 18 2021 16:26:59 +08:00

Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.11.0.0.0

SQL> select count(*) from dba_datapump_jobs;        

  COUNT(*)
----------
	 0

非并行普通导出,消耗34分钟,大小120G,比并行慢接近3倍。

[oracle@rac1 dmp]$ expdp xxx/xxx@xxx TABLES=MEDICAL_CHECK_SYSINFO_H directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H.dmp logfile=log_test.log

Export: Release 19.0.0.0.0 - Production on Fri Jun 18 16:48:00 2021
Version 19.11.0.0.0

Copyright (c) 1982, 2019, Oracle and/or its affiliates.  All rights reserved.

Connected to: Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Starting "xxx"."SYS_EXPORT_TABLE_01":  xxx/********@xxxdb TABLES=MEDICAL_CHECK_SYSINFO_H directory=DMP dumpfile=MEDICAL_CHECK_SYSINFO_H.dmp logfile=log_test.log 
Processing object type TABLE_EXPORT/TABLE/TABLE_DATA
Processing object type TABLE_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
Processing object type TABLE_EXPORT/TABLE/STATISTICS/MARKER
Processing object type TABLE_EXPORT/TABLE/TABLE
Processing object type TABLE_EXPORT/TABLE/GRANT/OWNER_GRANT/OBJECT_GRANT
Processing object type TABLE_EXPORT/TABLE/CONSTRAINT/CONSTRAINT
. . exported "xxx"."MEDICAL_CHECK_SYSINFO_H"             118.6 GB 3152056 rows
Master table "xxx"."SYS_EXPORT_TABLE_01" successfully loaded/unloaded
******************************************************************************
Dump file set for xxx.SYS_EXPORT_TABLE_01 is:
  /oracle/dmp/MEDICAL_CHECK_SYSINFO_H.dmp
Job "xxx"."SYS_EXPORT_TABLE_01" successfully completed at Fri Jun 18 17:22:54 2021 elapsed 0 00:34:53

[oracle@rac1 dmp]$ du -sh MEDICAL_CHECK_SYSINFO_H.dmp 
119G	MEDICAL_CHECK_SYSINFO_H.dmp

 

参考:https://www.linkedin.com/pulse/optimising-lob-export-import-performance-via-oracle-datapump-arya/

版权声明:本文为博主原创文章,遵循 CC 4.0 BY-SA 版权协议,转载请附上原文出处链接和本声明。
本文链接:https://blog.csdn.net/jycjyc/article/details/118029262

智能推荐

18个顶级人工智能平台-程序员宅基地

文章浏览阅读1w次,点赞2次,收藏27次。来源:机器人小妹  很多时候企业拥有重复,乏味且困难的工作流程,这些流程往往会减慢生产速度并增加运营成本。为了降低生产成本,企业别无选择,只能自动化某些功能以降低生产成本。  通过数字化..._人工智能平台

electron热加载_electron-reloader-程序员宅基地

文章浏览阅读2.2k次。热加载能够在每次保存修改的代码后自动刷新 electron 应用界面,而不必每次去手动操作重新运行,这极大的提升了开发效率。安装 electron 热加载插件热加载虽然很方便,但是不是每个 electron 项目必须的,所以想要舒服的开发 electron 就只能给 electron 项目单独的安装热加载插件[electron-reloader]:// 在项目的根目录下安装 electron-reloader,国内建议使用 cnpm 代替 npmnpm install electron-relo._electron-reloader

android 11.0 去掉recovery模式UI页面的选项_android recovery 删除 部分菜单-程序员宅基地

文章浏览阅读942次。在11.0 进行定制化开发,会根据需要去掉recovery模式的一些选项 就是在device.cpp去掉一些选项就可以了。_android recovery 删除 部分菜单

mnn linux编译_mnn 编译linux-程序员宅基地

文章浏览阅读3.7k次。https://www.yuque.com/mnn/cn/cvrt_linux_mac基础依赖这些依赖是无关编译选项的基础编译依赖• cmake(3.10 以上)• protobuf (3.0 以上)• 指protobuf库以及protobuf编译器。版本号使用 protoc --version 打印出来。• 在某些Linux发行版上这两个包是分开发布的,需要手动安装• Ubuntu需要分别安装 libprotobuf-dev 以及 protobuf-compiler 两个包•..._mnn 编译linux

利用CSS3制作淡入淡出动画效果_css3入场效果淡入淡出-程序员宅基地

文章浏览阅读1.8k次。CSS3新增动画属性“@-webkit-keyframes”,从字面就可以看出其含义——关键帧,这与Flash中的含义一致。利用CSS3制作动画效果其原理与Flash一样,我们需要定义关键帧处的状态效果,由CSS3来驱动产生动画效果。下面讲解一下如何利用CSS3制作淡入淡出的动画效果。具体实例可参考刚进入本站时的淡入效果。1. 定义动画,名称为fadeIn@-webkit-keyf_css3入场效果淡入淡出

计算机软件又必须包括什么,计算机系统应包括硬件和软件两个子系统,硬件和软件又必须依次分别包括______?...-程序员宅基地

文章浏览阅读2.8k次。计算机系统应包括硬件和软件两个子系统,硬件和软件又必须依次分别包括中央处理器和系统软件。按人的要求接收和存储信息,自动进行数据处理和计算,并输出结果信息的机器系统。计算机是脑力的延伸和扩充,是近代科学的重大成就之一。计算机系统由硬件(子)系统和软件(子)系统组成。前者是借助电、磁、光、机械等原理构成的各种物理部件的有机组合,是系统赖以工作的实体。后者是各种程序和文件,用于指挥全系统按指定的要求进行..._计算机系统包括硬件系统和软件系统 软件又必须包括

随便推点

进程调度(一)——FIFO算法_进程调度fifo算法代码-程序员宅基地

文章浏览阅读7.9k次,点赞3次,收藏22次。一 定义这是最早出现的置换算法。该算法总是淘汰最先进入内存的页面,即选择在内存中驻留时间最久的页面予以淘汰。该算法实现简单,只需把一个进程已调入内存的页面,按先后次序链接成一个队列,并设置一个指针,称为替换指针,使它总是指向最老的页面。但该算法与进程实际运行的规律不相适应,因为在进程中,有些页面经常被访问,比如,含有全局变量、常用函数、例程等的页面,FIFO 算法并不能保证这些页面不被淘汰。这里,我_进程调度fifo算法代码

mysql rownum写法_mysql应用之类似oracle rownum写法-程序员宅基地

文章浏览阅读133次。rownum是oracle才有的写法,rownum在oracle中可以用于取第一条数据,或者批量写数据时限定批量写的数量等mysql取第一条数据写法SELECT * FROM t order by id LIMIT 1;oracle取第一条数据写法SELECT * FROM t where rownum =1 order by id;ok,上面是mysql和oracle取第一条数据的写法对比,不过..._mysql 替换@rownum的写法

eclipse安装教程_ecjelm-程序员宅基地

文章浏览阅读790次,点赞3次,收藏4次。官网下载下载链接:http://www.eclipse.org/downloads/点击Download下载完成后双击运行我选择第2个,看自己需要(我选择企业级应用,如果只是单纯学习java选第一个就行)进入下一步后选择jre和安装路径修改jvm/jre的时候也可以选择本地的(点后面的文件夹进去),但是我们没有11版本的,所以还是用他的吧选择接受安装中安装过程中如果有其他界面弹出就点accept就行..._ecjelm

Linux常用网络命令_ifconfig 删除vlan-程序员宅基地

文章浏览阅读245次。原文链接:https://linux.cn/article-7801-1.htmlifconfigping &lt;IP地址&gt;:发送ICMP echo消息到某个主机traceroute &lt;IP地址&gt;:用于跟踪IP包的路由路由:netstat -r: 打印路由表route add :添加静态路由路径routed:控制动态路由的BSD守护程序。运行RIP路由协议gat..._ifconfig 删除vlan

redux_redux redis-程序员宅基地

文章浏览阅读224次。reduxredux里要求把数据都放在公共的存储区域叫store里面,组件中尽量少放数据,假如绿色的组件要给很多灰色的组件传值,绿色的组件只需要改变store里面对应的数据就行了,接着灰色的组件会自动感知到store里的数据发生了改变,store只要有变化,灰色的组件就会自动从store里重新取数据,这样绿色组件的数据就很方便的传到其它灰色组件里了。redux就是把公用的数据放在公共的区域去存..._redux redis

linux 解压zip大文件(解决乱码问题)_linux 7za解压中文乱码-程序员宅基地

文章浏览阅读2.2k次,点赞3次,收藏6次。unzip版本不支持4G以上的压缩包所以要使用p7zip:Linux一个高压缩率软件wget http://sourceforge.net/projects/p7zip/files/p7zip/9.20.1/p7zip_9.20.1_src_all.tar.bz2tar jxvf p7zip_9.20.1_src_all.tar.bz2cd p7zip_9.20.1make && make install 如果安装失败,看一下报错是不是因为没有下载gcc 和 gcc ++(p7_linux 7za解压中文乱码