Fastest way to move data across Exasol servers

anchalj
Padawan

Is there a faster way to move data across Exasol servers except creation of connection and using import. 

9 REPLIES 9

mwellbro
Xpert

a bit more details would be great ? if you want to copy the entire database it might be of interest to use storage snapshots and mount them to a second instance.
if you think more along the lines of individual tables - how is IMPORT too slow or what are the impediments your´re facing ?

Cheers,
Malte

anchalj
Padawan

Hi, Thanks for the comments. Use case is to export data from a huge table(~500M) to another server. Import takes long so wanted to check if there any workaround to do that faster. Running or multiple nodes or export to csv and import or something else.

mwellbro
Xpert

You might want to test if you can gain something by exporting to an SFTP-Server with a rather high number of files in parallel ( i.e. "EXPORT xyz into CSV AT MY_FTP
FILE 'c:\temp\file_01.gz'
FILE 'c:\temp\file_02.gz'
<about 100 addition FILE clauses>
)
and then lift them back into your other exa - I´d doubt that the "de-tour" over the additional server will help you much, but I was surprised in the past how fast this kind of export works. Just a thought.

anchalj
Padawan

Thanks for the input!

Will give a try and will share findings.

Charlie
Xpert

I know there were plans at Exasol to have some sort of replication of tables between 2 databases with delta apply.

I think the name was ExaSync.

As far as I know @exa-StefanR was building this. Perhaps he could comment on this question 😉

 

exa-StefanR
Team Exasol
Team Exasol

I guess you are referring to the Exasol Data Replication Service.

We pretty much stopped active marketing as it had a strong overlap with the the cloud scalability feature and there were only few cases the DRS should be preferred.

Also, it would not use anything better than IMPORT/EXPORT for actual data transfer.

mwellbro
Xpert

"Also, it would not use anything better than IMPORT/EXPORT for actual data transfer." => so there is no...ExaMagic ? 😉

Charlie
Xpert

but would only do delta transfer 😉

mwellbro
Xpert

"stopped active marketing" => is there any documentation on DRS available ? If so, where ?