Fastest way to move data across Exasol servers

[anchalj]

Is there a faster way to move data across Exasol servers except creation of connection and using import. 

[Charlie]

I know there were plans at Exasol to have some sort of replication of tables between 2 databases with delta apply.

I think the name was ExaSync.

As far as I know @exa-StefanR was building this. Perhaps he could comment on this question 😉

[exa-StefanR]

I guess you are referring to the Exasol Data Replication Service.

We pretty much stopped active marketing as it had a strong overlap with the the cloud scalability feature and there were only few cases the DRS should be preferred.

Also, it would not use anything better than IMPORT/EXPORT for actual data transfer.

[mwellbro]

"stopped active marketing" => is there any documentation on DRS available ? If so, where ?

[Charlie]

but would only do delta transfer 😉

[mwellbro]

"Also, it would not use anything better than IMPORT/EXPORT for actual data transfer." => so there is no...ExaMagic ? 😉

[mwellbro]

a bit more details would be great ? if you want to copy the entire database it might be of interest to use storage snapshots and mount them to a second instance.
if you think more along the lines of individual tables - how is IMPORT too slow or what are the impediments your´re facing ?

Cheers,
Malte

[anchalj]

Hi, Thanks for the comments. Use case is to export data from a huge table(~500M) to another server. Import takes long so wanted to check if there any workaround to do that faster. Running or multiple nodes or export to csv and import or something else.

[mwellbro]

You might want to test if you can gain something by exporting to an SFTP-Server with a rather high number of files in parallel ( i.e. "EXPORT xyz into CSV AT MY_FTP
FILE 'c:\temp\file_01.gz'
FILE 'c:\temp\file_02.gz'
<about 100 addition FILE clauses>
)
and then lift them back into your other exa - I´d doubt that the "de-tour" over the additional server will help you much, but I was surprised in the past how fast this kind of export works. Just a thought.

[anchalj]

Thanks for the input!

Will give a try and will share findings.