#Data Import and Export

1 Follower · 122 Posts

This topic unites posts which describe approaches, tools, and solutions to import and export data into InterSystems IRIS and other InterSystems Data platform products: CSV, JSON, SQL, flat files, binary files, globals, streams, etc.

Question David.Satorres6134 · Jun 24, 2024

Hi everyone,

We have successfully configured the Patient Index and are now looking to bring it to upper environments. Our plan is to export the Linkage Definition and import it into higher environments to avoid any manual work. However, I am having trouble finding an export option in the Linkage Definition Designer and locating the globals that hold this setup.

I would greatly appreciate any tips or guidance on how to export/import the Patient Index configuration between environments.

Thank you in advance!

4
0 197
Question Stella Ticker · May 26, 2021

I am trying to populate a table using the sql Data Import Wizard. The input file is a tab delimited text file. But the import keeps failing with a 104 error showing validation for the columns which use %Library.TimeStamp and %Boolean datatypes is failing. Yet when I insert values into the table through a SQL insert command, the values get saved correctly in the table.

For the TimeStamp format in the wizard form, I am choosing YYYY-MM-DD-HH:MI:SS because  there was no option for this format: YYYY-MM-DD HH:MM:SS.

4
0 466
Question Sam Duncan · Jul 12, 2023

It can sometimes be useful to list or export all of the subclasses that are derived, directly or indirectly, from a given class. In Studio, the Class -> Derived Classes menu option will show such a list, but I'm not aware of a built-in API for programmatically exporting their source code.

Yesterday I wrote some code for exporting derived classes, and I'm thinking about cleaning it up and putting it on Open Exchange. But if there's a simple way to do this that someone has already figured out, I'd be happy to know about that (and help others find that solution) rather than reinventing the wheel.

4
0 485
Question Jonathan Wald · May 25, 2022

I am creating "models" that contain rows in several class tables called Model, Path, Node.

So, model 19 includes 1 row in the Model table, 11 rows in the Path table, and 10 rows in the Node table. 

I'd like to write some utilities to "move" model 19 from one instance to another.

I found some old (maybe deprecated?) functionality, the %SYNC.Transporter, which seems to work.  I can write a SQL query to select the rows of interest, and export those record to a ,gof file.  I can create 3 of them (one file per class), and then on the target instance, I can import from the .

4
0 729
Question Jimmy Christian · Apr 11, 2019

Hello,

When i click on the menu to  run the  Data import wizard  from MP, i receive following CSP error



<UNDEFINED>zOnPageHEAD+229^%cspapp.exp.utilsqleximwizardcontent.1 *schemaname : CSP Error

It is happening for all the namespaces. Looks like some permission issue.  Same issue with Data Export wizard. Help to resolve this will be appreciated.

I am using

Cache for Windows (x86-64) 2017.2.2 (Build 865_0_18763U)

Thanks,

Jimmy Christian.

3
0 381
Question Niccolò Predebon · Nov 19, 2019

Hi everyone. I'm new to cache, and i  was looking for a command who reads a .txt file and store the informations in variables. I've found on the documentation the EnsLib.SQL.SNapshot class, and, even if i'm not sure if that's what i need, when i run the code it says that the class doesn't exist, but i couldn't find the right superclass to extend.

3
0 608
Question Sylvain Guilbaud · Aug 23, 2023

Is it planned that LOAD DATA takes into account several DATE/DATETIME formats with, for example, a parameter indicating the format used in the source data?

example :

LOAD DATA .../...
USING
{
  "from": {
    "file": {
       "dateformat": "DD/MM/YYYY"
    }
  }
}
3
0 275
Question Lucas Galdino · Jan 6, 2024

Dear experts,

I'm trying exported a project from version '2012.5' to '2018.1.4' but is returning ERROR #7602.
Please, could you help me. How can I do it?
Below is steps that I did:



ACB>D $System.OBJ.Load("C:\GlobalPatch.xml")
 
Load started on 01/07/2024 00:06:51
Loading file C:\GlobalPatch.xml as xml
Imported global: ^GlobalPatch
Load finished successfully.
 
ACB>Set sc = ##class(%Studio.Project).InstallFromGbl("^GlobalPatch","fv")
ERROR #7602: Exported on version '2012.5' but this machine on version '2018.1.4' so unable to import

Thank you.

3
0 225
Question Vitaly Furman · Apr 5, 2022

Hello,

I am working on the new USCDI Requirement to store LOINC Codes/Descriptions for various types of Clinical Notes in the SDA.

According to all of the documentation I had been able to find, in order to store a coded value for Document Type, I have to use Custom Pairs:

#; Code System
        do ..write(cr_"<CustomPairs")
        do ..write(cr_"<NVPair>")
        do ..write(cr_"<Name>DocumentNameCodingStandard</Name>")
        do ..write(cr_"<Value>LN</Value>")
        do ..write(cr_"</NVPair>")
        #; Code
        do ..write(cr_"<NVPair>")

3
0 444
Question Limyandi Vicotrico · Jan 13, 2021

Hi Everyone,

I am trying the Export and Import application as per this link referred here: ExImData

I have the following sample class I am trying to import:


Class Persistent.PersonBackup Extends %Persistent
{ Property Name As %String; Storage Default
{
<Data name="PersonBackupDefaultData">
<Value name="1">
<Value>%%CLASSNAME</Value>
</Value>
<Value name="2">
<Value>Name</Value>
</Value>
</Data>
<DataLocation>^Persistent.PersonBackupD</DataLocation>
<DefaultData>PersonBackupDefaultData</DefaultData>
<IdLocation>^Persistent.PersonBackupD</IdLocation>
<IndexLocation>^Persistent.

3
0 740
Question Scott Roth · Jan 6, 2022

We are migrating from AIX to Linux and part of our testing is trying to figure the best method to migrate the code. I am trying to export an entire Production, however I keep running into an error...

Error generating export list for production osuwmc.TestClin and all items may not be listed.
ERROR #5002: Cache error: <CLASS DOES NOT EXIST>zgetRecordandComplexMapClasses+34^Ens.Config.Production.1 *(No name)

I went through any Complex Record Maps, and recompiled them but I am still getting the same error

Does anyone know how I can track down this error and the culprit?

Thanks

Scott Roth

3
0 348
Question David.Satorres6134 · Nov 16, 2018

Hello,

We are trying to migrate all our production to new IRIS servers. To test everything is working fine, and to be able to script the process, we want to import the data into new IRIS servers using a backup file (created with ^BACKUP). But we've found that IRIS doesn't recognize Ensemble backups so we can't import it using ^DBREST  :-O

Any of you know how to import in IRIS an Ensemble backup file?

Thanks a lot,
David

3
0 659
Question James Hipp · Sep 14, 2021

https://docs.intersystems.com/irislatest/csp/documatic/%25CSP.Documatic…

method Export(savertn As %Boolean = 0) [ Language = objectscript ]

I am looking to export table to a text file in a programmatic way. I am not familiar with this class and how to invoke a "savertn" as input here.

Essentially I would like to Export Table (SELECT * FROM Table) and save it as a text file locally on Linux server. Is there any examples out there of that? Perhaps I need to save the query output to a global and then pass that input to the export?

2
0 549
Question Roderick Julius · Mar 16, 2022

Hello,

Our team is looking for a way to export all of our Cache SQL tables into Microsoft SQL Server.  I have only found a method to export one table at a time into an ASCII file.  We have over 170 tables so this would be very tedious and time consuming.  Is there a way to directly export from Cache to SQL Server.  Alternatively is it possible to export the entire database in a single shot or even multiple tables to text files?

Thanks!

2
0 1013
Question Edward Jalbert · Jan 4, 2021

I am hoping I explain this correctly.

We are using a query expire edge, to pass an API request to one of our vendor systems.

There is no feed into the gateway from an external system, and it is only used to query the external system with member data.

However, it is our understanding that the member needs to be registered on the edge.

Wondering if there is a way to export from the registry the bare demographic info in SDA to import to the new edge?

If anyone has done this and can point me to the right direction (documentation ect...) it would be greatly appreciated.

Thanks,

Ed

2
0 223
Question Justin Richter · Jan 3, 2022

So I've been reviewing a lot of questions posted in the InterSystems community regarding NULL properties in JSON. I've also been reviewing the JSON documentation. None of these things have been able to help me so far.

1. We don't seem to have the %JSON.Adaptor class available for us to use in our system.

2. I'm not really confident enough to create JSON Type classes or backporting code, etc.

I created a dummy class and I need my JSON to look like this:
{
    "notanumber":"28001",
    "aboolean":true,
    "anumber":12345,
    "adecimal":1.

2
0 873
Question David Underhill · Jul 28, 2020

We use the %Net.FtpSession class to perform FTPS file transfers.  This has worked fine with Implcit FTPS servers but crashes when trying to connect to an Explicit FTPS server.  Explicit FTPS has a slightly diffferent negotiation in the intitial connection and different ports.

Has anyone gotten Explicit FTPS working with the Cache classes?

2
0 619
Question Laura Cavanaugh · Dec 6, 2016

Hello.  When you export and then import a table of data, is the import smart enough to figure out if a row already exists in the new namespace, and if so update the row rather than just save/add the row?

For example, we have a table in DEV, and the same table in QA.  The DEV table has more fields than QA.  When we moved up the class, the field definitions went with the table into QA, so now the table definition is the same in both.

We need to export the data from DEV and import it into QA, but file each row in QA as an existing row, and just update its data.

2
0 618
Question water huang · Apr 6, 2023

hi,I meet a problem,i want to move huge data from ensemble to oracle.it`s about 3years business data.i have tried some case!

1. EnsLib.SQL.OutboundAdapter

i parse the data one by one,and translate it into inser or update sql statement then write to Oracle,it·s most slowly,and take more disk space。

2.save the data to a new table,and then use dbeaver transport data to oracle。

3.user linktable. save object as insert,but,i can·t user %openid method.

hope to find a high-efficiency way!

1
0 358