In the...good old days, we used to do that in one line 😂
s node="array" f s node=$q(@node) q:node="" w node,"=",@node,!
array(1)=1
array(1,1)=1,1
array(1,1,1)=1,1,1
array(1,1,1,1)=1,1,1,1
array(1,1,2)=1,1,2
array(1,1,3)=1,1,3
array(2)=2
array(2,1)=2,1
array(2,1,1)=2,1,1
If I recall correctly I had a similar issue in some old Ensemble system but I'm not 100% sure the global was really that.
If you can stop the production, then I think it's safe to kill ^Ens.AppData, with the production running I don't think killing it it's a good idea.
A curiosity, do you use EnsLib.SQL.Snapshot class in some SQL host (BO)?
Is the content of ^Ens.AppData somewhat related to EnsLib.SQL.Snapshot?
Looking at the content of ^Ens.AppData, what type of adapter/operation is likely using it?
When I was migrating a system I had to export and import SQL Gateway Connection, so in the source system I exported to a tab delimited file and in the target system I imported the definitions.
The code to create the imported definition is:
Set SQLConnection=##class(%SQLConnection).%New()
Set SQLConnection.DSN=$p(line,tab,1)
Set SQLConnection.Name=$p(line,tab,2)
Set SQLConnection.ReverseOJ=$p(line,tab,3)
Set SQLConnection.URL=$p(line,tab,4)
Set SQLConnection.Usr=$p(line,tab,5)
Set SQLConnection.bUnicodeStream=$p(line,tab,6)
Set SQLConnection.classpath=$p(line,tab,7)
Set SQLConnection.driver=$p(line,tab,8)
Set SQLConnection.isJDBC=$p(line,tab,9)
Set SQLConnection.needlongdatalen=$p(line,tab,10)
Set SQLConnection.noconcat=$p(line,tab,11)
Set SQLConnection.nodefq=$p(line,tab,12)
Set SQLConnection.nofnconv=$p(line,tab,13)
Set SQLConnection.nvl=$p(line,tab,14)
Set SQLConnection.properties=$p(line,tab,15)
Set SQLConnection.pwd=$p(line,tab,16)
Set SQLConnection.useCAST=$p(line,tab,17)
Set SQLConnection.useCASTCHAR=$p(line,tab,18)
Set SQLConnection.useCOALESCE=$p(line,tab,19)
Set SQLConnection.xadriver=$p(line,tab,20)
Set sc=SQLConnection.%Save()
If you want/need your code to handle ANY situation (JSON size), then you should use the first option.
Let's try with the second option:
USER>Set Body={}.%FromJSONFile("c:\temp\BigSample.json")
USER>Set Request = ##class(%Net.HttpRequest).%New()
USER>Set Request.Server = "server"
USER>Set Request.Location = "location"
USER>Set Request.ContentType = "application/json"
USER>Do Request.EntityBody.Write(Body.%ToJSON())
DO Request.EntityBody.Write(Body.%ToJSON())
^
<STRINGSTACK>
USER>As you see, it does not work. Now the first option:
SER>Set Body={}.%FromJSONFile("c:\temp\BigSample.json")
USER>Set Request = ##class(%Net.HttpRequest).%New()
USER>Set Request.Server = "server"
USER>Set Request.Location = "location"
USER>Set Request.ContentType = "application/json"
USER>Do Body.%ToJSON(Request.EntityBody)
USER>Write Request.EntityBody.Size
18378462
USER>Write ##class(%File).%New("c:\temp\BigSample.json").Size
50273869
USER>Curiosity: the difference between the original json file size and stream loaded into Request.EntityBody stream is due to the fact that the file is formatted with indents while the json exported stream is "compact" (minified) with no indents and new lines.
This is new info, you did not mention this in your original question.
Can you provide some context on your implementation?
Would you mind to share the code you are using to save "data inside response.Data"?
What class is "response"?
From the example in the first post it seems the stream is not a property of an Ens.Message, that's why is not purged.
You explicitly saved the stream using CopyFromAndSave(), so it will persist (on disk) until it's deleted.
It's like saving a persistent class, it persist even when the code has finished executing. Fortunately! ☺
What's the point of saving a stream that you don't want to persist?
But...are you using a Business Operation with EnsLib.SOAP.OutboundAdapter?
What namespace are you logged when you try to create that routine?
Maybe in your namespace the %Test (or %Test*, or...) is mapped to a read only database?
Otherwise you think you are authenticated as superuser but in fact you are not.
In your generated (from wsdl) SOAP client class change the LOCATION class parameter with correct url including port number.
Another option is to set the Location property in your code when you use the client class, somthing like:
Set wsClient=##class(your.generated.SoapClient).%New()
Set wsClient.Location="https://path.to.server:NNNN/path.to.service"
Set client.SSLConfiguration ="SSLConfig"
It looks like there is some disk I/O difference between the two systems.
How does the two systems storage (disk, controller etc.) compares?
Are the 2 systems equally configured in terms available RAM and of global buffers?
Is the shared memory using large pages? (check messages.log during startup)
I'd monitor and compare disk usage and I/O while running.
I had a similar issues with IRIS 2021.2.
In one case a class with an object reference calculated property failed to compile.
The workaround was to add %JSONINCLUDE = "OUTPUTONLY" to the property.
The second case was a class that contains a property (not calculated) that is an array of %Stream.GlobalBinary (that was not supported) and despite I added %JSONINCLUDE = "NONE" the class did not compile.
For this I got a quick fix modifying a library class.
My suggestion is first to to reproduce the issue with a VERY SIMPLE test case and test it using latest IRIS version 2025.1 and, whatever the test result is, report it to WRC including the result of your test using the latest IRIS version.
05/16/25-15:43:17:397 (11856) 2 Failed to allocate 882MB shared memory: 411MB global buffers, 300MB routine buffers
05/16/25-15:43:17:398 (11856) 2 Unable to allocate shared memory minimum of 128MB
It must be a very small system!
Maybe you are sending the HTTP request using an incorrect Content-Type HTTP header?
Check what Content-Type HTTP header the receiving end is expecting.
For Caché just change iris with ccontrol:
Stop your HS instance, then:
Every routine, class or global that start with "%" is mapped to a system database, usually "%SYS".
In your case %Test.mac is (by default) mapped to the %SYS database.
It seems that you (the user you connect to IRIS) don't have permissions to write to the %SYS database.
Please note that during IRIS upgrade all routines starting with "%" are DELETED, unless they start with %z or %Z, so I suggest to use a different name or, better, create your code in other namespace/database with consistent naming (package name) and map it from your application namespaces. If you need your code in all namespaces, create a mapping for the %ALL (pseudo) namespace.
Hi Daniel 😊
can you elaborate "$p($view(-1,-3),"^",6)"? 😉
Your code gives the impression that to implement this solution requires knowledge that we "simple humans" don't have.
Fortunately this is not the case, instead of the cryptic, obscure, arcane and undocumented $p($view(-1,-3),"^",6) the simple $ZNAME special variable can be used. 😃
I'd implement a custom function, create a class like:
Class Community.CustomFunctions Extends Ens.Rule.FunctionSet
{
/// Returns Age in years from DOB in YYYYMMDD format
ClassMethod GetAge(DateOfBirth As %String) As %Integer
{
Quit (($H-$ZDATETIMEH(DateOfBirth,8)) \ 365.25)
}
/// Returns Age in days from DOB in YYYYMMDD format
ClassMethod GetAgeDays(DateOfBirth As %String) As %Integer
{
Quit ($H-$ZDATETIMEH(DateOfBirth,8))
}
}
Then from any Rule or DTL transformation you can use these two function as any other built in function.
Make sure DOB is not null ("") before calling the function.
If you tell us what format you use for date of birth, then we can give you the code you may use
You cannot assign to arbitrary variable in rules. (edited, in fact, you can see other posts! 🙂)
To store some temporary data you can assign it to aux.RuleActionUserData
In case you want only the portalUrl and pureID of the first element of "item" array, then all you need is:
Write responseData.items.%Get(0).portalUrl
Write responseData.items.%Get(0).pureID
You case is simpler, you do know the json structure and all you need is to iterate the "items" array and find all the portalUrl and pureID properties. Note that since there can be many "items", there may be many portalUrl and pureID.
Set itr=responseData.items.%GetIterator()
while itr.%GetNext(.key, .value) {
Write value.portalUrl,!
Write value.pureID,!
}
P.S.: it's unlikely that the Response you get from a REST call is a %DynamicAbstractObject since, by definition, that's an abstract class and cannot be instantiated, what you actually get is a subclass of %DynamicAbstractObject, a %DynamicObject in this case or a %DynamicArray when the response is an array.
%Stream.DynamicBinary it's a stream that use a different storage, if you need your data in a %Stream.TmpCharacter just copy the stream using CopyFrom() method.
Both %Stream.DynamicBinary and %Stream.TmpCharacter are %StreamObject descendant, the use/have the same interface (methods) but a different storage.
If you receive "special characters, such as non-utf-8 characters either control characters or unicode characters" it means that somewhere upstream character set conversion is not properly configured/handled.
I'm not sure that removing characters from a text is a proper solution, instead I'd fix the problem from the source identifying where the character set conversion is not properly configured/handled and fixing it.
Surely after removing some characters the text can be printed and parsed by downstream systems, but....it's going to be a different text, potentially with a different meaning!
You did not provide details, so I try to guess.
You are writing a Business Operation that use the EnsLib.HTTP.OutboundAdapter, if so, double check the signature of the method SendFormDataArray() that is:
Your call is:
set tSC = ..Adapter.SendFormDataArray(.tHTTPResponse, "POST", tHTTPRequest, tURL, tPayload)
I think the passed arguments don't match the method signature.
Is it very complex to develop a new DICOM adapter that will use global streams instead?
It should not for InterSystems.
Note that the DICOM adapter/implementation in IRIS use some external ISC undocumented libraries.
It depends on use case.
In my case we use DICOM integration to orchestrate archiving of studies between AETs, so we use commands like CFIND, CMOVE etc. and never download a study.
At the moment we have 290K+ files, the biggest is 1KB.
I think that even when you download studies having the option to use global streams instead of files would be extremely useful in a mirror configuration.
Depending on the environment, having an high availability single shared directory between mirror members can be expensive from MANY point of view (resources, configuration, maintenance, backup, security, etc.).
When an async DR is in place things get even more complicated.
As it stands, using IRIS DICOM interoperability in mirror configuration it's a nightmare.
But...this is supposed to be a High Availability environment/configuration, a NAS would add a single point of failure along with the network between IRIS and NAS, there are also performance and maybe security consideration IMHO.
You edited your post after my answer 😊
Am I missing something or canonicalization does not minify the XML?
For other reasons (how data is consumed) we cannot compress it and the target property is a %String.
Maybe creating a compressed string datatype can be another option in other situations but in this case the target property/class is part of HealthShare (a Registry Slot).