Base 64 message is taking considering as a new segment

Question

Question

Hi Team,

I am converting xml message into HL7 message but the input XML message contains pdf which is converting into base 64 and getting mapped to OBX:5.5 in HL7 message and sending it to downstream

In Downstream service i am using normal HL7 TCP class EnsLib.HL7.Service.TCPService but the message looks like below i am not sure why stream is taking as another segment in HL7 message,

Any thoughts on this?

Thanks,

Smythee

Product version: Ensemble 2018.1

$ZV: Cache for Windows (x86-64) 2018.1.1 (Build 312_1_18937U) Fri Apr 26 2019 17:58:36 EDT

Discussion (15)3

Log in or sign up to continue

score 0 · Answer 1 · 2024-11-15T10:03:25-05:00

Hey Smythe.

Your Base64 has line breaks, so is breaking onto a new line which is then being read as a new line in the HL7.

Depending on what method you are using to convert the PDF to Base 64, you should have a setting to not use line breaks.

score 0 · Answer 2 · 2024-11-15T11:03:24-05:00

hi ,

this is how i am converting pdf to base 64

Set pInput.LineTerminator = $C(10)
Set tMax=$$$MaxLocalLength*.5\1
Set tMax=tMax-(tMax#57)
If $IsObject(pInput) {
$$$TRACE("pInput = object")
Set tCurrLineLen = 0
Set tStream = ##class(%Stream.FileBinary).%New()
While 'pInput.AtEnd {
$$$TRACE("Reading filestream")
Set tData = pInput.Read(tMax)
Set tValue = $SYSTEM.Encryption.Base64Encode(tData)
Set tSC = tStream.Write(tValue)
If 'pInput.AtEnd {
Set tSC = tStream.Write($C(10))
$$$TRACE("Adding terminator.")
}

score 1 · Answer 3 · 2024-11-15T12:53:26-05:00

Julian is correct, your code is inserting line breaks, remove the lines:

    If 'pInput.AtEnd {
        Set tSC = tStream.Write($C(10))
        $$$TRACE("Adding terminator.")
    }

score 0 · Answer 4 · 2024-11-15T14:15:45-05:00

So to do what you're trying to do in your DTL, add in a code block and paste in the following:

  Set CHUNKSIZE = 2097144
  Set outputStream=##class(%Stream.TmpCharacter).%New()
  Do source.EncodedPdf.Rewind()
  While ('source.EncodedPdf.AtEnd) {
    Set tReadLen=CHUNKSIZE
    Set tChunk=source.EncodedPdf.Read(.tReadLen)
    Do outputStream.Write($SYSTEM.Encryption.Base64Encode(tChunk,1))
  }
  Do outputStream.Rewind()
  Set Status = target.StoreFieldStreamRaw(outputStream,"OBXgrp(1).OBX:5.5")
  )

Yours is almost doing the same thing but, as Enrico points out with your code sample, you have the "Set tSC = tStream.Write($C(10))" line adding in the line breaks whereas my example has this excluded.

Separately, as alluded to by Scott, when adding the base 64 encoded PDF stream to the HL7, you'll want to use the StoreFieldStreamRaw method for the HL7. Trying to do a traditional set with a .Read() risks the input being truncated.

score 0 · Answer 5 · 2024-11-15T11:42:52-05:00

<if condition='source.{ORCgrp(1).OBRgrp(1).OBXgrp(k1).OBX:ValueType}="ED"' >
<true>
<assign value='source.GetFieldStreamRaw(.tStream,"ORCgrp(1).OBRgrp(1).OBXgrp("_k1_").OBX:ObservationValue(1).AlternateText",.tRemainder)' property='tSC' action='set' />
</true>
</if>
</foreach>
<if condition='..Length($get(tSC))&gt;0' >
<true>
<assign value='"1"' property='target.{OBXgrp(1).OBX:SetIDOBX}' action='set' />
<assign value='"ED"' property='target.{OBXgrp(1).OBX:ValueType}' action='set' />
<assign value='"7"' property='target.{OBXgrp(1).OBX:ObservationIdentifier.Identifier}' action='set' />
<assign value='"URL"' property='target.{OBXgrp(1).OBX:ObservationIdentifier.Text}' action='set' />
<assign value='"EXTLRR"' property='target.{OBXgrp(1).OBX:ObservationIdentifier.NameofCodingSystem}' action='set' />
<assign value='"1"' property='target.{OBXgrp(1).OBX:ObservationSubID}' action='set' />
<assign value='"PDF"' property='target.{OBXgrp(1).OBX:ObservationValue(1).Identifier}' action='set' />
<assign value='"PDF"' property='target.{OBXgrp(1).OBX:ObservationValue(1).NameofCodingSystem}' action='set' />
<assign value='"PDF"' property='target.{OBXgrp(1).OBX:ObservationValue(1).AlternateIdentifier}' action='set' />
<assign value='target.StoreFieldStreamRaw(tStream,"OBXgrp(1).OBX:ObservationValue(1).AlternateText",tRemainder)' property='tSC' action='set' />
<assign value='"F"' property='$P(tRemainder,"|",11)' action='set' />
</true>
</if>

This is an example of what we pretty much do for any system that sends us a Base64 encoded PDF that we have to reformat to send to Epic EMR.

score 0 · Answer 6 · 2024-11-15T12:20:19-05:00

My transformation is pretty much simple actually

how do i avoid line breaks

score 1 · Answer 7 · 2024-11-15T12:23:43-05:00

you need to convert the Base64 to a Stream to put into OBX:5.5.

source.GetFieldStreamRaw(.tStream,"ORCgrp(1).OBRgrp(1).OBXgrp("_k1_").OBX:ObservationValue(1).AlternateText",.tRemainder)'

score 0 · Answer 8 · 2024-11-16T09:41:08-05:00

Smythe Smythee · Nov 16

ok thank you for help

0 0

score 0 · Answer 9 · 2024-11-16T12:36:15-05:00

Scott Roth · Nov 16

If line feed and carriage returns still are problematic look into using $ZSTRIP

0 0

score 0 · Answer 10 · 2024-11-17T11:02:00-05:00

Smythe Smythee · Nov 17

just and example what i am getting at the end of every line

0 0

score 0 · Answer 11 · 2024-11-17T11:14:20-05:00

Smythe Smythee · Nov 17

screenshot of base64 converted stream which has CRLF at the end

0 0

score 0 · Answer 12 · 2024-11-17T13:12:21-05:00

Scott Roth · Nov 17

I would suggest that you follow up with WRC, as I never seen that issue before.

0 0

score 0 · Answer 13 · 2024-11-17T13:15:52-05:00

Enrico Parisi · Nov 17

How did you converted the stream to base64?

0 0

score 0 · Answer 14 · 2024-11-18T04:59:01-05:00

In Service class(by using record map as input) i am converting pdf to base 64 using below code and the same source.encodedpdf is getting converted to HL7 in data transformation

Set pInput.LineTerminator = $C(10)
Set tMax=$$$MaxLocalLength*.5\1
Set tMax=tMax-(tMax#57)
If $IsObject(pInput) {
$$$TRACE("pInput = object")
Set tCurrLineLen = 0
Set tStream = ##class(%Stream.FileBinary).%New()
While 'pInput.AtEnd {
$$$TRACE("Reading filestream")
Set tData = pInput.Read(tMax)
Set tValue = $SYSTEM.Encryption.Base64Encode(tData)
Set tSC = tStream.Write(tValue)
If 'pInput.AtEnd {
Set tSC = tStream.Write($C(10))
$$$TRACE("Adding terminator.")
}

score 0 · Answer 15 · 2024-11-18T06:44:56-05:00

Please look here for the solution: https://community.intersystems.com/post/base-64-message-taking-consideri...