go to post Alexey Maslov · Apr 1, 2017 Thanks for taking part, Eduard. According to this record: 2017-03-31 19:24:51 0 : USER1 is ready to be configured using USER1 and %DB_%DEFAULT MainDB was neither undefined nor empty. My post was mainly about %Installer's usage; doesn't it use transactions internally by itself? I didn't notice any transaction tags in it's language definition. As to the log level, my other scripts (not this one) are intended to be used during Cache installation. I don't know how to adjust the log level in this case, therefore I used to deliberately set it equal to "0" to be sure that my debug messages will be logged; having been finished with debugging, I just change all Level="0" to Level="3"
go to post Alexey Maslov · Mar 31, 2017 I've got into another issue trying to write a code which should configure some global mapping to already existing namespace. Here is its skeleton: Include %occInclude /// Create simple global mapping (main DB and cachetemp only) Class %z.Mapping Extends %Library.RegisteredObject { /// Application Definition XData qMS [ XMLNamespace = INSTALLER ] { <Manifest> <If Condition='$L("${NAMESPACE}")=0'> <!-- Report an error if the namespace wasn't specified --> <Error Status="$$$NamespaceDoesNotExist"> <Arg Value="${NAMESPACE}"/> </Error> </If> <If Condition='$zcvt("${NAMESPACE}","U")="%SYS"'> <!-- Report an error if the namespace = %SYS --> <Error Status="$$$GeneralError"> <Arg Value="${NAMESPACE} should not be %SYS"/> </Error> </If> <Invoke Class="%z.Mapping" Method="GetMainDB" CheckStatus="0" Return="MainDB" > <Arg Value="${NAMESPACE}"/> </Invoke> <If Condition='$L("${MainDB}")=0'> <!-- Report an error if the globals database was not detected --> <Error Status="$$$GeneralError"> <Arg Value="${NAMESPACE} has no Globals database" /> </Error> </If> <Var Name="DBRESOURCE" Value="%DB_%DEFAULT"/> <Namespace Name="${NAMESPACE}" Create="no" > <Log Level="0" Text="${NAMESPACE} is ready to be configured using ${MainDB} and ${DBRESOURCE}" /> <Configuration> <!-- ??? Configure the database that should exist upto this step --> <Database Name="${MainDB}" Dir="${MainDB}" Create="no" Resource="${DBRESOURCE}" PublicPermissions="" /> <!-- ??? Configure the database that should exist upto this step --> <GlobalMapping Global="Q("0!"):(END)" From="CACHETEMP"/> <GlobalMapping Global="Q("0mseSTATUS"):("0mseSTATUS~")" From="${MainDB}"/> <GlobalMapping Global="Qa" From="CACHETEMP"/> <GlobalMapping Global="Qi" From="CACHETEMP"/> <GlobalMapping Global="Qi("MO")" From="${MainDB}"/> </Configuration> </Namespace> </Manifest> } /// This is a method generator whose code is generated by XGL. ClassMethod setup(ByRef pVars, pLogLevel As %Integer, pInstaller As %Installer.Installer, pLogger As %Installer.AbstractLogger) As %Status [ CodeMode = objectgenerator, Internal ] { #; Let our XGL document generate code for this method. Quit ##class(%Installer.Manifest).%Generate(%compiledclass, %code, "qMS") } ClassMethod GetMainDB(pNamespace) As %String { new $namespace s $namespace="%SYS" s sc=##class(Config.Namespaces).Get(pNamespace,.p) if 'sc d $system.OBJ.DisplayError(sc) set ret="" g gmdbq s ret=p("Globals") gmdbq quit ret } /// Invoke the installer passing in some variables /// zn "USER1" s sc=$system.OBJ.Load("mapping.xml","ck") d:'sc $system.Status.DisplayError(sc) /// s sc=##class(%z.Mapping).RunInstallWithLog($zu(12)_"mapping.log",2) d:'sc $system.Status.DisplayError(sc) /// ClassMethod RunInstallWithLog(pLogfile As %String, pLogLevel = 1) As %Status { #dim tVars #dim tStatus As %Status Set tVars("NAMESPACE") = $zu(5) // Construct a file logger #dim tLogger As %Installer.FileLogger = ##class(%Installer.FileLogger).%New(1,pLogfile) // Invoke the installer Set tStatus = ..setup(.tVars,pLogLevel,,tLogger) Do:$$$ISERR(tStatus) $system.OBJ.DisplayError(tStatus) Quit tStatus } } I've started it at the same Cache instance where I wrote it with following commands: zn "USER1" s sc=##class(%z.Mapping).RunInstallWithLog($zu(12)_"mapping.log",2) d:'sc $system.Status.DisplayError(sc) And it works. But if I'm excluding an [unneeded] code fragment that resides between two lines: <!-- ??? Configure the database that should exist upto this step --> I'm getting several errors, please see below. Why this fragment is still needed nevertheless I marked my namespace with Create="no" attribute? 2017-03-31 19:24:51 0 %z.Mapping: Installation starting at 2017-03-31 19:24:51, LogLevel=2 2017-03-31 19:24:51 0 : USER1 is ready to be configured using USER1 and %DB_%DEFAULT 2017-03-31 19:24:51 1 CreateNamespace: Creating namespace USER1 using / 2017-03-31 19:24:51 2 CreateNamespace: Modifying namespace USER1 2017-03-31 19:24:51 0 %z.Mapping: ERROR #5002: Cache error: <SUBSCRIPT>%LoadData+6^Config.Databases.1 ^SYS("CONFIG","CACHE","Databases","") ERROR #5659: Property 'Config.Namespaces::Globals(3@Config.Namespaces,ID=CACHE||Namespaces||USER1)' required ERROR #7202: Datatype value '' length less than MINLEN allowed of 1 ERROR #5659: Property 'Config.Namespaces::Routines(3@Config.Namespaces,ID=CACHE||Namespaces||USER1)' required ERROR #7202: Datatype value '' length less than MINLEN allowed of 1 2017-03-31 19:24:51 0 %z.Mapping: ERROR #ConfigFailed: Unknown status code: <Ins>ConfigFailed (,,,,,,,) > ERROR #5002: Cache error: <SUBSCRIPT>%LoadData+6^Config.Databases.1 ^SYS("CONFIG","CACHE","Databases","") > ERROR #5659: Property 'Config.Namespaces::Globals(3@Config.Namespaces,ID=CACHE||Namespaces||USER1)' required > ERROR #7202: Datatype value '' length less than MINLEN allowed of 1 > ERROR #5659: Property 'Config.Namespaces::Routines(3@Config.Namespaces,ID=CACHE||Namespaces||USER1)' required > ERROR #7202: Datatype value '' length less than MINLEN allowed of 1 2017-03-31 19:24:51 0 %z.Mapping: Installation failed at 2017-03-31 19:24:51 2017-03-31 19:24:51 0 %Installer: Elapsed time .178622s
go to post Alexey Maslov · Mar 28, 2017 Timothy, Both options succeded. Thank you so much! Just FYI, your 1st option <Var Name="AddClassesErrors" Value="",5202,5373,"" /> generated a code: Do tInstaller.SetVariable("AddClassesErrors",""",5202,5373,""") and the 2nd one <Var Name="AddClassesErrors" Value="#{"5202,5373"}" /> generated: Do tInstaller.SetVariable("AddClassesErrors",tInstaller.Evaluate("#{""5202,5373""}"))
go to post Alexey Maslov · Mar 28, 2017 Timothy, Both options succeded. Thank you so much! Just FYI, your 1st option <Var Name="AddClassesErrors" Value="",5202,5373,"" /> generated a code: Do tInstaller.SetVariable("AddClassesErrors",""",5202,5373,""") and the 2nd one <Var Name="AddClassesErrors" Value="#{"5202,5373"}" /> generated: Do tInstaller.SetVariable("AddClassesErrors",tInstaller.Evaluate("#{""5202,5373""}"))
go to post Alexey Maslov · Mar 28, 2017 Hi Timothy and Sergey, Timothy, putting the literal codes list inside a variable doesn't help much: I'm getting the same error. Thank you anyway. P.S. The reason of the issue is a wrong code for variable evaluation, e.g. <Var Name="AddClassesErrors" Value="5202,5373" /> is transformed to Do tInstaller.SetVariable("AddClassesErrors","5202","5373")
go to post Alexey Maslov · Mar 22, 2017 Luca,It was clear that we can use VMs from the very beginning of the project, and maybe we'll take this approach at last. I've just looked at the Docker's side willing to search more light/reliable alternative.Thank you again.
go to post Alexey Maslov · Mar 22, 2017 Thanks, Dmitry and Luca.Meanwhile I read some docs and interviewed colleagues who had more experience with Docker than me (while w/o Caché inside). What I've got out of it: Docker doesn't fit well to this very case of mine, which is mostly associated with deployment of already developed app rather than with new development. The reasons are:- Only one containerized app at the client's server (our case) doesn't mean so many benefits as if it would be several ones;- Windows issues which Luca already mentioned;- I completely agree that "data should reside on a host volume..." with only one remark: most likely that all this stuff will be maintained at the client's site by not very well skilled IT personal. It seems that in case of Doker/host volume/etc its configuring will be more complex than rolling up Cache for Windows installation with all possible settings prepared by %Installer based class.
go to post Alexey Maslov · Mar 15, 2017 AFAIK, docker encourages to implement microservices. What about classic Cache based app deployment, can docker be useful in this case? By classic I mean the system accessible via several services (ActiveX, TCP sockets, SOAP and REST), multi-tasking, etc with initial 1-2 GB database inside. At the moment I'm to choose a solution to roll up several dozen of rather small systems of such kind. Should I look at docker technology in this very case?I am bound to ver. 2015.1.4. Host OS most likely will be Windows 2008/2012, while I'd prefer to deploy our system on Linux, that's why I am searching a light solution how to virtualize or containerize it. Thank you!
go to post Alexey Maslov · Mar 6, 2017 Several years ago our company (SP.ARM) had developed Krasnoyarsk Kray Regional HIS, which was finally deployed using haproxy to balance CacheActiveX traffic load among 7 ECP application servers. This kind of traffic is based on the same protocol as ODBC, so the behavior should be quite the same (long sessions via 1972/tcp). To achieve high availability of the proxy server, it was deployed in two similar copies connected with ucarp.Our initial solution for load balancing and high availability of proxy was based on LVS+keepalived, but the engineers of maintainer company (Rostelecom) prefered to use haproxy+ucarp as they felt themselves more comfortable with them; we didn't mind.
go to post Alexey Maslov · Mar 5, 2017 Hi Michael,Using Studio's keyboard heavily, I can add to your list:Shift-F2 - jump to previous bookmarkF6, Shift-F6 - switch to next and previous opened routine/class windowCtrl-F7 - compile current routine/classF7 - [re]compile the whole projectCtrl-F9, F9, Shift-F9 - deal with break points (similar logic as with bookmarks)Ctrl-E, Ctrl-Shift-E - switch to full commands/functions names, switch back to shortcutsCtrl-Shift-O - open projectCtrl-O - open routine/class/etc.P.S. Have not tried Atelier yet.
go to post Alexey Maslov · Feb 22, 2017 Mark, may I ask your for some clarification? You wrote:As a result THP are not used for shared memory, and are only used for each individual process. What's a problem here? Shared memory can use "normal" huge pages, meanwhile individual processes - THP. The memory layout on our developers' serber shows that it's possible.# uname -aLinux ubtst 4.4.0-59-generic #80-Ubuntu SMP Fri Jan 6 17:47:47 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux# cat /sys/kernel/mm/transparent_hugepage/enabled[always] madvise never# tail -11 /proc/meminfoAnonHugePages: 131072 kBCmaTotal: 0 kBCmaFree: 0 kBHugePages_Total: 1890HugePages_Free: 1546HugePages_Rsvd: 898HugePages_Surp: 0Hugepagesize: 2048 kBDirectMap4k: 243808 kBDirectMap2M: 19580928 kBDirectMap1G: 49283072 kB# ccontrol listConfiguration 'CACHE1' directory: /opt/cache1 versionid: 2015.1.4.803.0.16768 ...# cat /opt/cache1/mgr/cconsole.log | grep Allocated...01/27/17-16:41:57:276 (1425) 0 Allocated 1242MB shared memory using Huge Pages: 1024MB global buffers, 64MB routine buffers# grep -e AnonHugePages /proc/*/smaps | awk '{ if($2>4) print $0} ' | awk -F "/" '{print $0; system("ps -fp " $3)} '.../proc/165553/smaps:AnonHugePages: 2048 kBUID PID PPID C STIME TTY TIME CMDcacheusr 165553 1524 0 фев07 ? 00:00:00 cache -s/opt/cache1/mgr -cj -p18 SuperServer^%SYS.SERVER...
go to post Alexey Maslov · Feb 14, 2017 Just to complete an exercise: --- inst-guid.sh --- #!/bin/bash csession CACHE <<EOF | grep -E [0-9A-F\-]{36} write ##class(%SYS.System).InstanceGUID() halt EOF -------------------- $ ./inst-guid.sh 8BCD407E-EE5E-11E4-B9C2-2EAEB3D6024F $
go to post Alexey Maslov · Feb 14, 2017 You can get an output from a Caché routine provided it do some output to its principal device (= stdout), e.g. (approach #1): $ csession CACHE "##class(%SYSTEM.License).CKEY()" Cache Key display: Based on the active key file '/vol/cachesys/mgr/cache.key' LicenseCapacity = Cache 2017.1 Enterpriser - Concurrent Users:1000000, Anything You Need CustomerName = ZAO XX.XXX OrderNumber = 9876543210 ExpirationDate = 10/15/2114 AuthorizationKey = 3141592653592718281828662607004081 MachineID = currently available = 9997 minimum available = 97 maximum available = 1000000 $ as there is no way to pass an arbitrary text from COS routine to OS directly. To bypass it, just incorporate into your shell script a calling sequence like this (approach #2): #!/bin/bash csession CACHE <<EOF >output.txt write ##class(%SYS.System).InstanceGUID() halt EOF After calling it, you will get output.txt like this: Node: tdb01.xxxxx.com, Instance: CACHE USER> 8BCD407E-EE5E-11E4-B9C2-2EAEB3D6024F USER> (Missing 'halt' command causes an error). All you have to do is to parse an output. To avoid this, you may want to write a small wrapper in COS that will provide an output as you need it, than you'll be able to follow an approach #1. HTH.
go to post Alexey Maslov · Feb 7, 2017 Isn't it O(k) for PATRICIA tries, where k is an average key length?E.g., see https://en.wikipedia.org/wiki/Radix_tree#Comparison_to_other_data_struct...
go to post Alexey Maslov · Feb 3, 2017 Thank you, Timur and other CPM contributors, you are doing the great job.Freedom and independence are 2 greatest values which you can not buy for money. And you should keep it as long as possible.This great slogan should be set in stone and cast in steel! Meanwhile, your (potential) target audience could be wider prefer you building FOSS product keeping proprietary COS/Caché features usage minimized and localized as much as possible.While we at SP.ARM would hardly drop our home-brewed PM as it is pretty well integrated with our flagship product (qMS), personally I appreciate emerging of CPM and wonder why it is not CMPM?
go to post Alexey Maslov · Jan 31, 2017 If you are able to do it on Primary, it would be possible to write a line of code which sets the appropriate SQL Table privileges and insert it into ^ZMIRROR routine under NotifyBecomePrimary entry point (see http://docs.intersystems.com/latest/csp/docbook/DocBook.UI.Page.cls?KEY=...).
go to post Alexey Maslov · Jan 27, 2017 You may also want to try Monitoring for Disconnect Mode (D mode)(http://docs.intersystems.com/latest/csp/docbook/DocBook.UI.Page.cls?KEY=...).This mode prevents a Caché process from silent halting on disconnect, which occurs by default when the socket device is the process $principal. D mode garranties that process's error trap code will handle <DISCONNECT> errors anyway.
go to post Alexey Maslov · Jan 26, 2017 Class methods calls "decorating" with macros seems to be possible using #def1arg macros.But how to automate the substutitution of all flavors of an instance method calls to macros in a real world project? The method calls may use different <oref> variables in different parts of a project, or even use ".." or $this: set res=oref.Method1(x,y,.z) do Ref.Method1(x,y) if ..Method1(x,,.z) { ... } set a=$this.Method1(x,y)So we need to define a macro with at least two arguments: 1) for oref, 2) for all other method's arguments. Having no variable macro arguments list, how to achieve it?Note: we discussed direct calls only; taking in account $method() and indirection (@, Xecute), the situation would be even worse.
go to post Alexey Maslov · Jan 25, 2017 Dynamic dispatch is a hit on speed anyway.Sounds like yet another reason not to use it in production code.Macros can help in many cases but using $method() and other flavors of indirect method calls.
go to post Alexey Maslov · Jan 25, 2017 Dynamic dispatch is a hit on speed anyway.Sounds like yet another reason not to use it in production code.Macros can help in many cases but using $method() and other flavors of indirect method calls.