Article Yuri Marx · Dec 23, 2020 6m read

Web Crawling is a technique used to extract root and related content (HTML, Videos, Images, etc.) from websites to your local disk. This is allows you apply NLP to analyze the content and get important insights. This article detail how to do web crawling and NLP.

To do web crawling you can choose a tool in Java or Python. In my case I'm using Crawler4J. (https://github.com/yasserg/crawler4j).

Crawler4j is an open source web crawler for Java which provides a simple interface for crawling the Web. Using it, you can setup a multi-threaded web crawler in few minutes.

After create your Java project,

0
1 940
Article Yuri Marx · Dec 22, 2020 1m read

Hi community, I used website-analyzer - an app that uses InterSystems NLP and Crawler4J to extract all website content and do NLP on it. I limited to 200 pages and discovered this:

Top 10 Concepts - business and content topics in the InterSystems site:

 

Other frequency concepts, see the focus in the iris speed, scale and data value:

 

Top 10 Concept Dominance - business relations in the InterSystems site. See the InterSystems slogans ("first data platform", "intersystems data platform" and "healthcare data platform")

 

See the related concepts - the marketing message is: "customer choice",

0
2 294
Question Ahmad Bukhtiar · Nov 22, 2020

If I have table of 60 fields is there a way to add values to columns dynamically ?

Fields are like this Field1, Field2, Field3...Field60 and I am reading data from flat files. I tried below code but it didn’t work

For i=2:1:$LENGTH(line) {

set SourceTable.Field_i = $PIECE(line, "|", i)
 

3
0 707
Announcement Olga Zavrazhnova · Dec 22, 2020

Hi Developers!

Our Developer Community is growing - so great that it's now available in English, Spanish, Portuguese, Japanese and Chinese languages. And it's important to announce that no matter on which DC language version you publish posts and comments - they all are counted on Global Masters Advocate Hub! 

Let's see the number of points you get  on Global Masters for your contribution: 

Points for contribution to Developer Community

Write a post on Developer Community (EN)
Write a post on Developer Community (ES / PT / JP / CN / FR
)

100
200

Publish comment on Developer Community (EN)
Publish comment on Developer Community (ES / PT / JP / CN / FR
)

30
60

Your 1st answer marked as accepted / each next accepted answer

1 000 / 150

Translate a post to ES / PT / JP / CHN / CN

50

0
0 188
Question Anna Golitsyna · Dec 11, 2020

I am trying to send email via smtp.gmail.com.

  • I am using an object of %Net.SMTP to do so.
  • I am giving it an object of class %Net.Authenticator to provide credentials to the gmail server.
  • I am not encoding the user name or password.
  • I have set the UseSTARTTLS property to 1
  • I have set the SSLConfiguration property to “API”
  • Since I am using TLS, I have set the port to be 587
  • I am using an object of %Net.MailMessage for the message
  • I am passing it to the Send method of the %Net.SMTP object to send the msg.
  • I get the following error: ERROR #6033: Error response to SMTP MAIL FROM: 530
3
0 837
Question Scott Roth · Dec 7, 2020

I have a case where I need to look up the NPI provider against an External MS SQL database to retrieve our Provider Identifier to send to a downstream system. In the past I would use a Business Process (BPL) to connect to the outside MS SQL via JDBC and get that information for me. But I was thinking instead of creating a BPL process to do this, would it be better just to link to the outside MS SQL database table to retrieve the information in a SQL statement within a DTL?

So it is better to link to an outside database via a Linked Table wizard?

3
0 389
Question Yuri Marx · Dec 5, 2020

Languages like Java and C++ allows to develop a multi-threaded program with two or more parts that can run concurrently and each part can handle a different task at the same time making optimal use of the available resources specially when your computer has multiple CPUs. Is it possible In ObjectScript? If yes, Where I can get a good sample or application?

5
0 1023
Article sween · Dec 18, 2020 4m read

image

Table of Contents

  1. Hello Newman
    </li>
    
  2. Built With
  3. Getting Started
  4. Usage
  5. Acknowledgements

Hello Newman

So given the STAR method on how to introduce Newman with this effort, here it goes.

SITUATION

We are facing a Production implementation of a FHIRIS® Resource Server, fronted with a robust API Manager, Web Gateways for speed and availability, though not entirely relevant, the implementation is on Public Cloud, namely, Amazon

0
1 654
Question Henrique Dias · Dec 16, 2020

Hi everyone, 

I'm creating something to test the Analytics capabilities. 

I have a table with 100k records. Consulting the data using ^%G or SELECT, everything is working fine. 

But, when I create a Cube using this same class as Source, the Build results in only 1 fact.

I would like to know if anyone else faces the same situation before and have some guidance. 

Some details:

Class diashenrique.olist.data.order Extends %Persistent
{

Property customerID As diashenrique.olist.data.customer;

Property orderStatus As %String;

Property purchaseTimeStamp As %TimeStamp;

Property
6
0 331
Question Vitaly Furman · Dec 14, 2020

Hello,

We are working with a vendor who only accepts JSON as payload. We are currently still on Cache/HealthShare, not IRIS. Since we have to send Continuity of Care Documents, this raises issues with Long Strings (some CCDs can be quite large and in addition to that, they have to be b64-encoded which increases their size even more).

My question is: if we were to go on IRIS and use %JSON.Adapter, storing the encoded Stream in an object's Stream property, would calling %JSONExport() on this object produce the desired JSON? Or would we have to call %JSONExportToStream()?

We need the answer in

3
0 889
Question George Varghese · Sep 15, 2020

We are trying to make a document query from an HIE iti-43 on healthshare platform

the full SOAP message is follows

<?xml version="1.0" encoding="UTF-8"?>
<soap:Envelope xmlns:soap="http://www.w3.org/2003/05/soap-envelope" xmlns:wsa="http://www.w3.org/2005/08/addressing">
<soap:Header>
<wsa:To soap:mustUnderstand="1">XXXXXX</wsa:To>
<wsa:MessageID>4748c3e1-0cfe-4a0e-0888-4126ff66d183</wsa:MessageID>
<wsa:Action soap:mustUnderstand="1">urn:ihe:iti:2007:RetrieveDocumentSet</wsa:Action>
</soap:Header>
<soap:Body>
<RetrieveDocumentSetRequest xmlns="urn:ihe:iti:xds-b:2007">
<DocumentRequest>
<RepositoryUniqueId

3
0 409
Question Duncan Priest · Aug 9, 2019

Hi

I've had a play with the Docker image for IRIS Community Edition, but was disappointed to find that it seems to lack any of the HL7 v2 features that I'm familiar with in Ensemble/HealthShare.Is there another image with these features enabled (IRIS for Health Community Edition perhaps?) or is there any plan to make such a Docker image available?

7
0 871
Question Kurt Hofman · Dec 15, 2020

Hello,

I'm testing IRIS 2020.4 Preview with preview key.

I've access to the management portal but I can't connect with Studio.

This is my docker-command : docker run --name my-iris --detach --publish 9091:51773 --publish 9092:52773 --volume C:\Docker\iris_external:/external –-volume C:\Docker\iris_durable:/durable –-env ISC_DATA_DIRECTORY=/durable/irissys containers.intersystems.com/intersystems/iris:2020.4.0.524.0 --key /external/iris.key --password-file /external/password.txt

I notice that Caché Direct is disabled by the license.

Can someone help me out ?

2
0 483
Question MARK PONGONIS · Dec 15, 2020

Anyone know if it's possible using cache objectscript (or something else maybe) to reference an object property using a variable? For example:

s obj={}

s obj.prop1="hello"

s var="prop1"

w obj.var    <== which would result in a reference to obj.prop1 and write out "hello"

7
0 428
Question Scott Roth · Oct 19, 2017

We are trying to convert some of our SQL Service Integration Service jobs from Visual Studio to Ensemble. If we execute a Stored Procedure within SQL Server Management Studio it is returning approx 12,000 rows. However when Ensemble executes the same Stored Procedure it is only returning 250 rows.

Is there a limitation to EnsLib.SQL.Snapshot?

This is how we are calling the Stored procedure

Method uspInterfaceEnsSelectPER355MC(pRequest As osuwmc.SSIS.DataStructures.InputPER355MC, Output pResponse As EnsLib.SQL.Snapshot) As %Status
{
Set SPQuery = "{ ?= call dbo.usp_Interface_Ens_Select_PER355MC()}"

4
0 1001
Announcement Anastasia Dyubaylo · Dec 7, 2020

🏆 Create an innovative service for Krasnaya Polyana IT cluster participants and locals! 🏆

Steford group together with the Polyana IT community with the support of InterSystems Corporation invite you to join Polyana App 2020 Hackathon!

If you are suddenly now in Krasnaya Polyana, Sochi, Russia and want to share your ideas, your IT & business energy, come, participate, suggest and cheer for the teams on December 12-13 at the Steford coworking space. Or participate online!

Create the most helpful service for local IT infrastructure, business, and citizens and get the first prize of $1,400 and the opportunity to participate in the InterSystems track of MIT Grand Hack 2021

More details in English can be found here.

➡️ Visit the official landing page in Russian.

2
0 286