Clear filter
Announcement
Anastasia Dyubaylo · Feb 18, 2020
Hi Community,
The new video from Global Summit 2019 is already on InterSystems Developers YouTube:
⏯ InterSystems IRIS on HCI
HCI, or hyper-converged infrastructure, is a software-defined IT infrastructure that virtualizes all the elements of a conventional system. This video will show the benefits and limitations of deploying an InterSystems IRIS-based application on HCI.
Takeaway: You will gain an understanding of HCI, and learn where and when it may be useful.
Presenter: @Murray.Oldfield, Technology Architect, InterSystems
Additional materials to this video you can find in this InterSystems Online Learning Course.
Enjoy watching this video! 👍🏼
Article
Anton Umnikov · Oct 17, 2019
October 17, 2019
Anton UmnikovSr. Cloud Solutions Architect at InterSystemsAWS CSAA, GCP CACE
AWS Glue is a fully managed ETL (extract, transform, and load) service that makes it simple and cost-effective to categorize your data, clean it, enrich it, and move it reliably between various data stores.
In the case of InterSystems IRIS, AWS Glue allows moving large amounts of data from both Cloud and on-Prem data sources into IRIS. Potential data sources include, but not limited to on-Pem databases, CSV, JSON, Parquet and Avro files residing in S3 buckets, Cloud-native databases such as AWS Redshift and Aurora and many others.
This article assumes that you have the basic familiarity with AWS Glue, at least at the level of completing AWS Glue Getting Started tutorials. We will concentrate on the technical aspects of configuring AWS Glue Jobs to use InterSystems IRIS as a Data Target, or in other terms - "data sink".
Image from https://docs.aws.amazon.com/glue/latest/dg/components-key-concepts.html
AWS Glue Jobs are run in a "Serverless" manner. All the resources, required for performing the job are dynamically provisioned by AWS only for the time the job is actually running and immediately destroyed the moment the job is completed, so instead of provisioning, managing and incurring ongoing costs for the required infrastructure you are being billed only for the time job is actually running and spend you efforts only on writing the Job code. At the "idle" time - no resources are consumed, other than S3 buckets, storing the job code and configuration.
While multiple options are available, typically Glue Jobs are executed on dynamically provisioned Apache Spark and written in PySpark code. Glue Job contains the "Extract" portion, where data is being extracted from data sources, series of "Transformations", build using Glue API and finally the "Load" or "sink" part, where after final transformation data is being written to the target system.
In order to enable AWS Glue to interact with IRIS we need to ensure the following:
Glue has network access to the IRIS instances involved
IRIS JDBC driver JAR file is accessible to the Glue Job
Glue Job is using API, compatible with InterSystems IRIS JDBC
Let's examine each of the required steps.
Create IRIS Connection
In AWS Console select AWS Glue->Connections->Add Connection
Enter the name of your connection and select "JDBC" for Connection Type.
In JDBC URL enter JDBC connection string for your IRIS instance, username and password information.
The next step is crucial - you need to make sure that Glue places its endpoints into the same VPC as your IRIS instance. Select VPC and Subnet of your IRIS instance. Any security group with a self-referencing inbound rule for all TCP ports would do here. For instance - your IRIS Instance security group.
IAM Role with access to JDBC driver
If you haven't done it already - upload IRIS JDBC driver JAR file intersystems-jdbc-3.0.0.jar into S3 bucket. In this example, I'm using s3://irisdistr bucket. It would be different for your account.
You need to create IAM Role for your Glue Job, that can access that file, along with other S3 buckets that Glue would use to store scripts, logs etc.
Make sure it has the read access to the bucket of your JDBC driver. In this case, we granting this role (GlueJobRole) ReadOnly access to all buckets, along with predefined AWSGlueServiceRole. You might choose to further limit this role permissions.
Create and configure Glue Job
Create a new Glue Job. Select IAM Role, we created in the previous step. Leave everything else default.
Under "Security configuration, script libraries, and job parameters (optional)" set "Dependent jars path" to the location of the intersystems-jdbc-3.0.0.jar in the S3 bucket.
For Source - use one of your pre-existing data sources. If you followed tutorials, referenced above you'll have at least one already.
Use "Create tables in your data target" option and select IRIS connection you've created in the previos step. Leave everything else default.
If you followed us up until now you should arrive at the screen similar to this:
Almost there!!! We just need to make one simple change to the script in order to load data into IRIS.
Adjusting the script
The script that Glue generated for us uses AWS Glue Dynamic Frame - AWS proprietary extension to Spark. While it provides some benefits for ETL jobs it also ensures that you can't write data to any database that AWS don't have managed service offering for.
Good news - at the point of writing the data to the database all the benefits of Dynamic Dataframe such as no schema enforcement for "dirty" data are not required anymore (at the point of writing data is presumed to be "clean") and we can easily convert Dynamic Dataframe to Spark native Dataframe that is not limited to AWS managed targets and can work with IRIS.
So the line we need to change is line #40 on the picture above. One before last.
Here is the change we need to make:
#datasink4 = glueContext.write_dynamic_frame.from_jdbc_conf(frame = dropnullfields3, catalog_connection = "IRIS1", connection_options = {"dbtable": "elb_logs", "database": "USER"}, transformation_ctx = "datasink4")
dropnullfields3.toDF().write \
.format("jdbc") \
.option("url", "jdbc:IRIS://172.30.0.196:51773/USER/") \
.option("dbtable", "orders") \
.option("user", irisUsername) \
.option("password", irisPassword) \
.option("isolationlevel","NONE") \
.save()
Where irisUsername and irisPassword are the username and passwords for your IRIS JDBC connection.
Note: storing passwords in the source code is a big No No! We'll encourage you to use tools like AWS Secrets Manager for that, but going into this level of the security details is beyond the scope of this article. Here is the good article on using AWS Secrets Manager with AWS Glue.
Now hit "Run Job" button, sit back and relax while AWS Glue is doing ETL for you.
Well... more than likely you'll hit some errors at first... We all know how it works. A typo here, a wrong port in security group there... AWS Glue uses CloudWhatch to store all the execution and error logs. Browse /aws-glue/jobs/error and /aws-glue/jobs/output log groups to identify what went wrong.
Happy ETLing in the cloud!
-Anton
💡 This article is considered as InterSystems Data Platform Best Practice.
Announcement
Paul Lilienfeld · Nov 18, 2019
Good Morning-
I am currently looking for a Cache ObjectScript Developer. Please see job description below. If you are interested please send an email to paul.lilienfeld@libertyits.com
Required Qualifications:Bachelor s degree in Computer Science, Business Administration, Management Information Systems, Computer Engineering or equivalent experience/trainingWorking knowledge of programming languages3+ years of experience developing and supporting mainframe applications in a collaborative environment that includes business experts and other software developersDemonstrated desire and ability to make meaningful contributions in a team environmentPreferred Qualifications:Experience with MUMPS/Cache Object Script, which is the primary coding language for our Cache database Experience with MySQL would also be a plusShadow server configuration knowledgeECP, DCP, Cache database configuration and troubleshooting
Announcement
Olga Zavrazhnova · Dec 29, 2019
Hi Community!
Thank you so much for being with InterSystems Developer Community yet another year!
We want to know how helpful the Developer Community is for you today.
Could you please go through this short survey which will let us know what do you think and what could be improved.➡️ Developer Community Survey 2019 (4 min)
We wish you a Merry Christmas and a Happy New Year! ✨
Sincerely,
Your InterSystems Developer Community Team
Article
Evgeny Shvarov · Jan 9, 2020
Hi Developers!
Recently we updated the design of Open Exchange and I want to describe how you can find the solutions you are interested in.
Applications Catalog
The first thing you see is the catalog of published applications, tools, and solutions.
The number of applications shows you how many are published or/and fit your query.
You can find the solution you are looking for with the following set of Categories, Products or Industries:
Or you can just search for the tool you are looking for. E.g. let's find applications which help to work with "Python":
Application
The application page shows the Name, version, description, author, publisher (if any), release date, repository, documentation, license, and Download:
Also, it has an active Discuss button if the application has the related post on Developers Community
Every app could have release history:
And issues/tasks open for the application which you can add to a related Github repository:
All the application releases appear on the News page, where you can see the release news and links to the app and author:
You can check all the applications of a particular author. E.g. here are the apps from @Eduard.Lebedyuk:
Applications could be published on behalf of the company. Here are the companies which publish applications on Open Exchange:
And you can check all the applications published by a particular company. E.g. by George James:
This was a quick guide on InterSystems Open Exchange features. In the next article, we'll review how to publish an application on Open Exchange.
Stay tuned!
Announcement
Stefan Wittmann · Aug 5, 2019
I am happy to announce that InterSystems API Manager is now generally available. InterSystems API Manager (IAM) is a new feature of the InterSystems IRIS Data Platform™, enabling you to monitor, control and govern traffic to and from web-based APIs within your IT infrastructure.
The number of API deployments is skyrocketing across industries as more companies build service-oriented application layers. As this number grows, software environments are becoming more distributed, making it critical for API traffic to be properly governed and monitored. InterSystems API Manager provides ease of use by enabling developers to route all traffic through a centralized gateway and forward requests to the appropriate target nodes. Developers using InterSystems API Manager will also be able to:
Monitor all API traffic in a central location allowing users to identify and solve issues;
Control API traffic by throttling throughput, configuring allowable payload sizes, whitelist or blacklist IP addresses, and take endpoints into maintenance mode;
Onboard internal and external developers by providing interactive API documentation through a dedicated and customizable developer portal; and
Secure APIs in one central place.
InterSystems API Manager works with InterSystems IRIS or IRIS for Health 2019.2 and up. (Customers using 2019.2 need a new build, 2019.2.0.109.0, now available from the WRC Software Distribution Site).
In order to take advantage of IAM, partners require an InterSystems IRIS license that includes API Management capabilities. This is available free of charge but InterSystems has to issue a new key to enable the functionality.
The IAM distribution is only available in container format. It can be downloaded from the WRC Software Distribution site.
Documentation is part of the regular InterSystems IRIS documentation: InterSystems API Manager Documentation
The IAM version corresponding to this release is 0.34-1-1.
Additional resources
The official Press Release can be found here: InterSystems IRIS Data Platform 2019.2 introduces API Management capabilities
A short animated overview video: What is InterSystems API Manager
An 8-minute video walking you through some of the key highlights: Introducing InterSystems API Manager
A technical introduction on the developer community is now available: Introducing InterSystems API Manager The IAM distribution is only available in container format.Are there plans for rollouting IAM distribution to other options than container and when they will rollout? Hi Juha! Thanks for the question! What are the issues do you face with API Management with container? Hi Juha,IAM is only available in container format and we have no plans to change that at this point in time. I would like to understand the background of your question. Would you prefer a regular installer and if so, why?Thanks,Stefan Stefan,Great to hear that is is now available. Just something I was waiting for to use in my projects. I updated the announcement adding a link to the technical introduction which I just published. Enjoy! :) Can containerized IAM work with non-containerized InterSystems IRIS? Yes. The first release of InterSystems IRIS that supports IAM and is available on all platforms is 2019.1.1.
Question
Vikram Annadurai · Sep 10, 2019
Hi All,I would like to install Intersystems IRIS studio, So I went this link https://login.intersystems.com/login/SSO.UI.Login.cls?referrer=https%253A//wrc.intersystems.com/wrc/Login.cspBut I am getting the below error. So what will be the next step for me!!! please guide me........ Support should indeed help you out. What exactly are you trying to do? Are you already running an InterSystems IRIS server at your organization and you just want to install Studio to connect to it? Or are you looking to install a local evaluation copy of the data platform as well as the IDE? Note - if you're trying to do the former, you can also download and install Atelier, which is the InterSystems IDE plug-in for Eclipse:https://download.intersystems.com/download/atelier.csp Well, if you installed Eclipse 2019-06, can you still get that plug in? It seems to give me problems getting to the store. Hi Benjamin,No, I am not running an Intersystems IRIS serverI am new to Intersystems IRIS platform, So I need to know Where I can run the IRIS code and Where is the IRIS DB. And how can I find those things.(like cache studio, management portal,and so on...)Your guidance would be helpful for me.Best Vikram No. You need to use Eclipse IDE Photon R with Atelier. Got it; thanks. Vikram ... for now, I suggest that you use the opportunity to try InterSystems IRIS for free hosted in a cloud container:https://www.intersystems.com/try-intersystems-iris-for-free/Keep your eyes open for an announcement during Global Summit about another way that you can get your hands on InterSystems IRIS for evaluation purposes.Thanks!Ben Contact InterSystems Support:
https://www.intersystems.com/support-learning/support/immediate-help/ Instead of Studio, you can try to use VSCode-ObjectScript, which is available without any registration and completely for free.
Announcement
Anastasia Dyubaylo · Apr 5, 2023
Hi Community,
Watch this video to see InterSystems IRIS in action as it is applied to real-world use cases, including business 360 and real-time analytics processing:
⏯ InterSystems IRIS Live Demos @ Global Summit 2022
Presenters:
🗣 @joe.gallant, Manager, Sales Engineering, InterSystems🗣 Wei Wen Lee, Quantitative Development Engineer, Financial Services, InterSystems
Subscribe to InterSystems Developers YouTube to stay up to date!
Announcement
Anastasia Dyubaylo · Feb 28, 2023
Hey Developers,
Enjoy watching the new video on InterSystems Developers YouTube:
⏯ InterSystems Security Development Lifecycle @ Global Summit 2022
InterSystems actively partners with you to meet your security requirements. In this session, you'll learn about InterSystems approach to security and our security practices. This information will help you understand how to receive and use the information critical to developing, deploying, and operating secure applications. Beginner level.
🗣 Presenter: Mark-David McLaughlin, Principal Security Architect, InterSystems
Enjoy it and stay tuned! 👍
Announcement
Anastasia Dyubaylo · Nov 29, 2022
Hi Developers,
Enjoy watching the new video on InterSystems Developers YouTube:
⏯ Using Python with InterSystems IRIS @ Global Summit 2022
Witness all the ways you can use InterSystems IRIS with Python traditional client/server, Embedded Python, and the Python Gateway. Learn when to use each of them.
Presenters🗣 @Robert.Kuszewski, Product Manager, Developer Experience, InterSystems🗣 @Stefan.Wittmann, Product Manager, InterSystems🗣 @Raj.Singh5479, Developer Experience Product Manager, InterSystems
Enjoy it and stay tuned! 👍
Announcement
Anastasia Dyubaylo · Jan 30, 2023
Hey Developers,
It's time to announce the Top Contributors of InterSystems Developer Community for 2022 🎉
We are pleased to reward the most active contributors across all regional DC sites (EN, ES, PT, JP, CN, and FR):
Top Authors
Top Experts
Top Opinion Makers
And a new nomination ... Breakthrough of the Year!
Before we share our best of the best, we'd like to introduce a new exciting badge – Breakthrough of the Year. It is a person who started contributing this year and made the greatest contribution to the development of our Сommunity.
Let's take a closer look at the DC Wall of Fame 2022 and greet everyone with big applause! 👏🏼
Badge's Name
Winners DC
Winners InterSystems
Nomination: Breakthrough of the Year
Given to members who started contributing in 2022 and have the most posts, likes, translations, and views in 2022.
Breakthrough of 2022
@Lucas.Enard2487
@Smythe.Smythee
@Mark.OReilly
–
Nomination: InterSystems Best-selling Author
Given to authors whose articles gathered the maximum amount of views in 2022.
1st place: Gold Best-Selling Author 2022
@Yuri.Gomes
@Toshihiko.Minamoto
2nd place: Silver Best-Selling Author 2022
@Lucas.Enard2487
@Yunfei.Lei
3rd place: Bronze Best-Selling Author 2022
@姚.鑫
@Evgeny.Shvarov
4 - 10th places: Best-Selling Author 2022
@Muhammad.Waseem
@Evgeniy.Potapov
@Robert.Cemper1003
@José.Pereira
@Lorenzo.Scalese
@Irene.Mikhaylova
@Dmitry.Maslennikov
@Guillaume.Rongier7183
@Mihoko.Iijima
@Eduard.Lebedyuk
@Peng.Qiao
@Alberto.Fuentes
@Megumi.Kakechi
@Ricardo.Paiva
Nomination: InterSystems Expert
Given to authors, who got the largest number of accepted answers for 2022.
1st place: Gold Expert 2022
@Robert.Cemper1003
@Eduard.Lebedyuk
2nd place: SilverExpert 2022
@Julius.Kavay
@Yunfei.Lei
3rd place: Bronze Expert 2022
@Vitaliy.Serdtsev2149
@Alexander.Koblov
4 - 10th places: DC Expert 2022
@Dmitry.Maslennikov
@Jeffrey.Drumm
@David.Hockenbroch
@Cristiano.Silva
@John.Murray
@Yaron.Munz8173
@Julian.Matthews7786
@Vic.Sun
@Marc.Mundt
@Timothy.Leavitt
@Guillaume.Rongier7183
@Alex.Woodhead
@Benjamin.Spead
@Evgeny.Shvarov
Nomination: InterSystems Opinion Leader
Given to authors whose posts and answers scored the highest number of likes for 2022.
1st place: Gold Opinion Leader 2022
@Yuri.Gomes
@Angelo.Braga5765
2nd place: Silver Opinion Leader 2022
@Robert.Cemper1003
@Eduard.Lebedyuk
3rd place: Bronze Opinion Leader 2022
@Dmitry.Maslennikov
@Guillaume.Rongier7183
4 - 10th places: DC Opinion Leader 2022
@wang.zhe
@Muhammad.Waseem
@Lorenzo.Scalese
@姚.鑫
@Lucas.Enard2487
@Francisco.López1549
@Julius.Kavay
@Evgeny.Shvarov
@Benjamin.Spead
@Rochael.Ribeiro
@Timothy.Leavitt
@Robert.Kuszewski
@Danusa.Ferreira
@Raj.Singh5479
This list is a good reason to start following some of the great authors of the Developer Community ;)
BIG APPLAUSE TO OUR WINNERS!
Congratulations to all of you and thank you for your great contribution to the InterSystems Developer Community for 2022!
P.S. Please take part in our annual survey and help us become better:
👉🏼 InterSystems Developer Community Annual Survey 2022 👈🏼 Thanks the nominations! About Robert Cemper, he is a diamond expert for me, his contribution and apps are fundamental and fantastic to my personal learning @Yuri.Gomes, @Robert.Cemper1003
¡¡Congratulations!!
And thank you for your contribution and for sharing your knowledge and wisdow!
Congrats to all the contributors! You make the community! Thank you! My heartfelt congratulation to all the contributors! Especially to the French ones 😘 You guys rock! Thanks for all and congratulation to @Robert.Cemper1003 ... our light in our dark doubts I am especially grateful for the very active participation of @Robert.Cemper1003 in our Community :) Thank you, do we get a shiny badge for breakthrough on our profiles? Only just signed up for global masters I think badges are only awarded via Global Masters but I may be mistaken (that is where I saw my badges show up) Hi @Mark.OReilly congratulations on this great achievement!!!We award badges on Global Masters, and after that badges appear on Developer Community profiles as well.I now see your new profile on Global Masters, we will award the badge today, and it will appear within 1 day in your DC profile too :)
Announcement
Jayanth kotla · May 4, 2023
Hi,
This is Jayanth from OAK Technologies.
Hope you are all doing well!!
We have a position for InterSystems IRIS Technology Role for our client if anyone is interested, please drop your resume to jayanth@oaktechinc.com
Job Role: IRIS technology role
Location: Chicago, Illinois (Remote Work)
Contract:1+ Year W2 OR 1099 Contact
Required:
IRIS: inter system creative data technology
FHIR- based healthcare application development
Experience on IHE and any cloud Technology is Preferred.
Thanks, and regards,
Jayanth
OAK TECHNOLOGIES, Inc.
300 E Royal Lane Ste # 130, Irving, TX -75039
C: 972-777-4034
jayanth@oaktechinc.com
Announcement
Anastasia Dyubaylo · Nov 5, 2022
Hey Developers!
Watch this video to get a brief overview of the InterSystems API Manager (IAM) and a deeper dive into new features of IAM 2.3 and 2.8:
⏯ API Management with InterSystems IRIS @ Global Summit 2022
Presenters:🗣 @Stefan.Wittmann, Product Manager, InterSystems 🗣 @Robert.Kuszewski, Product Manager, Developer Experience, InterSystems
Stay tuned for the latest videos on InterSystems Developers YouTube!
Announcement
Anastasia Dyubaylo · Dec 7, 2022
Hi Developers,
Enjoy watching the new video on InterSystems Developers YouTube:
⏯ InterSystems IRIS Cloud SQL @ Global Summit 2022
Learn how to deploy a fully managed, scalable, and secure InterSystems IRIS SQL engine in the cloud in under a minute. We'll show you how to get up and running quickly through the InterSystems Cloud Portal — import your schemas and data and connect easily using InterSystems JDBC, ADO.NET, DB-API, and ODBC client drivers.
Presenters:
🗣 Richard Guidice, Senior Cloud Engineer, InterSystems🗣 @Steven.LeBlanc, Product Specialist, InterSystems
Enjoy it and stay tuned! 👍