วีดีโอ

Hi. This is not showing an IoT application like ThingWorx, it is showing an approach for custom monitoring of a ThingWorx application - by a monitoring suite like Prometheus and Grafana. Enterprise applications should have monitoring in place, and these videos help ThingWorx developers, architects and administrators to provide that for their ThingWorx solutions. Check out this video for an intro: th-cam.com/video/uEE3C4Ci08c/w-d-xo.html

Thank you for your feedback and encouragement

It is more than cool Emil... I just used the approach to slip a couple metrics into a running application to track them over time with no system stop, no configuration changes, no restarts!

Grafana is mostly used for I.T. systems monitoring, observability, etc. Some people (including myself) do use is to analyse data in the ThingWorx database(s) to correlate application data to infrastructure type metrics (files transferred, load balancer network bytes, shared file storage file ops, ...).

@@IAMGregEVA I think the visualization quality of Grafana is superior to what Thingworxx can do. Add to this the simplicity of use and convenience to lambda users

You're welcome - I'm glad that you appreciate the effort.

You want to verify the connection step-by-step: can you connect to the port? Can you authenticate the connection? Can the MQTT application layer connect? Can you exchange data? "Not allowed to connect" sounds more like an authentication problem, so I'd guess that you're stuck at that stage meaning that you need to generate a SaS token and add it to the MQTT agent client secret. That said, in 2024 I would not suggest using IoT Hub for such an industrial communication pattern. Microsoft has significantly changed their strategy and platform approach over the years having made this path an outdated option for ThingWorx industrial connectivity. Please just use our native AlwaysOn protocol for your own long-term benefit.

@@IAMGregEVA In fact the SAS token generator I used did not work so I generate the token from the CLI but I will follow your advice and use your protocol. Thanks a lot!

It depends on where you are seeing it update every 10000ms: if this is in OPC Test Client then your problem is in or before Kepware, if you are seeing correct behavior in OPC Test Client, but ThingWorx is updating every 10000ms then it is likely the Remote Property update rate which is configured in the Property Configuration (it should be 1000ms and push on change).

No, only 49320 is needed. See the command with specific port forwards in the video description, and then validate with something like netcat 'nc -zv hostname 49320' or 'telnet hostname 49320' to validate that a) port is open, b) you can hit it. I should have mentioned, first validate port is open and you can hit it from the Kepware network before attempting to validate the SSH tunnelled connection.

Yes we have (and I can share it with you if you'd like - email me at geva at ptc). I'd recommend sticking with InfluxQL mostly, and using Flux only where needed -- as InfluxDB 3 will be transitioning away from Flux.

@@IAMGregEVA thank you, I will send an email.

You bet

Hi Michael, Much appreciated. More videos certainly to come about observability for operations. I think what you want is the learning connector with the free tutorials which are kept up-to-date. learningconnector.ptc.com/search/tutorials?product=ThingWorx We still have the Mars rover trainings, but they are quite old for TWX 8.5 and have not been updated so you're best to use what is current. Prod your partner manager or sales/customer success manager to get more options.

Thanks - in full disclosure, we would most likely not use this approach for a one-off use case like this as the overhead required by Flow is significant and overkill for reading/writing to a spreadsheet. This would make more sense if many integration and orchestration workflows existed in a single solution.

@@IAMGregEVA Good to know! Thank you for that detailed response. While I have your attention, what would you recommend is the best way/resource to learn to be an end-to-end Thingsworx developer.

@@severtone263 Good question! On the job learning is the key. Get into projects, dig in, try to figure things out, ask others, test, compare results. It's the only way; there are no trainings that can provide the real experience required for such solution building. Experience and knowledge are very different but often it is forgotten to promote gathering experience. Our integrator partners think it takes about 2 years of on the job experience to be competent. I have been learning by doing for about 5 years (with ThingWorx that is).

@@IAMGregEVA Bravo! Great advice and thank you for that. I have no choice but to indulge in on-the-job training. I have been developing solutions on various platforms for my organizations and recently I was asked to pick up Thingworx (hence me bumping in your TH-cam ch that has helped a great deal). Thank you again.

Hello Alaa - Digital Transformation is an immense topic, so it is normal not to understand it all. What is important is not to confuse transformation with technology. The key to DX (transformation) is a clear strategy with well defined and measurable goals and requirements. MOST projects fail because technologists attempt to apply technology but it is not technology that solves problems. As Einstein said, if given 1 hour to solve a problem, he would use 59 minutes to understand the problem and 1 minute to solve it. Don't fall into the trap that so many do!

Hi. You can do CPU sampling with JDK Mission Control over the JMX connection. Otherwise you might look into something like Pyroscope/Grafana Phlare: grafana.com/blog/2022/11/02/announcing-grafana-phlare-oss-continuous-profiling-database/

I'm not sure what you're referring to exactly. At 10:00 the 500 limit is max threads, not bandwidth. StatefulSet combined network seen at 29:00 doesn't get up to 400 MB/s.

You're welcome! Share the knowledge! Check this out... you'll find in this building block extension the use of an Apache library which can interact with Excel files. You'll need to modify to fit your needs, but it is something that we're using internally. github.com/ptcfield-share-blocks/PTCSC.DataImport/releases/tag/v1.0.0

@@IAMGregEVA thank you greg, I cannot import PTCSC.DataImport.xml file , the error is : Export file missing version information. No migration will be performed. do you have any idea to solve this error

@@anassnasserallah9883 I don't know, likely because you need the base building block framework which you don't have. Don't worry about that however. Just extract and explore the contents of the ZIP file. You should find in there included Java libraries as well as the JavaScript code in the XML which can be taken out.

There is a link at the end of the video, I'll also add it to the description. th-cam.com/video/Fzn7Lh66Sfo/w-d-xo.html

@@IAMGregEVA Thank you. I will try to set up the same.

Yes - ThingWorx Azure IoT Hub Connector needs to be installed and working. support.ptc.com/help/thingworx/azure_connector_scm/en/

pls help me

@@nikipedia5336 Verify hostname of your IoT Hub and the port and that you can access this from the Kepware machine. It's common that I.T. blocks outbound traffic. docs.microsoft.com/en-us/azure/iot-hub/iot-hub-troubleshoot-connectivity

You are welcome! Thank you for your comment expressing that you find it useful.

Thanks for your feedback Sam

Thanks @WolfVillain. You can definitely query these metrics in various fashions as they're stored in Log Analytics. There are some included KQL pre-built queries that will give you an idea of how to get at them and present them as you're interested. What's nice about the pre-built stuff is that you don't need to know or build anything in KQL yourself (I've tried and it can be a pain if you don't know the language).

Thank you for your feedback and encouragement Rahul

Thank you @Manish - I'm glad that you find it useful.

There are some good articles explaining this... cloudsbaba.com/how-to-use-prometheus-to-monitoring-java-application/ The Java agent configuration needs to refer to the path of the JMX exporter executable, the port which it will listen on, and the configuration file. Something like this: JAVA_OPTS="$JAVA_OPTS -javaagent:/jmx_exporter/jmx_prometheus_javaagent-0.13.0.jar=19080:/jmx_exporter/tomcat.yaml"

@@IAMGregEVA Thanks for reply, but I tried this one. Just corrected directories and copied it to setenv.bat, it didn't work. Do I have to configure CATALINA_OPTS variable also, and how? I think I am so dumb :(

@@yati8522 I too struggled a lot with this sort of detail (and typically do). You're not dumb... it's part of I.T. ;-). It is possible that your setenv.bat isn't the authoritative place that you need to be setting that as it requires that bat to be run each time to hold context. Try instead to set it in a SYSTEM Environment Variable.

Anything is possible! 😁ThingWorx isn't a monitoring system however, so the way to do it would be through integration or embedding content from your monitoring system.

Hi - sorry, that's not my thing Sachin. Although I do a lot around architecture, I'm not a developer.

Thanks! Glad to hear that it is beneficial to you.

Hi Anass. You are welcome - glad to hear that they are useful. Yes, this is Grafana backed by metrics from Prometheus. I will be doing an 8 part series on how to do it yourself and what you'll get in the end (on my to do list now for many months).

Here it is... th-cam.com/video/-byEwO6_EXY/w-d-xo.html

Thank you so much God bless you

www.kepware.com/en-us/support/knowledge-base/2008/logging-data-to-an-excel-worksheet-using-datalogge/

Thanks Fino - glad to hear the time spent is proving beneficial.

It is in the Tomcat system tray application controller. There is a section for JAVA_OPTS where this is added.

@@IAMGregEVA Thanks for your response. I have already added -javaagent:path/to/applicationinsights-agent-3.2.3.jar in Java Options there. And created an environment variable for APPLICATIONINSIGHTS_CONNECTION_STRING with my InstrumentationKey value. But Azure Application Insights doesn't seem to capture data from ThingWorx. Is there any other configuration that I'm missing?

@@tridharamamilla164 You'll also need a configuration file in the agents path... I've added some examples that you can run with in the videos description.

@@IAMGregEVA Thanks for your support again! I have tried adding a configuration file in the same directory with the instrumentation key along with other configuration options specified in the sample applicationinsights.json file. However, it still doesn't seem to work :(

@@tridharamamilla164 That should be it. Tomcat is actually the one loading the Java agent into the JVM when it starts, so you should check the $CATALINA_HOME/logs/catalina.out file where you should see if it was able to load the agent or not. If not, it should give an indication of why not, and if so then you should be able to see something in the AppInsights dashboard. The configuration file is mainly for setting specific settings and adding custom metrics from the JVM.

You are quite welcome... it is the same approach for AWS, just different configuration for the MQTT Client. aws.amazon.com/blogs/iot/connecting-disparate-industrial-devices-and-applications-from-the-plant-floor-to-aws-using-kepserverex/

@@IAMGregEVA Thank you sir for your reply. can I get your help on my problem through any other platform. If can possible to you please tell me how can we get connect. That will be very thankful of you

@@bhupendrajamkhedkar4789 Best is that you contact our experts through your normal channels. Depending on your needs and partner/customer type, we have different people who will help you.

Hi Joost, Sorry for the late response - I am just seeing your question now. You can do what you're aiming for in a variety of ways -- opening firewall ports specifically for an IP address/range/subnet, SSH tunnel, VPN tunnel. The real question is what is validated and accepted by I.T. security? You want to make sure to get their blessing to avoid that your communications are unexpectedly shut down unknowingly one day. Sometimes standard ports and protocols are better as no specific router/firewall configuration is needed, however sometimes it is better to have a dedicated and visible OT communications pathway which can be monitored (OK, not OK, abnormal) and is separate from standard web traffic. Cheers, Greg