Nick Mudge Ignition Software Consulting & Development

I don't use client tags in Ignition much. Not because they are bad or something like that, but because there is something better: module level Python variables.

Python module level variables and client tags are both ways to store and use global data in an Ignition client.

Python module level variables don't have the following limitation: Client tags can only use a few Java data types.

Client tags have one data type for holding aggregate values, the dataset. Datasets are terrible for accessing, setting and manipulating data compared to Python dictionaries and lists. In addition datasets enforce a structure -- rows of the same kind of data. Python dictionaries allow you to structure and organize data in a way that is best suited to the data and how you use it. That makes short, easy to read and write maintainable code.

Python module level variables can hold data of any data type. In my experience Python dictionaries and lists are the most useful data types for storing and using global data in Ignition clients.

It is also nice that Python module variables can be defined in the same place as the functions and code that manipulate them.

Client tags have useful scalar data types like Integer, Float, String and so is most useful for holding single value data.

What About Tag Change Scripts and Other Client Tag Features?

Some client tag features are easily implemented in simple Python code. Here is a simple example that implements "value change script" functionality:

#project.machines Python module
#create module level variable
_machineConfig = {}
#create functions for setting and getting machines that can be used anywhere in the project
def addMachineConfig(machineID, config):
    _machineConfig[machineID] = config
    print "new machine config added:", config

def setMachineConfig(machineID,config):
    if machineID in _machineConfig:
        oldConfig = _machineConfig[machineID]
        _machineConfig[machineID] = config
        #value change script
        print "oldValue:",oldConfig, "newValue:",config
    else:
        addMachineConfig(machineID,config)

def getMachine(machineID)
    return _machineConfig[machineID]

Noticed that "value change script" code is executed any time a machine's configuration is changed by using the setMachineConfig function.

Here's a great comment from Alasdair Barclay (AlThePal) about this blog post:

As we got to know Ignition better we moved from the pointy-clicky interface to doing more things in code. It is more flexible but it's harder to get started - most beginners will need the pointy-clicky interface until they understand the concepts, then they can move to coding directly and enjoying more power.

GStore was some functionality I built into the Power Scripting module. It developed over a short time and now I think it is best to get rid of it.

GStore is short for global storage. It was a way to store global data in Python variables in Ignition projects. The main problem with it is that there is already a great way to do it -- just store global data in Python project modules. I thought I could add various functionality to gstore to make it more unique and useful. But I found that I could add the same functionality in more general ways.

GStore still exists in the Power Scripting module for backwards compatibility but I removed it from Power Scripting documentation and its use is no longer recommended.

GStore answered this question very clearly: "How can I store and use data globally in an Ignition project in a very flexible and dynamic way during runtime in an Ignition client?" But the best answer is use a Python module library; create a module level variable and functions for setting and accessing it, then use those functions in your application to store and manipulate global data.

Here is a simple example:

#project.machines Python module
#create module level variable
_machineConfig = {}
#create functions for setting and getting machines that can be used anywhere in the project
def addMachineConfig(machineID, config):
    _machineConfig[machineID] = config

def getMachine(machineID)
    return _machineConfig[machineID]

I really want to build new and useful things into the Power Scripting module, so let me know what you want.

I created the Perfect Abstractions (PA) Power Scripting Module to make some things easier to do and to make new things possible.

I will give a free license for this module to the first five people that send me a good example of using it in some way.

Contents:

pa.db.insertRows

Have you ever had data in an Ignition table or dataset and wanted to insert the data into a database table?

Did you write a Python script that looped though the dataset row by row, inserting each row into a database table? Man, that is slow, especially if the script is running in a client.

The right way to do this is to create a single SQL query that contains all the rows to insert, for example:

INSERT INTO mytable (col1,col2) VALUES (?,?,?), (?,?,?), (?,?,?), (?,?,?)

That query inserts four rows of data into a database table (but such a query could insert many more rows). It is much, much faster than running four separate queries.

So you should aggregate multiple inserts into a single query when you can. But have you written the logic in Python to dynamically create such a multi-insert database query and arranged the values so they can be inserted? It is ugly and painful.

That is why I created the pa.dataset.insertRows function. Let it do the tiresome work of dynamically creating the single efficient database query needed to insert all the rows of your dataset into a database table.

pa.db.insertRows documentation

serverFunction

This is my favorite feature. It might be hard to learn or understand at first because it adds something new to Ignition. A new idea, that's not part of regular Ignition. But it is really worth understanding because it is awesome and because it allows you to do very valuable things that you could not do before.

It might also be hard to understand because it is a general capability. It allows you to do many different things so it can be easy to get lost in the generalness of it and not see the value. Kind of like a programming language. What good is a programming language? A programming language is so general that you can say things like, "A programming language allows you to do stuff, to make stuff". And to a lot of people that means nothing because it isn't specific enough. So don't let the generalness of this feature hide its value from you. And don't let specific examples of its use limit your understanding of what it could be used for.

serverFunction enables you to write a Python script that runs in the runtime Ignition client that calls a user-defined function that gets executed in the Ignition Gateway and returns its results back to the client. This is a remote function call from the client to the Gateway, with the return value returned back to the client. What can you do with this? That is up to your imagination.

You should really understand this so contact me personally if you don't understand after finishing reading this blog post.

Here is an example:

#First script
#This is in the project.util Python module.
@serverFunction
def getServerTextFile(filePath):
    textFileContent = system.file.readFileAsString(filePath)
    return textFileContent
#Second script
#This is in a visionWindowOpened component event script
filePath = "C:\\Users\\nick\\Documents\\MyTextFile.txt"
text = project.util.getServerTextFile(filePath)
root = event.source.rootContainer
root.getComponent("DocumentViewer").text = text

The "getServerTextFile(filePath)" function has been declared a server function. When it is called in the client it will be executed on the Ignition server and the results will be returned back to the client.

The second script executes when an Ignition window opens. The script retrieves a file from the Ignition server computer (not the client computer) and updates a Document Viewer component in the window with the text from the file. This is a nice way for a window to display the contents of a file from the Ignition server. Similarly a writeServerTextFile(filePath) server function could be written to save changes made in the client to files on the Ignition server computer.

Notice the "@" symbol before "serverFunction". You might wonder what that is. That is standard Python syntax for something that has probably never been used in Ignition before. That syntax is shorthand for creating a Python decorator, which is a function that takes as an argument a function and returns a function. In the case above the syntax is shorthand for getServerTextFile = serverFunction(getServerTextFile).

You can learn more about Python decorators by searching google for Python decorators. It isn't anything special.

@serverFunction replaces the function defined after it with a different function that makes a remote function call to the Ignition Gateway to the function with the same name that exists in the Gateway.

Three Great Uses of serverFunction

1. As you saw in the example above serverFunction provides a great way for runtime clients to retrieve resources that exist on the Ignition server computer. serverFunction can also be used to send data and resources from clients to an Ignition server computer.

2. There is another fantastic use of serverFunction that is completely different: improve performance of multiple dependent database queries. It sometimes happens that multiple database queries that depend on each other need to be run in a Python script in a project. This creates a performance problem because each query can only execute after the one before it has completed executing. Each query needs to be sent across a computer network, which could include the Internet, to an Ignition Gateway, executed and the results need to be sent back to the client. The back and forth network traffic nature of queries makes Python scripts run slow. If it takes 1 second to execute a database query in an Ignition client and a script needs to execute 5 of them then the Python script will take at least 5 seconds to execute which in many cases is a noticeable and annoying lag or frozen screen for users.

In the past the solution has been to write an ugly database stored procedure, which gets hidden away from Ignition. This isn't a good solution because stored procedures don't get saved with an Ignition project and it is much nicer to implement logic in Python than in a SQL langauge.

A server function can solve this problem. Often an Ignition Gateway is installed on the same computer server as the database server or close to it. This enables very fast communication between the Ignition Gateway and the database server. Therefore a client can call a server function that executes multiple queries. Now the queries run fast because they are executed in the Ignition Gateway very near the database server. There have been a number of times I wished I could send multiple database queries to the server to be executed together, now this can be done.

3. It is also possible for a client to call a server function that is defined in a different project than the one running in the client. This allows functions to be grouped into appropriate projects but they can still be called from other projects if needed.

serverFunction documentation

@run

@run provides a nicer syntax for calling system.util.invokeLater(function) and system.util.invokeAsynchronous(function) functions.

system.util.invokeLater(function) is used for two different things. It is used to execute a function after all events and bindings have completed in a client. This is sometimes useful in the "visionWindowOpened" window event script because this script executes before bindings. This script might set properties in the window which will get overwritten when bindings are executed. Defining a function in this script and executing it with invokeLater prevents component properties that have been assigned values in the script from getting overwritten by bindings.

The underlying programming framework used by Ignition clients is Java Swing. Java Swing is single threaded meaning all GUI access and interaction is done on a single thread called the Event Dispatch Thread or EDT for short. No other thread is supposed to touch GUI components.

But sometimes other threads are needed in Ignition clients. If an operation (like getting data from somewhere or making a lot of calculations) takes a long time to execute and the code is running in the EDT (GUI Thread) then the screen will freeze for the user and this is not good. No one likes a frozen screen for any length of time. And when something is taking a long time it is nice to be notified graphically of the progress. This is where the system.util.invokeAsynchronous(function) function comes in. system.util.invokeAsynchronous(function) executes a function in a background thread.

A way is needed for a background thread to update the GUI with its progress and update the GUI when it is done. This is the second use of system.util.invokeLater(function). When system.util.invokeLater(function) is called in a background thread the function that is passed to it is executed in the EDT (GUI thread). system.util.invokeAsynchronous(function) and system.util.invokeLater(function) are used together to run background threads and update the GUI.

Here is an example:

def async():
    result = functionThatTakesALongTimeToFinish()
    def later():
        event.source.parent.getComponent("Label").text = "Finished running"
    system.util.invokeLater(later)
system.util.invokeAsynchronous(async)

The system.util.invokeAsynchronous function returns immediately so the EDT is uninterrupted. When the functionThatTakesALongTimeToFinish() function completes the GUI is updated.

Here is the same code using the new @run syntax:

@run
def async():
    result = functionThatTakesALongTimeToFinish()
    @run
    def later():
        event.source.parent.getComponent("Label").text = "Finished running"

This second version is not much different than the first version. In the second version the explicit calls to system.util.invokeAsynchronous and system.util.invokeLater are gone and instead @run is at the top of the functions. @run will execute a function defined after it based on its name. Functions named "async" are executed with system.util.invokeAsynchronous and functions named "later" are executed with system.util.invokeLater. The specific function names are useful because they document what the function is for: asynchonous execution or EDT execution.

I found that using @run makes code cleaner, easier to read and write, especially when code is dense with invokeLater and invokeAsynchronous.

@run documentation

pa.thread.multiTask(functions, endFunction)

The pa.thread.multiTask(functions, endFunction) function executes multiple functions concurrently in different threads.

The pa.thread.multiTask(functions, endFunction) function is useful in cases where multiple long-running independent operations or code need to run. Instead of executing long running operations in sequence all the long running operations can run at the same time, speeding up the application.

Python lists, sets and dictionaries are thread-safe, which means they can be shared between concurrently running functions. When the concurrent functions finish running the endFunction is executed. The endFunction can do something with the results like update the GUI.

Here is a simple example:

myTextList = []
myFunctionsList = []

def func1():
   text = system.db.runScalarQuery("SELECT name FROM names1 LIMIT 1","datasource1")
   myTextList.append([text])
myFunctionsList.append(func1)

def func2():
   text = system.db.runScalarQuery("SELECT name FROM names2 LIMIT 1","datasource2")
   myTextList.append([text])
myFunctionsList.append(func2)

def func3():
   text = system.db.runScalarQuery("SELECT name FROM names3 LIMIT 1","datasource3")
   myTextList.append([text])
myFunctionsList.append(func3)

def updateGUI():
   @run
   def later():
       table = event.source.parent.getComponent("Table")
       table.data = system.dataset.toDataSet(["Names"],myTextList)

pa.thread.multiTask(myFunctionsList,updateGUI)

In this example the pa.thread.multiTask function executes three functions concurrently. Each function executes a query in a different database. The results are collected in the MyTextList Python list. After the three functions have completed running the results are put in an Ignition table in a window.

I have used the above pattern in production to concurrently execute 10 different queries at the same time. It is about 10 times faster than executing the database queries sequentially.

pa.thread.multiTask documentation

MutablePyDataSet

Datasets are very very common in Python scripts in Ignition. Ignition components use them to hold tabular data and SQL queries return results in datasets. So they are everywhere.

I found myself writing the same code over and over again in different projects for handling datasets. The solution was MutablePyDataSet. I put in MutablePyDataSet many capabilities and methods that are useful. If you think of more let me know.

MutablePyDataSet is a swiss army knife for datasets. MutablePyDataSet helps write clear, short, easy code for datasets.

MutablePyDataSet is like PyDataSet except that it has many methods for accessing and manipulating its data and it is mutable.

MutablePyDataSet can do so many things to datasets that a huge page of documentation is needed to show what it can do.

Some of MutablePyDataSet's power comes from the generality of its functions. For example the sortRows method can receive a comparison function to determining how rows should be sorted. A comparison function can sort rows in any way the programmer wishes. Similarly, the findRows, filterRows, and removeRows methods receive a function argument to determine the condition or algorithm to use for the task. Such methods give flexibility/power while removing looping boilerplate code.

MutablePyDataSets print out to the console very nicely. This is very useful for development and debugging. Here's an example:

columnNames = ["name","age","rank"]
rows = [["Bob",32,"Private"],
        ["Bill",28,"Major"],
        ["Sarah",34,"Colonel"], 
        ["Kane",56,"General"], 
        ["Kirk",46,"Captain"],       
        ["Steve",22,"Lieutenant"], 
        ["Spock",156,"First Officer"], 
        ["Sierra",18,"Private"]]                      
mutablePyDataSet = pa.dataset.toData(columnNames,rows)
mutablePyDataSet.filterRows(lambda row: row["age"] > 30)
mutablePyDataSet.reverseRows()
print mutablePyDataSet
Output Console:
row | name  age rank         
-----------------------------
 0  | Spock 156 First Officer
 1  | Kirk  46  Captain      
 2  | Kane  56  General      
 3  | Sarah 34  Colonel      
 4  | Bob   32  Private     

The code creates a MutablePyDataSet with columns and rows. The filterRow method removes all rows that do not meet the condition given in the lambda function. lambda is Python syntax for creating a function without a name on the fly. The MutablePyDataSet is reversed and printed.

Method calls can be chained. For example the code could be written like this:

print pa.dataset.toData(columnNames,rows).filterRows(lambda row: row["age"] > 30).reverseRows()

For a primer on Datasets and MutablePyDataSets in Ignition read this blog post: Datasets in Ignition

MutablePyDataSet documentation

pa.ignition.db.runPrepInternalDBQuery

This function enables you to query Ignition's internal database, (SELECT queries only). The results are returned as a MutablePyDataSet.

Here is an example that gives all the datable tables that can be queried in Ignition:

query = """SELECT TABLE_NAME
            FROM INFORMATION_SCHEMA.SYSTEM_TABLES
            WHERE TABLE_SCHEM='PUBLIC'"""
result = pa.ignition.db.runPrepInternalDBQuery(query)
print result
Output Console:
row | TABLE_NAME                                             
-------------------------------------------------------------
 0  | ALARMJOURNALSETTINGS                                   
 1  | ALARMNOTIFICATIONPROFILES                              
 2  | ALERTLOG                                               
 3  | ALERTNOTIFICATIONPROFILEPROPERTIES_BASIC               
 4  | ALERTNOTIFICATIONPROFILEPROPERTIES_BASIC_EMAILADDRESSES
 5  | ALERTNOTIFICATIONPROFILEPROPERTIES_DISTRIBUTION        
 6  | ALERTNOTIFICATIONPROFILES                              
 7  | ALERTSTATE                                             
 8  | ALERTSTORAGEPROFILEPROPERTIES_DATASOURCE               
 9  | ALERTSTORAGEPROFILES                                   
 10 | AUDITEVENTS                                            
 11 | AUDITPROFILEPROPERTIES_DATASOURCE                      
 12 | AUDITPROFILES                                          
 13 | AUTHPROFILEPROPERTIES_AD                               
 14 | AUTHPROFILEPROPERTIES_ADHYBRID                         
 15 | AUTHPROFILEPROPERTIES_ADTODB                           
 16 | AUTHPROFILEPROPERTIES_DB                               
 17 | AUTHPROFILES                                           
 18 | BASIC_SCHEDULES                                        
 19 | COMPACTLOGIXDRIVERSETTINGS                             
 20 | COMPOSITE_SCHEDULES                                    
 21 | CONTROLLOGIXDRIVERSETTINGS                             
 22 | DATASOURCEDRIVINGSQLTSETTINGS                          
 23 | DATASOURCES                                            
 24 | DBTRANSLATORS                                          
 25 | DEVICES                                                
 26 | DEVICESETTINGS                                         
 27 | DRIVERPROPERTIES                                       
 28 | DUAL                                                   
 29 | EMAILNOTIFICATIONSETTINGS                              
 30 | GENERALALARMSETTINGS                                   
 31 | HOLIDAYS                                               
 32 | HOMEPAGE_SETTINGS                                      
 33 | IMAGES                                                 
 34 | INTERNALAUTHMAPPINGTABLE                               
 35 | INTERNALCONTACTINFOTABLE                               
 36 | INTERNALROLETABLE                                      
 37 | INTERNALSCHEDULEADJUSTMENTTABLE                        
 38 | INTERNALSQLTPROVIDERSETTINGS                           
 39 | INTERNALUSEREXTRAPROPS                                 
 40 | INTERNALUSERTABLE                                      
 41 | JDBCDRIVERS                                            
 42 | LEGACYSQLTPROVIDERSETTINGS                             
 43 | LOGIXDRIVERSETTINGS                                    
 44 | MICROLOGIXDRIVERSETTINGS                               
 45 | MOBILEMODULESETTINGS                                   
 46 | MODBUSTCPDRIVERSETTINGS                                
 47 | OPCSERVERS                                             
 48 | PLC5DRIVERSETTINGS                                     
 49 | PROJECTS                                               
 50 | PROJECT_CHANGES                                        
 51 | PROJECT_RESOURCES                                      
 52 | REGIONSETTINGS                                         
 53 | ROSTER                                                 
 54 | ROSTER_ENTRY                                           
 55 | S71200DRIVERSETTINGS                                   
 56 | S7300DRIVERSETTINGS                                    
 57 | S7400DRIVERSETTINGS                                    
 58 | SCHEDULES                                              
 59 | SCHEDULE_PROFILES                                      
 60 | SCRIPTSETTINGSRECORD                                   
 61 | SIMPLETAGPROVIDERPROFILE                               
 62 | SIPNOTIFICATIONSETTINGS                                
 63 | SLCDRIVERSETTINGS                                      
 64 | SMSNOTIFICATIONPROFILESETTINGS                         
 65 | SQLTAG                                                 
 66 | SQLTAGALARMPROP                                        
 67 | SQLTAGALARMS                                           
 68 | SQLTAGEVENTSCRIPTS                                     
 69 | SQLTAGHISTORYPROVIDER                                  
 70 | SQLTAGPROP                                             
 71 | SQLTAGPROVIDER                                         
 72 | SQLTSCANCLASS                                          
 73 | SRFEATURES                                             
 74 | STOREANDFORWARDSYSSETTINGS                             
 75 | SYSPROPS                                               
 76 | TAGHISTORYPROVIDEREP                                   
 77 | TAGPERMISSIONRECORD                                    
 78 | TCPDRIVERSETTINGS                                      
 79 | TRANSLATIONSETTINGS                                    
 80 | TRANSLATIONTERMS                                       
 81 | UACONNECTIONSETTINGS                                   
 82 | UDPDRIVERSETTINGS                                      
 83 | XOPCSETTINGS  

pa.ignition.db.runPrepInternalDBQuery documentation

pa.ignition.getContext()

The pa.ignition.getContext() function returns the context object for the scope it is called in. For example if called in a client the ClientContext is returned. If called in a designer then the DesignerContext is returned. If called in the gateway then the GatewayContext is returned.

The context object provides access to the Ignition Module SDK API. This means that internal Ignition data can be accessed and changed with the context object. For example all of a projects resources, such as windows, client tags, client properties and scripts can be accessed through a context object.

pa.ignition.getContext() documentation

The PA Power Scripting Module is available on the Module Marketplace.

The module works fully without a license in an Ignition designer. Without a license it works fully during the 2 hour trial period in Ignition clients.

I am interested in being notified about new features and capabilities that could be added to this Ignition module. What features and capabilities do you want?

A dataset in Ignition is a set of rows and columns holding values, like a spreadsheet.

Many components in Ignition use datasets, including table components, dropdown list, list,template repeater and canvas and chart components. In addition database queries return results as a dataset.

It is very true that if somebody is going to do any Python scripting in Ignition then he/she is going to be dealing with datasets.

Being able to access data in datasets, create new datasets and create modified versions of datasets are importand skills, and being able to do so smoothly and easily makes programming in Ignition that much smoother and easier.

This article is going to describe three different kinds of datasets.

Dataset

The Dataset dataset is a Java data type that is used by component properties in Ignition. For example the "data" property of an Ignition table is a Dataset.

Dataset are treated as immutable. That means Datasets are not changed. When you want to "change" a Dataset you actually create a new, different Dataset that is different in someway than the one before. Some built-in system.dataset.* functions in Ignition make it easier to do. Here is an example that makes all the values in a column upper case:

table = event.source.parent.getComponent('Table')
for rowIndex in range(table.data.rowCount):
    value = table.data.getValueAt(rowIndex,"Col 2")	
    table.data = system.dataset.setValue(table.data, rowIndex, "Col 2",value.upper())

Notice that the system.dataset.setValue function assigns its return value to the "data" property of the table in each iteration of the loop. This is because the system.dataset.setValue function actually creates a new Dataset each time it is called, copying the Dataset that was passed in as an argument except making the specified value different.

Also notice that we cannot directly loop through the rows of the Dataset. Instead we need to create a Python list of integers by using the range function and then loop through the integer list, using each integer as a rowIndex. The Dataset data type does not provide any of Pythons nice and easy syntax for looping through data, accessing data or modifying data.

PyDataSet

A PyDataSet is similar to a Dataset but it provides some of Python's nice syntax for looping, row access and slicing. PyDataSet isn't useful for anything else. Like Dataset, PyDataSet is immutable. But there are no functions for creating new different PyDataSets. Database queries in Ignition return PyDataSets. Here's some examples:

table = event.source.parent.getComponent('Table')
#Convert a Dataset into a PyDataSet
data = system.dataset.toPyDataSet(table.data)
#loop directly through a PyDataSet
for row in data:
    #Nice python syntax for accessing values in rows
    print row["Col 2"]

#Nice python syntax for row access
print data[2]

#Nice python syntax for row and column access to get values
print data[2]["Col 2"]

#Nice python slice syntax for getting the first three rows
firstThreeRows = data[:3]
print firstThreeRows

#Python syntax to get the last row? No cigar, doesn't work.
print data[-1]

#No, this does not work because PyDataSet is immutable, cannot be changed
data[2]["Col 2"] = "something"

A PyDataSet can help you manually create a different dataset. Here's a way to make all the values in a column uppercase:

table = event.source.parent.getComponent('Table')
newData = []
columnNames = list(table.data.getColumnNames())
pyDataSet = system.dataset.toPyDataSet(table.data)
for row in pyDataSet:
    rowList = []
    for column in columnNames:
        if column == "Col 2":
            rowList.append(row[column].upper())
        else:
            rowList.append(row[column])
    newData.append(rowList)
table.data = system.dataset.toDataSet(columnNames,newData)

This code copies the PyDataSet into a Python list of lists, except it uppercases the "Col 2" column. Once this is done the list of lists is converted into a Dataset and assigned to the table.

MutablePyDataSet

The MutablePyDataSet takes things further. It is like a PyDataSet except it is mutable and it has many many methods for accessing data in it, sorting, searching and modifying it. Here's the code for uppercasing a column:

table = event.source.parent.getComponent('Table')
#convert the Dataset into a MutablePyDataSet
data = pa.dataset.toData(table.data)
for row in data:
    row["Col 2"] = row["Col 2"].upper()
table.data = data.toDataSet()

Very simple, we convert a Dataset into a MutablePyDataSet, loop though it and directly change the "Col 2" column in each row. Then it is converted back into a Dataset.

Here's another example that achieves the same thing but in a completely different way. It shows off some interesting and useful ways to access and change data:

table = event.source.parent.getComponent('Table')
data = pa.dataset.toData(table.data)
data.setColumn("Col 2",map(unicode.upper,data.columns["Col 2"]))
table.data = data.toDataSet()

To summerize briefly, the third line of code accesses the "Col 2" column of the MutablePyDataSet, creates a new "Col 2" list with uppercase values and sets the values in the "Col 2" column of the MutablePyDataSet.

Here's a more detailed description: The 'data.columns["Col 2"]' part returns all the values in the "Col 2" column as a Python list. 'unicode.upper' is a function that uppercases unicode strings. The 'map' function applies the 'unicode.upper' function to each item in the 'data.columns["Col 2"]' list and returns the results as a new list.

The 'data.setColumn' method sets the 'Col 2' column position in all rows in the MutablePyDataSet to the values from the list created by 'map(unicode.upper,data.columns["Col 2"])'.

One of the nice things MutablePyDataSet does is provide a very nice print out of its contents. This is very useful for development and debugging. Here is an example:

table = event.source.parent.getComponent('Table')
print pa.dataset.toData(table.data)
Output Console:
row | Col 1 Col 2       Col 3        
-------------------------------------
 0  | 84    TEST ROW 11 43.4355031232
 1  | 12    TEST ROW 16 87.0748299491
 2  | 21    TEST ROW 1  46.9309520282
 3  | 76    TEST ROW 0  79.041838165 
 4  | 94    TEST ROW 1  17.8630985677
 5  | 97    TEST ROW 2  94.3354725437
 6  | 20    TEST ROW 17 27.9129276711

The output shows the columns and rows of the data.

There are many examples of various capabilities and methods of MutablePyDataSet I could show you but an example already exists for each capability and method in the MutablePyDataSet documentation.

You can find real-world examples of using MutablePyDataSet on the Inductive Automation forum by searching for MutablePyDataSet.

The MutablePyDataSet is part of the PA Power Scripting Module.

One of the Perfect Abstractions Ignition project developers developed a very useful tool for viewing the Ignition wrapper.log file in an Ignition client or designer.

Find out what the Ignition wrapper.log file is and why it is useful.

We are releasing the Wrapper.log Viewer project here for other people to use. Download this project file: WrapperLogViewer.proj. Ignition 7.7.5 or higher is required to import the project.

Here is a screenshot of the project:

The Wrapper.log Viewer project was designed to be very easy to install and use. To install it import the Wrapper.log Viewer project into an existing Ignition project or import it as a new project. Note that importing into an existing project will delete existing Gateway Event Scripts in the project. That is all that is needed to install it. No database connections or anything else.

To use the Wrapper.log Viewer project in an Ignition designer open up the ViewerWindow window and put the designer into preview mode. The current contents of the wrapper.log file will display within 5 seconds.

To use the project in a client simply start a client and open the ViewerWindow window. Very easy, nothing to it.

The Wrapper.log Viewer project has been tested on both Windows and Linux.

How it Works

The Wrapper.log Viewer project has a Gateway Timer Script that runs every 5 seconds. It checks to see if the wrapper.log file has been modified. If it has been modified then the last 64,000 characters of the wrapper.log file are copied into a memory tag. The memory tag is automatically created when the project is first used.

A binding and Python scripting in the ViewerWindow window updates the display of the wrapper.log file when the content changes.

The AutoRefresh button is used to toggle on and off the functionality to automatically update the display of the wrapper.log file content. The auto update functionality is on by default.

The ViewerWindow window automatically scrolls the display of the content to the newest content as it comes in.

The Highlight Text field is used to highlight text in the wrapper.log contents that is displayed. This is useful for searching and finding specific text in the content.

Find out what problem the Wrapper.log Viewer project solves.

More Useful Projects

The Perfect Abstractions development team is interested in developing more useful tools and projects. If you think of something that you want feel free to tell us. We might implement it.

The wrapper.log file is a file on the file system where Ignition is installed.

Ignition logs errors and various important information about what Ignition is doing to the wrapper.log file.

The wrapper.log file is used to test and debug Python scripts that execute in the Ignition Gateway. Gateway Event Scripts, Tag Event Scripts, Python scripts in Alarm Notification Pipelines and Python scripts in Sequential Function Charts all output print statements and logging statements to the wrapper.log file, and the wrapper.log file can be used to debug or test any of them.

The wrapper.log file also collects a lot of information about the internal workings of Ignition. If something is wrong with Ignition the wrapper.log file is a place to go to see if some error is being thrown causing things to not work correctly. If you want to know what and when something is happening in the Ignition Gateway the wrapper.log file may have some useful information about it.

The Problem

Ignition is very often installed on a computer server that most people do not have local access to -- meaning that people have to gain remote access to the computer in order to access files on the computer. Since the wrapper.log file is stored on the hard drive of the computer where Ignition is installed people have to use a remote access tool like RDP for windows or SSH for Linux or something like VNC. This also means these people need a username/password to log in to the server. This can be a lot of trouble just to view the wrapper.log file.

Some developers may not have or want remote access to the server where Ignition is installed, but if they don't have it then they can't view the wrapper.log file. This problem is solved to a degree by having administrative/configuration access to Ignition's System Console webpage where much of the same information from the wrapper.log file is displayed. But again, it requires that users have access to the configuration of Ignition's gateway in order to see logging information. Developers may not have administrative access to the Ignition gateway. And system administrators may not want to give administrative access to Ignition to all Ignition developers.

The Solution

The Wrapper.log Viewer project solves the problem by providing easy access to the wrapper.log file in an Ignition client or designer.

A year ago I started Perfect Abstractions. It was just me delivering custom Ignition programming to clients.

That was great but I was only able to do so much work on my own. I want my company to grow and be able to to handle a much larger volume of work.

Some time ago I found a bright software developer and helped him get up to speed with Ignition development. He now works with me on client projects. More recently I found four more bright people and they are currently in training to become expert Ignition developers.

Perfect Abstractions is changing from being a one-man company to being a team of Ignition developers. We will be able to handle more clients and projects.

My job is changing. Instead of implementing all projects myself my Ignition development team will help. It is my job to understand what the client needs and use my team to get it delivered.

If you have software applications that need to be implemented contact me and we can talk about how it can be done.

Edit (19 May 2015): Four people are in training to become Ignition developers so I am not hiring now. But I am interested in talking with people about future possibilities.

Awhile ago I found an experienced software developer and trained him on developing projects with Ignition. He is now working with me as a subcontractor on an Ignition project. The experience has been great. I need to do it more.

I am interested in finding programmers to get to know, train on Ignition and hire as employees or subcontractors. I am building a team of Ignition developers.

Here is what I am looking for:

Required

  1. Competent at programming with a firm grasp of programming in general.
  2. Ability to learn new things quickly.
  3. Communicates well verbally and in writing.

Not Required, but nice to have

  1. Knowledge of and experience with Ignition
  2. Python programming knowledge and experience.
  3. Java knowledge and experience.
  4. PLC programming knowledge and experience.
  5. Manufacturing knowledge and expericence.
  6. Software development knowledge and experience.

Most of the work is done remotely.

If you are interested then let's talk.

Recently Chris Powell, who I met in the Ignition Chat Room, started writing blog posts about Ignition - giving examples of how to use various functionality.

He wrote a guest post on my blog about Ignition Power Tables.

He recently started his own blog about Ignition. His first posts are about Ignition's Calendar Components and Ignition Template Repeaters.

For a long time there was no officially supported way to create screens dynamically in Ignition. Screens were created up front by designers/programmers by dropping components on windows and then scripting and configuring them.

There was no dynamic creation of components based on current data from a database or other source of information.

Ignition Containers

This has changed in Ignition. It started with the Template Repeater which was released in Ignition 7.7.0. This component allows an Ignition template to be configured and repeated any number of times. A vertical or horizontal scroll bar is automatically added to the template repeater when there isn't enough space for all templates to fit within the designated space. This is a great component but has various limitations; for example it only allows one template to be repeated in a single direction.

The Template Canvas was released in December 2014 in Ignition 7.7.2. The Template Canvas is the most powerful, most significant single component to be released by Inductive Automation since Ignition itself was released in 2010.

The Template Canvas makes it possible to dynamically create any number of instances of any number of templates. The position, width and height of each template instance can be configured. If there isn't enough space for all template instances to fit within the designated space scroll bars are automatically added - vertical or horizontal or both. Once all templates are displayed on a screen their position and configuration can be changed through Python scripting.

How to Use the Template Canvas

First a Template Canvas is dropped onto an Ignition window. You will see a box of ant track lines. The Template Canvas is a kind of Ignition container and the ant track lines show the dimensions of the Template Canvas. This shows how much space the Template Canvas will use on the window. Change the position and width and height of the Template Canvas as needed.

Templates Property

The Templates property of a Template Canvas is a dataset that contains template instance information. Each row of the dataset specifies a template to use to create a template instance and its position and layout. Populating this property is what creates and positions template instances. Here is a view of a Templates dataset:

Ignition Templates Dataset
Ignition Containers

There are different ways to populate the Templates property. One way is to use the Template Canvas Customizer. Right click on the Template Canvas in the designer, hover the mouse over Customizers, then choose Template Canvas Customizer. Using this customizer you can select templates to use and the layout and positioning. The Template Canvas Customizer also lets you input values for any template instance parameters. The Template Canvas Customizer is a static upfront way to create the Templates dataset. Using it is a good way to get started with the Template Canvas.

A dynamic way to create the Templates property (and therefor dynamically create template instances and configuration) is to bind a database query to the Templates property.

Python scripting is the most powerful and flexible way to dynamically create a dataset for the Templates property. Python provides many tools and capabilities to analyze and manipulate data and many ways to access sources of data.

Layout and Positioning

There are two ways to position template instances: Absolute Positioning and Layout Positioning.

Absolute Positioning uses absolute x and y coordinates and values for width and height. The x, y, width and height columns in the Templates dataset are used for Absolution Positioning. x and y coordinates need to be calculated for each template instance.

Layout Positioning uses a powerful and easy to use layout manager called MigLayout. The "layout" column in the Templates dataset is used for Layout Positioning. The layout column holds a MigLayout string for each row in the dataset.

Documentation for MigLayout is here: MigLayout QuickStart

Here is a handy MigLayout cheetsheet: MigLayout Cheetsheet.

Initializing Template Instances

By initializing template instances I mean setting any template parameters for each instance. There are a couple ways to do this.

The Template Canvas Templates property can have a column called "parameters". This column holds a string representation of a Python dictionary. Each item in the dictionary contains the name of a template parameter and a value to be set for the template parameter. The Template Canvas Customizer uses the "parameters" column to set parameter values for template instances.

Another way is to use the initializeTemplate extension function on the Template Canvas. Remember an extension function is an editable function on a component that exists to customize it.

initializeTemplate Ignition Script

The initializeTemplate function is called for each template instance created by the Template Canvas. The initializeTemplate function takes as an argument the template that it is called for. This extension function provides a chance to execute a Python script for each template instance to configure it, set template parameters etc. Each time the Template Canvas Templates property changes the initializeTemplate extension function runs for each template instance.

Template Canvas Video & Demo

I made a Template Canvas demo project and a video that shows how to use the Template Canvas. To see the video and get a copy of the Template Canvas demo project signup for my email list.

Okay you can see the video of the demo project here, and download the demo project here.

You are free to have and use the Template Canvas demo project for your own purposes.

Here's a screen shot of the Template Canvas demo application:

initializeTemplate Ignition Script

More blog posts...