2 Siding ReLU via its forward weight connections

Sean O'Connor — Wed, 12 Jul 2023 06:11:00 -0000

SwitchNet in Java: SwitchNet

2 Siding ReLU via its forward weight connections

Sean O'Connor — Fri, 23 Jun 2023 08:50:50 -0000

SwitchNet, a fast low parameter count neural network::
https://editor.p5js.org/siobhan.491/sketches/RvqZfikaE

Blog:
https://ai462qqq.blogspot.com/2023/04/switch-net.html
In the blog comments there is a near Java version (ie. processing).

2 Siding ReLU via its forward weight connections

Sean O'Connor — Sun, 02 Apr 2023 06:25:01 -0000

You can 2 side ReLU via its forward weight connections (not its backward weight connects). Hence you are involving the next layer in things.
Blog post: [2 Siding ReLU]https://ai462qqq.blogspot.com/2023/03/2-siding-relu-via-forward-projections.html/)

Also there is a way of streamlining a neural networks layer. Allowing you to reasonably use very wide layers.
Blog post:Reduced cost layers

Installation fail (won't start)

Duane Kunkee — Thu, 11 Aug 2022 23:01:50 -0000

I am getting the same thing on Windows 11. A message indicates that I should provide a javahome parameter, but there doesn't seem to be a way to do it. I tried defining a javahome environment variable, but that didn't make any difference. Is there anyone seeing this that has successfully installed Neuroph on Windows 10 or 11?

modulo neural network not working

Radoslavov — Sat, 18 Jun 2022 19:56:00 -0000

Hi! Your training set is empty.

Import trained networks in Neuroph

Gianni Casonato — Thu, 14 Apr 2022 10:47:11 -0000

Hi,
I have some trained networks generated using other libraries, and I wonder if Neuroph is able to handle some sort of standard exchange formats (.zip in particular including weights in hdf5 or bin, and model in yaml or jason).
From the examples I've only seen load of .nnet files generated by Neuroph itself.
Thanks in advance and regards,
Gianni

Help with Neural Network

Thiemo — Mon, 14 Feb 2022 10:51:03 -0000

Hey Guys,

can you help me a little bit out with neuroph.
I am new in neural networks.
I have a lot of background knowledge, such as types, history usw of neural networks but i fail to teach a network anything.

I already tried a few NeuroTypes and already played with the neuroph studio, where the training usw always works :(

So heres my current code, very compact its a "how to do ki" learning project xD

NeuralNetwork<BackPropagation> neuralNetwork = new MultiLayerPerceptron(2, 12, 1);

        BackPropagation backPropagation = new BackPropagation();
        backPropagation.setMaxError(0.01);

        DataSet dataSet = new DataSet(2, 1);
        dataSet.add(0, new DataSetRow(new double[]{0, 0}, new double[]{0}));
        dataSet.add(1, new DataSetRow(new double[]{0, 1}, new double[]{1}));
        dataSet.add(2, new DataSetRow(new double[]{1, 0}, new double[]{1}));
        dataSet.add(3, new DataSetRow(new double[]{1, 1}, new double[]{0}));

        backPropagation.setTrainingSet(dataSet);
        neuralNetwork.setLearningRule(backPropagation);

        System.out.println("train network");
        neuralNetwork.learn(dataSet);
        System.out.println("training completed");

        System.out.println("evulating network");

        for(DataSetRow row : dataSet.getRows()) {
            neuralNetwork.setInput(row.getInput());
            double[] result = neuralNetwork.getOutput();

            System.out.println("Input: "+row.getInput()[0]+" : "+row.getInput()[1]+" | Desired Output: "+row.getDesiredOutput()[0]+" | Output: "+result[0]);
        }

What i see is that the training is exiting after only 1 second.
In Neuroph Studio this takes up to 20 Seconds until i reach a max error rate of 0.01

Can you please tell me what i am doing wrong :(

Neuroph API Custom Network Not Configured Correctly (Outputs 0)

Pieter Svenson — Thu, 11 Nov 2021 20:50:16 -0000

Hello! I have an issue with creating a custom neural network. I detailed out my issue on StackOverflow. Can someone take a look and try to find the problem?

https://stackoverflow.com/questions/69932361/neuroph-api-custom-network-not-configured-correctly-outputs-0

Problems with CNN and MNIST following github sample

Jakob Behnke — Fri, 05 Nov 2021 17:56:04 -0000

Hi,
I trained a CNN with MNIST, following the example in the github-repository. However the results are always around 10% accuracy, even after 100 epochs. Is there a known problem in the source with v2.98?

installation shell script doesn't work on M1 macbook air

Peter Lin — Mon, 01 Nov 2021 03:08:51 -0000

Here is the error from the IDE log when I click "new project"

SEVERE [global]
java.lang.ClassNotFoundException: javax.activation.DataContentHandlerFactory
at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:606)
at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:168)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
at org.netbeans.ProxyClassLoader.loadClass(ProxyClassLoader.java:222)
Caused: java.lang.ClassNotFoundException: javax.activation.DataContentHandlerFactory starting from ModuleCL@20412498[org.openide.awt] with possible defining loaders [ModuleCL@2cf4cda2[org.netbeans.modules.xml.jaxb.api]] and declared parents [ModuleCL@62edc23c[org.netbeans.api.annotations.common], org.netbeans.MainImpl$BootClassLoader@573f2bb1]
at org.netbeans.ProxyClassLoader.loadClass(ProxyClassLoader.java:224)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
Caused: java.lang.NoClassDefFoundError: javax/activation/DataContentHandlerFactory
at org.openide.awt.QuickSearch.setUpSearch(QuickSearch.java:369)
at org.openide.awt.QuickSearch.<init>(QuickSearch.java:107)
at org.openide.awt.QuickSearch.attach(QuickSearch.java:197)
at org.openide.awt.QuickSearch.attach(QuickSearch.java:125)
at org.openide.explorer.view.TreeView$ExplorerTree.setupSearch(TreeView.java:1936)
at org.openide.explorer.view.TreeView$ExplorerTree.<init>(TreeView.java:1753)
at org.openide.explorer.view.TreeView.initializeTree(TreeView.java:299)
at org.openide.explorer.view.TreeView.<init>(TreeView.java:238)
at org.openide.explorer.view.TreeView.<init>(TreeView.java:228)
at org.openide.explorer.view.BeanTreeView.<init>(BeanTreeView.java:98)
at org.netbeans.modules.project.ui.TemplatesPanelGUI$CategoriesBeanTreeView.<init>(TemplatesPanelGUI.java:679)
at org.netbeans.modules.project.ui.TemplatesPanelGUI$CategoriesPanel.createComponent(TemplatesPanelGUI.java:729)
at org.netbeans.modules.project.ui.TemplatesPanelGUI$ExplorerProviderPanel.initGUI(TemplatesPanelGUI.java:644)
at org.netbeans.modules.project.ui.TemplatesPanelGUI$ExplorerProviderPanel.<init>(TemplatesPanelGUI.java:535)
at org.netbeans.modules.project.ui.TemplatesPanelGUI$CategoriesPanel.<init>(TemplatesPanelGUI.java:719)
at org.netbeans.modules.project.ui.TemplatesPanelGUI$CategoriesPanel.<init>(TemplatesPanelGUI.java:719)
at org.netbeans.modules.project.ui.TemplatesPanelGUI.initComponents(TemplatesPanelGUI.java:421)
at org.netbeans.modules.project.ui.TemplatesPanelGUI.<init>(TemplatesPanelGUI.java:156)
at org.netbeans.modules.project.ui.ProjectTemplatePanel.getComponent(ProjectTemplatePanel.java:187)
at org.netbeans.modules.project.ui.NewProjectWizard.createTemplateChooser(NewProjectWizard.java:104)
at org.openide.loaders.TemplateWizard.templateChooser(TemplateWizard.java:320)
at org.openide.loaders.TemplateWizardIterImpl.firstPanel(TemplateWizardIterImpl.java:87)
at org.openide.loaders.TemplateWizardIterImpl.current(TemplateWizardIterImpl.java:144)
at org.openide.loaders.TemplateWizardIteratorWrapper.current(TemplateWizardIteratorWrapper.java:92)
at org.openide.WizardDescriptor.updateStateOpen(WizardDescriptor.java:844)
at org.openide.WizardDescriptor.updateState(WizardDescriptor.java:822)
at org.openide.loaders.TemplateWizard.updateState(TemplateWizard.java:761)
at org.netbeans.modules.project.ui.NewProjectWizard.updateState(NewProjectWizard.java:84)
at org.openide.WizardDescriptor._updateState(WizardDescriptor.java:800)
at org.openide.WizardDescriptor.access$200(WizardDescriptor.java:92)
at org.openide.WizardDescriptor$Listener.stateChanged(WizardDescriptor.java:2180)
at org.openide.util.WeakListenerImpl$Change.stateChanged(WeakListenerImpl.java:356)
at org.openide.loaders.TemplateWizardIterImpl.run(TemplateWizardIterImpl.java:275)
at java.desktop/java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:316)
at java.desktop/java.awt.EventQueue.dispatchEventImpl(EventQueue.java:770)
at java.desktop/java.awt.EventQueue$4.run(EventQueue.java:721)
at java.desktop/java.awt.EventQueue$4.run(EventQueue.java:715)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:391)
at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:85)
at java.desktop/java.awt.EventQueue.dispatchEvent(EventQueue.java:740)
at org.netbeans.core.TimableEventQueue.dispatchEvent(TimableEventQueue.java:159)
[catch] at java.desktop/java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:203)
at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:124)
at java.desktop/java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:113)
at java.desktop/java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:109)
at java.desktop/java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101)
at java.desktop/java.awt.EventDispatchThread.run(EventDispatchThread.java:90)
SEVERE [org.openide.util.RequestProcessor]: Error in RequestProcessor org.netbeans.modules.project.ui.actions.NewProject$1
java.lang.ClassNotFoundException: javax.activation.DataContentHandlerFactory
at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:606)
at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:168)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
at org.netbeans.ProxyClassLoader.loadClass(ProxyClassLoader.java:222)
Caused: java.lang.ClassNotFoundException: javax.activation.DataContentHandlerFactory starting from ModuleCL@20412498[org.openide.awt] with possible defining loaders [ModuleCL@2cf4cda2[org.netbeans.modules.xml.jaxb.api]] and declared parents [ModuleCL@62edc23c[org.netbeans.api.annotations.common], org.netbeans.MainImpl$BootClassLoader@573f2bb1]
at org.netbeans.ProxyClassLoader.loadClass(ProxyClassLoader.java:224)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
Caused: java.lang.NoClassDefFoundError: javax/activation/DataContentHandlerFactory
at org.openide.awt.QuickSearch.setUpSearch(QuickSearch.java:369)
at org.openide.awt.QuickSearch.<init>(QuickSearch.java:107)
at org.openide.awt.QuickSearch.attach(QuickSearch.java:197)
at org.openide.awt.QuickSearch.attach(QuickSearch.java:125)
at org.openide.explorer.view.TreeView$ExplorerTree.setupSearch(TreeView.java:1936)
at org.openide.explorer.view.TreeView$ExplorerTree.<init>(TreeView.java:1753)
at org.openide.explorer.view.TreeView.initializeTree(TreeView.java:299)
at org.openide.explorer.view.TreeView.<init>(TreeView.java:238)
at org.openide.explorer.view.TreeView.<init>(TreeView.java:228)
at org.openide.explorer.view.BeanTreeView.<init>(BeanTreeView.java:98)
at org.netbeans.modules.project.ui.TemplatesPanelGUI$CategoriesBeanTreeView.<init>(TemplatesPanelGUI.java:679)
at org.netbeans.modules.project.ui.TemplatesPanelGUI$CategoriesPanel.createComponent(TemplatesPanelGUI.java:729)
at org.netbeans.modules.project.ui.TemplatesPanelGUI$ExplorerProviderPanel.initGUI(TemplatesPanelGUI.java:644)
at org.netbeans.modules.project.ui.TemplatesPanelGUI$ExplorerProviderPanel.<init>(TemplatesPanelGUI.java:535)
at org.netbeans.modules.project.ui.TemplatesPanelGUI$CategoriesPanel.<init>(TemplatesPanelGUI.java:719)
at org.netbeans.modules.project.ui.TemplatesPanelGUI$CategoriesPanel.<init>(TemplatesPanelGUI.java:719)
at org.netbeans.modules.project.ui.TemplatesPanelGUI.initComponents(TemplatesPanelGUI.java:421)
at org.netbeans.modules.project.ui.TemplatesPanelGUI.<init>(TemplatesPanelGUI.java:156)
at org.netbeans.modules.project.ui.ProjectTemplatePanel.getComponent(ProjectTemplatePanel.java:187)
at org.netbeans.modules.project.ui.NewProjectWizard.createTemplateChooser(NewProjectWizard.java:104)
at org.openide.loaders.TemplateWizard.templateChooser(TemplateWizard.java:320)
at org.openide.loaders.TemplateWizardIterImpl.firstPanel(TemplateWizardIterImpl.java:87)
at org.openide.loaders.TemplateWizardIterImpl.current(TemplateWizardIterImpl.java:144)
at org.openide.loaders.TemplateWizardIteratorWrapper.current(TemplateWizardIteratorWrapper.java:92)
at org.openide.WizardDescriptor.updateStateOpen(WizardDescriptor.java:844)
at org.openide.WizardDescriptor.updateState(WizardDescriptor.java:822)
at org.openide.loaders.TemplateWizard.updateState(TemplateWizard.java:761)
at org.netbeans.modules.project.ui.NewProjectWizard.updateState(NewProjectWizard.java:84)
at org.openide.loaders.TemplateWizard$2.run(TemplateWizard.java:497)
at org.openide.loaders.TemplateWizard$2.run(TemplateWizard.java:494)
at org.netbeans.modules.openide.util.NbMutexEventProvider$Event$1AWTWorker.run(NbMutexEventProvider.java:156)
at java.desktop/java.awt.event.InvocationEvent.dispatch(InvocationEvent.java:306)
at java.desktop/java.awt.EventQueue.dispatchEventImpl(EventQueue.java:770)
at java.desktop/java.awt.EventQueue$4.run(EventQueue.java:721)
at java.desktop/java.awt.EventQueue$4.run(EventQueue.java:715)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:391)
at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:85)
at java.desktop/java.awt.EventQueue.dispatchEvent(EventQueue.java:740)
at org.netbeans.core.TimableEventQueue.dispatchEvent(TimableEventQueue.java:159)
at java.desktop/java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:203)
at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:124)
at java.desktop/java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:113)
at java.desktop/java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:109)
at java.desktop/java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101)
[catch] at java.desktop/java.awt.EventDispatchThread.run(EventDispatchThread.java:90)
SEVERE [global]
java.lang.ClassNotFoundException: javax.activation.DataContentHandlerFactory
at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:606)
at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:168)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:522)
at org.netbeans.ProxyClassLoader.loadClass(ProxyClassLoader.java:222)</init></init></init></init></init></init></init></init></init></init></init></init></init></init></init></init></init></init></init></init>

Recent posts to Discussion

2 Siding ReLU via its forward weight connections

2 Siding ReLU via its forward weight connections

2 Siding ReLU via its forward weight connections

Installation fail (won't start)

modulo neural network not working

Import trained networks in Neuroph

Help with Neural Network

Neuroph API Custom Network Not Configured Correctly (Outputs 0)

Problems with CNN and MNIST following github sample

installation shell script doesn't work on M1 macbook air