Microsoft Neural Network, how do I feed it ?

Hello there,

I'm working with Analysis sevices 2005 developer edition. Looking through the documentation i becomes apperent that the NN algorithm takes 255 input attributes by default. This can be changed to any integer value, OK....

My problem is that I want to feed the network with 40000 input variables. In order to do so, I will have to do a select:

SELECT fld1, fld2, ...... fld39999, fld40000

FROM tblSometable

However, this is not possible, as the books online describes it is only possible to return 4096 columns from a select statement.

Question : How do I populate a NN in AS2005, with nmore than 4096 inputs ?!

The limit may actually be smaller. SQL Server supports, I think, only 1024 columns

Analysis Services 2005 supports the concept of nested table which allows multiple related tables to be included in modeling.

With nested tables, Analysis Services can use much larger input sets (even hundreds of thousands) represented in multiple tables. Some details on the nested table concept are available here. http://msdn2.microsoft.com/en-us/library/ms175659.aspx

However, this is a data modeling issue and not related to the NN 255 default limit.

The NN algorithm (and many other algorithms included in SQL Server 2005) will always perform feature selection,using (by default) 255 input attributes. it means that, even when your data contains 40K inputs, NN will still use, by default, only the most significant 255. To increase this limit, change the value of the MAXIMUM_INPUT_ATTRIBUTES algorithm parameter. This parameter has the same name for all the algorithms that perform feature selection. If you cange this parameter value to, say, 40000, then all 40K inputs will be used.

|||

Thanks.

I suspected I could do this using nested tables. Thanks for confirming this. Time might be an issue, however. Mu current test-network consisting of 1000 inputs (MAX_INPUT_ATTRIB = 1000), that are zeros and ones, takes +3 hours on a 3.0Ghz PentiumD with 3 GB om memory. Is the time going to grow exponential or linear with the number of input nodes ?

regs,

Mads

Microsoft Neural Network, how do I feed it ?

Hello there,

I'm working with Analysis sevices 2005 developer edition. Looking through the documentation i becomes apperent that the NN algorithm takes 255 input attributes by default. This can be changed to any integer value, OK....

My problem is that I want to feed the network with 40000 input variables. In order to do so, I will have to do a select:

SELECT fld1, fld2, ...... fld39999, fld40000

FROM tblSometable

However, this is not possible, as the books online describes it is only possible to return 4096 columns from a select statement.

Question : How do I populate a NN in AS2005, with nmore than 4096 inputs ?!

The limit may actually be smaller. SQL Server supports, I think, only 1024 columns

Analysis Services 2005 supports the concept of nested table which allows multiple related tables to be included in modeling.

With nested tables, Analysis Services can use much larger input sets (even hundreds of thousands) represented in multiple tables. Some details on the nested table concept are available here. http://msdn2.microsoft.com/en-us/library/ms175659.aspx

However, this is a data modeling issue and not related to the NN 255 default limit.

The NN algorithm (and many other algorithms included in SQL Server 2005) will always perform feature selection,using (by default) 255 input attributes. it means that, even when your data contains 40K inputs, NN will still use, by default, only the most significant 255. To increase this limit, change the value of the MAXIMUM_INPUT_ATTRIBUTES algorithm parameter. This parameter has the same name for all the algorithms that perform feature selection. If you cange this parameter value to, say, 40000, then all 40K inputs will be used.

|||

Thanks.

I suspected I could do this using nested tables. Thanks for confirming this. Time might be an issue, however. Mu current test-network consisting of 1000 inputs (MAX_INPUT_ATTRIB = 1000), that are zeros and ones, takes +3 hours on a 3.0Ghz PentiumD with 3 GB om memory. Is the time going to grow exponential or linear with the number of input nodes ?

regs,

Mads

Metadata documentation

We're getting ready to launch Reporting Services and are looking for a way to
document the business logic and metadata behind the reports. Does reporting
Svc. offer a quick & easy way to do this?You have access to the RDL, which is stored in the database, along with the
other metadata... Perhaps you can write something to do what you wish...
What exactly do you want to do?
--
Wayne Snyder, MCDBA, SQL Server MVP
Mariner, Charlotte, NC
www.mariner-usa.com
(Please respond only to the newsgroups.)
I support the Professional Association of SQL Server (PASS) and it's
community of SQL Server professionals.
www.sqlpass.org
"BL" <BL@.discussions.microsoft.com> wrote in message
news:41C4F351-A803-4445-8F15-B855B74DD86F@.microsoft.com...
> We're getting ready to launch Reporting Services and are looking for a way
> to
> document the business logic and metadata behind the reports. Does
> reporting
> Svc. offer a quick & easy way to do this?
>|||We want to be able to document the business logic behind the report, and
store it with the report so that it's readily available.
What's the RDL stand for?|||RDL = Report Definition Language
See also: http://www.microsoft.com/sql/reporting/techinfo/rdlspec.mspx
-- Robert
This posting is provided "AS IS" with no warranties, and confers no rights.
"BL" <BL@.discussions.microsoft.com> wrote in message
news:B23DC42D-CAE1-4AE0-A391-40F27C121AC5@.microsoft.com...
> We want to be able to document the business logic behind the report, and
> store it with the report so that it's readily available.
> What's the RDL stand for?
>|||Hi,
I am also interested in metadata documentation and report specification.
Did you find any useful tools, or does anyone else know of any?
Richard
"BL" wrote:
> We want to be able to document the business logic behind the report, and
> store it with the report so that it's readily available.
> What's the RDL stand for?
>