Showing posts with label packages. Show all posts
Showing posts with label packages. Show all posts

Friday, March 9, 2012

Metadata Refresh

-We are using SSIS packages for various kind of data load from excel source.

-If there are any change in the data type or format of excel, the package cries for the Metadata mismatch.

-During design time if you accept the metadata changes, all things work fine.

But in our case we have deployed the packages on Production Server, now the excel file format/data has changed. The packages are expecting a different metadata so they are not working at all.

Do you have any suggestions for the above problem?

Thanks, Vijay.

You'll have to edit the package. Metadata cannot change once it has been designed into the package.

Wednesday, March 7, 2012

Metadata driven SSIS

I am looking for some pointers on Metadata driven SSIS. Specifically, how to automate creation of a large number of packages in SSIS using metadata. I am looking at this as a solution to deploy multiple packages on multiple servers. Any other ideas on this would be highly appreciated.

Thanks

Vishal Verma

This feature is not available right now. But seems we can get this feature in the next service pack (may be in end 2006)|||While I cannot confirm Suresh is correct (and in fact this is the first time I'm hearing this being associated with service pack), you can go through the object model documentation and generate the packages programmatically.

regards,
ash|||Well, I am not sure either. I read some posts by Microsoft guys (Ash why dont u chat with ur boss Kamal or Donald) and what I infered is that we might get something in near future.|||Ash is correct as usual. There are no confirmed plans for work in the SP. You may have interpreted what Kamal or Donald said as an assertion of forthcoming features. That is not correct. The planning for SPs and other releases is still under way and will not be announced for some time.
K|||By the way, I think what Suresh may be talking about here is that we're doing some work to identify and promulgate best practices around metadata for IS that will be released as either a KB article or whitepaper. That is supposed to be available around the time IS is released. But, no new metadata features, per se.

Metadata application

Hi all of you,

I'm focused on writing a SSIS metadata application. I'm trying to get all the metadata for all the DTSX packages from a concrete server.

I'm loading successfully tasks as Execute Sql Task, ForEach task and so on but how could I do the same for

Data Flow Task and its components. ???

For a Data Flow I don't know how to begin...

If TypeOf tmpTaskHost.InnerObject Is ? Then

My central code is the following:

sServer = "TEST1"

pkgIn = app.GetPackageInfos(carpetaraiz, sServer, Nothing, Nothing)

'''''''''''''''Para cada carpeta creada a partir de \MSDB

For Each pkgCarpeta In pkgIn

If pkgIn.Item(y).PackageDataSize <= 0 Then

pkgCarpetaSSIS = app.GetPackageInfos(pkgCarpeta.Name, sServer, Nothing, Nothing)

Else

pkgCarpetaSSIS = app.GetPackageInfos(carpetaraiz, sServer, Nothing, Nothing)

End If

If pkgCarpetaSSIS.Count >= 1 Then

While i < pkgCarpetaSSIS.Count

'cargar en memoria el SSIS en el objeto PAQUETE

pkg = app.LoadFromSqlServer(pkgCarpetaSSIS.Item(i).Folder & "\" & pkgCarpetaSSIS.Item(i).Name, _

sServer, Nothing, Nothing, Nothing)

Dim task As Microsoft.SqlServer.Dts.Tasks.ExecuteSQLTask.ExecuteSQLTask

Dim task2 As Microsoft.SqlServer.Dts.Runtime.ForEachLoop

Dim exe As Executable

Dim tmpTaskLoop As ForEachLoop = CType(exe, ForEachLoop)

Dim tmpTaskHost As TaskHost = CType(exe, TaskHost)

For Each exe In pkg.Executables

Select Case exe.ToString

Case "Microsoft.SqlServer.Dts.Runtime.ForEachLoop"

tmpTaskLoop = CType(exe, ForEachLoop)

Case "Microsoft.SqlServer.Dts.Runtime.TaskHost"

tmpTaskHost = CType(exe, TaskHost)

End Select

issue raises here.

If TypeOf tmpTaskHost.InnerObject Is ExecuteSQLTask.ExecuteSQLTask Then

n1 = tmpTaskHost.Properties.Item(33).GetValue(tmpTaskHost)

For y = 0 To 42

Console.WriteLine(tmpTaskHost.Properties.Item(y).Name)

Next

End If

Next

'contador de paquetes

i += 1

End While

y += 1

End If

Next

..

..

..

..

..

Thanks a lot for ideas and thoughts!!!!

Hi enric

see http://www.developer.com/db/print.php/3567941

There is application called ExploreIS which the author of the website wrote ,which might be a good starting point.You can download the application source code from the above .Maybe use that as a starting point

Regards

Cedric

|||The inner object for the Data Flow is MainPipe.|||Thanks man. I'll check it.

Meta Data

Hi,

I want to get meta data information for DTS packages, I don't see anything when I click on Meta Data Services Package. Also, I get an error when I click on Meta Data "An error occurred while trying to access the database information.
The msdb database could not be opened."

Need help.. Thanx

SQLBob

Hi, SQLBob,

I was having the same problem. On the assumption that you are running under Win2003 SP1 look for hot fix 912812 on the operating system. Remove it and Meta Data goes back to working.

Uncle Davy

|||

You should post this question in the Integration Services forum: http://forums.microsoft.com/MSDN/ShowForum.aspx?ForumID=80&SiteID=1

|||

Steven,

Are you saying that the original question belongs in the Integration area, or the response as a general post?

Sorry I'm new to this forum stuff.

Uncle Davy

|||

I was actually referring to the original post.

I meant to say that DTS was renamed SQL Server Integration Services in SQL Server 2005. The SSIS crew that would know the answer to your DTS questions watch the SSIS forum, so if you post your DTS question there, you will probably get an answer faster.

Meta Data

Hi,

I want to get meta data information for DTS packages, I don't see anything when I click on Meta Data Services Package. Also, I get an error when I click on Meta Data "An error occurred while trying to access the database information.
The msdb database could not be opened."

Need help.. Thanx

SQLBob

Hi, SQLBob,

I was having the same problem. On the assumption that you are running under Win2003 SP1 look for hot fix 912812 on the operating system. Remove it and Meta Data goes back to working.

Uncle Davy

|||

You should post this question in the Integration Services forum: http://forums.microsoft.com/MSDN/ShowForum.aspx?ForumID=80&SiteID=1

|||

Steven,

Are you saying that the original question belongs in the Integration area, or the response as a general post?

Sorry I'm new to this forum stuff.

Uncle Davy

|||

I was actually referring to the original post.

I meant to say that DTS was renamed SQL Server Integration Services in SQL Server 2005. The SSIS crew that would know the answer to your DTS questions watch the SSIS forum, so if you post your DTS question there, you will probably get an answer faster.

Meta Data

What is the difference between meta data packages and DTS packages?
Is there any advantage in Meta data?Meta data id data about data

Or a dictionary/Encylopedia

First_Name: The familar term a person is none by...yada yada yada

What's a Meta data package?|||for a great article, not specific only to databases, see What is Metadata? (http://www.nedbatchelder.com/text/metadata-is-nothing-new.html)

hat tip: Simon Willison's Weblog (http://simon.incutio.com/)

rudy
http://r937.com/