Jobs & Executions

After trying to import data from a REST source in the ODX I got an SQL Exception with error code 4815. After a bit of Google I ended up on this page, telling me that it had something to do with SQLBulk copy not able to match the columns in source and destination or the value of a column was larger than in the destination allowed (e.g. string with length of 200 -> nvarchar(100)). Because TimeXtender defines the columns it probably didn't have something to do with that. Because the RSD I created didn't have a column size specified, all my string type field allowed 2000 chars. Thinking that none of the string fields were going to be larger, I started changing int to double and after that all the fields to string and later even to text. None of this worked which send me back to start. After properly examining the parquet file I found 1 record that had a text field that exceeded the 2000 char limit. The next time I get this error I will do the following steps: 1. Examine data type of API

Hi,  I'd love to get your thoughts on issue we're dealing in the past few days. We've noticed that transfer time from ODX to DSA is growing rapidly. This as significant impact on total running time of DWH and SLA towards our client Execution log of DSA  As you can see. as insert and cleansing tasks remains pretty much the same, transfer time is growing. In terms of volume, data hasn't grown significantly   Batch Id 13428 (first) - 46347863 rows Batch Id 13481 (last)  46536187 rows (+0.4%) difference in transfer time is more apparent as you zoom in into the package execution (Gantt chart) Batch Id 13428   vs last batch (13481) There is no inconsistencies in ODX que or ODX service logs found.  I've also checked it there is long running transactions (sp_who2) in both TX and DWH server but could find anything out of the ordinary    Our setup consists of ODX repository and DWH storage on same Azure Managed Instance. TX application server is (still) on-prem  My burning question is: what c

Would be great if within TX (or via external script) you could trigger Data Source transfer tasks as an initial Step within an Execution Package (or batch), so that once the transfer of new data is complete, the execution package runs the next dependant step?  This way, if the transfer task from the data source to the DL takes longer (more data than expected) then the execution package won't run until it completes.  There seems to be no method currently to trigger a transfer load within the execution packages - and therefore no way to make the two different scheduling tools (it's really that) align with each other intelligently.

Hi, I am a bit unclear on how to configure Max Threads for an execution package. The way I perceive it now is: if I run on 4 cores, I choose 4 Max Threads, if I run on 16 cores, I choose 16 Max Threads. i.e. N Cores -> N Max Threads. Is this the correct approach or are there other factors that need to be accounted for? 

When we perform a transfer from the acceptance environment to the production environment, there are settings that you do not want to take with you. First the time schedule. We have an Execution package for both acceptance and production. These should run at different times.  Secondly, the acceptance environment naturally refers to other TimeXtender databases than the production environment. Nevertheless, the database links are taken literally after the transfer.  Third, when you accept a change in acceptance, you transfer to production. However, when you have executed these, the sources are literally copied from the acceptance. We have circumvented the latter by allowing acceptance to refer to production, but this is not always desirable. Fourth, it would be nice to be able to include project perspectives during the transfer. It would be nice if you could set the above points as settings to transfer. 

Never had this before ...Trying to execute just the object I am working on..It auto selects the whole project ...where to change that setting...Very strange... 20.10.25.64

When I do 1 on the exercise, I get a pop-up information message "No constraint suggestions are available" Right click DSA node and choose Automate -> Add Suggested Constraints Don't know how to resolve this?

Hi, we are receiving a file where the order of the rows is important information that needs to be maintained for our transformation process. When TimeXtender loads a text file, are the rows loaded in order? (I.e. will the DW_Id in the Business Unit table act as row numbers of the source table). Thanks, Mark

Timextender rearrange include steps in Execution Package 1) yes i know you can hold [Alt] and use Arrowkeys up and down but really drag and drop should be possible   Also make the "all Steps" "include Steps" and "Exclude Steps" 3 separate columns and the click options at the bottom - make it better 1) post execution first 2) during Execution  middle 3) after exe last like we use it ...

Hi, Currently we have execution packages set to retry upon failure, this is set as Retries = 5 , Retries per step = 3Occasionally we encounter a failure, however it seems we can then only access the logs for the most recent fail, is there a way to get the logs for all of the failures?Similarly, is there a way so get logs of a failed execution step when the full execution package succeeded after a retry?

We would like to be able to set specific schedules for our different environments. For example som execution packages could run on schedule in our QA environment during testing. And the TXDictionary should run on schedule in all environments.

It would be great if in the Multi Environment Transfer Step it would be possible to refresh the Data source as well.Currently I have to add new tables in Dev en Prod environment on a weekly basis (chaning ERP systems).It happens that a table is added in Dev, but that table is not yet avialable in Prod. So when I transfer the project and deploy I do not get a warning that the table does not exists. So after deployment, the schedule will run in morning and it will fail on the missing table.Only after a refresh of the Data source the project recognises the missing table and gives a warning. Now I have to in Dev transfer project and deploy to Prod and then open the Prod environment itself to refresh data source in order to check if all tables are available or not.

Hi, I tried to execute a transfer task on my data source however I encountered the following error:  The execution failed with error:System.Data.SqlClient.SqlException (0x80131904): Property cannot be updated or deleted. Property 'OwnerId' does not exist for 'object specified'. at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction) at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose) at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady) at System.Data.SqlClient.SqlCommand.RunExecuteNonQueryTds(String methodName, Boolean async, Int32 timeout, Boolean asyncWrite) at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(TaskCompletionSource`1 completion, String m

I have a package with an active schedule and now and then the package is, for some unknown reason, not executed.  Scheduler Service was running at the time of the preferred execution time. How do I resolve the cause of this issue?  

As of now we need to deploy the whole project from one environment to another. This requires a lot of effort. Let’s say is there is defect in TEST environment in a single component, then we need to do the fix in DEV and TEST manually only for that component. As TX doesn't allow to migrate only a single or multiple components. It has to be the whole project. It also causes a lot of dependencies if multiple teams are working on the same project.

When I recently moved our production environment to a new server and was working on deploying the entire data warehouse in TimeXtender I had some difficulties. First I did a complete (full?) and managed deploy which seemed to be successful. When I then tried to run a few execution packages one of them said it was missing a view. Then I did a differential managed deploy and it listed a lot of objects not already deployed!! OK, so I ran that which seemed to succeed as well. Tried the execution package that failed again but with the same result. Third time I did a differential deploy but this time after the deploy was done I noticed that the scrollbar in the results dialog was not all the way up! There at the top an error message was hiding. I had guard on deploy on some tables which was highlighted and hence covering up the error message. The actual error was that a view was not able to deploy because of a user defined function was missing. This UDF is defined in TimeXtender so why does

I have a generic stored procedure that does some custom post processing based on the table that has just been reloaded (Executed).  The stored procedure takes a parameter "TableName".  I've created a Script Action that executes the stored procedure.  I need this Script Action to run as a Post Step after the last execution step is run for one of several tables.  I can create one script action per table with the tablename hardcoded, but I've got a lot of tables to work with and would really prefer do this as a parameter containing the current table name.  Is the currently executing table name available in a system parameter somewhere and/or is there a way to create one that can be referenced by a script action?

Good Morning, We have recently upgraded TimeXtender to version 20.10.15.64. Both in QA and PROD servers. We have TX ETL jobs that extract data from Oracle database server to both server every night. They run at different times. However, the PROD ETL job takes longer to extract data. QA ETL job takes quicker. 1. QA TX on average takes 3hours to extract data from PROD oracle. 2. PROD TX on average takes 5 hours or more to extract the same information from PROD Oracle. Sometimes this take longer than this. 3.PROD TX sometimes hangs the whole night. 4. PROD TX has higher specs than QA. 5. We have checked the Performance Indicators  on PROD server while PROD TX is running. The CPU, Memory and other indicators seems well. 6. We trying to figure out why performance on PROD is slow during the data extraction from Oracle. We have checked all necessary indicators to and we still don't have answers. Is there anything that you can advice us to check so we can understand why PROD is slower than QA

Enable Continuous Integration and deployment by integrating with Azure DevOps. This can be done if we can deploy components in TX based on scripts or commands. We need a task for TX which can be added to build and release pipeline of Azure DevOps This feature is in addition to the below feature request for enabling deployment of single/multiple components to multiple environments.     In addition to the below feature request https://support.timextender.com/hc/en-us/community/posts/360014857198-Add-feature-to-deploy-single-or-multiple-component-between-environments-instead-of-deploying-the-whole-project tion to the below feature request https://support.timextender.com/hc/en-us/community/posts/360014857198-Add-feature-to-deploy-single-or-multiple-component-between-environments-instead-of-deploying-the-whole-project

I'm making a TimeXtender Dictionary using Azure (Azure SQL DB's & Azure Analysis Services). When deploying & executing the project I got an error for the StepExecutionTime table:Invalid object name 'MDW_etl.StepExecutionTime_I'. Details: SQL Server: 'bffa063c7c84.tr366.westeurope1-a.worker.database.windows.net,11009'SQL Procedure: 'MDW_etl.usp_CrDM_MDW_etl_StepExecutionTime_DSA_DSA_etl_StepExecutionTime'SQL Line Number: 16SQL Error Number: 208 Invalid object name 'MDW_etl.StepExecutionTime_I'.Module: .Net SqlClient Data ProviderSystem.Data.SqlClient.SqlExceptionat System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, T

Is it possible to create a clustered column-store index in TimeXtender 20.103.64?

Once in a while my scheduled job does not finish without an error. It just stops doing anything. My event log states that around the time my job stopped running, both the server and the scheduler started. I do not find anything in the logs where it says the server and scheduler stopped running, so I have no idea why they restarted. Would the server/scheduler being down explain why the job stops running rather than failing and providing an error? Does anybody experience the same? Any ideas where I can find more information on why the server/scheduler stopped or restarted? And possibly how I can prevent this of course?  

Hi!   Can you clearify that if I run a full load ( on a source based incremental table), it doesn't update the _I table with the current max value?  In our scenario, I run a full load very early in the morning and then run incremental loads during the day. But I have seen that the first incremental load of the day takes a very long time to run which I suspect is due to there being a lot of changes since the last incremental load, i.e. the full load's transfer is ignored by the incremental load? So the first incremental load, more or less, transfers the same data that the full load did? Version 19.11.7.64   Regards Niclas

I have enabled simple mode on a project with 1 data source and 1 Business Unit.  I have also updated the settings for all tables to support simple mode: When i try to deploy the project i get the error: Could not load file or assembly 'Microsoft.SqlServer.BatchParser.dll' or one of its dependencies. The specified module could not be found.Location: Business Unit 'ABC'.Details:Could not load file or assembly 'Microsoft.SqlServer.BatchParser.dll' or one of its dependencies. The specified module could not be found.Module: mscorlibSystem.IO.FileNotFoundExceptionat System.Reflection.RuntimeAssembly.GetType(RuntimeAssembly assembly, String name, Boolean throwOnError, Boolean ignoreCase, ObjectHandleOnStack type)at System.Reflection.RuntimeAssembly.GetType(String name, Boolean throwOnError, Boolean ignoreCase)at Microsoft.SqlServer.Management.Common.ServerConnection.GetStatements(String query, ExecutionTypes executionType, Int32& statementsToReverse)at Microsoft.SqlServer.Management.Commo

Hi, I need more information on how i can do continuous integration in discovery hub.