Large Matrix Analysis

Large Matrix Analysis - Messages

#1 Posted: 4/29/2015 3:31:38 AM
NDTM Amarasekera

NDTM Amarasekera

130 likes in 352 posts.

Group: User

Dear All,
I am a civil engineer, specialized in water resources engineering.
My aim is to analyze 30 years of daily stream flow data in an Excel table with about 300 rows x 31 columns.
The data table contains negative values and strings which I have to discard first.
Then I want to create a column vector of data for further analysis.
The Smath program shown below gives the result, but takes a long time (about 50 seconds- see image).
As I build up the program for further analysis, the time grows up to even 5 minutes or more.
However, my Mathcad 15 program yields the result almost immediately.

Can anyone help to resolve this please? Thanks in advance.
ndtma

Image1
DailyQ_Malwala.xls (121 KiB) downloaded 30 time(s).
Look within!... The secret is inside you. Best Regards Eng. NDTM Amarasekera - Sri Lanka
#2 Posted: 4/29/2015 5:21:12 AM
Davide Carpi

Davide Carpi

1415 likes in 2872 posts.

Group: Moderator

Hello ndtma

I attach my proposal (approx. 25s on my notebook). The first part takes advantage from how are built matrices in SMath. The slower part is the 2nd (as for now I don't have ideas on how to improve this part).

[edit] please note that the first part is not strictly required, anyway seems to me (?) that there's a small speed improvement using a vector instead of the linear indexing on the matrix
2015-04-29 10_41_14-SMath Studio Desktop - [Kalu Ganga-Malwala Operation Study-Simple-R1 (2).sm_].png
If you like my plugins please consider to support the program buying a license; for personal contributions to me: paypal.me/dcprojects
1 users liked this post
NDTM Amarasekera 4/29/2015 5:50:00 AM
#3 Posted: 4/29/2015 6:14:44 AM
NDTM Amarasekera

NDTM Amarasekera

130 likes in 352 posts.

Group: User

Hello Davide

Thanks for your valuable proposal, and I am awaiting more improvements.

Best Regards
ndtma
Look within!... The secret is inside you. Best Regards Eng. NDTM Amarasekera - Sri Lanka
#4 Posted: 4/29/2015 10:19:25 AM
Davide Carpi

Davide Carpi

1415 likes in 2872 posts.

Group: Moderator

12s average (not immediate, however faster than the previous solution)
Kalu Ganga-Malwala Operation Study-Simple-R1 (1).sm (44 KiB) downloaded 41 time(s).
If you like my plugins please consider to support the program buying a license; for personal contributions to me: paypal.me/dcprojects
#5 Posted: 4/29/2015 10:37:03 PM
NDTM Amarasekera

NDTM Amarasekera

130 likes in 352 posts.

Group: User

Hello Davide

Thanks for the second improvement.

Best Regards
ndtma
Look within!... The secret is inside you. Best Regards Eng. NDTM Amarasekera - Sri Lanka
#6 Posted: 5/2/2015 11:17:07 PM
Alexander O. Melnik

Alexander O. Melnik

127 likes in 494 posts.

Group: Moderator

I was faced with a similar problem of a slow function (in fact EXCEL interop call). I could not speed up the function so I have created if() loops that will run the function only when input has changed. This makes sure that when workbook automatically recalculates it will not get "stuck" on a slow function unless necessary.

A sample is attached. In the workbook c:a+b is an example function, while a+b is input.

Hope that helps
input_CHK.sm (5 KiB) downloaded 44 time(s).
  • New Posts New Posts
  • No New Posts No New Posts