Icon View Incident Report

Minor Minor
Reported By: Roy Lambert [NLH Associates]
Reported On: 1/18/2015
For: Version 2.18 Build 2
# 4134 Reverse Engineering Complex Character Data for BLOBs Can Cause Performance Issues

Using the drag'n'drop facility in EDBManager to create the table definition & insert statements with largeish blobs had to be bombed after 11 minutes.

35 rows, total size c2Mb table structure

CREATE TABLE "EMails"
(
"_fkMailBoxes" INTEGER,
"_MsgNo" INTEGER GENERATED BY DEFAULT AS IDENTITY (START WITH 0, INCREMENT BY 1) NOT NULL,
"_MD5" VARCHAR(16) COLLATE "ANSI_CI",
"_fkStaff" VARCHAR(5) COLLATE "ANSI_CI",
"_Private" BOOLEAN DEFAULT FALSE,
"_fkContacts" INTEGER,
"_Comments" VARCHAR(100) COLLATE "ANSI_CI",
"_Size" INTEGER,
"_Subject" VARCHAR(100) COLLATE "ANSI_CI",
"_Sender" VARCHAR(45) COLLATE "ANSI_CI",
"_emSender" VARCHAR(60) COLLATE "ANSI_CI",
"_Colour" INTEGER DEFAULT 0,
"_Reply" CHAR(1) COLLATE "ANSI_CI",
"_DisplayFormat" VARCHAR(4) COLLATE "ANSI_CI",
"_Encoding" VARCHAR(5) COLLATE "ANSI_CI",
"_TimeStamp" TIMESTAMP,
"_Destination" VARCHAR(45) COLLATE "ANSI_CI",
"_emDestination" VARCHAR(60) COLLATE "ANSI_CI",
"_InOutInd" VARCHAR(2) COLLATE "ANSI_CI",
"_aList" CLOB COLLATE "ANSI_CI" COMPRESSION 6,
"_Message" CLOB COLLATE "ANSI_CI" COMPRESSION 6,
"_Graphics" BLOB COMPRESSION 6,
"_Recipients" CLOB COLLATE "ANSI_CI" COMPRESSION 6,
"_Flags" CLOB COLLATE "ANSI_CI" COMPRESSION 6,
"_Encoded" CLOB COLLATE "ANSI_CI" COMPRESSION 6,
CONSTRAINT "PK" PRIMARY KEY ("_MsgNo")
)
VERSION 1.00
READWRITE
ENCRYPTED
INDEX PAGE SIZE 4096
BLOB BLOCK SIZE 4096
PUBLISH BLOCK SIZE 512
PUBLISH COMPRESSION 0
MAX ROW BUFFER SIZE 32768
MAX INDEX BUFFER SIZE 65536
MAX BLOB BUFFER SIZE 32768
MAX PUBLISH BUFFER SIZE 32768



Comments Comments
The problem was with the content of some of the BLOB columns that contained MIME-encoded mail messages. There were excessive numbers of both CRLFs and TAB characters, and the internal functions that handled stripping/converting them were very inefficient.


Resolution Resolution
Fixed Problem on 1/25/2015 in version 2.18 build 3


Products Affected Products Affected
ElevateDB Additional Software and Utilities

Image